o i e }@s$dZddlZddlmZddlmZddlmZddlmZddlmZddl m Z dd l m Z dd l m Zdd l mZdd lmZdd lmZddlmZddlmZddlmZddlmZddlmZddlmZGdddeZddZddZ e!dgdZ"ddZ#ddZ$d d!Z%dS)"z7Logic for restoring checkpointed values for Trackables.N)checkpoint_view)functional_saver) save_util_v1)saveable_compat)context)ops) array_ops) gen_io_ops)io_ops) tf_logging) registration)base) constants) python_state)trackable_utils)saveable_object_util)object_identityc@seZdZdZgdZddZd0ddZdd Zd d Zd0d d Z ddZ ddZ ddZ d0ddZ eddZeddZeddZeddZeddZd d!Zd"d#Zd$d%Zd&d'Zd(d)Zd*d+Zd0d,d-Zd.d/ZdS)1CheckpointPositionz>Indicates a position within a `_CheckpointRestoreCoordinator`. _checkpoint _proto_id skip_restorecCs||_||_d|_dS)zSpecify an object within a checkpoint. Args: checkpoint: A _CheckpointRestoreCoordinator object. proto_id: The index of this object in TrackableObjectGraph.nodes. FNr)self checkpointproto_idrS/var/www/myenv/lib/python3.10/site-packages/tensorflow/python/checkpoint/restore.py__init__+s zCheckpointPosition.__init__NcCsrt+||r||}|r'|j|WddSWddSWddS1s2wYdS)z$Restore this value into `trackable`.N)r init_scope bind_object_restore_descendantsrnew_restore_ops)r trackablereader restore_opsrrrrestore8s   "zCheckpointPosition.restorecCsl|j}|j||j|jd}|j|j|dur$||j|j<dS||ur4td|d|ddS)a\Set a checkpoint<->object correspondence. Args: trackable: The object to record a correspondence for. Returns: True if this is a new assignment, False if this object has already been mapped to a checkpointed `Object` proto. Raises: AssertionError: If another object is already bound to the `Object` proto. NTa&Inconsistent references when loading the checkpoint into this object graph. For example, in the saved checkpoint object, `model.layer.weight` and `model.layer_copy.weight` reference the same variable, while in the current object these are two different variables. The referenced variables are:(z and z).F) rall_python_objectsaddobject_by_proto_idgetrmatched_proto_idsloggingwarning)rr"rcurrent_assignmentrrrrBs   zCheckpointPosition.bind_objectcCs.|jj}t|dko|djtjko|jj S)zEDetermine whether this value is restorable with a Tensor initializer.r) object_proto attributeslennamerVARIABLE_VALUE_KEYchildren)rr0rrris_simple_variableds  z%CheckpointPosition.is_simple_variablec Csi}|jjD]k}|j}|jj|}|j}|jjjpd}t Jt |-|dur5|j |vr5||j }nd}t j |jj|g|g|gd|j fd\} Wdn1sUwYt| ||j <Wdn1slwYq|S)aCreate value `Tensor`s for this object's attributes. Does not require that the Python object has been created. Used for restore-on-create when executing eagerly. Args: shape_and_slices: A dict mapping from object attribute names to a shape and slice string that will be passed to a RestoreV2 op. If the dict is None or if an object attribute is not in the dict, the full tensor will be restored. Returns: A dictionary mapping from object attribute names to `Tensor`s. zcpu:0Nz%s_checkpoint_read)prefix tensor_namesshape_and_slicesdtypesr2)r/r0checkpoint_keyr dtype_map base_dtypeoptionsexperimental_io_devicerrdevicer2r restore_v2save_path_tensorridentity) rr9 value_tensorsserialized_tensorr;dtype base_type io_deviceshape_and_slicevaluerrrrDks0        z CheckpointPosition.value_tensorsc Cs|}|jjs|sgigifSg}i}g}tt}t|j}t |j}|r9|j s8|jj j }|j|||<nJ|rH|jjdj |ji||<n;t|jtjrU||n.|tjhkre||\}}n|ro||\}}n|jjD]} |jj|jg| jqs||||fS)zLooks up or creates SaveableObjects which don't have cached ops. Returns: A tuple of ( existing_restore_ops: list, named_saveables: dict, python_positions: list, registered_savers: dict) r)get_registered_saver_namer/r0 collections defaultdictdictrsaveable_objects_from_trackabler"r rregistered_saver object_namer; isinstancer PythonStateappendkeysrSERIALIZE_TO_TENSORS_NAME$_create_serialize_to_tensor_saveable#_create_saveables_by_attribute_namerunused_attributes setdefaultrr2) rrecorded_registered_saverexisting_restore_opsnamed_saveablespython_positionsregistered_saverssaveable_factories saver_namer2rErrrgather_ops_or_named_saveablessJ         z0CheckpointPosition.gather_ops_or_named_saveablescCst|jpd}t|jjdj|}ts=|j j |d}|dur(|gifS|j j |ji}||vr=g|||ifS|tj|d}tsM|||<g||ifS)z9Creates a saveable using the _serialize_to_tensor method.r6rNr2)rget_saveable_namer"_extract_saveable_namer/r0r;rexecuting_eagerlyrrestore_ops_by_namer)saveables_cacherZrrV)rr`suffix saveable_name existing_oprhsaveablerrrrWs.   z7CheckpointPosition._create_serialize_to_tensor_saveablec s6i}g}t}|jjD]trd}n |jjjd}|dur'| |q t fdd|Dr3q |jj }|dur>d}n||j ij d}t|dkrT|\}nd}|durfj|j vrfd}||j =|durt||}|dur|jj|jg j q |dur|g||j ij <||j<q ||fS)a+Creates or caches SaveableObjects by matching the attribute names. The attribute name keys in the `saveable_factories` is used to find the corresponding attribute in the object proto. Attributes contain checkpoint keys which are passed to the factory function to generate the SaveableObject. Args: saveable_factories: a dict mapping attribute name to a callable factory function that produces a SaveableObject. Returns: A tuple of ( existing_restore_ops: list, named_saveables: dict) Nc3s|] }j|VqdSN)r2 startswith).0r2rErr szICheckpointPosition._create_saveables_by_attribute_name..rmr.)setr/r0rrfrrgr)r;rTanyrhr"r2r1_get_saveable_from_factoryrYrZr) rr`r]r\created_compat_namesrkrhrl saveable_listrrprrXsj       z6CheckpointPosition._create_saveables_by_attribute_namecCs<|rtd|\}}}}||jj|||d|S)ajCreate or fetch restore ops for this object's attributes. Requires that the `Trackable` Python object has been bound to an object ID in the checkpoint. Args: reader: A `CheckpointReader`. If None, a new instance will be created. Returns: A list of operations when graph building, or an empty list when executing eagerly. zOUnable to run individual checkpoint restore for objects with registered savers.r#)_has_registered_saver ValueErrorrbextendrrestore_saveables)rr#r$tensor_saveablesr^_rrrr$Cs zCheckpointPosition.restore_opscC|jSrm)rrrrrrZzCheckpointPosition.checkpointcCs|jj|jSrm)rr(rrrrrr"^szCheckpointPosition.trackablecCs|jjj|jSrm)robject_graph_protonodesrrrrrr/bszCheckpointPosition.object_protocCr~rm)rrrrrrfrzCheckpointPosition.proto_idcCs|jjSrm)r restore_uidrrrrrjszCheckpointPosition.restore_uidcCs t|jSrm)reprr/rrrr__repr__ns zCheckpointPosition.__repr__cCs0|jjD]}|jtjkr|jj|jSqdS)zoThe shape of the VARIABLE_VALUE tensor. Returns: If found a TensorShape object, otherwise None. N)r/r0r2rr3r shape_mapr;)rrErrr value_shapeqs  zCheckpointPosition.value_shapecCst|jjjSrm)boolr/rPr2rrrrrx|z(CheckpointPosition._has_registered_saverc Csf|r1|jjj}z t|j|W|Sty0}zt|r"|d|_ WYd}~|Sd}~wwdS)z Y         )rc Cs|durtdt|tstdt|}|}|D]0\}}||vs.|jj|dur9td|d|d|dusCt|t j sNtd|d|d qt }|D]\}}|jj|j }|jj|} t|} | s| j st|rtd |d |d qWt } t| j d j| |<t| d\} } t| d }t| j t|krtd t|dt| j d t||}|||<t||}|r|std |d |d |s|rtd |d|d|d t| j t||kr tdt||dt| j d | st||qWt }i||<| j D]}|j}|j}||||||<q"t||qWdS)aRestores nodes from a dict. Requires that the `Trackable` Python object has been bound to an object ID in the checkpoint. Args: save_path: a string represents path to the checkpoint. nodes_to_restore: a dict maps `node_id` to `trackable` to be restored. Nzsave_path cannot be empty.zDExpecting a dictionary of node_id to Trackable for nodes_to_restore.zThe expected node_id: z to Trackable z- to restore does not exist in the checkpoint.z(Expecting a valid Trackable to node_id: z but got trackable: .z Trackable z] expects checkpointed values but checkpoint does not contain serialized tensors for node_id: rz)Size for saveable_objects for Trackable: z? did not match the size for serialized_tensors for checkpoint: zQ does not expect checkpointed values but checkpoint contains serialized tensors: z for node_id: z+Size for serialized_tensors for Trackable: z; did not match size for serialized_tensors for checkpoint: )ryrRrNrCheckpointView descendantsr_object_graph_protorr TrackablerObjectIdentityDictionaryr0r!trackable_has_serialize_to_tensorrOrextract_object_namer;r!get_checkpoint_factories_and_keysgenerate_saveable_objectsr1SaveableCompatibilityConverter_serialize_to_tensorsrrMultiDeviceSaverr%r2) save_pathnodes_to_restore ckpt_viewckpt_view_descendantsrr"serialized_tensorscurrent_trackable ckpt_contains_serialized_tensorsnoder object_namescheckpoint_factory_mapr}saveable_objectstrackable_expects_ckpted_valueserialized_tensors_renamed attributer2r;rrr restore_nodess            rc Cs|j}|}|jjD]Y}|jj|jd}|durq ||j}| |j |}|j}|durW| dr9|j j } nt|jpG|jpG|jpG| d} | rV|j|j g|q |j|drd|||fq dS)z>Queues the restoration of trackable's children or defers them.Nhas_checkpoint_valuesrP)r")r"_trackable_childrenr/r4rr(r)rr_lookup_dependency local_nameHasFieldrrJrr0slot_variables_deferred_dependenciesrZrTr) checkpoint_positionrr"trackable_childrenchildcorrespondencechild_position local_object child_proto has_valuerrrrPs@       r _DeferredSlotVariableRestorationoriginal_variablerrc Cs|j}|j}|j|jdD]}|||j|j|j\}}|dur(| ||fq|j |jdD]=}|j |j d}|durR|j|j g t||j|jdq1t|drn||||j|j\}}|durn| ||fq1dS)z&Queues slot variables for restoration.rNrr)r"rdeferred_slot_restorationspoprrrrrrTslot_restorationsr(r) optimizer_idrZrhasattr) rrr"rdeferred_slot_restorationrrslot_restorationrrrrrsR rcCs$tjd}|d||t|S)N/)rOBJECT_ATTRIBUTES_NAMEindexr1)r; search_keyrrrres recCsd}|j}|j}||vr||}|dur8|D]\}}||r7|dur)td|}t|j|}||qt|rA||dS|S)z7Returns the saveable generated from the factory method.NzForward compatibility load error: Unable to load checkpoint saved in future version of TensorFlow. Please update your version of TensorFlow to the version in which the checkpoint was saved.rc)r2r;rrnryrer'callable)r`rErumatched_factoryexpected_factory_namefactory_input_name factory_namefactoryrrrrts*   rt)&rrLtensorflow.python.checkpointrrrrtensorflow.python.eagerrtensorflow.python.frameworkrtensorflow.python.opsrr r tensorflow.python.platformr r+tensorflow.python.saved_modelr tensorflow.python.trackabler rrr!tensorflow.python.training.savingrtensorflow.python.utilrobjectrrr namedtuplerrrertrrrrs>                 Fg)(