o i e=@sdZddlmZddlmZehdZiZiZddZ ddZ d d Z ed gd Gd dde Z ed gd Gddde ZdS)zClass to represent a device.) tf_export) pywrap_tfe>CPUEPUGPUTPUCUSTOMcC|durdSt|SN)strinprV/var/www/myenv/lib/python3.10/site-packages/tensorflow/python/framework/device_spec.py_as_str_or_nonercCr r )intr rrr_as_int_or_none"rrcCs|dvr|St|S)N)cpugpu)upperr) device_typerrr_as_device_str_or_none&sr DeviceSpec)v1c@seZdZdZdZ     d(ddZddZedd Zd d Z d d Z ddZ e ddZ e ddZe ddZe ddZe ddZddZeddZed)ddZed d!Zd"d#Zd$d%Zd&d'ZdS)* DeviceSpecV2aRepresents a (possibly partial) specification for a TensorFlow device. `DeviceSpec`s are used throughout TensorFlow to describe where state is stored and computations occur. Using `DeviceSpec` allows you to parse device spec strings to verify their validity, merge them or compose them programmatically. Example: ```python # Place the operations on device "GPU:0" in the "ps" job. device_spec = DeviceSpec(job="ps", device_type="GPU", device_index=0) with tf.device(device_spec.to_string()): # Both my_var and squared_var will be placed on /job:ps/device:GPU:0. my_var = tf.Variable(..., name="my_variable") squared_var = tf.square(my_var) ``` With eager execution disabled (by default in TensorFlow 1.x and by calling disable_eager_execution() in TensorFlow 2.x), the following syntax can be used: ```python tf.compat.v1.disable_eager_execution() # Same as previous device_spec = DeviceSpec(job="ps", device_type="GPU", device_index=0) # No need of .to_string() method. with tf.device(device_spec): my_var = tf.Variable(..., name="my_variable") squared_var = tf.square(my_var) ``` If a `DeviceSpec` is partially specified, it will be merged with other `DeviceSpec`s according to the scope in which it is defined. `DeviceSpec` components defined in inner scopes take precedence over those defined in outer scopes. ```python gpu0_spec = DeviceSpec(job="ps", device_type="GPU", device_index=0) with tf.device(DeviceSpec(job="train").to_string()): with tf.device(gpu0_spec.to_string()): # Nodes created here will be assigned to /job:ps/device:GPU:0. with tf.device(DeviceSpec(device_type="GPU", device_index=1).to_string()): # Nodes created here will be assigned to /job:train/device:GPU:1. ``` A `DeviceSpec` consists of 5 components -- each of which is optionally specified: * Job: The job name. * Replica: The replica index. * Task: The task index. * Device type: The device type string (e.g. "CPU" or "GPU"). * Device index: The device index. )_job_replica_task _device_type _device_index _as_string_hashNcCsdt||_t||_t||_t||_t||_|j|j|j|j|j|jd|_ t | |_ dS)afCreate a new `DeviceSpec` object. Args: job: string. Optional job name. replica: int. Optional replica index. task: int. Optional task index. device_type: Optional device type string (e.g. "CPU" or "GPU") device_index: int. Optional device index. If left unspecified, device represents 'any' device_index. jobreplicataskr device_indexN) rrrrrrrr _components_to_stringr!hash to_stringr")selfr$r%r&rr'rrr__init__ks     zDeviceSpecV2.__init__cC|jS)zReturn a string representation of this `DeviceSpec`. Returns: a string of the form /job:/replica:/task:/device::. )r!r+rrrr*szDeviceSpecV2.to_stringcCs|||S)a;Construct a `DeviceSpec` from a string. Args: spec: a string of the form /job:/replica:/task:/device:CPU: or /job:/replica:/task:/device:GPU: as cpu and gpu are mutually exclusive. All entries are optional. Returns: A DeviceSpec. )_string_to_components)clsspecrrr from_strings zDeviceSpecV2.from_stringcCs ||S)aParse a `DeviceSpec` name into its components. **2.x behavior change**: In TensorFlow 1.x, this function mutates its own state and returns itself. In 2.x, DeviceSpecs are immutable, and this function will return a DeviceSpec which contains the spec. * Recommended: ``` # my_spec and my_updated_spec are unrelated. my_spec = tf.DeviceSpec.from_string("/CPU:0") my_updated_spec = tf.DeviceSpec.from_string("/GPU:0") with tf.device(my_updated_spec): ... ``` * Will work in 1.x and 2.x (though deprecated in 2.x): ``` my_spec = tf.DeviceSpec.from_string("/CPU:0") my_updated_spec = my_spec.parse_from_string("/GPU:0") with tf.device(my_updated_spec): ... ``` * Will NOT work in 2.x: ``` my_spec = tf.DeviceSpec.from_string("/CPU:0") my_spec.parse_from_string("/GPU:0") # <== Will not update my_spec with tf.device(my_spec): ... ``` In general, `DeviceSpec.from_string` should completely replace `DeviceSpec.parse_from_string`, and `DeviceSpec.replace` should completely replace setting attributes directly. Args: spec: an optional string of the form /job:/replica:/task:/device:CPU: or /job:/replica:/task:/device:GPU: as cpu and gpu are mutually exclusive. All entries are optional. Returns: The `DeviceSpec`. Raises: ValueError: if the spec was not valid. )r2r+r1rrrparse_from_strings 5zDeviceSpecV2.parse_from_stringcCs|j||S)a!Returns a new DeviceSpec which incorporates `dev`. When combining specs, `dev` will take precedence over the current spec. So for instance: ``` first_spec = tf.DeviceSpec(job=0, device_type="CPU") second_spec = tf.DeviceSpec(device_type="GPU") combined_spec = first_spec.make_merged_spec(second_spec) ``` is equivalent to: ``` combined_spec = tf.DeviceSpec(job=0, device_type="GPU") ``` Args: dev: a `DeviceSpec` Returns: A new `DeviceSpec` which combines `self` and `dev` ) __class___get_combined_propertiesr+devrrrmake_merged_specszDeviceSpecV2.make_merged_speccKs6t|j|j|j|j|jd}|||jdi|S)aConvenience method for making a new DeviceSpec by overriding fields. For instance: ``` my_spec = DeviceSpec=(job="my_job", device="CPU") my_updated_spec = my_spec.replace(device="GPU") my_other_spec = my_spec.replace(device=None) ``` Args: **kwargs: This method takes the same args as the DeviceSpec constructor Returns: A DeviceSpec with the fields specified in kwargs overridden. r#Nr)dictr$r%r&rr'updater5)r+kwargs init_kwargsrrrreplaces zDeviceSpecV2.replacecCr-r )rr.rrrr$ zDeviceSpecV2.jobcCr-r )rr.rrrr%r?zDeviceSpecV2.replicacCr-r )rr.rrrr&r?zDeviceSpecV2.taskcCr-r )rr.rrrrr?zDeviceSpecV2.device_typecCr-r )r r.rrrr'r?zDeviceSpecV2.device_indexcCsj|jdur|jn|j|jdur|jn|j|jdur|jn|j|jdur&|jn|j|jdur1|jfS|jfS)a*Combine the current DeviceSpec with another DeviceSpec. The combination of DeviceSpecs is will give priority to dev. Args: dev: a `DeviceSpec` Returns: A tuple of (job, replica, task, device_type, device_index) which represents the combination of self and dev. Nr#r7rrrr6s z%DeviceSpecV2._get_combined_propertiescCs>ti}t}|D]}||ddq |tB}|S)N:)setrTF_ListPluggablePhysicalDevicesadddecodesplit_VALID_DEVICE_TYPES)valid_device_typesphysical_devicesdevicerrr_get_valid_device_types2s z$DeviceSpecV2._get_valid_device_typesc Cst|}|dur |S|}d\}}}}}|pd}dd|dD}t} |D]} t| } | r| dkr?| dd kr?| d }q(| dkrN| dd krN| d }q(| dkr]| dd kr]| d }q(| d kse| dkr| d| vr|durytd |d| d}| dkr| d dkrt| d }q(| dkr| ddkr|durtd |d| d }| ddkrt| d}q(| r| ddkrtd| dd|dq(|||||f} | t|<| S)aEStateless portion of device spec string parsing. Args: spec: An optional string specifying a device specification. Returns: The parsed components of `spec`. Note that the result of this function must go through attribute setters of DeviceSpec, and should therefore NOT be used directly. NNNNNNcSsg|]}|dqS)r@)rF).0xrrr Osz6DeviceSpecV2._string_to_components../rr$rAr%r&zEMultiple device types are not allowed while parsing the device spec: .*rJzUnknown attribute 'z1' is encountered while parsing the device spec: 'z'.) _STRING_TO_COMPONENTS_CACHEgetrFrrKlenr ValueErrorr) r1 cached_resultraw_specr$r%r&rr'splitsrHylyoutputrrrr/;sV           z"DeviceSpecV2._string_to_componentsc Cs|||||f}t|}|dur|Sg}|dur|d||dur,|dt||dur9|dt||durPd}|durGt|}|d||fd|}|t|<|S)z>Stateless portion of `to_string` (separated to allow caching).Nz/job:z /replica:z/task:rTz /device:%s:%srM)_COMPONENTS_TO_STRING_CACHErWappendr join) r$r%r&rr'keyrZr_device_index_stringrrrr(qs&  z"DeviceSpecV2._components_to_stringcCst||jo ||kS)aFChecks if the `other` DeviceSpec is same as the current instance, eg have same value for all the internal fields. Args: other: Another DeviceSpec Returns: Return `True` if `other` is also a DeviceSpec instance and has same value as the current instance. Return `False` otherwise. ) isinstancer5r*)r+otherrrr__eq__s zDeviceSpecV2.__eq__cCr-r )r"r.rrr__hash__szDeviceSpecV2.__hash__c Cs.d|jd|jd|jd|jd|jd S)Nzr#r.rrr__repr__s zDeviceSpecV2.__repr__rLr )__name__ __module__ __qualname____doc__ __slots__r,r* classmethodr2r4r9r>propertyr$r%r&rr'r6 staticmethodrKr/r(rgrhrirrrrr.sF8  7       5  rc@seZdZejZejZejjddZejjddZej jddZ ej jddZ ej jd d Z d d Z d dZ ddZddZej je _ejje_dS) DeviceSpecV1cCt||_d\|_|_dSN)NN)rrr!r")r+r$rrrr$ zDeviceSpecV1.jobcCrsrt)rrr!r")r+r%rrrr%ruzDeviceSpecV1.replicacCrsrt)rrr!r")r+r&rrrr&ruzDeviceSpecV1.taskcCrsrt)rrr!r")r+rrrrrruzDeviceSpecV1.device_typecCrsrt)rr r!r")r+r'rrrr'ruzDeviceSpecV1.device_indexcCs|jdur t||_|jSr )r"r)r*r.rrrrhs zDeviceSpecV1.__hash__cCs0|jdur|j|j|j|j|j|jd|_|jS)Nr#)r!r(r$r%r&rr'r.rrrr*s zDeviceSpecV1.to_stringcCs"||\|_|_|_|_|_|Sr )r/r$r%r&rr'r3rrrr4szDeviceSpecV1.parse_from_stringcCs"||\|_|_|_|_|_dS)zMerge the properties of "dev" into this `DeviceSpec`. Note: Will be removed in TensorFlow 2.x since DeviceSpecs will become immutable. Args: dev: a `DeviceSpec`. N)r6r$r%r&rr'r7rrr merge_froms zDeviceSpecV1.merge_fromN)rjrkrlrrmrnr$setterr%r&rr'rhr*r4rvrrrrrrs&       rrN)rm tensorflow.python.util.tf_exportrtensorflow.pythonr frozensetrGrVr`rrrobjectrrrrrrrs     w