o i e@sdZddlZddlmmZddlmZddl m Z ddl m Z dZGdddejjejZd d Zd d Zd dZddZddZddZdS)z&Keras utilities for DTensor unit test.N) parameterized)api)contextcs<eZdZdZefddZfddZeddZZ S)DTensorBaseTestz8Provides comparison helper for dtensor vs local results.cstt|dSN)superr setUpClass)cls __class__J/var/www/myenv/lib/python3.10/site-packages/keras/src/dtensor/test_util.pyr szDTensorBaseTest.setUpClasscstttdSr)rtearDownr async_wait reset_dtensor)selfr r rr#s  zDTensorBaseTest.tearDowncshtfdd}d}tjdr |d}tdt|n|d}tdt|t |S)aConfigs corresponding mesh given test context. If runs on a CPU mesh, set virtual device on CPU. If runs on a GPU mesh, sets virtual device on GPU with proper memory limits. if runs on a TPU mesh, initializes TPU system. Args: device_type_mesh_map: A dictionary containing device_type -> mesh mapping. Returns: A properly configured mesh for use in test. cs2|d}|dur|}td|d|d|S)Nz Requires a z mesh to run test on .)get ValueError) device_typemeshdtdevice_type_mesh_mapr rget_mesh>s z0DTensorBaseTest.configTestMesh..get_meshNGPUCPU) reset_contexttfconfiglist_physical_devicesreset_logical_devicesnpprodshaperensure_initialized)rrrr rrconfigTestMesh,s  zDTensorBaseTest.configTestMesh) __name__ __module__ __qualname____doc__ classmethodr r staticmethodr' __classcell__r r r rrs  rcs,t|}tfddt|D|S)Ncsg|] }tjd|dqS)zlocalhost/replica:0/task:0)jobr device_index)r DeviceSpec).0irr r Tsz'create_device_array..)r#r$asarrayrangereshape)r%r device_countr r4rcreate_device_arrayQs   r:cCst||}t|Sr)r:r#raveltolist)r%rdevicesr r rcreate_device_list_s r>cCst|}t||Sr)r#r$aranger8)r%r9r r rcreate_device_ids_arrayds r@cC tdSr)r_reset_contextr r r rri rcCs|dvr td|ttjd}|dkr3tj|}tj|dtjjtdg|tj|dtjg|dS)aVResets logical devices for CPU/GPU. Logical devices can only be instantiated once on a particular context. For now, context re-use is triggering some function duplication errors, so we reset the context on each call. Args: device_type: The device_type to reset. count: numbers of virtual device to reset to. )rrz8resetting logical device for non-supported device type: rrr) memory_limitN) upperrrrr r! set_logical_device_configurationLogicalDeviceConfiguration_DEFAULT_GPU_MEMORY_LIMIT)rcountcpusgpusr r rr"ms4     r"cCrAr) dtensor_api_resetr r r rrrCr)r+numpyr#tensorflow.compat.v2compatv2r absl.testingrtensorflow.dtensor.pythonrrLtensorflow.python.eagerrrHtestTestCaserr:r>r@rr"rr r r rs   5 (