a du@s8ddlZddlZddlZddlmZmZddlmZm Z m Z m Z m Z m Z ddlZddlmZddlmZddlmZGdddeZd Zee eedd d d Ze e d ddZeedddZedZedddZe e eee efe e ee efdddZeedddZ ee ee efdddZ!dS)N)ProcessQueue)AnyCallableDictListOptionalUnion)ModuleAvailableCache) Accelerator)_check_data_typecseZdZdZeeddfdd ZejddddZdd d d Z e e e e ee fee e ee fd d dZe e e ee fee d ddZe e d ddZe ejdded ddZeeddddZZS)TPUAcceleratorzAccelerator for TPU devices.Nargskwargsreturncs&tsttttj|i|dSN)_XLA_AVAILABLEModuleNotFoundErrorstrsuper__init__)selfrr __class__j/var/www/html/stable-diffusion-webui/venv/lib/python3.9/site-packages/lightning_fabric/accelerators/tpu.pyrs zTPUAccelerator.__init__)devicercCsdSrr)rrrrr setup_device#szTPUAccelerator.setup_devicercCsdSrr)rrrrteardown&szTPUAccelerator.teardowndevicesrcCst|S)z!Accelerator device parsing logic.)_parse_tpu_devicesr"rrr parse_devices)szTPUAccelerator.parse_devicescCst|trtt|S|S)z*Gets parallel devices for the Accelerator.) isinstanceintlistranger$rrrget_parallel_devices.s  z#TPUAccelerator.get_parallel_devicescCsdS)z!Get the devices when set to auto.rrrrrauto_device_count5sz TPUAccelerator.auto_device_count)maxsizecCstto tSr)boolr_is_device_tpurrrr is_available:szTPUAccelerator.is_available)accelerator_registryrcCs|jd||jjddS)NZtpu) description)registerr__name__)clsr2rrrregister_accelerators@s z$TPUAccelerator.register_accelerators)r5 __module__ __qualname____doc__rrtorchrrr staticmethodr r'rrrr%r*r, functools lru_cacher/r1 classmethodrr7 __classcell__rrrrr s0" r <)queuefuncrrrcOsBz|||i|Wn$ty<t|dYn0dSr)put Exception traceback print_exc)rBrCrrrrr_inner_fMs  rH)rCrcs,ttttttfdfdd }|S)Nrcs^t}tt|g|R|d}||tz |WStjyXt YdS0dS)N)targetrrF) rrrHstartjoinTPU_CHECK_TIMEOUT get_nowaitqEmptyrFrG)rrrBprocrCrrwrapperVs  z_multi_process..wrapper)r=wrapsrr r/)rCrRrrQr_multi_processUs rTrcCs4tsdSddlmm}|dkp2t|dS)zCheck if TPU devices are available. Runs XLA device check within a separate process. Return: A boolean value indicating if TPU devices are available FrNr-ZTPU)rtorch_xla.core.xla_modelcore xla_modelxrt_world_sizer/Zget_xla_supported_devicesZxmrrrr0esr0Z torch_xlacCs*ts dSddlmm}|dkS)NFrr-)r r1rUrVrWrXrYrrr_tpu_distributed{srZr!cCs2t|t|trt|}t|s.td|S)a Parses the TPU devices given in the format as accepted by the :class:`~pytorch_lightning.trainer.Trainer` and :class:`~lightning_fabric.Fabric`. Args: devices: An int of 1 or string '1' indicates that 1 core with multi-processing should be used An int 8 or string '8' indicates that all 8 cores with multi-processing should be used A list of ints or a strings containing a list of comma separated integers indicates the specific TPU core to use. Returns: A list of tpu_cores to be used or ``None`` if no TPU cores were requested Raises: TypeError: If TPU devices aren't 1, 8 or [<1-8>] z/`devices` can only be 1, 8 or [<1-8>] for TPUs.)r r&r_parse_tpu_devices_strstrip_tpu_devices_valid TypeErrorr$rrrr#s   r#cCsX|dvr dSt|tttfrTt|dk}dt|dkoBdkn}|oN|}|SdS)N)r-r+NTr-rr+F)r&r(tuplesetlen)r"Z has_1_tpu_idxZis_valid_tpu_idxZis_valid_tpu_core_choicerrrr]s  r]cCs$|dvrt|Sdd|dDS)N)18cSs$g|]}t|dkrt|qS)r)rar'r\).0xrrr z*_parse_tpu_devices_str..,)r'splitr$rrrr[sr[)"r=rBrNrFmultiprocessingrrtypingrrrrrr r;Z lightning_utilities.core.importsr Z)lightning_fabric.accelerators.acceleratorr Z(lightning_fabric.utilities.device_parserr r rLrHrTr/r0rrZr'rr#r]r[rrrrs&    /2