a dl@sddlZddlmZddlmZmZmZmZddlm Z ddl m Z ddl m Z ddlmZddlmZerxdd lmZGd d d e Zedd d dZdS)N) SimpleQueue)AnyCallableOptional TYPE_CHECKING) get_context)_XLA_AVAILABLE) _Launcher)_GlobalStateSnapshot)move_data_to_device) XLAStrategyc @sfeZdZdZdddddZeeddd Zee e e d d d Z de ee e e e edd ddZdS) _XLALauncheraLaunches processes that run a given function in parallel on XLA supported hardware, and joins them all at the end. The main process in which this launcher is invoked creates N so-called worker processes (using the `torch_xla` :func:`xmp.spawn`) that run the given function. Worker processes have a rank that ranges from 0 to N - 1. Note: - This launcher requires all objects to be pickleable. - It is important that the entry point to the program/script is guarded by ``if __name__ == "__main__"``. Args: strategy: A reference to the strategy that is used together with this launcher r N)strategyreturncCs tsttt||_d|_dS)Nfork)rModuleNotFoundErrorstr _strategy _start_method)selfrrr/var/www/html/stable-diffusion-webui/venv/lib/python3.9/site-packages/lightning_fabric/strategies/launchers/xla.py__init__-s z_XLALauncher.__init__)rcCsdS)NTr)rrrris_interactive_compatible3sz&_XLALauncher.is_interactive_compatible)functionargskwargsrcOsNt|j}|}ddlmm}|j|j||||f|jj |jd| S)aLaunches processes that run the given function in parallel. The function is allowed to have a return value. However, when all processes join, only the return value of worker process 0 gets returned from this `launch` method in the main process. Arguments: function: The entry point for all launched processes. *args: Optional positional arguments to be passed to the given function. **kwargs: Optional keyword arguments to be passed to the given function. rN)rZnprocsZ start_method) rrrZ)torch_xla.distributed.xla_multiprocessingZ distributedZxla_multiprocessingspawn_wrapping_functionrZ num_processesget)rrrrcontext return_queuexmprrrlaunch7s  z_XLALauncher.launch) process_idxrrrr! global_statesrcCs:||i|}|jjdkr*|t|dt|jjdS)Nrcpu)rZ local_rankputr _rank_teardown)rr$rrrr!r%resultsrrrrNs  z_XLALauncher._wrapping_function)N)__name__ __module__ __qualname____doc__rpropertyboolrrrr#intrrr rrrrrr s r )rankrcCs2ddlmm}|d|dkr.tddS)Nrz end-process)Ztorch_xla.core.xla_modelcoreZ xla_modelZ rendezvoustimesleep)r1Zxmrrrr(as r()r4Zmultiprocessing.queuesrtypingrrrrZtorch.multiprocessingrZ!lightning_fabric.accelerators.tpurZ*lightning_fabric.strategies.launchers.baser Z5lightning_fabric.strategies.launchers.multiprocessingr Z%lightning_fabric.utilities.apply_funcr Zlightning_fabric.strategiesr r r0r(rrrrs       D