a d@sRddlmZmZmZmZmZmZddlmZddl m Z ddl m Z ddl mZeeeedddZdeeeeeefeeeeed d d Zeeeeefeeeefd ddZdeeeeeed ddZeeeeeedffeeeeed ddZdeeeedddZeeddddZeddddZdS) )AnyListMutableSequenceOptionalTupleUnionN)TorchElasticEnvironment)MisconfigurationException)_DEVICE)gpusreturncCs>|dur dSt|tstdt|dks2Jd|d}|S)a Args: gpus: Non-empty list of ints representing which GPUs to use Returns: Designated root GPU device id Raises: TypeError: If ``gpus`` is not a list AssertionError: If GPU list is empty NzGPUs should be a listrzGPUs should be a non-empty list) isinstancelist TypeErrorlen)r Zroot_gpurq/var/www/html/stable-diffusion-webui/venv/lib/python3.9/site-packages/lightning_fabric/utilities/device_parser.py_determine_root_gpu_devices rF)r include_cuda include_mpsr cCst||dus2t|tr"|dks2t|dvr6dSt|}t|||d}|sXtdt rt |dkrt t ||ddkr|St |t |||dS)aH Parses the GPU IDs given in the format as accepted by the :class:`~pytorch_lightning.trainer.Trainer`. Args: gpus: An int -1 or string '-1' indicate that all available GPUs should be used. A list of unique ints or a string containing a list of comma separated unique integers indicates specific GPUs to use. An int of 0 means that no GPUs should be used. Any int N > 0 indicates that GPUs [0..N) should be used. include_cuda: A boolean value indicating whether to include CUDA devices for GPU parsing. include_mps: A boolean value indicating whether to include MPS devices for GPU parsing. Returns: A list of GPUs to be used or ``None`` if no GPUs were requested Raises: MisconfigurationException: If no GPUs are available but the value of gpus variable indicates request for GPUs .. note:: ``include_cuda`` and ``include_mps`` default to ``False`` so that you only have to specify which device type to use and all other devices are not disabled. Nr)0z[]rrz&GPUs requested but none are available.)_check_data_typer intstrstrip!_normalize_parse_gpu_string_input"_normalize_parse_gpu_input_to_listr rdetectr_get_all_available_gpus _check_unique_sanitize_gpu_idsr rrrrr_parse_gpu_ids2s * r$)sr cCsBt|ts|S|dkrdSd|vr6dd|dDSt|S)Nz-1,cSs$g|]}t|dkrt|qS)r)rrr).0xrrr qz5_normalize_parse_gpu_string_input..)r rsplitrr)r%rrrrks rcCsNt||fdkrtdt||d}|D] }||vr(td|d|q(|S)arChecks that each of the GPUs in the list is actually available. Raises a MisconfigurationException if any of the GPUs is not available. Args: gpus: List of ints corresponding to GPU indices Returns: Unmodified gpus variable Raises: MisconfigurationException: If machine has fewer available GPUs than requested. rz*At least one gpu type should be specified!rzYou requested gpu: z But your machine only has: )sum ValueErrorr r )r rrZall_available_gpusZgpurrrr"us r".cCsJ|dus Jt|ttfr"t|S|s*dS|dkr>t||dStt|S)Nr&r)r rtuplerr ranger#rrrrs  r)rrr cCs,|rtjng}|r tjng}||S)z7 Returns: A list of all available GPUs ) acceleratorsZcudaZ_get_all_visible_cuda_devicesZmpsZ_get_all_available_mps_gpus)rrZ cuda_gpusZmps_gpusrrrr sr ) device_idsr cCs t|tt|krtddS)zChecks that the device_ids are unique. Args: device_ids: List of ints corresponding to GPUs indices Raises: MisconfigurationException: If ``device_ids`` of GPUs aren't unique z!Device ID's (GPU) must be unique.N)rsetr )r2rrrr!s r!cCs~d}|durdSt|ttfrP|D]*}t|tur"t|dt|jdq"n*t|ttfvrzt|dt|jddS)aQChecks that the device_ids argument is one of the following: None, int, string, or sequence of integers. Args: device_ids: gpus/tpu_cores parameter as passed to the Trainer Raises: MisconfigurationException: If ``device_ids`` of GPU/TPUs aren't ``int``, ``str``, sequence of ``int`` or ``None`` zYDevice IDs (GPU/TPU) must be an int, a string, a sequence of ints or None, but you passedNz a sequence of . )r rr/typerr __name__r)r2msgZid_rrrrs  r)FF)FF)FF)typingrrrrrrZlightning_fabric.acceleratorsr1Z2lightning_fabric.plugins.environments.torchelasticrZ%lightning_fabric.utilities.exceptionsr Z lightning_fabric.utilities.typesr rrrboolr$rr"rr r!rrrrrs*      9*