a
þdÛ
ã @ sN d dl Z d dlZd dlZd dlmZ d dlmZ e e ¡Z
G dd„ deƒZ dS )é N)ÚClusterEnvironment)Úrank_zero_warnc @ s° e Zd ZdZeedœdd„ƒZeedœdd„ƒZee dœdd„ƒZ
e edœd d
„ƒZ e dœd d „Z
e d
dœdd„Ze dœdd„Ze d
dœdd„Ze dœdd„Ze dœdd„Zd
S )ÚTorchElasticEnvironmentzgEnvironment for fault-tolerant and elastic training with `torchelastic `_)Úreturnc C s dS )NT© ©Úselfr r ú{/var/www/html/stable-diffusion-webui/venv/lib/python3.9/site-packages/lightning_fabric/plugins/environments/torchelastic.pyÚ creates_processes_externally s z4TorchElasticEnvironment.creates_processes_externallyc C s< dt jvr tdƒ dt jd< t dt jd › ¡ t jd S )NZ MASTER_ADDRzAMASTER_ADDR environment variable is not defined. Set as localhostz 127.0.0.1z
MASTER_ADDR: )ÚosÚenvironr ÚlogÚdebugr r r r Ú main_address! s
z$TorchElasticEnvironment.main_addressc C s@ dt jvr tdƒ dt jd< t dt jd › ¡ tt jd ƒS )NZ MASTER_PORTz=MASTER_PORT environment variable is not defined. Set as 12910Z12910z
MASTER_PORT: )r r r r
r Úintr r r r Ú main_port) s
z!TorchElasticEnvironment.main_portc C s t j ¡ ot j ¡ S )zTReturns ``True`` if the current process was launched using the torchelastic command.)ÚtorchZ distributedZ is_availableZis_torchelastic_launchedr r r r Údetect2 s z TorchElasticEnvironment.detectc C s t tjd ƒS )NZ
WORLD_SIZE©r r r r r r r Ú
world_size8 s z"TorchElasticEnvironment.world_sizeN)Úsizer c C s t d¡ d S )NzbTorchElasticEnvironment.set_world_size was called, but setting world size is not allowed. Ignored.©r
r )r r r r r Úset_world_size; s z&TorchElasticEnvironment.set_world_sizec C s t tjd ƒS )NZRANKr r r r r Ú global_rank> s z#TorchElasticEnvironment.global_rank)Úrankr c C s t d¡ d S )NzdTorchElasticEnvironment.set_global_rank was called, but setting global rank is not allowed. Ignored.r )r r r r r Úset_global_rankA s ÿz'TorchElasticEnvironment.set_global_rankc C s t tjd ƒS )NZ
LOCAL_RANKr r r r r Ú
local_rankF s z"TorchElasticEnvironment.local_rankc C s t tj dd¡ƒS )NZ
GROUP_RANKr )r r r Úgetr r r r Ú node_rankI s z!TorchElasticEnvironment.node_rank)Ú__name__Ú
__module__Ú __qualname__Ú__doc__ÚpropertyÚboolr
Ústrr r r Ú staticmethodr r r r r r r r r r r r s r ) Úloggingr Ztorch.distributedr Z9lightning_fabric.plugins.environments.cluster_environmentr Z$lightning_fabric.utilities.rank_zeror Ú getLoggerr r
r r r r r Ú s