a d@sddlZddlmZmZmZddlZddlZddlm Z ddl m Z ddl m Z mZddlmZmZmZed d rddlmmZdeed d d ZdeeeejdddZdeeeefeejdddZdS)N)ListOptionalUnion)AcceleratorState)CUDA_DISTRIBUTED_TYPES)DistributedTypeRNGType)is_npu_availableis_tpu_availableis_xpu_availableF)Z check_deviceseedZdevice_specificcCsx|r|tj7}t|tj|t|trDtj |n t rXtj |n tj |t rtt|dS)a= Helper function for reproducible behavior to set the seed in `random`, `numpy`, `torch`. Args: seed (`int`): The seed to set. device_specific (`bool`, *optional*, defaults to `False`): Whether to differ the seed on each device slightly with `self.process_index`. N)rZ process_indexrandomrnptorchZ manual_seedr xpuZmanual_seed_allr npucudar xm set_rng_staterr`/var/www/html/stable-diffusion-webui/venv/lib/python3.9/site-packages/accelerate/utils/random.pyset_seeds      r)rng_type generatorcCs|tjkrt}n|tjkr*tj}n|tjkrRtsBJdtt }nj|tj krvt sjJdtj }nF|tj krtsJdtj}n"|tjkr|dusJd|}t}|jtjkr|t }t |gt |}nh|jtvs"|jtjks"|jtjkrF||j}tj |d|}n|jtj!krbtj |d|tjkrzt"|n|tjkrtj"|nf|tj krtj "|nL|tj krtj"|n2|tjkrt "|#n|tjkr|$|dS)Nz;Can't synchronize XLA seeds on an environment without TPUs.z;Can't synchronize NPU seeds on an environment without NPUs.z;Can't synchronize XPU seeds on an environment without XPUs.z)Need a generator to synchronize its seed.r)%r ZTORCHrZ get_rng_stateZCUDArZXLAr ZtensorrZNPUr rZXPUr r GENERATORZ get_staterZdistributed_typer ZTPUtoZ xla_deviceZcollective_broadcastZ mark_stepcpurZ MULTI_NPUZ MULTI_XPUZdeviceZ distributed broadcastZ MULTI_CPUritemZ set_state)rrZ rng_statestaterrrsynchronize_rng_state9sZ                        r#) rng_typesrcCs|D]}tt||dqdS)N)r)r#r )r$rrrrrsynchronize_rng_statesmsr%)F)NN)N)rtypingrrrnumpyrrr"r constantsrZ dataclassesr r Zimportsr r r Ztorch_xla.core.xla_modelcoreZ xla_modelrintboolr Generatorr#strr%rrrrs   4