a þd³ã@s2UdZddlmZddlmZmZmZmZddlZgd¢Z ee ed<Gdd„dƒZeƒZ eejjefZejed œd d„Zejed œdd „Zejed œdd„Zeejedd œdd„ƒZeeeddœdd„ƒZeejdœdd„Zeeddœdd„Zejeddœdd„Zeedœdd„Zeejjdœd d!„ZdS)"zWUtilities for eliminating boilerplate code to handle abstract streams with CPU device. é)Úcontextmanager)Ú GeneratorÚListÚUnionÚcastN)Ú CPUStreamTypeÚ new_streamÚcurrent_streamÚdefault_streamÚ use_deviceÚ use_streamÚ get_deviceÚwait_streamÚ record_streamÚis_cudaÚas_cudaÚ__all__c@seZdZdS)rN)Ú__name__Ú __module__Ú__qualname__©rrúo/var/www/html/stable-diffusion-webui/venv/lib/python3.9/site-packages/torch/distributed/pipeline/sync/stream.pyrsr)ÚdeviceÚreturncCs|jdkrtStj |¡S)z3Creates a new stream for either CPU or CUDA device.Úcuda)ÚtypeÚ CPUStreamÚtorchrÚStream©rrrrrs rcCs|jdkrtStj |¡S)z@:func:`torch.cuda.current_stream` for either CPU or CUDA device.r)rrrrr rrrrr &s r cCs|jdkrtStj |¡S)z@:func:`torch.cuda.default_stream` for either CPU or CUDA device.r)rrrrr rrrrr -s r )NNNccsJ|jdkrdVdStj |¡dVWdƒn1s<0YdS)z8:func:`torch.cuda.device` for either CPU or CUDA device.rN)rrrrrrrrr4s r)ÚstreamrccsLt|ƒsdVdStj t|ƒ¡dVWdƒn1s>0YdS)z8:func:`torch.cuda.stream` for either CPU or CUDA stream.N)rrrr r©r rrrr?s rcCst|ƒrt|ƒjSt d¡S)z(Gets the device from CPU or CUDA stream.Úcpu)rrrrr!rrrr Js r )ÚsourceÚtargetrcCs4t|ƒr0t|ƒr$t|ƒ t|ƒ¡nt|ƒ ¡dS)zœ:meth:`torch.cuda.Stream.wait_stream` for either CPU or CUDA stream. It makes the source stream wait until the target stream completes work queued. N)rrrZsynchronize)r#r$rrrrQsr)Útensorr rcCs0t|ƒr,| dg¡ | ¡¡}| t|ƒ¡dS)zA:meth:`torch.Tensor.record_stream` for either CPU or CUDA stream.rN)rZ new_emptyÚset_Z_typed_storagerr)r%r rrrr`s rcCs|tuS)zs&