a d@sUdZddlZddlmZeejdddZdaejje d<ejjd d d Z dd d d Z ed ddZ eddddZ eddddZdd ddZdd ddZdd ddZed ddZed ddZgd ZdS)!zG This package enables an interface for accessing MPS backend in python N)TensorZ_mps_is_in_bad_forkcCsdS)NFrrr[/var/www/html/stable-diffusion-webui/venv/lib/python3.9/site-packages/torch/mps/__init__.pyr_default_mps_generator)returncCstdurtjatS)N)rtorch_CZ_mps_get_default_generatorrrrr_get_default_mps_generator s r cCs tjS)zAWaits for all kernels in all streams on a MPS device to complete.)r r Z_mps_synchronizerrrr synchronizesr cCs tS)z:Returns the random number generator state as a ByteTensor.)r Z get_staterrrr get_rng_statesr) new_stater cCs|jtjd}t|dS)zoSets the random number generator state. Args: new_state (torch.ByteTensor): The desired state )Z memory_formatN)cloner Zcontiguous_formatr Z set_state)rZnew_state_copyrrr set_rng_statesr)seedr cCs"tjs dSt|}t|dS)zbSets the seed for generating random numbers. Args: seed (int): The desired seed. N)r Zhas_mpsintr manual_seed)rrrrr"s rcCstdS)z?Sets the seed for generating random numbers to a random number.N)r rrrrrr1srcCstjdS)zReleases all unoccupied cached memory currently held by the caching allocator so that those can be used in other GPU applications. N)r r Z_mps_emptyCacherrrr empty_cache5srcCs@t|tstd|dks"|dkr0td|tj|dS)aSet memory fraction for limiting process's memory allocation on MPS device. The allowed value equals the fraction multiplied by recommended maximum device memory (obtained from Metal API device.recommendedMaxWorkingSetSize). If trying to allocate more than the allowed value in a process, it will raise an out of memory error in allocator. Args: fraction(float): Range: 0~2. Allowed memory equals total_memory * fraction. .. note:: Passing 0 to fraction means unlimited allocations (may cause system failure if out of memory). Passing fraction greater than 1.0 allows limits beyond the value returned from device.recommendedMaxWorkingSetSize. z3Invalid type for fraction argument, must be `float`rrz.Invalid fraction value: {}. Allowed range: 0~2N) isinstancefloat TypeError ValueErrorformatr r Z_mps_setMemoryFraction)fractionrrrset_per_process_memory_fraction;s  rcCs tjS)zReturns the current GPU memory occupied by tensors in bytes. .. note:: The returned size does not include cached allocations in memory pools of MPSAllocator. )r r Z_mps_currentAllocatedMemoryrrrrcurrent_allocated_memorySsrcCs tjS)zReturns total GPU memory allocated by Metal driver for the process in bytes. .. note:: The returned size includes cached allocations in MPSAllocator pools as well as allocations from MPS/MPSGraph frameworks. )r r Z_mps_driverAllocatedMemoryrrrrdriver_allocated_memory\sr) rrrrr rrrr)__doc__r rgetattrr Z_is_in_bad_forkr Generator__annotations__r r rrrrrrrrr__all__rrrrs