a d'@sdZddlZddlmZddlmZddlZddlmZddlm Z ddl m Z dee ed d d Z ee d d dZee d ddZee d ddZee d ddZddddZe edddZdS)zUtilities related to memory.N)BytesIO)Any)apply_to_collection)Tensor)ModuleF)in_dictto_cpureturncCs"tttddd}t|t||dS)aDetach all tensors in `in_dict`. May operate recursively if some of the values in `in_dict` are dictionaries which contain instances of `Tensor`. Other types in `in_dict` are not affected by this utility function. Args: in_dict: Dictionary with tensors to detach to_cpu: Whether to move tensor to cpu Return: out_dict: Dictionary with detached tensors )trr cSs|}|r|}|SN)detachcpu)r rrk/var/www/html/stable-diffusion-webui/venv/lib/python3.9/site-packages/pytorch_lightning/utilities/memory.pydetach_and_move)sz)recursive_detach..detach_and_move)r)rboolr)rrrrrrrecursive_detachsr) exceptionr cCst|pt|pt|Sr )is_cuda_out_of_memoryis_cudnn_snafuis_out_of_cpu_memoryrrrr is_oom_error2srcCs4t|to2t|jdko2d|jdvo2d|jdvS)NZCUDArz out of memory isinstance RuntimeErrorlenargsrrrrr7s    rcCs&t|to$t|jdko$d|jdvS)Nrz(cuDNN error: CUDNN_STATUS_NOT_SUPPORTED.rrrrrrrAs    rcCs&t|to$t|jdko$d|jdvS)Nrz*DefaultCPUAllocator: can't allocate memoryrrrrrrrKs    r)r c CsJtztjWn.tyD}zt|s0WYd}~n d}~00dS)z'Garbage collection Torch (CUDA) memory.N)gcZcollecttorchZcudaZ empty_cacherrrrrrgarbage_collection_cudaTs r!)modelr cCs(t}t|||jd}|S)a Calculates the size of a Module in megabytes. The computation includes everything in the :meth:`~torch.nn.Module.state_dict`, i.e., by default the parameters and buffers. Returns: Number of megabytes in the parameters of the input module. g.A)rr saveZ state_dict getbuffernbytes)r"Z model_sizeZsize_mbrrrget_model_size_mb`s r&)F)__doc__riortypingrr Z#lightning_utilities.core.apply_funcrrZtorch.nnrrr BaseExceptionrrrrr!floatr&rrrrs