a d@sddlZddlZddlZzddlZdZWney>dZYn0ddlmZgdZ Gdddej j j Z ddZ ddd d d Zd d ZdS)NT)Any)autocast custom_fwd custom_bwdcsdeZdZdZdejdfeejedfdd ZfddZ e e e dfd d Z fd d Z Z S) rz See :class:`torch.autocast`. ``torch.cuda.amp.autocast(args...)`` is equivalent to ``torch.autocast("cuda", args...)`` Tenableddtype cache_enabledcs8tjr ||_d|_||_dStjd|||ddS)NZcudar)torch _jit_internal is_scriptingZ_enabledZdeviceZ fast_dtypesuper__init__)selfrrr  __class__e/var/www/html/stable-diffusion-webui/venv/lib/python3.9/site-packages/torch/cuda/amp/autocast_mode.pyrs  zautocast.__init__cstjr|StSN)r r r r __enter__)rrrrrs zautocast.__enter__)exc_typeexc_valexc_tbcstjrdSt|||Sr)r r r r __exit__)rrrrrrrr!s zautocast.__exit__cstjr|St|Sr)r r r r __call__)rfuncrrrr&s zautocast.__call__)__name__ __module__ __qualname____doc__r float16boolrrrrrr __classcell__rrrrr s " rcst|tjr8|o$|jo$|jtju}|r4|S|St|tt frJ|St r^t|t j r^|St|t jjrfdd|DSt|t jjrtfdd|}t|ttfrt||S|Sn|SdS)Ncs"i|]\}}t|t|qSr_cast).0kvrrr 7z_cast..cs t|Srr#)r'r(rr9r*z_cast..) isinstancer ZTensorZis_floating_pointZis_cudarfloat64tostrbytes HAS_NUMPYnpZndarray collectionsabcMappingitemsIterablemaplisttupletype)valuerZ is_eligibleiterablerr(rr$.s  r$ cast_inputscs2durtjtdStfdd}|S)a> Helper decorator for ``forward`` methods of custom autograd functions (subclasses of :class:`torch.autograd.Function`). See the :ref:`example page` for more detail. Args: cast_inputs (:class:`torch.dtype` or None, optional, default=None): If not ``None``, when ``forward`` runs in an autocast-enabled region, casts incoming floating-point CUDA Tensors to the target dtype (non-floating-point Tensors are not affected), then executes ``forward`` with autocast disabled. If ``None``, ``forward``'s internal ops execute with the current autocast state. .. note:: If the decorated ``forward`` is called outside an autocast-enabled region, :func:`custom_fwd` is a no-op and ``cast_inputs`` has no effect. Nr>cst|d_dur2t|d_|i|St}d|d_|rtdd*t|it|WdS1s0Yn|i|SdS)NrF)r)r Zget_autocast_gpu_dtype_dtypeZis_autocast_enabled_fwd_used_autocastrr$)argskwargsZautocast_contextr?fwdrr decorate_fwd]s  :z custom_fwd..decorate_fwd) functoolspartialrwraps)rEr?rFrrDrrJs  rcstfdd}|S)a Helper decorator for backward methods of custom autograd functions (subclasses of :class:`torch.autograd.Function`). Ensures that ``backward`` executes with the same autocast state as ``forward``. See the :ref:`example page` for more detail. csJt|dj|djd|i|WdS1s<0YdS)Nr)rr)rrAr@)rBrCbwdrr decorate_bwdxsz custom_bwd..decorate_bwd)rGrI)rKrLrrJrrqsr)N)r rGr3numpyr2r1ModuleNotFoundErrortypingr__all__ampZ autocast_moderr$rrrrrrs   !'