a d@sddlmZmZmZddlZddlmZddlmZddlm Z ddl Z ddl m Z ddlmZGddde ejjZGd d d e ejjZdejed d ddZdS))AnyOptionalUnionN) DataParallel)DistributedDataParallel)_DeviceDtypeModuleMixin)rank_zero_deprecationcs~eZdZdddfdd ZeeedddZeeedd d Zeeedd d Zeeedd dZeeedddZ Z S)$_LightningPrecisionModuleWrapperBasepl.LightningModuleN) pl_modulereturncs0t||_t|dg}dd|D|_dS)aWraps the user's LightningModule. Requires overriding all ``*_step`` methods and ``forward`` so that it can safely be wrapped by a ``_LightningModuleWrapperBase`` and a ``*DataParallel``. Args: pl_module: the model to wrap !_ddp_params_and_buffers_to_ignorecSsg|]}d|qSzmodule..0prri/var/www/html/stable-diffusion-webui/venv/lib/python3.9/site-packages/pytorch_lightning/overrides/base.py 'zA_LightningPrecisionModuleWrapperBase.__init__..N)super__init__modulegetattrr )selfr r  __class__rrrs  z-_LightningPrecisionModuleWrapperBase.__init__)argskwargsr cOstdSNNotImplementedErrorrrrrrr training_step)sz2_LightningPrecisionModuleWrapperBase.training_stepcOstdSrr r"rrrvalidation_step,sz4_LightningPrecisionModuleWrapperBase.validation_stepcOstdSrr r"rrr test_step/sz._LightningPrecisionModuleWrapperBase.test_stepcOstdSrr r"rrr predict_step2sz1_LightningPrecisionModuleWrapperBase.predict_stepcOstdSrr r"rrrforward5sz,_LightningPrecisionModuleWrapperBase.forward) __name__ __module__ __qualname__rrr#r$r%r&r' __classcell__rrrrr s r cseZdZeedefddfdd ZeddddZe e e d d d Z e deedefeedefdd d dZ Z S)_LightningModuleWrapperBaser N)forward_moduler csptt|tjs.) rr isinstanceplLightningModuler ValueErrorrr*_forward_moduler )rr-r rrrr:s   z$_LightningModuleWrapperBase.__init__)r cCst|jtjr|jS|jjSr)r.r2r/r0r)rrrrlightning_moduleVsz,_LightningModuleWrapperBase.lightning_module)inputsrr cOs|j}|j}|dur|jrL|jj|i|}|jsH|jdus@Jd|j_|S|jrd|jj |i|S|j sp|j r|jj |i|S|j r|jj|i|S|j|i|S)NF)r3Z_trainerZtrainingr2r#Zautomatic_optimizationmodelZrequire_backward_grad_syncZtestingr%Zsanity_checkingZ validatingr$Z predictingr&)rr4rr Ztraineroutputrrrr'\s  z#_LightningModuleWrapperBase.forward)r r-r cCs0|durtd|jdn|dur,tddS)NzThe argument `pl_module` in `z]` is deprecated in v1.8.0 and will be removed in v2.0.0. Please use `forward_module` instead.z&Argument `forward_module` is required.)rr(r1)clsr r-rrr_validate_init_argumentsss  z4_LightningModuleWrapperBase._validate_init_arguments)NN)r(r)r*rrr rpropertyr3rr' classmethodr8r+rrrrr,9sr,Fr ) wrapped_model_suppress_warningr cCsl|s td|}t|ttfr(t|j}t|tr8|j}t|trH|j}t|t j sht dt |d|S)aRecursively unwraps a :class:`~pytorch_lightning.core.module.LightningModule` by following the ``.module`` attributes on the wrapper. .. deprecated:: v1.8.0 The function ``unwrap_lightning_module`` is deprecated in v1.8.0 and will be removed in v2.0.0. Access the ``LightningModule`` directly through the strategy attribute ``Strategy.lightning_module``. Raises: TypeError: If the unwrapping leads to a module that is not a LightningModule and that cannot be unwrapped further. zThe function `unwrap_lightning_module` is deprecated in v1.8.0 and will be removed in v2.0.0. Access the `LightningModule` directly through the strategy attribute `Strategy.lightning_module`.z=Unwrapping the module did not yield a `LightningModule`, got z instead.) rr.rrunwrap_lightning_modulerr,r3r r/r0 TypeErrortype)r;r<r5rrrr=s     r=)F)typingrrrZtorchZtorch.nnnnrZtorch.nn.parallelrZpytorch_lightningr/Z-lightning_fabric.utilities.device_dtype_mixinrZ%pytorch_lightning.utilities.rank_zerorModuler r,boolr=rrrrs     J