a d$@sddlmZmZmZddlmZeGdddZeGdddeZeGdddeZeGd d d eZ eGd d d eZ eGd dde Z eGddde Z eGddde Z eGdddeZeGdddeZdS))asdict dataclassfield)Typec@sPeZdZdZedddZeddddZeeddd d Zddd d Z dS) BaseProgressz>Mixin that implements state-loading utilities for dataclasses.returncCst|SN)rselfr k/var/www/html/stable-diffusion-webui/venv/lib/python3.9/site-packages/pytorch_lightning/trainer/progress.py state_dictszBaseProgress.state_dictNrrcCs|j|dSr )__dict__updater rr r r load_state_dictszBaseProgress.load_state_dictcCs|}|||Sr )r)clsrobjr r r from_state_dicts zBaseProgress.from_state_dictcCstdS)zReset the object's state.N)NotImplementedErrorr r r r reset"szBaseProgress.reset) __name__ __module__ __qualname____doc__dictrr classmethodrrr r r r rs rc@sFeZdZUdZdZeed<dZeed<ddddZddd d Z dS) ReadyCompletedTrackeraETrack an event's progress. Args: ready: Intended to track the number of events ready to start. completed: Intended to be incremented after the event completes (e.g. after ``on_*_end`` runs). These attributes should be increased in order, that is, :attr:`ready` first and :attr:`completed` last. rready completedNrcCsd|_d|_dS)zReset the state.rN)r r!r r r r r5szReadyCompletedTracker.resetcCs |j|_dS)zReset the progress on restart. If there is a failure before all attributes are increased, restore the attributes to the last fully completed value. N)r!r r r r r reset_on_restart:sz&ReadyCompletedTracker.reset_on_restart) rrrrr int__annotations__r!rr"r r r r r's   rcsFeZdZUdZdZeed<ddfdd Zddfdd ZZ S) StartedTrackeraTrack an event's progress. Args: ready: Intended to track the number of events ready to start. started: Intended to be incremented after the event is started (e.g. after ``on_*_start`` runs). completed: Intended to be incremented after the event completes (e.g. after ``on_*_end`` runs). These attributes should be increased in order, that is, :attr:`ready` first and :attr:`completed` last. rstartedNrcstd|_dSNr)superrr&r  __class__r r rQs zStartedTracker.resetcst|j|_dSr )r(r"r!r&r r)r r r"Us zStartedTracker.reset_on_restart) rrrrr&r#r$rr" __classcell__r r r)r r%Cs  r%csFeZdZUdZdZeed<ddfdd Zddfdd ZZ S) ProcessedTrackeraTrack an event's progress. Args: ready: Intended to track the number of events ready to start. started: Intended to be incremented after the event is started (e.g. after ``on_*_start`` runs). processed: Intended to be incremented after the event is processed. completed: Intended to be incremented after the event completes (e.g. after ``on_*_end`` runs). These attributes should be increased in order, that is, :attr:`ready` first and :attr:`completed` last. r processedNrcstd|_dSr')r(rr-r r)r r ris zProcessedTracker.resetcst|j|_dSr )r(r"r!r-r r)r r r"ms z!ProcessedTracker.reset_on_restart) rrrrr-r#r$rr"r+r r r)r r,Zs  r,c@seZdZUdZeedZeed<eedZ eed<ddddZ ddd d Z ddd d Z ddd dZ ddddZeeeeddddZddddZddddZddddZeddddZdS)ProgresszTrack aggregated and current progress. Args: total: Intended to track the total progress of an event. current: Intended to track the current progress of an event. default_factorytotalcurrentNrcCs t|jt|jurtddS)Nz?The `total` and `current` instances should be of the same class)typer1r2 ValueErrorr r r r __post_init__~szProgress.__post_init__cCs$|jjd7_|jjd7_dSN)r1r r2r r r r increment_readyszProgress.increment_readycCsFt|jts"td|jjjd|jjd7_|jjd7_dS)N`z$` doesn't have a `started` attributer7) isinstancer1r% TypeErrorr*rr&r2r r r r increment_starteds zProgress.increment_startedcCsFt|jts"td|jjjd|jjd7_|jjd7_dS)Nr9z&` doesn't have a `processed` attributer7)r:r1r,r;r*rr-r2r r r r increment_processeds zProgress.increment_processedcCs$|jjd7_|jjd7_dSr6)r1r!r2r r r r increment_completedszProgress.increment_completed) tracker_clskwargsrcKs ||fi||fi|dS)zZUtility function to easily create an instance from keyword arguments to both ``Tracker``s.)r1r2r )rr?r@r r r from_defaultsszProgress.from_defaultscCs|j|jdSr )r1rr2r r r r rs zProgress.resetcCs|jdSr )r2rr r r r reset_on_runszProgress.reset_on_runcCs|jdSr )r2r"r r r r r"szProgress.reset_on_restartrcCs$|j|d|j|ddS)Nr1r2)r1rr2rr r r rszProgress.load_state_dict)rrrrrr,r1rr$r2r5r8r<r=r>rrr#rArrBr"rrr r r r r.rs r.c@s6eZdZUdZeedZeed<eedZeed<dS)DataLoaderProgressaTracks dataloader progress. These counters are local to a trainer rank. By default, they are not globally synced across all ranks. Args: total: Tracks the total dataloader progress. current: Tracks the current dataloader progress. r/r1r2N rrrrrrr1r$r2r r r r rCs  rCcsZeZdZUdZdZeed<ddfdd Zddfdd Ze dd fd d Z Z S) BatchProgressaVTracks batch progress. These counters are local to a trainer rank. By default, they are not globally synced across all ranks. Args: total: Tracks the total batch progress. current: Tracks the current batch progress. is_last_batch: Whether the batch is the last one. This is useful for iterable datasets. F is_last_batchNrcstd|_dSNF)r(rrFr r)r r rs zBatchProgress.resetcstd|_dSrG)r(rBrFr r)r r rBs zBatchProgress.reset_on_runrcst||d|_dS)NrF)r(rrFrr)r r rs zBatchProgress.load_state_dict) rrrrrFboolr$rrBrrr+r r r)r rEs  rEc@s6eZdZUdZeedZeed<eedZeed<dS)SchedulerProgressaTracks scheduler progress. These counters are local to a trainer rank. By default, they are not globally synced across all ranks. Args: total: Tracks the total scheduler progress. current: Tracks the current scheduler progress. r/r1r2NrDr r r r rIs  rIc@sxeZdZUdZedddZeed<edddZeed<dd d d Z dd d d Z dd ddZ e ddddZ dS)OptimizerProgresszTrack optimizer progress. Args: step: Tracks ``optimizer.step`` calls. zero_grad: Tracks ``optimizer.zero_grad`` calls. cCs ttSr )r.rArr r r r zOptimizerProgress.r/stepcCs ttSr )r.rAr%r r r r rKrL zero_gradNrcCs|j|jdSr )rMrrNr r r r rs zOptimizerProgress.resetcCs|j|jdSr )rMrBrNr r r r rBs zOptimizerProgress.reset_on_runcCs|j|jdSr )rMr"rNr r r r r"s z"OptimizerProgress.reset_on_restartrcCs$|j|d|j|ddS)NrMrN)rMrrNrr r r rsz!OptimizerProgress.load_state_dict)rrrrrrMr.r$rNrrBr"rrr r r r rJs rJc@s|eZdZUdZeedZeed<dZe ed<e e dddZ d dd d Z d dd d Z d dddZed dddZd S)OptimizationProgressaTrack optimization progress. Args: optimizer: Tracks optimizer progress. optimizer_position: The index of the current optimizer amongst the currently active optimizers. Used to know which optimizer we were using when restarting. Since not all optimizers may be active at a given time, this index is different from the ``optimizer_idx`` seen in the optimization loops. r/ optimizerroptimizer_positionrcCs |jjjjSr )rPrMr1r!r r r r optimizer_stepssz$OptimizationProgress.optimizer_stepsNcCs|jd|_dSr')rPrrQr r r r rs zOptimizationProgress.resetcCs|jd|_dSr')rPrBrQr r r r rBs z!OptimizationProgress.reset_on_runcCs|jdSr )rPr"r r r r r"sz%OptimizationProgress.reset_on_restartrcCs|j|d|d|_dS)NrPrQ)rPrrQrr r r rsz$OptimizationProgress.load_state_dict)rrrrrrJrPr$rQr#propertyrRrrBr"rrr r r r rOs   rON)Z dataclassesrrrtypingrrrr%r,r.rCrErIrJrOr r r r s* 7