a  d4 @s8dZddlZddlZddlmZddlmZmZmZm Z m Z ddl Z zddl Z dZWneyjdZYn0eeZgdZeeefeeefdd d Zdeee ee jfeeefd d dZde jjeee ee jfeee edddZdeeefe jjedddZde jjee jjeedddZdS)zi Model creation / weight loading / state_dict helpers Hacked together by / Copyright 2020 Ross Wightman N) OrderedDict)AnyCallableDictOptionalUnionTF)clean_state_dictload_state_dictload_checkpointremap_state_dictresume_checkpoint) state_dictreturncCs<i}|D]*\}}|dr*|ddn|}|||<q |S)Nzmodule.)items startswith)r Zcleaned_state_dictkvnamer]/var/www/html/stable-diffusion-webui/venv/lib/python3.9/site-packages/timm/models/_helpers.pyrs  rcpu)checkpoint_pathuse_emadevicercCs|rtj|rt|drs     r )r r allow_reshapec Csi}t||D]\\}}\}}||ks`Jd|d|jd|d|jd |j|jkr|r~||j}n*dsJd|d|jd|d|jd |||<q|S)z remap checkpoint by iterating over state dicts in order (ignoring original keys). This assumes models (and originating state dict) were created with params registered in same order. zTensor size mismatch z: z vs z. Remap failed.FzTensor shape mismatch )zipr rZnumelshapeZreshape)r rr<Zout_dictkavakbZvbrrrr Xs&6 * r )rr optimizer loss_scalerlog_infocCs8d}tj|rtj|dd}t|trd|vr|r@tdt |d}| ||durd|vr|rttd| |d|dur|j |vr|rtd| ||j d|vr|d}d |vr|d d kr|d 7}|rtd ||dn | ||rtd ||St d |tdS)Nrrr z(Restoring model state from checkpoint...rBz,Restoring optimizer state from checkpoint...z2Restoring AMP loss scaler state from checkpoint...epochversionz!Loaded checkpoint '{}' (epoch {})zLoaded checkpoint '{}'r)r r!r"r'r(r)r*r,r-rr r2r.r/r0)rrrBrCrDZ resume_epochr1r rrrr ls8      r )Tr)TrTFN)T)NNT) __doc__loggingr collectionsrtypingrrrrrr'Zsafetensors.torchr&r% ImportError getLogger__name__r,__all__r#rboolrr nnModuler r ZoptimZ Optimizerr rrrrsf       "