a  þdC5ã@sˆddlZddlZddlZddlmZddlmZddlmZddl m Z Gdd„de ƒZ Gd d „d ej ƒZ e ¡Gd d „d ej ƒƒZdS) éN)Ú ARCH_REGISTRY)Únn)Ú functionalé)ÚStyleGAN2GeneratorCleancs,eZdZdZd ‡fdd„ Zdd d „Z‡ZS)ÚStyleGAN2GeneratorCSFTavStyleGAN2 Generator with SFT modulation (Spatial Feature Transform). It is the clean version without custom compiled CUDA extensions used in StyleGAN2. Args: out_size (int): The spatial size of outputs. num_style_feat (int): Channel number of style features. Default: 512. num_mlp (int): Layer number of MLP style layers. Default: 8. channel_multiplier (int): Channel multiplier for large networks of StyleGAN2. Default: 2. narrow (float): The narrow ratio for channels. Default: 1. sft_half (bool): Whether to apply SFT on half of the input channels. Default: False. ééérFcs$tt|ƒj|||||d||_dS)N)Únum_style_featÚnum_mlpÚchannel_multiplierÚnarrow)ÚsuperrÚ__init__Úsft_half)ÚselfÚout_sizer r r rr©Ú __class__©úi/var/www/html/stable-diffusion-webui/venv/lib/python3.9/site-packages/gfpgan/archs/gfpganv1_clean_arch.pyrs ûzStyleGAN2GeneratorCSFT.__init__NTc s¼|s‡fdd„|Dƒ}|durH|r0dgˆj}n‡fdd„tˆjƒDƒ}|dkrxg} |D]} |  ||| |¡qX| }t|ƒdkr¼ˆj}|djdkr²|d d¡ d|d¡} n|d} nnt|ƒdkr*|durät  dˆjd¡}|d d¡ d|d¡} |d d¡ dˆj|d¡}t   | |gd¡} ˆ  | j d¡}ˆj|| dd…df|dd }ˆ || dd…df¡}d}tˆjddd…ˆjddd…|ddd…|ddd…ˆjƒD]è\}}}}}||| dd…|f|d }|t|ƒkrXˆjr@t j|t| d¡dƒdd \}}|||d||}t j ||gdd }n|||d||}||| dd…|df|d }||| dd…|df|ƒ}|d7}q´|}| r°|| fS|dfSdS) a Forward function for StyleGAN2GeneratorCSFT. Args: styles (list[Tensor]): Sample codes of styles. conditions (list[Tensor]): SFT conditions to generators. input_is_latent (bool): Whether input is latent style. Default: False. noise (Tensor | None): Input noise or None. Default: None. randomize_noise (bool): Randomize noise, used when 'noise' is False. Default: True. truncation (float): The truncation ratio. Default: 1. truncation_latent (Tensor | None): The truncation latent tensor. Default: None. inject_index (int | None): The injection index for mixing noise. Default: None. return_latents (bool): Whether to return style latents. Default: False. csg|]}ˆ |¡‘qSr)Z style_mlp)Ú.0Ús©rrrÚ ;óz2StyleGAN2GeneratorCSFT.forward..Ncsg|]}tˆjd|›ƒ‘qS©Únoise)ÚgetattrZnoises)rÚirrrrArrrér r)Zdim)Z num_layersÚrangeÚappendÚlenZ num_latentÚndimZ unsqueezeÚrepeatÚrandomÚrandintÚtorchÚcatZconstant_inputÚshapeZ style_conv1Zto_rgb1ÚzipZ style_convsZto_rgbsrÚsplitÚintÚsize)rZstylesÚ conditionsÚinput_is_latentrÚrandomize_noiseZ truncationZtruncation_latentZ inject_indexÚreturn_latentsZstyle_truncationÚstyleZlatentZlatent1Zlatent2ÚoutÚskipr Úconv1Úconv2Znoise1Znoise2Zto_rgbZout_sameZout_sftÚimagerrrÚforward"sV   *ÿ" zStyleGAN2GeneratorCSFT.forward)rr r rF)FNTrNNF©Ú__name__Ú __module__Ú __qualname__Ú__doc__rr:Ú __classcell__rrrrr s  ÷rcs*eZdZdZd‡fdd„ Zdd„Z‡ZS)ÚResBlocka Residual block with bilinear upsampling/downsampling. Args: in_channels (int): Channel number of the input. out_channels (int): Channel number of the output. mode (str): Upsampling/downsampling mode. Options: down | up. Default: down. Údowncsltt|ƒ ¡t ||ddd¡|_t ||ddd¡|_tj||ddd|_|dkrZd|_n|dkrhd|_dS) Nr!rF)ZbiasrBçà?Úupr ) rrArrÚConv2dr7r8r6Ú scale_factor)rÚ in_channelsÚ out_channelsÚmoderrrrszResBlock.__init__cCsftj| |¡dd}tj||jddd}tj| |¡dd}tj||jddd}| |¡}||}|S)Nçš™™™™™É?©Znegative_slopeZbilinearF)rFrIZ align_corners)ÚFÚ leaky_relu_r7Z interpolaterFr8r6)rÚxr5r6rrrr:Œs zResBlock.forward)rBr;rrrrrAxs rAc s,eZdZdZd ‡fdd „ Zd d d „Z‡ZS)Ú GFPGANv1Cleana7The GFPGAN architecture: Unet + StyleGAN2 decoder with SFT. It is the clean version without custom compiled CUDA extensions used in StyleGAN2. Ref: GFP-GAN: Towards Real-World Blind Face Restoration with Generative Facial Prior. Args: out_size (int): The spatial size of outputs. num_style_feat (int): Channel number of style features. Default: 512. channel_multiplier (int): Channel multiplier for large networks of StyleGAN2. Default: 2. decoder_load_path (str): The path to the pre-trained decoder model (usually, the StyleGAN2). Default: None. fix_decoder (bool): Whether to fix the decoder. Default: True. num_mlp (int): Layer number of MLP style layers. Default: 8. input_is_latent (bool): Whether input is latent style. Default: False. different_w (bool): Whether to use different latent w for different layers. Default: False. narrow (float): The narrow ratio for channels. Default: 1. sft_half (bool): Whether to apply SFT on half of the input channels. Default: False. rrNTr Fc s<tt|ƒ ¡||_||_||_| d} td| ƒtd| ƒtd| ƒtd| ƒtd|| ƒtd|| ƒtd|| ƒtd|| ƒtd|| ƒdœ } tt |d ¡ƒ|_ d tt |d ¡ƒ} t   d | | ›d ¡|_ | | ›}t   ¡|_t|j d d ƒD]0}| d |d ›}|j t||d d¡|}qút   || dd d d ¡|_| d}t   ¡|_td |j d ƒD].}| d |›}|j t||dd¡|}qft   ¡|_td |j d ƒD]&}|j t   | d |›d d ¡¡q°|rütt |d ¡ƒd d |}n|}t  | ddd|¡|_t||||| | d|_|rT|j tj|dd„dd¡|rv|j ¡D]\}}d|_qdt   ¡|_t   ¡|_td |j d ƒD]œ}| d |›}| r¸|}n|d }|j t   t   ||d d d ¡t  !dd¡t   ||d d d ¡¡¡|j t   t   ||d d d ¡t  !dd¡t   ||d d d ¡¡¡qšdS)NrCréé€é@é é) Ú4Ú8Z16Z32Z64Z128Z256Z512Z1024r r!réÿÿÿÿrB)rIrUrDé)rr r r rrcSs|S)Nr)ZstorageÚlocrrrÚýrz(GFPGANv1Clean.__init__..)Z map_locationZ params_emaFrJT)"rrOrr1Ú different_wr r.ÚmathÚlogÚlog_sizerrEÚconv_body_firstZ ModuleListÚconv_body_downr"r#rAÚ final_convÚ conv_body_upÚtoRGBZLinearÚ final_linearrÚstylegan_decoderZload_state_dictr)ÚloadZnamed_parametersZ requires_gradÚcondition_scaleÚcondition_shiftZ SequentialZ LeakyReLU)rrr r Zdecoder_load_pathZ fix_decoderr r1r[rrZ unet_narrowZchannelsZfirst_out_sizerGr rHZlinear_out_channelÚ_ÚparamZsft_out_channelsrrrr®s    ÷     $ú ÿ   þÿþÿzGFPGANv1Clean.__init__cKs8g}g}g}tj| |¡dd} t|jdƒD]} |j| | ƒ} | d| ¡q.tj| | ¡dd} | |   |   d¡d¡¡} |j r–|   |   d¡d|j ¡} t|jdƒD]n} | || } |j | | ƒ} |j| | ƒ} | |  ¡¡|j| | ƒ} | |  ¡¡|r¤| |j| | ƒ¡q¤|j| g|||j|d\}}||fS)akForward function for GFPGANv1Clean. Args: x (Tensor): Input images. return_latents (bool): Whether to return style latents. Default: False. return_rgb (bool): Whether return intermediate rgb images. Default: True. randomize_noise (bool): Randomize noise, used when 'noise' is False. Default: True. rJrKr rrW)r3r1r2)rLrMr_r"r^r`ÚinsertrardÚviewr/r[r rbrgr#Úclonerhrcrer1)rrNr3Z return_rgbr2Úkwargsr0Z unet_skipsZout_rgbsZfeatr Z style_codeZscaleÚshiftr9rirrrr:s6  ü zGFPGANv1Clean.forward) rrNTr FFrF)FTTr;rrrrrO˜sôgrO)r\r'r)Zbasicsr.utils.registryrrZtorch.nnrrLZstylegan2_clean_archrrÚModulerAÚregisterrOrrrrÚs    m