a  d7@sddlZddlZddlZddlmZddlmZddlmZddlm Z Gdddej Z Gdd d ej Z Gd d d ej ZGd d d ej ZGdddej ZeGdddej ZdS)N)default_init_weights) ARCH_REGISTRY)nn) functionalc@seZdZddZdS) NormStyleCodecCs"|ttj|dddddS)zNormalize the style codes. Args: x (Tensor): Style codes with shape (b, c). Returns: Tensor: Normalized tensor. T)Zdimkeepdim:0yE>)torchrsqrtmeanselfxrj/var/www/html/stable-diffusion-webui/venv/lib/python3.9/site-packages/gfpgan/archs/stylegan2_clean_arch.pyforward s zNormStyleCode.forwardN)__name__ __module__ __qualname__rrrrrr srcs2eZdZdZd fdd ZddZd d ZZS) ModulatedConv2daXModulated Conv2d used in StyleGAN2. There is no bias in ModulatedConv2d. Args: in_channels (int): Channel number of the input. out_channels (int): Channel number of the output. kernel_size (int): Size of the convolving kernel. num_style_feat (int): Channel number of style features. demodulate (bool): Whether to demodulate in the conv layer. Default: True. sample_mode (str | None): Indicating 'upsample', 'downsample' or None. Default: None. eps (float): A value added to the denominator for numerical stability. Default: 1e-8. TNr c stt|||_||_||_||_||_||_t j ||dd|_ t |j ddddddt td||||t||d|_|d|_dS) NTbiasrrfan_inZlinearZscaleZ bias_fillamodeZ nonlinearityr)superr__init__ in_channels out_channels kernel_size demodulate sample_modeepsrLinear modulationr Parameterr randnmathsqrtweightpadding)rr r!r"num_style_featr#r$r% __class__rrr'szModulatedConv2d.__init__c Cs|j\}}}}|||d|dd}|j|}|jrnt|dgd|j }||||j ddd}|||j ||j |j }|j dkrt j|dddd}n|j dkrt j|d ddd}|j\}}}}|d||||}t j|||j|d } | j||j g| jdd R} | S) zForward function. Args: x (Tensor): Tensor with shape (b, c, h, w). style (Tensor): Tensor with shape (b, num_style_feat). Returns: Tensor: Modulated tensor after convolution. rr)rupsamplebilinearFZ scale_factorrZ align_cornersZ downsampleg?)r-groupsr2)shaper'viewr,r#r r powsumr%r!r"r$F interpolateZconv2dr-) rrstylebchwr,ZdemodoutrrrrAs      zModulatedConv2d.forwardc Cs6|jjd|jd|jd|jd|jd|jd S)Nz (in_channels=z, out_channels=z, kernel_size=z , demodulate=z, sample_mode=))r0rr r!r"r#r$rrrr__repr__eszModulatedConv2d.__repr__)TNr )rrr__doc__rrrE __classcell__rrr/rrs$rcs,eZdZdZdfdd Zd ddZZS) StyleConvaStyle conv used in StyleGAN2. Args: in_channels (int): Channel number of the input. out_channels (int): Channel number of the output. kernel_size (int): Size of the convolving kernel. num_style_feat (int): Channel number of style features. demodulate (bool): Whether demodulate in the conv layer. Default: True. sample_mode (str | None): Indicating 'upsample', 'downsample' or None. Default: None. TNcsbtt|t||||||d|_ttd|_ ttd|dd|_ tj ddd|_ dS)N)r#r$r皙?TZnegative_slopeZinplace) rrHrrmodulated_convrr(r zerosr,r LeakyReLUactivate)rr r!r"r.r#r$r/rrrvs zStyleConv.__init__c Cs`|||d}|dur:|j\}}}}||d||}||j|}||j}||}|S)Ng;f?r)rKr7Z new_emptyZnormal_r,rrN) rrr=noiserBr>_r@rArrrr~s  zStyleConv.forward)TN)NrrrrFrrrGrrr/rrHjs rHcs,eZdZdZdfdd Zd ddZZS) ToRGBzTo RGB (image space) from features. Args: in_channels (int): Channel number of input. num_style_feat (int): Channel number of style features. upsample (bool): Whether to upsample. Default: True. TcsFtt|||_t|dd|ddd|_tt dddd|_ dS)Nr1rFr"r.r#r$) rrRrr3rrKrr(r rLr)rr r.r3r/rrrs  zToRGB.__init__NcCsB|||}||j}|dur>|jr6tj|dddd}||}|S)aForward function. Args: x (Tensor): Feature tensor with shape (b, c, h, w). style (Tensor): Tensor with shape (b, num_style_feat). skip (Tensor): Base/skip tensor. Default: None. Returns: Tensor: RGB images. Nrr4Fr5)rKrr3r;r<)rrr=skiprBrrrrs  z ToRGB.forward)T)NrQrrr/rrRsrRcs(eZdZdZfddZddZZS) ConstantInputzConstant input. Args: num_channel (int): Channel number of constant input. size (int): Spatial size of constant input. cs*tt|ttd||||_dSNr)rrUrrr(r r)r,)rZ num_channelsizer/rrrszConstantInput.__init__cCs|j|ddd}|SrV)r,repeat)rbatchrBrrrrszConstantInput.forwardrQrrr/rrUs rUcsDeZdZdZdfdd Zdd Zd d Zd d ZdddZZ S)StyleGAN2GeneratorCleanaClean version of StyleGAN2 Generator. Args: out_size (int): The spatial size of outputs. num_style_feat (int): Channel number of style features. Default: 512. num_mlp (int): Layer number of MLP style layers. Default: 8. channel_multiplier (int): Channel multiplier for large networks of StyleGAN2. Default: 2. narrow (float): Narrow ratio for channels. Default: 1.0. rrc sNtt|||_tg}t|D](}|tj||ddtj dddgq$tj ||_ t |j dddddd t d |t d |t d |t d |t d ||t d ||t d ||t d||t d||d }||_t|ddd|_t|d|dd|ddd|_t|d|dd|_t t|d|_|jddd|_|jdd|_t|_t|_t|_|d} t|jD]<} d| dd} dd| | g} |jd| t j!| qtd|jdD]f}|d|} |j"t| | d|ddd|j"t| | d|ddd|j"t| |dd| } qdS)NTrrIrJrrrZ leaky_relurr[@ ) 48Z16Z32Z64Z128Z256Z512Z1024rbr2)rWr1rSF)r3rrOr3)#rrZrr.rrangeextendrr&rMZ Sequential style_mlprintchannelsrUconstant_inputrH style_conv1rRto_rgb1r*loglog_size num_layers num_latentZ ModuleList style_convsto_rgbsModulenoisesZregister_bufferr r)append)rZout_sizer.Znum_mlpZchannel_multiplierZnarrowZstyle_mlp_layersirir Z layer_idx resolutionr7r!r/rrrs            z StyleGAN2GeneratorClean.__init__c Csj|jjj}tjdddd|dg}td|jdD]4}tdD]&}|tjddd|d||dqAz3StyleGAN2GeneratorClean.forward..Ncsg|]}tjd|qSrO)getattrrt)rrvrDrrrGrrrr1rr)rorerulenrpndimZ unsqueezerXrandomrandintr catrjr7rkrlziprqrr)rZstylesZinput_is_latentrOZrandomize_noiseZ truncationZtruncation_latentZ inject_indexZreturn_latentsZstyle_truncationr=r}Zlatent1Zlatent2rBrTrvZconv1Zconv2Znoise1Znoise2Zto_rgbimagerrDrr*sJ   * zStyleGAN2GeneratorClean.forward)r[r\rr)FNTrNNF) rrrrFrrzr|r~rrGrrr/rrZs I rZ)r*rr Zbasicsr.archs.arch_utilrZbasicsr.utils.registryrrZtorch.nnrr;rsrrrHrRrUregisterrZrrrrs    R#$