a dB @sddlZddlmZmZmZmZmZmZmZm Z ddl Z ddl m Z ddlmZddlmZddlmZmZmZmZddlmZmZgdZe dededed fZhd Ze jjjZeee e!ed d d Z"e j#e!e j#dddZ$daee!edddZ%eee dfee dfedddZ&e'eee e ee!edddZ(e'eee e ee!e!edddZ)e'eee e ee!eddd Z*eej+edbeee e eed"d#d$Z,eej-edceee e eed"d%d&Z.eej/eddeee e eed"d'd(Z0eej1edeeee e eed"d)d*Z2eej3edfeee e eed"d+d,Z4eej5edgeee e eed"d-d.Z6Gd/d0d0eZ7eeeeee7d1d2d3Z8ee e d4d5d6Z9e'eee dfee dfee!ed7d8d9Z:eej;edheeeeeeed:d;d<ZZ>eej?edjeeeeeeed:d?d@Z@eejAedkeeeeeeed:dAdBZBGdCdDdDeZCe'eeeeeeCdEdFdGZDeejEedleeeeeeed:dHdIZFeejGedmeeeeeeed:dJdKZHeejIedneeeeeeed:dMdNZJeejKedoeeeeeeed:dOdPZLeejMedpeeeeeeed:dQdRZNeejOedqeeeeeeed:dSdTZPeejQedreeeeeeed:dUdVZReejSedseeeeeeed:dWdXZTeeeee dYdZd[ZUeejVdteeeed\d]d^ZWeejXdueeeed\d_d`ZYdS)vN)IterableListLiteral NamedTupleOptionalSequenceTupleUnion)register_decomposition)checkDimsType ShapeTypeTensorLikeType)_maybe_convert_to_dtype out_wrapper)fftfft2fftnhffthfft2hfftnrfftrfft2rfftnifftifft2ifftnihfftihfft2ihfftnirfftirfft2irfftnfftshift ifftshiftforwardbackwardortho>r'r%Nr&)xnorm signal_numelr%returncsfttvfdddkr0|dt|S| rFdupPdkpP|oPdk}|rb|d|S|S)z3Apply normalization to the un-normalized FFT resultcs dS)NzInvalid normalization mode: r,r)r,X/var/www/html/stable-diffusion-webui/venv/lib/python3.9/site-packages/torch/_refs/fft.py.z_apply_norm..r'Nr&r%)r _NORM_VALUESmathsqrt)r(r)r*r% normalizer,r-r. _apply_norm*s r6)dtyperequire_complexr+cCs*|jr |S|jst}|r&t|}|S)z@Helper to promote a dtype to one supported by the FFT primitives) is_complexZis_floating_pointtorchZget_default_dtypeutilsZcorresponding_complex_dtype)r7r8r,r,r._promote_type_fft9s r<F)tr8r+cCs|j}t||}t||S)zEHelper to promote a tensor to a dtype supported by the FFT primitives)r7r<r)r=r8Zcur_typenew_typer,r,r._maybe_promote_tensor_fftHs r?.)r(dimssizesr+cCst|t|ksJd}|j}dgt|d}tt|D]}||dkrNq<|||||krd}t|d||d}|||||||<|||||kr<|||d||}q<|rt||S|S)z Fixes the shape of x such that x.size(dims[i]) == sizes[i], either by zero-padding, or by slicing x starting from 0. FrTr1)lenshaperangeZnarrowr:Zconstant_pad_nd)r(r@rAZ must_copyZx_sizesZ pad_amountiZpad_idxr,r,r._resize_fft_inputQs rH) func_nameinputndimr)r%r+c st|dd}tj|j|ddf}dur,nd|j|d}t|dkfdd durtt|||ddfd }|rt|}t j |||d }t ||||d S) zBCommon code for performing any complex to real FFT (irfft or hfft)Tr8FZ wrap_scalarNrBr1cs ddSNzInvalid number of data points (z ) specifiedr,r,rKr,r.r/wr0z_fft_c2r..)r@rArL last_dim_sizer)r*r%) r?r;canonicalize_dimndimrEr rHr:conjprimsfft_c2rr6) rIrJrKrLr)r%r@rRoutputr,rPr._fft_c2rks  rZ)rIrJrKrLr)r%onesidedr+c stjj fddttjj|ddf}|durLt||ftj ||d}t ||j ||}|rx|St |S)zBCommon code for performing any real to complex FFT (rfft or ihfft)csdjS)Nz0 expects a floating point input tensor, but got r7r,rIrJr,r.r/r0z_fft_r2c..FrNNrLr[)r r7r9r?r;rTrUrHrWfft_r2cr6rEr:rV) rIrJrKrLr)r%r[r@retr,r]r._fft_r2cs  racsftjjfddtjj|ddf}|durBt||ftj||d}t ||j ||S)zCCommon code for performing any complex to complex FFT (fft or ifft)csdjSNz) expects a complex input tensor, but got r\r,r]r,r.r/r0z_fft_c2c..FrNNrLr%) r r7r9r;rTrUrHrWfft_c2cr6rE)rIrJrKrLr)r%r@r`r,r]r._fft_c2cs  rerC)rJrKrLr)r+c Cs6|jjrtd||||ddStd||||dddSdS)NrTr%Fr%r[r7r9rerarJrKrLr)r,r,r.rsrc Cs6|jjrtd||||ddStd||||dddSdS)NrFrfrgrhrir,r,r.rsrc Cstd||||dddS)NrTrgrarir,r,r.rsrcCstd||||ddS)Nr FrfrZrir,r,r.r sr cCstd||||ddS)NrTrfrkrir,r,r.rsrc Cstd||||dddS)NrFTrgrjrir,r,r.rsrc@s.eZdZUeedfed<eedfed<dS) _ShapeAndDims.rEr@N__name__ __module__ __qualname__rint__annotations__r,r,r,r.rls rl)rJrErLr+csH|j|j|durRt|ts$|f}tj|dd}ttt|t|kdd|durt|tsj|f}t|dupt|t|kddt|tkfdd|durt t }t fdd t ||D}n6|durt t }t }nt fd d |D}|D]td kfd dqt ||d S)zTConvert the shape and dim arguments into a canonical form where neither are optionalNFrNcSsdS)NzFFT dims must be uniquer,r,r,r,r.r/ r0z6_canonicalize_fft_shape_and_dim_args..cSsdS)Nz=When given, dim and shape arguments must have the same lengthr,r,r,r,r.r/r0csdddS)NzGot shape with z" values but input tensor only has z dimensions.r,r,) input_dimtransform_ndimr,r.r/sc3s&|]\}}|dkr|n|VqdS)rCNr,).0sd input_sizesr,r. $sz7_canonicalize_fft_shape_and_dim_args..c3s|]}|VqdSNr,rurwrxr,r.rz-r0rcs ddSrOr,r,rPr,r.r/0r0)rEr@) rUrE isinstancerr;Zcanonicalize_dimsr rDsettuplerFziprl)rJrErLZret_dimsZ ret_shaper,)rsryrKrtr.$_canonicalize_fft_shape_and_dim_argss>        r)xsr+cCsd}|D] }||9}q|S)zCompute product of a listr1r,)rprodr(r,r,r._prod5s r) function_namerJrErLr)r%r+csHtjjfddt||}tj|||d}t||t||dS)zECommon code for n-dimensional complex to complex FFTs (fftn or ifftn)csdjSrbr\r,rrJr,r.r/Hsz_fftn_c2c..rcrS)r r7r9rHrWrdr6r)rrJrErLr)r%r(rYr,rr. _fftn_c2c=s   r)rJrvrLr)r+cCs0t|||\}}t|dd}td||||ddS)NTrMrrfrr?rrJrvrLr)rEr(r,r,r.rPs rcCs0t|||\}}t|dd}td||||ddS)NTrMrFrfrrr,r,r.r]s rcsdtjj fddt||\}}tddt||tj|dd}t||t |ddS)Ncs djS)Nz2rfftn expects a real-valued input tensor, but got r\r,rJr,r.r/tr0zrfftn..FrMTr^rS) r r7r9rr?rHrWr_r6r)rJrvrLr)rEoutr,rr.rjs   rcstjj fddt||\}}tt|dkddtddt||tj|dddd }t|d krt |||ddd }t |St |}tj ||dddd }t ||t |dd S) Ncs djS)Nz3ihfftn expects a real-valued input tensor, but got r\r,rr,r.r/r0zihfftn..rcSsdS)Nz'ihfftn must transform at least one axisr,r,r,r,r.r/r0FrMrCTr^r1rSrc)r r7r9rrDr?rHrWr_r6rV conj_physicalrdr)rJrvrLr)rEtmpr,rr.r}s      rc@s6eZdZUeedfed<eedfed<eed<dS)_CanonicalizeC2rReturn.rErLrRNrmr,r,r,r.rs r)fnamerJrvrLr+cst|||\}}tt|dkfdd|dus>|ddkrVd|j|ddn|dtdkfddt|}dd|d<tt||d S) zCanonicalize shape and dim arguments for n-dimensional c2r transforms, as well as calculating the last_dim_size which is shape[dim[-1]] for the outputrcs dS)Nz! must transform at least one axisr,r,)rr,r.r/r0z:_canonicalize_fft_c2r_shape_and_dim_args..NrCrBr1cs ddSrOr,r,)rRr,r.r/r0)rErLrR)rr rDrElistrr)rrJrvrLrEZ shape_listr,)rrRr.(_canonicalize_fft_c2r_shape_and_dim_argss  rcs^td|||\}}}t|dd}t|||}tj|||dt|tfdd|DddS) Nr"TrMrQc3s|]}j|VqdSr{rEr|rr,r.rzr0zirfftn..Frf)rr?rHrWrXr6r)rJrvrLr)rErRr,rr.r"s   r"cCstd|||\}}}t|dd}t|||}t|dkrPtj||ddddn|}t||t|dddd}t|}tj ||dd|d}t|||ddS) NrTrMr1rCrcrfrQ) rr?rHrDrWrdr6rrrX)rJrvrLr)rErRrrr,r,r.rs   ( rrCcCstjj||||dSN)rvrLr))r:rrrJrvrLr)r,r,r.rsrcCstjj||||dSr)r:rrrr,r,r.rsrcCstjj||||dSr)r:rrrr,r,r.rsrcCstjj||||dSr)r:rr"rr,r,r.r!sr!cCstjj||||dSr)r:rrrr,r,r.r srcCstjj||||dSr)r:rrrr,r,r.rsr)rLr(r+cCs2|durtt|jSt|ts&|gSt|SdS)zIConvert Optional[DimsType] to a simple list, defaulting to all dimensionsN)rrFrUr}r)rLr(r,r,r._default_alldims#s  r)rJrLr+cs*t|}fdd|D}t||S)Ncsg|]}j|dqS)rBrr|rr,r. 0r0zfftshift..rr:ZrollrJrLr@shiftr,rr.r#-s r#cs*t|}fdd|D}t||S)Ncsg|]}j|ddqS)r1rBrr|rr,r.r7r0zifftshift..rrr,rr.r$4s r$)F)NrCN)NrCN)NrCN)NrCN)NrCN)NrCN)NNN)NNN)NNN)NNN)NNN)NNN)NrN)NrN)NrN)NrN)NrN)NrN)N)N)Zr3typingrrrrrrrr r:Z torch._primsZ_primsrWZtorch._prims_commonZ _prims_commonr;Z torch._decompr r r r rZtorch._prims_common.wrappersrr__all__ZNormTyper2Z_opsopsZatenrqboolr6r7r<r?rHstrrZrareZfft_fftrZfft_ifftrZfft_rfftrZ fft_irfftr Zfft_hfftrZ fft_ihfftrrlrrrZfft_fftnrZ fft_ifftnrZ fft_rfftnrZ fft_ihfftnrrrZ fft_irfftnr"Z fft_hfftnrZfft_fft2rZ fft_ifft2rZ fft_rfft2rZ fft_irfft2r!Z fft_hfft2rZ fft_ihfft2rrZ fft_fftshiftr#Z fft_ifftshiftr$r,r,r,r.sB(                 6