a d''@sddlmZddlmZddlZddlmZddlmm Z ddl m Z m Z mZddlmZmZmZddlmZddlmZdd lmZmZmZmZmZdd lmZdd lm Z m!Z!dd lm"Z"eGd dde#Z$edZ%ddZ&e%'e j(e%'e j)ddZ*e%'e j+e%'e j,ddZ-e%'eddZ.e%'eddZ/e%'e j0ddZ1ddZ2ddZ3e%'ej4j5j6j7d d!Z8e%9e j:e%9e j;e%9e j<dS)") dataclass)partialN)StorageWeakRef) DispatchKeyDispatchKeySetExcludeDispatchKeyGuard)#_unwrap_all_tensors_from_functional_wrap_all_tensors_to_functional functionalize) PyOperator)FakeTensorMode)disable_proxy_modes_tracingProxyTorchDispatchModemake_fxtrack_tensor_tree unwrap_proxy)_extract_tensor_metadata)_get_current_dispatch_mode_pop_mode_temporarily) tree_flattenc@seZdZUeed<dS)!UnsupportedAliasMutationExceptionreasonN)__name__ __module__ __qualname__str__annotations__rre/var/www/html/stable-diffusion-webui/venv/lib/python3.9/site-packages/functorch/experimental/_cond.pyrs rcondcCst|ttfsJdtdd|Ds0Jdt(t||}t||}Wdn1sd0Yg}g} |jjD]} | jdkr~| | j q~|jjD]} | jdkr| | j qt |\} } t | \} } t | t | ksJtdt | D],}| |}| |}|jd|jdksJqd}d}|sdd|}t|jj|r\|d 7}n|}q2|}d |}t|jj|rJ|jj|||jj||||||f}t tt||}|jjd ||id d }||}t||d|jdS)Nz0Cond operands must be a list or tuple of tensorscss|]}t|tjVqdSN) isinstancetorchTensor).0orrr )ztrace_cond..z'Cond operands must be a list of tensorsoutputrZ tensor_metaZ true_graph_Z false_graph_ call_functionZ conditional)name)Zconstanttracer)r!listtupleallr rgraphnodesopextendargspytreerlenrangemetahasattrr,rootZregister_moduleZtree_maprrZ create_proxyr)Z proxy_modeZ func_overloadpredtrue_fnfalse_fnoperandsZ true_graphZ false_graph true_outsZ false_outsnodeflat_true_outs_flat_false_outsitrue_out false_outZ next_name candidateZ true_nameZ false_namer4Z proxy_argsZ out_proxyoutrrr trace_cond'sN *         rIcCs.t}|dusJd|r"||S||SdS)Nz-Mode should never be enabled for CPU/CUDA key)r)r;r<r=r>moderrr cond_densehs rKcGsNt||g|g\}}tdd|Ds,Jtttj}t|||g|RS)NcSs g|]}t|tjr|j qSr)r!r"r#Z requires_grad)r$frrr xs z!cond_autograd..)rr/rrr AutogradCPUr)r;r<r=r>Z flat_operandsrBZguardrrr cond_autogradssrOcCsRt}|dusJdt"}t|t||||}Wdn1sD0Y|S)Nz5Mode should always be enabled for python fallback key)rrrIr)r;r<r=r>rJresrrrinners 0rQc Cs||}t|\}}t||\}}t|t|kr@tdt||D]4\}} t|} t| } | | krJtd| d| qJ|S)Nz1Unmatched number of outputs from cond() branches.z=Unmatched tensor metadata from cond() branches. true branch: z, false branch: )r5rr6 RuntimeErrorzipr) r;r<r=r>r?rArBrCrErFZ true_metaZ false_metarrrcond_fake_tensor_modesrTcGstttj}t|Sr )rrrPythonDispatcherr)r4rBrrrcond_python_dispatchersrVc Cszt||}Wn:ty$YdStyJ}z|WYd}~n d}~00t}|jjD]Z}|jdkrr|||jdkrZ|j}t |t j j rZ|j jrZ|jD]}||vrdSqqZdS)z Dispatch-trace the branch with fake inputs and check if producing graph has mutable op on the input. This is bit restrictive as the branch must be traceable. TN placeholderr*F)rr Exceptionsetr0r1r2addtargetr!r"Z_opsZ OpOverloadZ_schemaZ is_mutabler4)branch fake_inputsgmeZ input_nodesr@r[argrrr$_has_potential_branch_input_mutations"       rac Cszt||}Wn:ty$YdStyJ}z|WYd}~n d}~00t}|jjD]&}|jdkrZ|t|j d qZt ||\}}|D]&}t |tjrt| |vrdSqdS)z Dispatch-trace the branch with fake inputs and check if producing graph has output aliasing the branch input. This is bit restrictive as the branch must be traceable. TNrWvalF)rrrXrYr0r1r2rZrr8Z_typed_storager5rr!r"r#) r\r]r^r_Zinput_storagesr@ZoutsrBrHrrr!_has_potential_branch_input_aliass   rcc s2|}|rdnd}t||d}t||d}t||d} t||d} |t} | | | fD]2} fdd} ttj| |}t | |rbt dqb||fD]2} fdd} ttj| |}t | |rt d qWd n1s0Yt || | |}t ||d Wd S1s$0Yd S) z Functionalization implementation for torch.cond. Currently: 1. We don't allow any input mutation inside the branches 2. Our check for above condition is not exhaustive Zmutations_and_viewsZ mutations) reapply_views)removecs |Sr Zfake_tensor_converterxZft_moderrconvertsz#cond_functionalize..convertz6One of torch.cond branch might be modifying the input!cs |Sr rfrgrirrrjsz5One of torch.cond branch might be aliasing the input!N)level)Zfunctionalize_add_back_viewsrr lowerr r5Z tree_map_onlyr"r#rarrcrr rk) interpreterr;r<r=inputsrdrJZunwrapped_inputsZunwrapped_predZfunctional_true_fnZfunctional_false_fnZfake_tensor_moder\rjr]Z cond_returnrrircond_functionalizes*             (ro)=Z dataclassesr functoolsrr"Z torch.multiprocessing.reductionsrZtorch.utils._pytreeutilsZ_pytreer5Ztorch._CrrrZ!torch._functorch.eager_transformsrr r Z torch._opsr Ztorch._subclasses.fake_tensorr Z"torch.fx.experimental.proxy_tensorr rrrrZtorch.fx.passes.shape_proprZtorch.utils._python_dispatchrrrrRrrrIZpy_implZCUDAZCPUrKZ AutogradCUDArNrOrQrTrUrVrarcZ_CZ _functorchZ TransformTypeZ FunctionalizeroZ fallthroughZPythonTLSSnapshotZADInplaceOrViewZ BackendSelectrrrrsF       A          %