a db%@sPddlmZmZmZmZmZmZmZddlZddl m Z ddl Z ddl Z ddl mZddlmZgdZeee jee jfZee jefZee jjZee jjZeeZhdZedd d d Zedd eee jjfe jjed d dZedd e jje dddZ!edd GdddZ"edd e jj#e jj#dddZ$dS))ListTupleUnionDictAnySetMappingN) dataclass)_get_qualified_name) compatibility)get_acc_ops_nameget_node_targetis_node_output_tensorFxNetAccFusionsFinderlegalize_graph> call_moduleZ call_method call_functionF)Zis_backward_compatiblecCsTt|tr|S|jr*d|jvr*d|jS|jdd}|r@|ndd|jSdS)Nacc_opsacc_ops.z torch._opsz torch.ops.) isinstancestr __module____name__replace)kmodulere/var/www/html/stable-diffusion-webui/venv/lib/python3.9/site-packages/torch/fx/passes/tools_common.pyr s   r ) submodulesnodereturncCs|jtvs(Jddtd|j|jdkrdt|jtsBJ||j}t|dt|}t|S|jdkr|j}|j durd|j vrd |j St |St|jtsJ|jSdS) a, Given a `node` returns its target typename. For "call_method" node, return node.target which is the name of that method being called. This could potential lead to conflict but should be okay because normally it's on a tensor. For "call_function" node, return typename of node.target. For "call_module" node, return typename of the module that node.target point to. If seeing "_VariableFunctionsClass" in the target name string, it will be replaced by "torch". e.g. _VariableFunctionsClass.relu would become torch.relu. zExpect op types of z, z , but found rZ_base_class_originrNrr) opCALLABLE_NODE_OPSjoinrtargetrgetattrtyper rrr )r r!ZsubmodZ submod_typer&rrrr s$    r )r!r"cCs"|jdd}|duo t|tjS)aChecks if the node output produces a Tensor or not. NOTE: This requires to run `ShapeProp` on the containing fx graph before calling this function. This is because it works by checking the `type` metadata on the node. This metadata is produced by the `ShapeProp`. r(N)metaget issubclasstorchTensor)r!type_rrrrCsrc@sheZdZdZejjedddZe GdddZ de ee fdd d Z eejjefd d d ZdS)rz Finds groups of connected ACC nodes that pass non-tensor data between each other. Such groups are called fusion groups. )r acc_nodescCs||_t|jj|_||_dSN)rlistgraphnodesr/)selfrr/rrr__init__UszFxNetAccFusionsFinder.__init__c@s6eZdZUeed<eed<eed<eed<ddZdS)!FxNetAccFusionsFinder.FusionGroup top_node_idxr3inputsnodes_need_processcsR|jvrdSj|j|j|jfdd|jDdS)z5 Add a node to fusion group. Ncs$h|]}|jtvr|jvr|qSr)r#r$r3).0nr4rr ssz=FxNetAccFusionsFinder.FusionGroup.add_node..)r3r9addr8discardupdateall_input_nodes)r4r!rr<radd_nodehs     z*FxNetAccFusionsFinder.FusionGroup.add_nodeN)rr __qualname__int__annotations__NodeSetrBrrrr FusionGroupZs rGr6) fusion_groupr8cCs\|D]R}|jtvrq|j||jkr(q||jvr8dS|||jr||dSqdS)z Start from inputs and going reverse topological order. If any upstream node is in the fusion group, add all the nodes in this path to fusion group. TF)r#r$r3indexr7recursive_add_noderArB)r4rHr8argrrrrJzs    z(FxNetAccFusionsFinder.recursive_add_node)r"cCsri}t|j}|D]X}||vr"q|jtvr.qd|jvr:q||jvrFq|j|j||ht|j |hd}|j r0|j }| ||j d|jvr|jD]4}|jtvrq||jvrq||| ||j q|j D]V}|jtvrqd|jvrq||jvrq||t|j|j||_| ||j qqjt|j|jksT|j|j8_q|jD]}|j||<qZq|S)NZ tensor_meta)r7r3r8r9)r1r/r#r$r)rGr3rIsetrAr9poprJr8usersrBminr7)r4resultr/r!rHuserrKr;rrr__call__sZ                  zFxNetAccFusionsFinder.__call__N)rrrC__doc__r,fx GraphModulerFr5r rGrNodeListrJrNoderRrrrrrNs! r)gmr"csdd|jjDtj}|jjD] }|jD]}|d7<q.q$t}|jjD]}|dkrV||qVit |dkr| }| |fdd|<|jD]*}|d8<|dkr||qqvt |jt |jjkr t dfdd D|jj |_ ||_|S) a Replace the graph of the given GraphModule with one that contains the same nodes as the original, but in topologically sorted order. This is used by the merge_matmul transformation below, which disturbs the topologically sorted order of its input GraphModule, so that this order is restored before further transformation. Arguments: gm: The graph module to topologically sort. It is modified in-place. Returns: The graph module in-place sorted cSsi|] }|dqSrrr:r!rrr z"legalize_graph..rcs|Sr0r)x)envrrr\z legalize_graph..z&Input graph has cycles, unable to add csg|]}|dkr|qSrYrrZ)indegrr r\z"legalize_graph..)r2r3r,rTZGraphrN collectionsdequeappendlenpopleftZ node_copy RuntimeErrorZ_codegen)rXZ new_graphr!rQqueuecurr)r_rarrs,          r)%typingrrrrrrrrcZ dataclassesr r,Ztorch.fxZ torch.fx.noder Ztorch.fx._compatibilityr __all__r-ZTensorsZTensorOrTensorsrTrWrVrFrZNamesr$r nnModuler boolrrrUrrrrrs0$      $#