a  dG@s dZddlZddlZddlmZmZddlmZddlm Z m Z ddl m Z ddl mZddlmZmZmZmZddlZd d lmZmZmZmZerddlmZGd d d eZd dZddZ ddZ!ddZ"ddZ#ddZ$ddZ%ddZ&ddZ'dd Z(d!d"Z)d#d$Z*d%d&Z+d'd(Z,d)d*Z-d+d,Z.d-d.Z/d/d0Z0Gd1d2d2eZ1Gd3d4d4e2eZ3Gd5d6d6e3Z4Gd7d8d8e3Z5Gd9d:d:Z6d;d<Z7d=d>Z8dVee2e2dAdBdCZ9e dWe:dEdFdGZ;dXdHdIZdNdOZ?dPdQZ@dRdSZAdTdUZBdS)Zz Generic utilities N) OrderedDictUserDict)MutableMapping) ExitStackcontextmanager)fields)Enum)AnyContextManagerListTuple)is_flax_availableis_tf_availableis_torch_availableis_torch_fx_proxyc@seZdZdZdddZdS)cached_propertyz Descriptor that mimics @property but caches output in member variable. From tensorflow_datasets Built-in in functools from Python 3.8. NcCsX|dur |S|jdurtdd|jj}t||d}|durT||}t||||S)Nzunreadable attributeZ __cached_)fgetAttributeError__name__getattrsetattr)selfobjZobjtypeattrcachedrc/var/www/html/stable-diffusion-webui/venv/lib/python3.9/site-packages/transformers/utils/generic.py__get__-s     zcached_property.__get__)N)r __module__ __qualname____doc__rrrrrr$srcCs2|}|dvrdS|dvr dStd|dS)zConvert a string representation of truth to true (1) or false (0). True values are 'y', 'yes', 't', 'true', 'on', and '1'; false values are 'n', 'no', 'f', 'false', 'off', and '0'. Raises ValueError if 'val' is anything else. >on1tytrueyesr >falsenofn0offrzinvalid truth value N)lower ValueError)valrrr strtobool<s r1cCst|r dStr*ddl}t||jr*dStrHddl}t||jrHdStrzddlm }ddl m }t||j |frzdSt|t j S)zl Tests if `x` is a `torch.Tensor`, `tf.Tensor`, `jaxlib.xla_extension.DeviceArray` or `np.ndarray`. TrN)Tracer)rrtorch isinstanceTensorr tensorflowr jax.numpynumpyZjax.corer2ndarraynp)xr3tfjnpr2rrr is_tensorJs     r>cCs t|tjSN)r4r:r9r;rrr _is_numpyesrAcCst|S)z/ Tests if `x` is a numpy array or not. )rAr@rrris_numpy_arrayisrBcCsddl}t||jSNr)r3r4r5r;r3rrr _is_torchpsrEcCsts dSt|S)z] Tests if `x` is a torch tensor or not. Safe to call even if torch is not installed. F)rrEr@rrris_torch_tensorvsrFcCsddl}t||jSrC)r3r4ZdevicerDrrr_is_torch_device}srGcCsts dSt|S)z] Tests if `x` is a torch device or not. Safe to call even if torch is not installed. F)rrGr@rrris_torch_devicesrHcCs8ddl}t|tr,t||r(t||}ndSt||jS)NrF)r3r4strhasattrrZdtyperDrrr_is_torch_dtypes    rKcCsts dSt|S)z\ Tests if `x` is a torch dtype or not. Safe to call even if torch is not installed. F)rrKr@rrris_torch_dtypesrLcCsddl}t||jSrC)r6r4r5r;r<rrr_is_tensorflowsrNcCsts dSt|S)zg Tests if `x` is a tensorflow tensor or not. Safe to call even if tensorflow is not installed. F)rrNr@rrr is_tf_tensorsrOcCs*ddl}t|dr||St||jkS)Nris_symbolic_tensor)r6rJrPtyper5rMrrr_is_tf_symbolic_tensors  rRcCsts dSt|S)z Tests if `x` is a tensorflow symbolic tensor or not (ie. not eager). Safe to call even if tensorflow is not installed. F)rrRr@rrris_tf_symbolic_tensorsrScCsddlm}t||jSrC)r7r8r4r9)r;r=rrr_is_jaxs rTcCsts dSt|S)zY Tests if `x` is a Jax tensor or not. Safe to call even if jax is not installed. F)rrTr@rrr is_jax_tensorsrUcCst|ttfr dd|DSt|ttfrzto_py_obj..cSsg|] }t|qSrrV)rYorrr r]zto_py_obj..N)r4dictritemslisttuplerOr8tolistrFdetachcpurUr:asarrayr9numberrrrrrWs rWcCszt|ttfr dd|DSt|ttfr8t|St|rH| St |r`| St |rrt|S|SdS)zc Convert a TensorFlow tensor, PyTorch tensor, Numpy array or python list to a Numpy array. cSsi|]\}}|t|qSr)to_numpyrXrrrr\r]zto_numpy..N)r4r`rrarbrcr:arrayrOr8rFrerfrUrgrirrrrjs  rjcsneZdZdZddZddZddZdd Zd d Zd d Z fddZ fddZ e e dddZZS) ModelOutputa Base class for all model outputs as dataclass. Has a `__getitem__` that allows indexing by integer or slice (like a tuple) or strings (like a dictionary) that will ignore the `None` attributes. Otherwise behaves like a regular python dictionary. You can't unpack a `ModelOutput` directly. Use the [`~utils.ModelOutput.to_tuple`] method to convert it to a tuple before. c st}t|s"tjjdtdd|ddDsNtjjdt|dj}tfdd|ddD}|rt|st |t r| }d}n(zt |}d}Wnt yd }Yn0|rtt|D]\}}t |ttfrt|d krt |dts@|dkr*||dj<ntd |d qt|d|d|ddur|d|d<qn|dur||dj<n,|D]&}t|j} | dur| |j<qdS) Nz has no fields.css|]}|jduVqdSr?)defaultrYfieldrrr r]z,ModelOutput.__post_init__..r z. should not have more than one required field.rc3s|]}t|jduVqdSr?)rnamernrrrrpr]TFzCannot set key/value for z&. It needs to be a tuple (key, value).)rlenr/ __class__rallrrqr>r4r`raiter TypeError enumeraterbrcrIr) rZ class_fieldsZ first_fieldZother_fields_are_noneiteratorZfirst_field_iteratoridxelementror[rrrr __post_init__sN            zModelOutput.__post_init__cOstd|jjddS)Nz$You cannot use ``__delitem__`` on a instance. Exceptionrurrargskwargsrrr __delitem__/szModelOutput.__delitem__cOstd|jjddS)Nz#You cannot use ``setdefault`` on a r~rrrrr setdefault2szModelOutput.setdefaultcOstd|jjddS)NzYou cannot use ``pop`` on a r~rrrrrpop5szModelOutput.popcOstd|jjddS)NzYou cannot use ``update`` on a r~rrrrrupdate8szModelOutput.updatecCs.t|trt|}||S||SdSr?)r4rIr`rato_tuple)rrZZ inner_dictrrr __getitem__;s  zModelOutput.__getitem__cs4||vr"|dur"t||t||dSr?)keyssuper __setitem__ __setattr__)rrqvaluerurrrBszModelOutput.__setattr__cs t||t||dSr?)rrr)rkeyrrrrrHszModelOutput.__setitem__)returncstfddDS)za Convert self to a tuple containing all the attributes/keys that are not `None`. c3s|]}|VqdSr?r)rYrZrrrrrpRr]z'ModelOutput.to_tuple..)rcrrrrrrrrNszModelOutput.to_tuple)rrr r!r}rrrrrrrr r r __classcell__rrrrrls 4  rlc@seZdZdZeddZdS) ExplicitEnumzC Enum with more explicit error message for missing values. cCs(t|d|jdt|jdS)Nz is not a valid z, please select one of )r/rrb_value2member_map_r)clsrrrr _missing_ZszExplicitEnum._missing_N)rrr r! classmethodrrrrrrUsrc@seZdZdZdZdZdZdS)PaddingStrategyz Possible values for the `padding` argument in [`PreTrainedTokenizerBase.__call__`]. Useful for tab-completion in an IDE. longest max_lengthZ do_not_padN)rrr r!ZLONGESTZ MAX_LENGTHZ DO_NOT_PADrrrrrasrc@s eZdZdZdZdZdZdZdS) TensorTypez Possible values for the `return_tensors` argument in [`PreTrainedTokenizerBase.__call__`]. Useful for tab-completion in an IDE. ptr<r:jaxN)rrr r!ZPYTORCHZ TENSORFLOWZNUMPYZJAXrrrrrls rc@s2eZdZdZeedddZddZddZd S) ContextManagersz Wrapper for `contextlib.ExitStack` which enters a collection of context managers. Adaptation of `ContextManagers` in the `fastcore` library. )context_managerscCs||_t|_dSr?)rrstack)rrrrr__init__~szContextManagers.__init__cCs|jD]}|j|qdSr?)rr enter_context)rZcontext_managerrrr __enter__s zContextManagers.__enter__cOs|jj|i|dSr?)r__exit__rrrrrszContextManagers.__exit__N) rrr r!r r rrrrrrrrxsrcCsnt|}|dkrt|j}n"|dkr4t|j}n t|j}|jD]"}|dkrF|j|jdurFdSqFdS)zr Check if a given model can return loss. Args: model_class (`type`): The class of the model. r<rZ return_lossTF)infer_frameworkinspect signaturecallforward__call__ parametersrm) model_class frameworkrprrrcan_return_losss  rcCsr|j}t|}|dkr$t|j}n"|dkr:t|j}n t|j}d|vr^dd|jDSdd|jDSdS)zq Find the labels used by a given model. Args: model_class (`type`): The class of the model. r<rZQuestionAnsweringcSs g|]}d|vs|dvr|qS)label)Zstart_positionsZ end_positionsrrYrrrrr_r]zfind_labels..cSsg|]}d|vr|qS)rrrrrrr_r]N)rrrrrrrr)rZ model_namerrrrr find_labelss r.)d parent_key delimitercCsddd}t||||S)z/Flatten a nested dict into a single level dict.rrcssd|D]V\}}|r(t||t|n|}|rTt|trTt|||dEdHq||fVqdS)N)r)rarIr4r flatten_dict)rrrrZr[rrrr _flatten_dicts z#flatten_dict.._flatten_dict)rr)r`)rrrrrrrrs rF) use_temp_dirccs>|r4t}|VWdq:1s(0Yn|VdSr?)tempfileTemporaryDirectory)Z working_dirrZtmp_dirrrrworking_or_temp_dirs &rcCst|rtj||dSt|r6|dur,|jS|j|St|rTddl}|j||dSt|rjt j||dSt dt |ddS)z Framework-agnostic version of `numpy.transpose` that will work on torch/TensorFlow/Jax tensors as well as NumPy arrays. )axesNr)permz"Type not supported for transpose: r) rBr: transposerFTZpermuterOr6rUr=r/rQ)rkrr<rrrrsrcCsnt|rt||St|r&|j|St|rBddl}|||St|rVt||Stdt |ddS)z Framework-agnostic version of `numpy.reshape` that will work on torch/TensorFlow/Jax tensors as well as NumPy arrays. rNz Type not supported for reshape: r) rBr:reshaperFrOr6rUr=r/rQ)rkZnewshaper<rrrrs    rcCst|rtj||dSt|r:|dur.|S|j|dSt|rXddl}|j||dSt|rntj||dStdt |ddS)z Framework-agnostic version of `numpy.squeeze` that will work on torch/TensorFlow/Jax tensors as well as NumPy arrays. axisNZdimrz Type not supported for squeeze: r) rBr:squeezerFrOr6rUr=r/rQrkrr<rrrrsrcCstt|rt||St|r(|j|dSt|rFddl}|j||dSt|r\tj||dSt dt |ddS)z Framework-agnostic version of `numpy.expand_dims` that will work on torch/TensorFlow/Jax tensors as well as NumPy arrays. rrNr$Type not supported for expand_dims: r) rBr: expand_dimsrFZ unsqueezerOr6rUr=r/rQrrrrrs  rcCsbt|rt|St|r"|St|r.Nr)rar4rcrb)Zauto_maprrrrrradd_model_info_to_auto_map+s rcCst|D]l}|j}|j}|ds6|ds6|dkr<dS|dsN|dkrTdS|dsp|d sp|d kr dSq td |d d S)z Infers the framework of a given model without using isinstance(), because we cannot guarantee that the relevant classes are imported or available. r6ZkerasZTFPreTrainedModelr<r3ZPreTrainedModelrZflaxrZFlaxPreTrainedModelz%Could not infer framework from class rN)rgetmrorr startswithrx)rZ base_classmodulerqrrrr8sr)rr)F)N)N)Cr!rr collectionsrrcollections.abcr contextlibrrZ dataclassesrenumrtypingr r r r r8r:Z import_utilsrrrrr7r=propertyrr1r>rArBrErFrGrHrKrLrNrOrRrSrTrUrWrjrlrIrrrrrrrboolrrrrrrrrrrrrs`      h