a d>@sNddlZddlZddlZddlZddlZddlZddlZddlmZddl m Z ddl Z z ddl ZWneye s~ddlZYn0ddlmZddlmZddlmZmZmZddlmZmZmZed ZGd d d eZd d Z ddZ!ddZ"Gdddej#j$Z%Gdddej#j&Z'ddZ(Gdddej#j)Z*GdddeZ+dS)N) lru_cache) TYPE_CHECKING)AsyncFileSystem)_DEFAULT_CALLBACK) filesystemopensplit_protocol) isfilelikemerge_offset_ranges other_pathszfsspec.referencecs$eZdZfddZddZZS)ReferenceNotReachablecstj|||_||_dSN)super__init__ referencetarget)selfrrargs __class__i/var/www/html/stable-diffusion-webui/venv/lib/python3.9/site-packages/fsspec/implementations/reference.pyrs zReferenceNotReachable.__init__cCsd|jd|jS)Nz Reference "z" failed to fetch target )rrrrrr__str__!szReferenceNotReachable.__str__)__name__ __module__ __qualname__rr __classcell__rrrrr s r cCst|dSNr)listvalues)drrr_first%sr#cCs<||}t|ttfr8|dr0t|ddS|dSdSr)get isinstancer tupler )path referencesrefrrr_prot_in_references)s r*cCsHt|trt|||giSi}|D] }t||}||g|q"|Sr)r%strr* setdefaultappend)pathsr(outr'protocolrrr_protocol_groups/s  r1c@seZdZddZdS)RefsValuesViewccs|jjD]}t|Vq |jjEdH|jD]@}|j|}t |dkrl|j|dVq>|j |EdHq>dS)Nr/0) _mapping zmetadatar!jsondumpsencode_itemslistdir_get_chunk_sizeslen_generate_all_records)rvalfield chunk_sizesrrr__iter__:s  zRefsValuesView.__iter__NrrrrArrrrr29sr2c@seZdZddZdS) RefsItemsViewcCst|j|jSr)zipr4keysr!rrrrrAGszRefsItemsView.__iter__NrBrrrrrCFsrCcCsHd}d}t|ddd|dddD]\}}|||7}||9}q&|S)Nr)rD)idxsizesr>Zmultisrrrravel_multi_indexKs &  rLc@seZdZdZeddZeddZd9d d Zed d Z d:ddZ d;ddZ ddZ e dddZddZddZddZddZd d!Zd"d#Ze d$d%d&Zd'd(Zed)d*Zd+d,ZdLazyReferenceMapperzVInterface to read parquet store as if it were a standard kerchunk references dict.cCs ddl}|Sr)numpy)rnprrrrOYszLazyReferenceMapper.npcCs ddl}|Sr)pandas)rpdrrrrQ_szLazyReferenceMapper.pdN c s|_i_i_d_|dur*tdn|_jdjdgd}| jd<Wdn1sn0Yt jd}|d_ |d_ jd_|pj_|_t|d fd d }|_dS) a Parameters ---------- root : str Root of parquet store fs : fsspec.AbstractFileSystem fsspec filesystem object, default is local filesystem. cache_size : int Maximum size of LRU cache, where cache_size*record_size denotes the total number of references that can be loaded in memory at once. Nfile/ .zmetadatarb record_sizemetadataz/{field}/refs.{record}.parq)maxsizecsdjj||d}j| }jj|ddWdn1sB0YfddjD}|S)zcached parquet file loader)r?record fastparquet)engineNcsi|]}||jqSr)r!.0cdfrr zCLazyReferenceMapper.__init__..open_refs..)urlformatfsrrQZ read_parquetcolumns)r?r[r'frefsrrar open_refss .z/LazyReferenceMapper.__init__..open_refs)rootr@r9dirsfsspecrrgrjoinreadr6loadsrXr5reout_root cat_threshrrk) rrlrgrr cache_sizeZcategorical_thresholdrimetrkrrrres ,     zLazyReferenceMapper.__init__cKs<i|d}|d|dgt|t||fi|S)NrYrXrUrV)piperor6r7r8rM)rXrlrgkwargsrurrrcreates  zLazyReferenceMapper.createTcCsN|jdur2dd|jD}ttdd|D|_|j}|rJdd|D}|S)zList top-level directoriesNcSsg|]}|dddqS)rUrFr)splitr_prrr rdz/LazyReferenceMapper.listdir..css |]}|r|ds|VqdS).N startswithr{rrr rdz.LazyReferenceMapper.listdir..cSsg|]}tj|qSr)osr'basename)r_r'rrrr}rd)rmr5setsorted)rrrmlistingrrrr:s zLazyReferenceMapper.listdirc s4s}tdgddjDddjD}|durP||t|Sdd|D}fdd|D}t||dd d Sd d }t|d krtd |d}tfddjDfddjD}fdd|D} |} |durt |t | S |} ddt | | D} || S)zShortcut file listingsrVcSsg|]}d|vr|qSrUrr_namerrrr}rdz*LazyReferenceMapper.ls..cSsg|]}d|vr|qSrrrrrrr}rdFcSsg|]}|dddqS) directoryrrtypesizerrrrrr}sc s<g|]4}|dt|jvr(tj|nj|dqSrTrr<r5r6r7r9rrrrr}s cSs|dS)Nrr)rKrrrrdz(LazyReferenceMapper.ls..keyrUrFz(Cannot list within directories right nowrcs g|]}|dr|qSrrrr'rrr}rdcs g|]}|dr|qSrrrrrrr}rdc s<g|]4}|dt|jvr(tj|nj|dqSrrrrrrr}s cSs(g|] \}}|dr|d|ddqS)rrTrGrr)r_rZrecrrrr}s) r:rr5r9updaterrzr<FileNotFoundError_keys_in_fieldr r=rD) rr'detaildirnamesothersZdirinfoZfileinfopartsr?rEZrecsZrecinforr'rrlssN         zLazyReferenceMapper.lsc s`||jvr|j|S||jvr2t|j|Sd|vsD||rLt||d\}}||\}}}|j ||fi |d}|durtn|r|Sz.||\}}|dkrWdS| ||Wn t t t fyt|Yn0gd}fdd|D} | d } | dur| S| ddur2td | d d ddgkrT| dd S| dd S) zfGet the reference for one key Returns bytes, one-element list or three-element list. rUFNrrdr'offsetrrawcs$g|]}|vr|ndqSrrr^rjrirrr}rdz5LazyReferenceMapper._load_one_key..rGzThis reference has been deletedrF)r9r5r6r7r8_is_metaKeyErrorrz_key_to_recordr$rk ValueError TypeErrorr) rrr?Zsub_keyr[_maybe chunk_sizerhZ selectionrrrr _load_one_keys<     z!LazyReferenceMapper._load_one_keyic Csh|d\}}||}t|dkr(dSdd|dD}t||}||j}||j}||t|fS)z3Details needed to construct a reference for one keyrUr)rrrcSsg|] }t|qSr)intr^rrrr} rdz6LazyReferenceMapper._key_to_record..r~)rzr;r<rLrX) rrr?chunkr@Z chunk_idxZ chunk_numberr[rrrrrs     z"LazyReferenceMapper._key_to_recordcCsJ||jvr@|j|d}ddt|d|dD}||j|<|j|S)z6The number of chunks along each axis for a given fieldz/.zarraycSsg|]\}}t||qSr)mathceil)r_rKr`rrrr}sz8LazyReferenceMapper._get_chunk_sizes..shapechunks)r@r5rD)rr?ZzarrayZ size_ratiorrrr;s  z$LazyReferenceMapper._get_chunk_sizescCs\|||}tt|}t|dkr6dd|DSt|dkrJ|dSdd|DSdS)z8The references for a given parquet file of a given fieldrcss|]}t|VqdSrr r_trrrr!rdz7LazyReferenceMapper._generate_record..rFrcss.|]&}|dst|ddn|dVqdS)rNrrrrrr'rdN)rkiterrDr!r<)rr?r[rjitrrr_generate_records   z$LazyReferenceMapper._generate_recordccsPd}||D] }||9}qt||j}t|D]}|||EdHq4dS)zJLoad all the references within a field by iterating over the parquet filesrFN)r;rrrXranger)rr?Znrecchr[rrrr=)s   z)LazyReferenceMapper._generate_all_recordscCst|Sr)r2rrrrr!2szLazyReferenceMapper.valuescCst|Sr)rCrrrritems5szLazyReferenceMapper.itemscCst|Sr)idrrrr__hash__8szLazyReferenceMapper.__hash__cCs ||Sr)r)rrrrr __getitem__;szLazyReferenceMapper.__getitem__c Csd|vrf||sf|d\}}||\}}}|j||fi}|||<t||jkr|||n,||j|<t t |t r| n||j |<dSNrU)rrzrr9r,r<rXwriter6rqr%bytesdecoder5) rrvaluer?rr[rJrsubdictrrr __setitem__?s zLazyReferenceMapper.__setitem__cCs|dpd|vS)N.zz/.zrrrrrrNszLazyReferenceMapper._is_metacCs||jvr|j|=n||jvr(|j|=npd|vr||s|d\}}||\}}}|j||fi}d||<t||jkr|||n d|j|<dSr) r9r5rrzrr,r<rXr)rrr?rr[rrrrr __delitem__Rs    zLazyReferenceMapper.__delitem__c Csddl}ddl}ddl}|j||f}|p.|jd|d|d} |j|j|jdd} |j|jdd} |j|jdd} |j|j|jdd} d}d}| D]d\}}t |t r|d7}|d| |<t |dkr|d| |<|d | |<q|d7}|j || |<q|jt| | | | d d d }|j|jp0d|jkrN|d d|d <tddd}d dg}|jj|pr|jd|dd|j| d|pt|jdddd d ||d||j||fdS)NrrUz/refs.z.parqO)Zdtypeint64rFrrF)copyr'categoryrutf8)rr'rTexist_okr\storage_optionsZzstd)r]r compressionindexstatsobject_encoding has_nulls)Z kerchunk.dfrNrPr9rrfullrXnanzerosrr%r r<rbZ _proc_rawZ DataFramedictr'countZnuniquersZastypergZmkdirsZ to_parquetgetattrclearpop)rr?r[base_urlrZkerchunkrOrQ partitionfnr.offsetsrIZrawsZnrawnpathjdatarbrrrrrrcs^     " "  zLazyReferenceMapper.writecCst|jD](}t|tr |\}}|j||||dq t|jD],}|dkr>d|vr>t|j||j|<q>|j|j d}t | |jd<|j d|p|jdg|jd|jdS)zOutput any modified or deleted keys Parameters ---------- base_url: str Location of the output )rrrVrrvrUN)r r9r%r&rr6rqrr5rXr7r8rgrwrorrrk cache_clear)rrrthingr?r[krurrrflushs&  zLazyReferenceMapper.flushcCsdd}|D]6}|dr$|d7}q ||}|j|}||7}q |t|j7}|t|j7}|S)Nrr~rF)r:rr;rOproductr<r5r9)rrr?r@Znchunksrrr__len__s      zLazyReferenceMapper.__len__ccsRt|j}||j|D]}t|tr|Vq|D]}||EdHq8dSr)rr5rr9r%r+r:r)rZmetasbitr?rrrrAs    zLazyReferenceMapper.__iter__cCs*z||WdSty$YdS0dS)NTF)rr)ritemrrr __contains__s   z LazyReferenceMapper.__contains__ccsd||}t|dkr$|dVdStjdd|D}|D]"}|dddd |DVq.rUr~cSsg|] }t|qSr)r+r^rrrr}rdz6LazyReferenceMapper._keys_in_field..)r;r< itertoolsrro)rr?r@Zindsindrrrrs   z"LazyReferenceMapper._keys_in_field)NNrRrS)T)rT)NN)NN)rrr__doc__propertyrOrQr staticmethodryr:rrrrr;rr=r!rrrrrrrrrrArrrrrrrMTs@   *  <)      : ! rMc seZdZdZdZdCfdd ZdDd d ZdEd d ZdFddZddZ ddZ e fddZ dGddZ dHddZdIddZddZdJd d!Zd"d#Zd$d%Zd&d'ZdKd)d*ZdLd+d,Zd-d.Zd/d0Zd1d2ZdMd3d4ZdNfd5d6 Zd7d8Zd9d:Zd;d<Zd=d>Zd?d@Z dAdBZ!Z"S)OReferenceFileSystemaView byte ranges of some other file as a file system Initial version: single file system target, which must support async, and must allow start and end args in _cat_file. Later versions may allow multiple arbitrary URLs for the targets. This FileSystem is read-only. It is designed to be used with async targets (for now). This FileSystem only allows whole-file access, no ``open``. We do not get original file details from the target FS. Configuration is by passing a dict of references at init, or a URL to a JSON file containing the same; this dict can also contain concrete data for some set of paths. Reference dict format: {path0: bytes_data, path1: (target_url, offset, size)} https://github.com/fsspec/kerchunk/blob/main/README.md rNT@BrRc stjfi|||_| |_| |_i|_i|_i|_| |_| |_ t |t rt fi|p^|p^id|i}t jj|fi|\}}||rt j|dfi|&}td|t|}Wdn1s0Y||| ntd|t||| d|_n ||| t |t rNdd|D|_d|jvrJtd |jd<dS|durt |jtrp|jd n|j}||j|<|dur|jD]X}t|r|}t j|\}}|r||jvrt|fi|pi}||j|<q|durv|jD]r}t|r|}t |t r|d rt j|d \}}||jvrt|fi|p\i}||j|<qvq|r||jvrt|fi|pi}||j|<|ptd |jd<dS) a Parameters ---------- fo : dict or str The set of references to use for this instance, with a structure as above. If str referencing a JSON file, will use fsspec.open, in conjunction with target_options and target_protocol to open and parse JSON at this location. If a directory, then assume references are a set of parquet files to be loaded lazily. target : str For any references having target_url as None, this is the default file target to use ref_storage_args : dict If references is a str, use these kwargs for loading the JSON file. Deprecated: use target_options instead. target_protocol : str Used for loading the reference file, if it is a path. If None, protocol will be derived from the given path target_options : dict Extra FS options for loading the reference file ``fo``, if given as a path remote_protocol : str The protocol of the filesystem on which the references will be evaluated (unless fs is provided). If not given, will be derived from the first URL that has a protocol in the templates or in the references, in that order. remote_options : dict kwargs to go with remote_protocol fs : AbstractFileSystem | dict(str, (AbstractFileSystem | dict)) Directly provide a file system(s): - a single filesystem instance - a dict of protocol:filesystem, where each value is either a filesystem instance, or a dict of kwargs that can be used to create in instance for the given protocol If this is given, remote_options and remote_protocol are ignored. template_overrides : dict Swap out any templates in the references file with these - useful for testing. simple_templates: bool Whether templates can be processed with simple replace (True) or if jinja is needed (False, much slower). All reference sets produced by ``kerchunk`` are simple in this sense, but the spec allows for complex. max_gap, max_block: int For merging multiple concurrent requests to the same remote file. Neighboring byte ranges will only be merged when their inter-range gap is <= ``max_gap``. Default is 64KB. Set to 0 to only merge when it requires no extra bytes. Pass a negative number to disable merging, appropriate for local target files. Neighboring byte ranges will only be merged when the size of the aggregated range is <= ``max_block``. Default is 256MB. cache_size : int Maximum size of LRU cache, where cache_size*record_size denotes the total number of references that can be loaded in memory at once. Only used for lazily loaded references. kwargs : passed to parent class r0rWzRead reference from URL %sNz$Open lazy reference dict from URL %s)rgrtcSs>i|]6\}}|t|tr6tj|dddfi|n|qS):rFr)r%rrnrrz)r_roptsrrrrcgs  z0ReferenceFileSystem.__init__..rTr)!rrrtemplate_overridessimple_templates templatesfssZ _dircachemax_gap max_blockr%r+rrncoreZ url_to_fsisfilerloggerinfor6load_process_referencesrMr(rrr0r&r!callabler r )rforZref_storage_argsZtarget_protocolZtarget_optionsZremote_protocolZremote_optionsrgrrrrrtrxZdicZref_fsZfo2ritextr)r0rrrrrszI    (               zReferenceFileSystem.__init__c Cst||}td|z|j|}WntyBt|Yn0t|trV|}t|t rtd|d| drt |dd}|ddfSt |dkrtd|d||d}||}}n|\}}} td|d |d |d | || } |dur*|dkr ||}n| |}n|}|durV|dkrL||}n| |}n| }|durj|j}|||fS) Nzcat: z Reference: z , type bytesbase64:rFz, whole file => rz => z , offset z, size )_strip_protocolrdebugr(rrr%r+r8rrbase64 b64decoder<r) rr'startendpartreZstart1Zend1start0rend0rrr _cat_commonsB         "         zReferenceFileSystem._cat_commonc s|j|||d\}}}t|tr,|||St|\}} z |j|j|||dIdHWn0ty} zt||| WYd} ~ n d} ~ 00dSN)r r)rr%rr r _cat_file Exceptionr rr'r rrxZ part_or_urlrrr0rerrrrs    zReferenceFileSystem._cat_filec Ks|j|||d\}}}t|tr,|||St|\}} z|j|j|||dWSty} zt||| WYd} ~ n d} ~ 00dSr)rr%rr rcat_filerr rrrrrs   zReferenceFileSystem.cat_filecKs||j|<dS)z2Temporarily add binary data or reference as a fileNr()rr'rrrrr pipe_fileszReferenceFileSystem.pipe_filecs`||rtj|ddS||IdH}t|d}||Wdn1sR0YdSNTrwb)isdirrmakedirsrrr)rrpathlpathrxrrirrr _get_files   zReferenceFileSystem._get_filecKs||rtj|ddS|j|fi|}|t|t|rL||n4t|d}||Wdn1sv0Y| t|dSr) rrrrZset_sizer<r rrZabsolute_update)rrr callbackrxrrirrrget_files   (zReferenceFileSystem.get_fileFc  s|rdj||d}tjddd}t||}|rRfdd|D}n |}t||D] \}} ||vrf|| ||qfdS)Nr) recursiverTT)Z auto_mkdircsg|]}|s|qSr)r)r_rrrrr}rdz+ReferenceFileSystem.get..)rZ expand_pathrnrr catrDr) rrr r$rxrgtargetsrremotelocalrrrr$s   zReferenceFileSystem.getraisec# Kst|tr|rtt|tr6|s2tdd|Dr6tt||j}i}|D]\}}|j|} ggg} } } |D]v} z2| | \}}}| || || |Wqvt y}z&|dkrƂ|dkr||| <WYd}~qvd}~00qvg}g}g}g}t }t | | | |D]`\}}}} t|tr4||| <n<|dur||| || || || | qt | | | |D]J\}}}} |dur||vr| || || || | qtt|t|t|d|j|jd\}}}| |||}t | | | |D]\}}}} | |vr.qt ||||D]\}}}}||kr|dusf|durt|tr|||| <n||||| <nR||kr<||kr<||kr.r*ZomitT)sortrrrFr+)r%r+NotImplementedErrorr anyr1r(rrrr-rrrDraddr rrZ cat_rangesrrr __cause__r<r#)#rr'r$Zon_errorrxZ proto_dictr/protor.rgurlsZstartsZendsr|urKrerrZurls2Zstarts2Zends2Zpaths2Z whole_filesZ new_pathsZ new_startsZnew_endsZ bytes_outrOnsnebrvexZnew_exrrrr&s                      (   $zReferenceFileSystem.catcCsJ|dd}|dur ||n&|dkr8|j||dntd|dS)NversionrF)rz Unknown reference spec version: )r$_process_references0_process_references1r)rr(rversrrrrUs   z'ReferenceFileSystem._process_referencescCs ||_dS)z&Make reference dict for Spec Version 0Nr)rr(rrrr;`sz(ReferenceFileSystem._process_references0cs2jr jrddli_|ditdfdd}|diD]\}}t|t r| drt |ddj|<|j|<qRjr|d}d |vr܈jr| d d  d d jfij}n||}t|d kr|gn||d |dgj|<qR|j|<qRj|dgdS)Nrrics|jfijSr)Templaterenderr)r3jinja2rrr _render_jinjajsz?ReferenceFileSystem._process_references1.._render_jinjarjzbase64:r{{{z}}}rFrgen)rrrAr(_process_templatesr$rrr%r+rr r replacerfr<r _process_gen)rr(rrBrr8r3rr@rr<ds2     , z(ReferenceFileSystem._process_references1csdi|_|jdur||j|D]:\}}d|vrTddl|ffdd |j|<q$||j|<q$dS)NrCrcs|jfi|Sr)r>r?)temprxrArrrsz8ReferenceFileSystem._process_templates..)rrrrrA)rtmprr8rrKrrGs  z&ReferenceFileSystem._process_templatesc s&i}|D]}dd|dDfddtjD}|D]}ddl}||djfi||j}||djfi||j}d |vrd |vrt||d jfi||j} t||d jfi||j} || | g||<qDd |vd |vArt d qD|g||<qDq|S) Nc Ss@i|]8\}}|t|tr|nt|dd|d|ddqS)r rstopsteprF)r%r rr$)r_rr8rrrrcs z4ReferenceFileSystem._process_gen..Z dimensionsc3s |]}tt|VqdSr)rrDrE)r_r!Z dimensionrrrsz3ReferenceFileSystem._process_gen..rrrerlengthz^Both 'offset' and 'length' are required for a reference generator entry if either is provided.) rrrr!rAr>r?rrr) rZgensr/rFZproductsprrArrerrPrrOrrIs4      z ReferenceFileSystem._process_genc Csdgi|_|j}|D]\}}t|ttfr8t|}nt|dkrJd}n |\}}}d|vrl|dddnd}|}|r||jvrg|j|<|jd|vr|dddndg |ddd| |}qt|j| |d|dqdS)NrrFrUrrrrT) dircacher(rr%rr+r<rsplitr,r-_parent) rrr'rrrr parZpar0rrr_dircache_from_itemss&         z(ReferenceFileSystem._dircache_from_itemsrWcKs||}t|Sr)rioBytesIO)rr'mode block_sizeZ cache_optionsrxrrrr_opens zReferenceFileSystem._opencKs||}t|jtrJz|j||WSty8Yn0td|d|jsX|| |}|durrt||rz|Sdd|DS)N'z' is not a known keycSsg|] }|dqSrrr_orrrr}rdz*ReferenceFileSystem.ls..) r r%r(rMrrrrRrV_ls_from_cache)rr'rrxr/rrrrs    zReferenceFileSystem.lscKs||p||Sr)rrrr'rxrrrexistsszReferenceFileSystem.existscsH|jr|jvSt|jtr,|jdvStfdd|jDSdS)Nrc3s|]}|dVqdS)rUNr)r_rrrrrrdz,ReferenceFileSystem.isdir..)rRr%r(rMr:r.rr'rrrrs   zReferenceFileSystem.isdircCs ||jvSrrrcrrrrszReferenceFileSystem.isfilecs|j||fi|Sr)r)rr'rrxrrr_lsszReferenceFileSystem._lsc s~|r tjf|||d|SrHtfddjD}n tj}|rvjsdfdd|DS|SdS)N)maxdepthwithdirsrc3s|]}|r|VqdSrrr_rrrrrrdz+ReferenceFileSystem.find..csi|]}||dqS)r)r`rgrrrrcrdz,ReferenceFileSystem.find..)rfindr rr(rRrV)rr'rerfrrxr%rrrrhs"  zReferenceFileSystem.findc s|j}|dur^t|ttfr2dt|dSt|dkrNd|ddSdddg}n.|d}fdd|D}|sdd dS|d d durt|jd \}}|j| |jd |d d <|d S) NrTrrFrTcsg|]}|dkr|qSr]rr^rrrr}rdz,ReferenceFileSystem.info..rrr) r(r$r%r+rr<rr rr)rr'rxr/Zout0Zprotrrrrrs    "zReferenceFileSystem.infocs ||Sr)rrarrr_infoszReferenceFileSystem._infocs|j|d|jdSr)r(rrRrrarrr_rm_fileszReferenceFileSystem._rm_filecs||j|<|jdSr)r(rRr)rr'rrrr _pipe_file!s zReferenceFileSystem._pipe_filecsFt|d}||j|<Wdn1s.0Y|jdS)NrW)rrpr(rRr)rr rrirrr _put_file&s ,zReferenceFileSystem._put_filec Ksi}|jD]X\}}t|tr^z|d||<WqftyZdt|||<Yqf0q|||<qtj |dfi|*}| t d|d Wdn1s0YdS)z+Write modified references into new locationasciirrrF)r:rjN)r(rr%rrUnicodeDecodeErrorr  b64encodernrrr6r7r8)rrerr/rr8rirrr save_json,s   zReferenceFileSystem.save_json) NNNNNNNNTrrrR)NN)NN)NN)F)Fr*)N)N)rWNN)T)T)NFF)#rrrrr0rrrrrr!rr#r$r&rr;r<rGrIrVr[rrbrrrdrhrrirjrkrlrprrrrrrsV *   \  #    r),r  collectionsrWrloggingrr functoolsrtypingrZ fsspec.corernZujsonr6 ImportErrorZasynr callbacksrrrrr utilsr r r getLoggerr RuntimeErrorr r#r*r1abc ValuesViewr2 ItemsViewrCrLMutableMappingrMrrrrrs>