a d@sddlmZddlmZddlmZmZmZmZm Z ddl Z ddl m m ZddZdeeee eefeee ee jfed d d Zdeeee eefe ee jfed ddZdS))partial)islice)CallableListOptionalSequenceUnionNccs(t|}tt||}|sq$|VqdS)zBatch data into lists of length *n*. The last batch may be shorter. NOTE based on more-itertools impl, to be replaced by python 3.12 itertools.batched impl N)iterlistr)iterablenitbatchrg/var/www/html/stable-diffusion-webui/venv/lib/python3.9/site-packages/open_clip/zero_shot_classifier.pybatched s r cpuF) classnames templatesnum_classes_per_batchdeviceuse_tqdmc s ttrtdksJt|tr0t|dks4Jtdttt|}|rddl}|durjdn|d|d} t|j| |d} nt} fddtH|rfdd| t ||D} tj | dd } n|} Wdn1s0Y| S) a Build zero-shot classifier weights by iterating over class names in batches Args: model: CLIP model instance tokenizer: CLIP tokenizer instance classnames: A sequence of class (label) names templates: A sequence of callables or format() friendly strings to produce templates per class name num_classes_per_batch: The number of classes to batch together in each forward, all if None device: Device to use. use_tqdm: Enable TQDM progress bar. rN)totalZ unit_scalecspt|}fdd|D}|}tj|dd}||djdd}||jddd}|j}|S)Ncs,g|]$}D]}r||n||q qSrformat).0ctemplate)r use_formatrr 6zFbuild_zero_shot_classifier.._process_batch..dimrT)r%Zkeepdim) lentoF normalize encode_textZreshapemeannormT)Zbatch_classnamesZnum_batch_classestextsclass_embeddings)rmodel num_templatesr tokenizerr rr_process_batch4sz2build_zero_shot_classifier.._process_batchcsg|] }|qSrr)rr)r3rrr!@r"z.build_zero_shot_classifier..r$) isinstancerr&strtqdmrr torchno_gradrcat) r0r2rrrrrZ num_classesr6Znum_iter iter_wrapZbatched_embedszeroshot_weightsr)r3rr0r1rr2r rbuild_zero_shot_classifiers" &r<)rrrrc st|trt|dksJt|tr0t|dks4J|rHddl}|j}nt}t|dttg}||D]\fdd|D} || |} | | } t j | ddj dd} | | } || qptj|dd|}Wdn1s0Y|S)a Build zero-shot classifier weights by iterating over class names 1 by 1 Args: model: CLIP model instance tokenizer: CLIP tokenizer instance classnames: A sequence of class (label) names templates: A sequence of callables or format() friendly strings to produce templates per class name device: Device to use. use_tqdm: Enable TQDM progress bar. rNcs"g|]}r|n|qSrr)rr classnamer rrr!er"z5build_zero_shot_classifier_legacy..r#r$r)r4rr&r6r r5r7r8r'r*r(r)r+r,appendstack) r0r2rrrrr6r:r;r.r/Zclass_embeddingrr=r!build_zero_shot_classifier_legacyGs$     2rA)rrF)rF) functoolsr itertoolsrtypingrrrrrr7Ztorch.nn.functionalnnZ functionalr(rr5intrboolr<rArrrrs.    7