a
dd @ s^ d dl Z d dlZd dlZd dlmZmZmZmZmZm Z d dl
Z ddl m
Z
ddlmZ ddlmZmZmZmZmZmZmZmZmZ ee Z G dd deZG d d
d
eZ G d d d e Z d
dhdhddhdhfZ dd Z!d ee" e#e#dddZ$d e e"ee" ee%e"f f ee" e#e#e&dddZ'ee j(e _(e j(j)durZe j(j)j*dd d d e j(_)dS )! N)AnyDictIterableOptionalTupleUnion )custom_object_save) BatchFeature) IMAGE_PROCESSOR_NAMEPushToHubMixinadd_model_info_to_auto_map cached_file copy_func download_urlis_offline_mode
is_remote_urlloggingc @ s e Zd ZdZdS )r
a
Holds the output of the image processor specific `__call__` methods.
This class is derived from a python dictionary and can be used as a dictionary.
Args:
data (`dict`):
Dictionary of lists/arrays/tensors returned by the __call__ method ('pixel_values', etc.).
tensor_type (`Union[None, str, TensorType]`, *optional*):
You can give a tensor_type here to convert the lists of integers in PyTorch/TensorFlow/Numpy Tensors at
initialization.
N)__name__
__module__ __qualname____doc__ r r l/var/www/html/stable-diffusion-webui/venv/lib/python3.9/site-packages/transformers/image_processing_utils.pyr
+ s r
c @ s e Zd ZdZdZdd ZedddZee ee
j f dd d
Z d%e ee
j f e
d d
dZee ee
j f eeeef eeef f dddZeeeef dddZeeef dddZee ee
j f dddZeddd Ze ee
j f d d d Zd d! Zed&d#d$ZdS )'ImageProcessingMixinz
This is an image processor mixin used to provide saving/loading functionality for sequential and image feature
extractors.
Nc K sz | dd| _| D ]^\}}zt| || W q tyr } z,td| d| d| |W Y d}~qd}~0 0 qdS )z'Set elements of `kwargs` as attributes.processor_classNz
Can't set z with value z for )pop_processor_classitemssetattrAttributeErrorloggererror)selfkwargskeyvalueerrr r r __init__C s z ImageProcessingMixin.__init__)r c C s
|| _ dS )z%Sets processor class as an attribute.N)r )r# r r r r _set_processor_classO s z)ImageProcessingMixin._set_processor_class) pretrained_model_name_or_pathc K s( | j |fi |\}}| j|fi |S )a
Instantiate a type of [`~image_processing_utils.ImageProcessingMixin`] from an image processor.
Args:
pretrained_model_name_or_path (`str` or `os.PathLike`):
This can be either:
- a string, the *model id* of a pretrained image_processor hosted inside a model repo on
huggingface.co. Valid model ids can be located at the root-level, like `bert-base-uncased`, or
namespaced under a user or organization name, like `dbmdz/bert-base-german-cased`.
- a path to a *directory* containing a image processor file saved using the
[`~image_processing_utils.ImageProcessingMixin.save_pretrained`] method, e.g.,
`./my_model_directory/`.
- a path or url to a saved image processor JSON *file*, e.g.,
`./my_model_directory/preprocessor_config.json`.
cache_dir (`str` or `os.PathLike`, *optional*):
Path to a directory in which a downloaded pretrained model image processor should be cached if the
standard cache should not be used.
force_download (`bool`, *optional*, defaults to `False`):
Whether or not to force to (re-)download the image processor files and override the cached versions if
they exist.
resume_download (`bool`, *optional*, defaults to `False`):
Whether or not to delete incompletely received file. Attempts to resume the download if such a file
exists.
proxies (`Dict[str, str]`, *optional*):
A dictionary of proxy servers to use by protocol or endpoint, e.g., `{'http': 'foo.bar:3128',
'http://hostname': 'foo.bar:4012'}.` The proxies are used on each request.
use_auth_token (`str` or `bool`, *optional*):
The token to use as HTTP bearer authorization for remote files. If `True`, or not specified, will use
the token generated when running `huggingface-cli login` (stored in `~/.huggingface`).
revision (`str`, *optional*, defaults to `"main"`):
The specific model version to use. It can be a branch name, a tag name, or a commit id, since we use a
git-based system for storing models and other artifacts on huggingface.co, so `revision` can be any
identifier allowed by git.
To test a pull request you made on the Hub, you can pass `revision="refs/pr/".
return_unused_kwargs (`bool`, *optional*, defaults to `False`):
If `False`, then this function returns just the final image processor object. If `True`, then this
functions returns a `Tuple(image_processor, unused_kwargs)` where *unused_kwargs* is a dictionary
consisting of the key/value pairs whose keys are not image processor attributes: i.e., the part of
`kwargs` which has not been used to update `image_processor` and is otherwise ignored.
subfolder (`str`, *optional*, defaults to `""`):
In case the relevant files are located inside a subfolder of the model repo on huggingface.co, you can
specify the folder name here.
kwargs (`Dict[str, Any]`, *optional*):
The values in kwargs of any keys which are image processor attributes will be used to override the
loaded values. Behavior concerning key/value pairs whose keys are *not* image processor attributes is
controlled by the `return_unused_kwargs` keyword parameter.
Returns:
A image processor of type [`~image_processing_utils.ImageProcessingMixin`].
Examples:
```python
# We can't instantiate directly the base class *ImageProcessingMixin* so let's show the examples on a
# derived class: *CLIPImageProcessor*
image_processor = CLIPImageProcessor.from_pretrained(
"openai/clip-vit-base-patch32"
) # Download image_processing_config from huggingface.co and cache.
image_processor = CLIPImageProcessor.from_pretrained(
"./test/saved_model/"
) # E.g. image processor (or model) was saved using *save_pretrained('./test/saved_model/')*
image_processor = CLIPImageProcessor.from_pretrained("./test/saved_model/preprocessor_config.json")
image_processor = CLIPImageProcessor.from_pretrained(
"openai/clip-vit-base-patch32", do_normalize=False, foo=False
)
assert image_processor.do_normalize is False
image_processor, unused_kwargs = CLIPImageProcessor.from_pretrained(
"openai/clip-vit-base-patch32", do_normalize=False, foo=False, return_unused_kwargs=True
)
assert image_processor.do_normalize is False
assert unused_kwargs == {"foo": False}
```)get_image_processor_dict from_dict)clsr* r$ image_processor_dictr r r from_pretrainedS s Rz$ImageProcessingMixin.from_pretrainedF)save_directory push_to_hubc K s t j|r td| dt j|dd |rp|dd}|d|t jjd }| j|fi |}| |}| j
durt | || d t j |t
}| | td
| |r| j|||||d d |gS )
aT
Save an image processor object to the directory `save_directory`, so that it can be re-loaded using the
[`~image_processing_utils.ImageProcessingMixin.from_pretrained`] class method.
Args:
save_directory (`str` or `os.PathLike`):
Directory where the image processor JSON file will be saved (will be created if it does not exist).
push_to_hub (`bool`, *optional*, defaults to `False`):
Whether or not to push your model to the Hugging Face model hub after saving it. You can specify the
repository you want to push to with `repo_id` (will default to the name of `save_directory` in your
namespace).
kwargs:
Additional key word arguments passed along to the [`~utils.PushToHubMixin.push_to_hub`] method.
zProvided path (z#) should be a directory, not a fileT)exist_okcommit_messageNrepo_id)configzImage processor saved in use_auth_token)r3 token)ospathisfileAssertionErrormakedirsr splitsepZ _create_repoZ_get_files_timestamps _auto_classr joinr to_json_filer! infoZ_upload_modified_filesget)r# r0 r1 r$ r3 r4 Zfiles_timestampsZoutput_image_processor_filer r r save_pretrained s,
z$ImageProcessingMixin.save_pretrained)r* returnc
K s8 | dd}| dd}| dd}| dd}| dd}| dd}| d d} | d
d }
| d d} | d
d} d| d}
| dur| |
d< t r|std d}t|}tj|}tj|rtj|t }tj
|r|}d}nt |r|}t |}nlt }z"t
|||||||||
| |
d }W nD tyB Y n0 typ td| d| dt dY n0 zFt|ddd}| }W d n1 s0 Y t|}W n& tjy td| d Y n0 |rtd | ntd | d | d |v r0|s0t|d ||d < ||fS ) a
From a `pretrained_model_name_or_path`, resolve to a dictionary of parameters, to be used for instantiating a
image processor of type [`~image_processor_utils.ImageProcessingMixin`] using `from_dict`.
Parameters:
pretrained_model_name_or_path (`str` or `os.PathLike`):
The identifier of the pre-trained checkpoint from which we want the dictionary of parameters.
subfolder (`str`, *optional*, defaults to `""`):
In case the relevant files are located inside a subfolder of the model repo on huggingface.co, you can
specify the folder name here.
Returns:
`Tuple[Dict, Dict]`: The dictionary(ies) that will be used to instantiate the image processor object.
cache_dirNforce_downloadFresume_downloadproxiesr7 local_files_onlyrevision subfolder Z_from_pipelineZ
_from_autoimage processor) file_typefrom_auto_classZusing_pipelinez+Offline mode: forcing local_files_only=TrueT) rG rH rJ rI rK r7
user_agentrL rM z Can't load image processor for 'z'. If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. Otherwise, make sure 'z2' is the correct path to a directory containing a z filerutf-8encodingz"It looks like the config file at 'z' is not a valid JSON file.zloading configuration file z from cache at Zauto_map)r r r! rC strr9 r: isdirrA r r; r r r EnvironmentError ExceptionopenreadjsonloadsJSONDecodeErrorr
)r- r* r$ rG rH rI rJ r7 rK rL rM Z
from_pipelinerQ rR is_localZimage_processor_fileZ resolved_image_processor_filereadertextr. r r r r+ s
(
z-ImageProcessingMixin.get_image_processor_dict)r. c K s | }|dd}d|v r2d|v r2|d|d< d|v rPd|v rP|d|d< | f i |}g }| D ](\}}t||rjt||| || qj|D ]}||d qtd| |r||fS |S dS )a
Instantiates a type of [`~image_processing_utils.ImageProcessingMixin`] from a Python dictionary of parameters.
Args:
image_processor_dict (`Dict[str, Any]`):
Dictionary that will be used to instantiate the image processor object. Such a dictionary can be
retrieved from a pretrained checkpoint by leveraging the
[`~image_processing_utils.ImageProcessingMixin.to_dict`] method.
kwargs (`Dict[str, Any]`):
Additional parameters from which to initialize the image processor object.
Returns:
[`~image_processing_utils.ImageProcessingMixin`]: The image processor object instantiated from those
parameters.
return_unused_kwargsFsizeZ crop_sizeNzImage processor )copyr r hasattrr appendr! rC )r- r. r$ rc Zimage_processorZ to_remover% r& r r r r, @ s$
z ImageProcessingMixin.from_dictrF c C s t | j}| jj|d< |S )z
Serializes this instance to a Python dictionary.
Returns:
`Dict[str, Any]`: Dictionary of all the attributes that make up this image processor instance.
Zimage_processor_type)re deepcopy__dict__ __class__r )r# outputr r r to_dictm s z ImageProcessingMixin.to_dict) json_filec C sN t |ddd}| }W d n1 s,0 Y t|}| f i |S )a
Instantiates a image processor of type [`~image_processing_utils.ImageProcessingMixin`] from the path to a JSON
file of parameters.
Args:
json_file (`str` or `os.PathLike`):
Path to the JSON file containing the parameters.
Returns:
A image processor of type [`~image_processing_utils.ImageProcessingMixin`]: The image_processor object
instantiated from that JSON file.
rS rT rU N)r[ r\ r] r^ )r- rn ra rb r. r r r from_json_filey s &
z#ImageProcessingMixin.from_json_filec C sb | }| D ] \}}t|tjr| ||< q|dd}|durN||d< tj|dddd S )z
Serializes this instance to a JSON string.
Returns:
`str`: String containing all the attributes that make up this feature_extractor instance in JSON format.
r Nr T)indent sort_keys
) rm r
isinstancenpZndarraytolistr r] dumps)r#
dictionaryr% r& r r r r to_json_string s z#ImageProcessingMixin.to_json_string)json_file_pathc C s@ t |ddd }|| W d n1 s20 Y dS )z
Save this instance to a JSON file.
Args:
json_file_path (`str` or `os.PathLike`):
Path to the JSON file in which this image_processor instance's parameters will be saved.
wrT rU N)r[ writery )r# rz writerr r r rB s z!ImageProcessingMixin.to_json_filec C s | j j d| S )N )rk r ry )r# r r r __repr__ s z ImageProcessingMixin.__repr__AutoImageProcessorc C sD t |ts|j}ddlm m} t||s:t| d|| _dS )a
Register this class with a given auto class. This should only be used for custom image processors as the ones
in the library are already mapped with `AutoImageProcessor `.
This API is experimental and may have some slight breaking changes in the next releases.
Args:
auto_class (`str` or `type`, *optional*, defaults to `"AutoImageProcessor "`):
The auto class to register this new image processor with.
r Nz is not a valid auto class.) rt rW r Ztransformers.models.automodelsautorf
ValueErrorr@ )r- Z
auto_classZ auto_moduler r r register_for_auto_class s
z,ImageProcessingMixin.register_for_auto_class)F)r )r r r r r@ r( rW r) classmethodr r9 PathLiker/ boolrE r r r r+ r, rm ro ry rB r r r r r r r ; s* U 0 f, r c s8 e Zd Z fddZedddZedddZ ZS )BaseImageProcessorc s t jf i | d S )N)superr( )r# r$ rk r r r( s zBaseImageProcessor.__init__rh c K s | j |fi |S )z)Preprocess an image or a batch of images.)
preprocessr# Zimagesr$ r r r __call__ s zBaseImageProcessor.__call__c K s t dd S )Nz=Each image processor must implement its own preprocess method)NotImplementedErrorr r r r r s z BaseImageProcessor.preprocess)r r r r( r
r r
__classcell__r r r r r s r heightwidth
shortest_edge longest_edgec C s6 t | tsdS t| }tD ]}||kr dS q dS )NFT)rt dictsetkeysVALID_SIZE_DICT_KEYS) size_dictZsize_dict_keysZ allowed_keysr r r is_valid_size_dict s
r T)max_sizedefault_to_squareheight_width_orderc C s t | tr(|r(|d ur td| | dS t | trR|sRd| i}|d urN||d< |S t | ttfrv|rv| d | d dS t | ttfr|s| d | d dS | d u r|d ur|rtdd|iS td| d S ) NzLCannot specify both size as an int, with default_to_square=True and max_size)r r r r r r z7Cannot specify both default_to_square=True and max_sizez+Could not convert size input to size dict: )rt intr tuplelist)rd r r r r r r r convert_to_size_dict s$
r rd )rd r r r rF c
C sh t | ts sJ ,
,