a  d&@sddlZddlmZddlZddlZddlmZmZm Z ddl m Z m Z erZddl mZe eZeeejdd d Zee Gd d d e ZdS) N)Union)add_end_docstringsis_torch_availablelogging)PIPELINE_INIT_ARGSPipeline)&MODEL_FOR_AUDIO_CLASSIFICATION_MAPPING)bpayload sampling_ratereturnc Cs|}d}d}dddd|d|d|d d d d g }ztj|tjtjd }Wnty^tdYn0||}|d}t|tj} | j ddkrtd| S)z? Helper function to read an audio file through ffmpeg. 1Zf32leZffmpegz-izpipe:0z-acz-arz-fz -hide_bannerz -loglevelquietzpipe:1)stdinstdoutzFffmpeg was not found but is required to load audio files from filenamerzMalformed soundfile) subprocessPopenPIPEFileNotFoundError ValueError communicatenpZ frombufferfloat32shape) r r aracZformat_for_conversionZffmpeg_commandZffmpeg_processZ output_stream out_bytesaudiort/var/www/html/stable-diffusion-webui/venv/lib/python3.9/site-packages/transformers/pipelines/audio_classification.py ffmpeg_reads6  r!csbeZdZdZfddZeejee fdfdd Z ddd Z d d Z d d Z dddZZS)AudioClassificationPipelinea Audio classification pipeline using any `AutoModelForAudioClassification`. This pipeline predicts the class of a raw waveform or an audio file. In case of an audio file, ffmpeg should be installed to support multiple audio formats. Example: ```python >>> from transformers import pipeline >>> classifier = pipeline(model="superb/wav2vec2-base-superb-ks") >>> classifier("https://huggingface.co/datasets/Narsil/asr_dummy/resolve/main/1.flac") [{'score': 0.997, 'label': '_unknown_'}, {'score': 0.002, 'label': 'left'}, {'score': 0.0, 'label': 'yes'}, {'score': 0.0, 'label': 'down'}, {'score': 0.0, 'label': 'stop'}] ``` Learn more about the basics of using a pipeline in the [pipeline tutorial](../pipeline_tutorial) This pipeline can currently be loaded from [`pipeline`] using the following task identifier: `"audio-classification"`. See the list of available models on [huggingface.co/models](https://huggingface.co/models?filter=audio-classification). csDd|d<tj|i||jdkr6td|jd|tdS)Ntop_kptzThe z is only available in PyTorch.)super__init__Z frameworkr __class__Zcheck_model_typer )selfargskwargsr(rr r']s  z$AudioClassificationPipeline.__init__)inputsc stj|fi|S)a  Classify the sequence(s) given as inputs. See the [`AutomaticSpeechRecognitionPipeline`] documentation for more information. Args: inputs (`np.ndarray` or `bytes` or `str`): The inputs is either a raw waveform (`np.ndarray` of shape (n, ) of type `np.float32` or `np.float64`) at the correct sampling rate (no further check will be done) or a `str` that is the filename of the audio file, the file will be read at the correct sampling rate to get the waveform using *ffmpeg*. This requires *ffmpeg* to be installed on the system. If *inputs* is `bytes` it is supposed to be the content of an audio file and is interpreted by *ffmpeg* in the same way. top_k (`int`, *optional*, defaults to None): The number of top labels that will be returned by the pipeline. If the provided number is `None` or higher than the number of labels available in the model configuration, it will default to the number of labels. Return: A list of `dict` with the following keys: - **label** (`str`) -- The label predicted. - **score** (`float`) -- The corresponding probability. )r&__call__)r)r-r+r,rr r.gsz$AudioClassificationPipeline.__call__NcKs6i}|dur,||jjjkr$|jjj}||d<ii|fS)Nr$)modelconfigZ num_labels)r)r$r+Zpostprocess_paramsrrr _sanitize_parameterss  z0AudioClassificationPipeline._sanitize_parameterscCst|tr^|ds|dr,t|j}n2t|d}|}Wdn1sT0Yt|trvt ||j j }t|t j stdt|jdkrtd|j ||j j dd}|S) Nzhttp://zhttps://rbz"We expect a numpy ndarray as inputrzMWe expect a single channel audio input for AutomaticSpeechRecognitionPipeliner%)r Zreturn_tensors) isinstancestr startswithrequestsgetcontentopenreadbytesr!Zfeature_extractorr rndarrayrlenr)r)r-f processedrrr preprocesss  &   z&AudioClassificationPipeline.preprocesscCs|jfi|}|S)N)r/)r)Z model_inputs model_outputsrrr _forwardsz$AudioClassificationPipeline._forwardr#csJ|jdd}||\}}|}|}fddt||D}|S)Nrcs$g|]\}}|jjj|dqS))scorelabel)r/r0Zid2label).0rDZ_idr)rr z;AudioClassificationPipeline.postprocess..)ZlogitsZsoftmaxZtopktolistzip)r)rAr$ZprobsZscoresidslabelsrrGr postprocesss z'AudioClassificationPipeline.postprocess)N)r#)__name__ __module__ __qualname____doc__r'rrr<r;r4r.r1r@rBrN __classcell__rrr,r r"Bs  r")rtypingrnumpyrr6utilsrrrbaserr Zmodels.auto.modeling_autor Z get_loggerrOloggerr;intarrayr!r"rrrr s   $