a d7@sBddlZddlZddlZddlZddlZddlZddlZddlmZddl m Z ddl m Z ddl mZmZddlmZddlZddlmZmZdd lmZmZmZmZmZmZmZmZmZmZm Z m!Z!m"Z"dQd d Z#e#d d dZ$ddZ%ddZ&ddZ'ddZ(ddZ)ddZ*ddZ+ddZ,dd Z-d!d"Z.d#d$Z/d%d&Z0d'd(Z1d)d*Z2d+d,Z3d-d.Z4dRd/d0Z5d1d2Z6d3d4Z7d5d6Z8e9e!egoe Z:d7d8Z;Gd9d:d:ej<Z=Gd;d<dGd=d>d>ej<Z?d?d@Z@GdAdBdBZAdCdDZBdSeAdEdFdGZCdTeAdEdJdKZDGdLdMdMeEZFdUeeGdNdOdPZHdS)VN) strtobool)partial)Path)ListUnion)mock)AcceleratorState PartialState) gatheris_bnb_availableis_comet_ml_availableis_datasets_availableis_deepspeed_availableis_mps_availableis_safetensors_availableis_tensorboard_availableis_torch_versionis_tpu_availableis_transformers_availableis_wandb_availableis_xpu_availableFcCsZztj|}Wnty$|}Yn20z t|}Wn"tyTtd|dYn0|S)NzIf set, z must be yes or no.)osenvironKeyErrorr ValueError)keydefaultvalue_valuer f/var/www/html/stable-diffusion-webui/venv/lib/python3.9/site-packages/accelerate/test_utils/testing.pyparse_flag_from_env0s    r"ZRUN_SLOW)rcCstd|S)z+Decorator that skips a test unconditionallyzTest was skipped)unittestskip test_caser r r!r$Csr$cCsttd|S)z Decorator marking a test as slow. Slow tests are skipped by default. Set the RUN_SLOW environment variable to a truthy value to run them. z test is slow)r# skipUnless_run_slow_testsr%r r r!slowHsr)cCsttj d|S)zu Decorator marking a test that must be only ran on the CPU. These tests are skipped when a GPU is available. ztest requires only a CPUr#r'torchcudaZ is_availabler%r r r! require_cpuPsr-cCsttjd|S)zo Decorator marking a test that requires CUDA. These tests are skipped when there are no GPU available. test requires a GPUr*r%r r r! require_cudaWsr/cCsttd|S)zn Decorator marking a test that requires XPU. These tests are skipped when there are no XPU available. test requires a XPU)r#r'rr%r r r! require_xpu^sr1cCsttd|S)z Decorator marking a test that requires MPS backend. These tests are skipped when torch doesn't support `mps` backend. z0test requires a `mps` backend support in `torch`)r#r'rr%r r r! require_mpsesr2cCsttotd|S)zv Decorator marking a test that requires transformers and datasets. These tests are skipped when they are not. z$test requires the Hugging Face suite)r#r'rrr%r r r!require_huggingface_suitems  r3cCsttd|S)zi Decorator marking a test that requires bitsandbytes. These tests are skipped when they are not. z&test requires the bitsandbytes library)r#r'r r%r r r! require_bnbvsr4cCsttd|S)zp Decorator marking a test that requires TPUs. These tests are skipped when there are no TPUs available. ztest requires TPU)r#r'rr%r r r! require_tpu}sr5cCsttjdkd|S)z Decorator marking a test that requires CUDA on a single GPU. These tests are skipped when there are no GPU available or number of GPUs is more than one. r.r#r'r+r, device_countr%r r r!require_single_gpusr9cCsttjdkd|S)z Decorator marking a test that requires CUDA on a single XPU. These tests are skipped when there are no XPU available or number of xPUs is more than one. r6r0r#r'r+Zxpur8r%r r r!require_single_xpusr;cCsttjdkd|S)z Decorator marking a test that requires a multi-GPU setup. These tests are skipped on a machine without multiple GPUs. r6ztest requires multiple GPUsr7r%r r r!require_multi_gpusr<cCsttjdkd|S)z Decorator marking a test that requires a multi-XPU setup. These tests are skipped on a machine without multiple XPUs. r6ztest requires multiple XPUsr:r%r r r!require_multi_xpusr=cCsttd|S)z Decorator marking a test that requires safetensors installed. These tests are skipped when safetensors isn't installed ztest requires safetensors)r#r'rr%r r r!require_safetensorssr>cCsttd|S)z| Decorator marking a test that requires DeepSpeed installed. These tests are skipped when DeepSpeed isn't installed ztest requires DeepSpeed)r#r'rr%r r r!require_deepspeedsr?cCsttddd|S)zr Decorator marking a test that requires FSDP installed. These tests are skipped when FSDP isn't installed >=z1.12.0z%test requires torch version >= 1.12.0)r#r'rr%r r r! require_fsdpsrAcCs0|durtt|dSttd|d||S)z Decorator marking that a test requires a particular torch version to be tested. These tests are skipped when an installed torch version is less than the required one. N)versionr@ztest requires torch version >= )rrequire_torch_min_versionr#r'r)r&rBr r r!rCs rCcCsttd|S)z Decorator marking a test that requires tensorboard installed. These tests are skipped when tensorboard isn't installed ztest requires Tensorboard)r#r'rr%r r r!require_tensorboardsrDcCsttd|S)zt Decorator marking a test that requires wandb installed. These tests are skipped when wandb isn't installed ztest requires wandb)r#r'rr%r r r! require_wandbsrEcCsttd|S)zz Decorator marking a test that requires comet_ml installed. These tests are skipped when comet_ml isn't installed ztest requires comet_ml)r#r'r r%r r r!require_comet_mlsrFcCsttd|S)z Decorator marking that a test requires at least one tracking library installed. These tests are skipped when none are installed zYtest requires at least one tracker to be available and for `comet_ml` to not be installed)r#r'_atleast_one_tracker_availabler%r r r!require_trackerss rHc@s4eZdZdZdZeddZeddZddZd S) TempDirTestCasea A TestCase class that keeps a single `tempfile.TemporaryDirectory` open for the duration of the class, wipes its data at the start of a test, and then destroyes it at the end of the TestCase. Useful for when a class or API requires a single constant folder throughout it's use, such as Weights and Biases The temporary directory location will be stored in `self.tmpdir` TcCst|_dS)zECreates a `tempfile.TemporaryDirectory` and stores it in `cls.tmpdir`N)tempfilemkdtemptmpdirclsr r r! setUpClassszTempDirTestCase.setUpClasscCstj|jrt|jdS)z1Remove `cls.tmpdir` after test suite has finishedN)rpathexistsrLshutilrmtreerMr r r! tearDownClassszTempDirTestCase.tearDownClasscCsD|jr@t|jdD](}|r,|q|rt|qdS)zt|ttfr|n|g|_|jD]}|||jq dS)aQ Add custom mocks for tests that should be repeated on each test. Should be called during `MockingTestCase.setUp`, after `super().setUp()`. Args: mocks (`mock.Mock` or list of `mock.Mock`): Mocks that should be added to the `TestCase` after `TestCase.setUpClass` has been run N) isinstancetuplelistristartZ addCleanupstop)rZrimr r r! add_mocks+s  zMockingTestCase.add_mocksN) r\r]r^r_rrZMockrrpr r r r!rhsrhcCs`t}|d|j}t|}|d}t|jdD]}t |||s@dSq@dS)NrFT) r clonetoZdevicer cpurangeshaper+equal)ZtensorstateZtensorsir r r!are_the_same_tensors:s  ryc@seZdZddZdS) _RunOutputcCs||_||_||_dSrb) returncodestdoutstderr)rZr{r|r}r r r!__init__Fsz_RunOutput.__init__N)r\r]r^r~r r r r!rzEsrzcs$|IdH}|r ||qq qdSrb)readline)streamcallbackliner r r! _read_streamLs r)returnc s|rtdd|tj|dg|ddR|tjjtjj|dIdH}ggd fdd tjtt|j fd d tt|j fd d g|d IdHt |IdHS)Nz Running:  rr6)stdinr|r}envcs.|d}||s*t|||ddS)Nutf-8)file)decoderstripappendprint)rZsinkpipelabel)quietr r!teems z_stream_subprocess..teecs|tjddS)Nzstdout:r)sysr|l)outrr r!vz$_stream_subprocess..cs|tjddS)Nzstderr:r)rr}r)errrr r!rwr)timeout)r) rjoinasyncioZcreate_subprocess_exec subprocessPIPEwaitZ create_taskrr|r}rz)cmdrrrrechopr )rrrrr!_stream_subprocessUs,  rTc Csbt}|t||||||d}d|}|jdkr^d|j} td|d|jd| |S)N)rrrrrrr 'z' failed with returncode z, The combined stderr from workers follows: )rZget_event_loopZrun_until_completerrr{r} RuntimeError) rrrrrrZloopresultZcmd_strr}r r r!execute_subprocess_async~s   rc@s eZdZdS)SubprocessCallExceptionN)r\r]r^r r r r!rsr)commandc Csz2tj|tjd}|r0t|dr*|d}|WSWnHtjyz}z.tdd|d|j|WYd}~n d}~00dS)z Runs `command` with `subprocess.check_output` and will potentially return the `stdout`. Will also properly capture if an error occured while running `command` )r}rrz Command `rz$` failed with the following error: N) r check_outputSTDOUThasattrrCalledProcessErrorrroutput)rZ return_stdoutrer r r! run_commands   r)F)NN)NNNFF)NNrFT)F)IrrrRrrrJr#distutils.utilr functoolsrpathlibrtypingrrrr+rwr r utilsr r r rrrrrrrrrrr"r(r$r)r-r/r1r2r3r4r5r9r;r<r=r>r?rArCrDrErFanyrGrHZTestCaserIrarhryrzrrr Exceptionrstrrr r r r!sb    <     !!  )