a d@sTUddlmZmZddlmZgZeeed<eeeeeeeefdddZ dS))ListTuple) ShardMetadata__all__) saved_shard current_shardreturnc Csg}tt|j|j|j|jD]d\}\}}}}t||||}|t||} ||krdd} ||} n ||} d} ||| | | fq|S)aZ Return the overlapping region between saved_shard and current_shard. There returned list has the same number of elements as the tensor's dimension. For each element, we produce a tuple with the following contents: (dimension, `saved_shard` offset, `current_shard` offset, length) Offsets are relative to each shard. r) enumeratezipZ shard_offsetsZ shard_sizesminmaxappend) rrZnarrowsZdimZsaved_shard_offsetZcurrent_shard_offsetZsaved_shard_sizeZcurrent_shard_sizeZ min_range_endlengthZoffset_for_saved_tensorZoffset_for_current_tensorrp/var/www/html/stable-diffusion-webui/venv/lib/python3.9/site-packages/torch/distributed/checkpoint/resharding.py+_shards_get_overlap_region_wrt_saved_tensor s:    rN) typingrrZ&torch.distributed._shard.sharding_specrrstr__annotations__intrrrrrs