a d@s@ddlmZddlmZdgZdejeeeedddZdS))nn)Listpartition_modelN)modulebalancedevicesc Cszd}d}g}|D]^}g}t|D]}||||d7}q |durH|n||} |tj|| |d7}qtj|S)a, Given an :class:`nn.Sequential ` module, partitions the model across multiple GPU devices according the provided ``balance`` and ``devices``. Args: module (:class:`nn.Sequential `): Sequential model representing the pipe. balance (List[int]): List indicating the number of layers in each partition. devices (List[int], optional): List indicating the device to use for each partition. Defaults to ``range(len(balance))`` rN)rangeappendr Sequentialto) rrrZ device_idxZpipe_idxZ balanced_pipeZ num_layersZlayersiZdevicern/var/www/html/stable-diffusion-webui/venv/lib/python3.9/site-packages/torch/distributed/pipeline/sync/utils.pyrs   )N)Ztorchrtypingr__all__r intrrrrrs