a þd³ ã@sDddlmZmZmZmZddlZddlmZGdd„dejjƒZ dS)é)ÚAnyÚCallableÚDictÚTupleN)ÚTensorc@s|eZdZdZeeefdœdd„Zeeee feee ffdœdd„Z e e eee fdœdd „Z eeefdœd d „Z d S) ÚServableModuleaXThe ServableModule provides a simple API to make your model servable. .. warning:: This is currently an experimental feature and API changes are to be expected. Here is an example of how to use the ``ServableModule`` module. .. code-block:: python from typing import Dict, Any, Callable import torch from pytorch_lightning import Trainer from pytorch_lightning.demos.boring_classes import BoringModel from pytorch_lightning.serve.servable_module_validator import ServableModule, ServableModuleValidator class ServableBoringModel(BoringModel, ServableModule): def configure_payload(self) -> Dict[str, Any]: return {"body": {"x": list(range(32))}} def configure_serialization(self) -> Tuple[Dict[str, Callable], Dict[str, Callable]]: def deserialize(x): return torch.tensor(x, dtype=torch.float) def serialize(x): return x.tolist() return {"x": deserialize}, {"output": serialize} def serve_step(self, x: torch.Tensor) -> Dict[str, torch.Tensor]: return {"output": torch.tensor([0, 1])} def configure_response(self): return {"output": [0, 1]} serve_cb = ServableModuleValidator() trainer = Trainer( max_epochs=1, limit_train_batches=2, limit_val_batches=0, callbacks=[serve_cb], ) trainer.fit(ServableBoringModel()) assert serve_cb.resp.json() == {"output": [0, 1]} )ÚreturncCsdS)z*Returns a request payload as a dictionary.N©©Úselfr r úp/var/www/html/stable-diffusion-webui/venv/lib/python3.9/site-packages/pytorch_lightning/serve/servable_module.pyÚconfigure_payload;sz ServableModule.configure_payloadcCsdS)aÂReturns a tuple of dictionaries. The first dictionary contains the name of the ``serve_step`` input variables name as its keys and the associated de-serialization function (e.g function to convert a payload to tensors). The second dictionary contains the name of the ``serve_step`` output variables name as its keys and the associated serialization function (e.g function to convert a tensors into payload). Nr r r r r Úconfigure_serialization?s z&ServableModule.configure_serialization)ÚargsÚkwargsrcOsdS)a0 Returns the predictions of your model as a dictionary. .. code-block:: python def serve_step(self, x: torch.Tensor) -> Dict[str, torch.Tensor]: return {"predictions": self(x)} Args: args: The output from de-serializer functions provided by the ``configure_serialization`` hook. kwargs: The keyword output of the de-serializer functions provided by the ``configure_serialization`` hook. Return: - ``dict`` - A dictionary with their associated tensors. Nr )r rrr r r Ú serve_stepJszServableModule.serve_stepcCsdS)z3Returns a response to validate the server response.Nr r r r r Úconfigure_response\sz!ServableModule.configure_responseN)Ú__name__Ú __module__Ú __qualname__Ú__doc__rÚstrrr rrrrrrr r r r rs 2& r) ÚtypingrrrrZtorchrÚnnÚModulerr r r r Ús