Pretty much what the title says, I have a single MAR file that I generated for my model. Is there a way that I can run multiple instances of that same model with TorchServe?
I have tried duplicating the MAR file I got, but I got an error saying there is the same version of the model that is running already which means that the first file was loaded. I'm assuming I would have to regenerate the MAR file again with the same files. I'm trying to avoid that for storage reasons.
source https://stackoverflow.com/questions/77251118/running-multiple-instances-of-the-same-model-on-torchserve
Comments
Post a Comment