How to debug a bentoml app like fastapi flavor?

[decadance-dance]

To debug the fast api application we just need to set breakpoints somewhere in code and run app using uvicorn sdk:

import uvicorn
from some_module import fastapi_app


if __name__ == "__main__":
    uvicorn.run(fastapi_app, host="0.0.0.0", port=3001)

How I can achieve the same flow using the bentoml?

[decadance-dance]

I think I answered it.
There is a way to do:

import uvicorn
from service import svc

if __name__ == "__main__":
    uvicorn.run(svc.asgi_app, host="0.0.0.0", port=3001)

[adrian-arapiles]

Is there any workaround to use with new @bentoml.service annotation?

Thanks in advance.

[darkopetrovic]

This way:

import uvicorn
from bentoml._internal.service.loader import load

if __name__ == "__main__":
  svc = load(bento_identifier='my-bento:latest')
  uvicorn.run(svc.to_asgi(), host="0.0.0.0", port=3001)

The service.py file used to create the bento will be debuggable with breakpoints.