Skip to content

[Feature] Non-blocking fastAPI server #183

@tikikun

Description

@tikikun

Issues:
The server is currently blocking, which means that it only took another input after it has finished generated one api call, this is not expected from an api server.

Suggestion:
Maybe enable multi-processing since this is CPU bound.

Metadata

Metadata

Assignees

No one assigned

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions