Overview
ai-job-gateway is a self-hostable, provider-agnostic server and Python client that implements an asynchronous job contract for generative AI tasks. It allows users to submit a job, receive an ID immediately, and then poll for results or receive a webhook when the job completes. The server is built with FastAPI and supports both in-memory and SQLite job stores. It includes a pluggable Provider interface for integrating custom backends, and ships with demo providers like echo and mock-generate, as well as real providers for image generation and local media processing. The project is designed as a reference implementation of a common API shape used by services like fal.ai and RunPod, focusing on the submit/poll/webhook pattern. It is not intended for multi-tenant public use due to limitations such as a single shared API key and no rate limiting.
Pricing
Free
Detailed plans have not been confirmed in our catalog. Check the official website for current limits and billing terms.
Visit WebsitePrices and limits may change. Confirm the currency, billing period, seat minimum and usage caps on the official website.
Use Cases
- Developers use ai-job-gateway to wrap slow generative backends (e.g., image, video, lip-sync) behind an HTTP API with a submit/poll/webhook contract.
- Teams use ai-job-gateway as a reference implementation for the async job contract to understand or replicate the pattern.
- Users can submit jobs via the command-line interface using the provided client.
- Developers can write custom providers to integrate their own models or services.
- Teams can run the server with SQLite persistence for job storage.
- Users can enable local media processing capabilities by installing the media extra.
- Developers can use the Python client to submit and poll jobs programmatically.
Features
Submit asynchronous generative AI jobs
Receive job identifiers immediately
Poll endpoints for job results
Deliver completion through webhooks
Prevent duplicate jobs with idempotency keys
Use a provider agnostic Python client
Reviews
No reviews yet. Be the first to share your experience!