Requirements

• Strong experience with FastAPI (or equivalent async frameworks), including dependency injection, UV, Pydantic, and async/await patterns (including thread pool executors for blocking operations).
• Solid understanding of REST API design, including multi-tenancy, pagination, filtering, JWT/OAuth2 authentication, and structured error handling.
• Proficiency in SQLAlchemy (including async sessions), raw parameterized queries, schema design, and migrations.
• Hands-on experience integrating multiple LLM providers (e.g., OpenAI, Anthropic, AWS Bedrock, Ollama, Google Gemini, Snowflake Cortex) using provider abstraction layers.
• Experience with JSON response validation, markdown/code-block extraction, and fallback error handling (preferably using frameworks like Pydantic).
• Knowledge of prompt engineering techniques, including context injection, temperature/token tuning, and confidence scoring.
• Familiarity with emb...