Principal AI Solution Engineer / Generative AI Engineer (LLM)

Back to Search
Principal AI Solution Engineer
Remote in Belarus, & 5 others
AI Solution Engineering& 12 others
Looking for something else?
Find a vacancy that works for you. Send us your CV to receive a personalized offer.
Find me a job
Choose an option
We are seeking a Principal AI Solution Engineer to join an engineering organization building a sovereign, multi-tenant agentic AI platform, along with the applied products on top of it. Everything ships under strict data residency constraints and operates in both Arabic and English. Squads are small — three senior engineers — and decisions are made in the room. You will work across three layers and need to be credible in all of them: applied AI, AI infrastructure, and the backend platform.
Responsibilities
- Set architecture for systems that span squads; write the decision down and defend it
- Build and tune GPU-based serving — vLLM, TGI or TensorRT-LLM — for latency, throughput and a cost per token you can justify
- Own the reference RAG and agent architecture other teams build against
- Define service boundaries, API contracts, event-driven infrastructure and the SLO work that prevents incidents rather than answering them
- Develop offline and online evaluation and regression detection, so models, prompts and retrieval can change without flying blind
Requirements
- 5+ years of hands-on engineering experience with shipped production systems spanning applied AI, AI infrastructure and backend platforms
- At least 1 year of relevant leadership experience
- Expertise in Python and its production ecosystem, including FastAPI, Pydantic and asyncio
- Proficiency in production RAG end-to-end: ingestion, vector search, reranking and grounding evaluation
- Background in agent orchestration frameworks such as LangGraph, LangChain, OpenAI Agent SDK or Microsoft Agent Framework
- Competency in distributed systems, including idempotency, back-pressure and retry semantics, with strong event-driven architecture skills
- Knowledge of PostgreSQL at scale, along with GPU inference and serving using vLLM, TGI or TensorRT-LLM
- Familiarity with Kubernetes on Azure
- Skills in at least one infrastructure language: Go, Rust, Java or Kotlin
- Capability to use agentic coding tooling as a daily workflow, including project setup with CLAUDE.md, skills and agent configuration
- Excellent command of written and spoken English (B2+ level)
Nice to have
- Showcase of pgvector or Qdrant at production scale
- Experience with Arabic-language, voice or conversational AI
- Background in AI or mission-critical delivery in regulated environments such as government, defence or financial services
- Familiarity with Azure sovereign cloud, Entra ID and Azure OpenAI
- Understanding of Langfuse, Grafana, Prometheus and Terraform