
Senior Software Engineer
- Lisboa
- Permanente
- Horário completo
- Build and maintain an orchestration layer for LLM-powered applications.
- Implement adapters to allow seamless switching between model providers (OpenAI, Anthropic, AWS Bedrock, Azure, etc.).
- Integrate Langfuse for tracing, observability, cost monitoring, and feedback loops.
- Design and develop monitoring dashboards and alerts for LLM usage (latency, cost, quality, errors).
- Enable prompt versioning, structured logging, and experiment tracking.
- Work closely with product and application teams to ensure scalability, reliability, and cost efficiency of LLM services.
- Ensure all LLM integrations follow security and compliance best practices.
- Strong proficiency in Python (Node.js/TypeScript familiarity is a plus).
- Knowledge of LLMOps practices: logging, monitoring, evaluation metrics, and feedback loops.
- Strong understanding of APIs, microservices, and distributed systems.
- Experience with AWS Bedrock or other managed LLM providers is a plus.
- Hands-on experience with LangChain (chains, agents, tools, memory, RAG pipelines) is desired.
- Familiarity with LiteLLM or similar framework for model abstraction and provider integrations is beneficial.
- Experience with vector databases (Pinecone, Weaviate, FAISS, OpenSearch) and RAG pipelines is valued.
- Due to client contractual obligations, the successful candidate will be asked to clear a background check and drug test upon hire.
- Flexible Time-Off
- Comprehensive Health, Dental and Vision benefits
- 401(k) with employee sponsored match
- Bi-Weekly Meeting Free Days
- Mentoring Programs
- Globally recognized Training and Development programs
- Tuition Reimbursement, Time off to Volunteer, Charitable Giving Match, and more!
Qualifications