𝗧𝗵𝗶𝘀 𝗿𝗼𝗹𝗲 𝗶𝘀 𝗳𝗼𝗿 𝗼𝗻𝗲 𝗼𝗳 𝘁𝗵𝗲 𝗪𝗲𝗲𝗸𝗱𝗮𝘆'𝘀 𝗰𝗹𝗶𝗲𝗻𝘁𝘀
𝗦𝗮𝗹𝗮𝗿𝘆 𝗿𝗮𝗻𝗴𝗲: 𝗥𝘀 𝟯𝟱𝟬𝟬𝟬𝟬𝟬 - 𝗥𝘀 𝟱𝟬𝟬𝟬𝟬𝟬𝟬 (𝗶𝗲 𝗜𝗡𝗥 𝟯𝟱-𝟱𝟬 𝗟𝗣𝗔)
Experience: 5+ yrs
Location: Bengaluru, Karnataka, India
Job Type: Full-time
We are seeking a highly skilled Senior Software Engineer – Backend to design, build, and scale next-generation AI platform services that power enterprise-grade intelligent applications. This role is ideal for engineers with strong expertise in Java, cloud-native microservices, distributed systems, and AI platform architecture, along with hands-on experience integrating Large Language Models (LLMs), agent orchestration frameworks, and modern backend technologies.
As a senior member of the engineering team, you will own the development of scalable backend services, AI gateways, and orchestration frameworks while collaborating with cross-functional teams to deliver secure, reliable, and high-performance solutions. The role demands strong technical leadership, excellent problem-solving skills, and a passion for building production-ready AI-powered platforms.
Requirements
Key Responsibilities
- Design, develop, and maintain production-grade backend services for AI platforms, including LLM gateways, model integration services, and agent orchestration frameworks.
- Build scalable cloud-native microservices using Java, Spring Boot, Kafka, and modern distributed system design principles.
- Architect and implement AI gateway capabilities such as multi-provider model routing, intelligent failover, token management, cost optimization, request logging, and observability.
- Develop infrastructure supporting Model Context Protocol (MCP), tool integration, and intelligent agent workflows.
- Design and implement multi-step AI reasoning workflows, tool orchestration, guardrails, and human-in-the-loop processes for enterprise AI applications.
- Take end-to-end ownership of critical backend components, ensuring scalability, security, reliability, and maintainability.
- Diagnose and resolve complex performance bottlenecks across backend services, AI inference layers, and distributed architectures.
- Collaborate with Product, AI/ML, QA, UX, and Engineering teams to design and deliver high-quality software solutions.
- Mentor junior engineers through technical guidance, code reviews, architecture discussions, and engineering best practices.
- Promote software quality through clean code, automated testing, performance optimization, and continuous improvement initiatives.
What Makes You a Great Fit
- 5+ years of professional experience in backend software engineering with strong expertise in Java and object-oriented programming.
- Proven experience building and scaling cloud-native microservices and enterprise backend applications using Spring Boot, Kafka, and distributed architectures.
- Strong understanding of relational and NoSQL databases, including MySQL, MongoDB, and modern data management practices.
- Experience developing enterprise-scale applications with strong knowledge of performance tuning, debugging, monitoring, and backend optimization.
- Hands-on experience with cloud platforms such as AWS and familiarity with observability tools, logging frameworks, and monitoring solutions.
- Solid understanding of Large Language Models (LLMs), AI platform architecture, and intelligent application development.
- Experience or strong knowledge of Model Context Protocol (MCP), AI gateways, multi-model routing, semantic caching, and AI service orchestration.
- Familiarity with agentic AI frameworks such as LangChain, LangGraph, LlamaIndex, CrewAI, OpenAI Agents SDK, or similar orchestration technologies.
- Understanding of AI observability, evaluation techniques, prompt execution monitoring, AI safety practices, content filtering, and hallucination mitigation.
- Excellent analytical thinking, communication, mentoring, and collaboration skills with the ability to thrive in a fast-paced engineering environment while delivering high-quality, production-ready solutions.
Sign in
To continue your applicationor continue with email
By continuing you agree to our Terms & Privacy Policy.
