Senior AI Software Engineer (Java/Python + LLMs)

Job Title: Senior AI Software Engineer (Java/Python + LLMs)

Location: San Jose, CA (Hybrid)

Employment Type: Contract to hire

Rate: $75/hr W2

Interview Mode: Face to Face

What you'll do:

Design, build, and own backend microservices in Java and Python running on AWS.
Architect scalable, fault-tolerant distributed systems with clean service boundaries and well-designed APIs.
Build and maintain robust CI/CD pipelines — automated testing, deployment, observability, rollback strategies.
Integrate AI/ML capabilities (LLMs, model APIs, RAG, embeddings, etc.) into product features and backend services.
Operate services end-to-end on AWS — compute, networking, storage, IAM, monitoring, cost management.
Stay current on the rapidly evolving AI landscape and bring relevant advances into the stack.
Collaborate cross-functionally with product, ML, and platform teams during ramp-up.

Required qualifications:

6–9 years of professional software engineering experience.
Strong production experience in both Java and Python (Spring Boot, FastAPI/Flask, or equivalent).
Proven track record designing and operating microservices architectures in production.
Deep AWS expertise — EKS/ECS, Lambda, API Gateway, RDS/DynamoDB, S3, SQS/SNS, CloudWatch, IAM.
Hands-on CI/CD experience — Jenkins, GitHub Actions, GitLab CI, AWS CodePipeline, or similar; IaC with Terraform or CloudFormation.
Practical AI/ML integration experience — working with LLM APIs (OpenAI, Anthropic, Bedrock), RAG pipelines, vector databases, or embedding-based features in production.
Strong fundamentals: distributed systems, API design, testing strategy, observability, security.
Working knowledge of current AI/LLM trends — you can speak fluently to what's changed in the last 6 months.