Senior Java Backend Developer – AI Integration

Full-time

Role

Java Backend Developer (JAVA + AI)

Location

Toronto, ON – Hybrid (4 Days WFO)

Duration

6–12 Months

Key Responsibilities

Design, develop, and maintain high performance backend services using Java (17+), Spring Boot, and Microservices architecture.
Build and expose RESTful and event driven APIs supporting enterprise scale applications.
Integrate Generative AI / LLM capabilities (e.g., text generation, summarization, Q&A, classification) into backend workflows.
Design, test, and optimize prompts and prompt orchestration strategies to ensure accuracy, determinism, and performance.
Develop AI aware backend components such as:
- Prompt templates and prompt pipelines
- Retrieval Augmented Generation (RAG) services
- AI inference orchestration layers
Implement secure API integrations with AI platforms and internal data sources, ensuring compliance with enterprise security standards.
Apply prompt versioning, evaluation, and monitoring techniques to improve AI output quality over time.
Ensure non functional requirements: scalability, resiliency, performance, and observability.
Contribute to CI/CD pipelines, containerization, and cloud native deployments.
Participate in code reviews, architecture discussions, and technical design decisions.
Support production systems and troubleshoot complex backend or AI integration issues.

Required Technical Skills

Core Backend Engineering

5+ years of strong hands on experience in Java backend development.
Expertise in Java 11/17+, Spring Boot, Spring MVC, Spring Security.
Solid experience in Microservices, REST APIs, and API design (OpenAPI/Swagger).
Experience with containers and cloud platforms (Docker, Kubernetes, OpenShift, Azure/AWS).
Strong knowledge of SQL and NoSQL databases (e.g., DB2, PostgreSQL, MongoDB).
Experience in CI/CD, DevOps practices, and automated testing.

AI & Prompt Engineering

Hands on experience integrating Large Language Models (LLMs) into backend systems.
Strong understanding of prompt engineering techniques, including:
- Zero shot, few shot, and chain of thought prompting
- Prompt templates and dynamic prompt generation
- Guardrails, validation, and hallucination reduction
Experience building RAG based solutions using vector stores and embeddings.
Familiarity with AI orchestration frameworks or SDKs (enterprise or open source).
Ability to evaluate prompt and model responses for quality, bias, and consistency.

Security & Compliance

Experience implementing OAuth2.0, JWT, SSL/TLS, and secure API patterns.
Awareness of data privacy, PII handling, and AI governance in regulated environments (BFSI preferred).