Senior DevOps/ MLOps Engineer

VINFAST is a pioneering electric vehicle (EV) company committed to revolutionizing the automotive industry with sustainable and innovative mobility solutions. As a leading player in the EV market, VinFast is dedicated to delivering high-quality, cutting-edge electric vehicles that redefine the driving experience. Our team consists of passionate professionals driven by a shared vision of creating a greener and more sustainable future through innovation, technology, and excellence.

The Speech & Language Processing (SLP) Center – Automotive AI Development Institute , is responsible for researching, developing, and deploying advanced Agentic AI and VoiceAI solutions, applied in vehicles and extended to other group-wide use cases such as robotics and AI assistants.

We're looking for people with relevant experience, passion, and drive — ready to challenge themselves, keep learning, and thrive under high pressure to help build innovative products.

Position Overview: This critical role serves as the backbone of infrastructure execution for Vingroup, directly accelerating the productionization of advanced AI capabilities across the global ecosystem. By architecting scalable MLOps pipelines and optimizing high-performance GPU infrastructure, this position ensures VinFast’s intelligent voice, Agentic AI, and robotics solutions run with maximum efficiency and near-zero latency. The role drives engineering excellence within the AI Model Deployment Department, translating heavy AI models into lean, resilient, and highly available production services. Ultimately, this position safeguards Vingroup’s technological velocity by scaling cutting-edge autonomous and smart solutions globally.

In this role, you will be instrumental in AI Model Deployment Department , using your skills to build, scale, and optimize the core infrastructure that powers our next-generation Agentic AI and VoiceAI systems. As a Senior DevOps/MLOps Engineer, you will own the end-to-end deployment lifecycle, mastering model serving frameworks and advanced GPU compute orchestration. You will be responsible for transforming complex AI architectures into production-ready, ultra-low-latency services running on enterprise cloud and hybrid environments.

You will collaborate with diverse teams, including AI Research Scientists, Technical Project Managers, Embedded Systems Developers, Cloud Architects, and Core Product Teams , to create cutting-edge solutions that will drive the future of transportation.

Model Serving & GPU Optimization

• Design, deploy, and maintain high-performance model serving infrastructures utilizing advanced engines such as vLLM and Triton Inference Server to support Large Language Models (LLMs) and VoiceAI systems.

• Implement deep GPU optimization strategies (e.g., dynamic batching, quantization, tensor parallelism, and memory management) to maximize hardware utilization, minimize time-to-first-token (TTFT), and reduce VRAM overhead.

• Architect auto-scaling policies based on custom metrics (such as concurrent requests, GPU queue time, and VRAM limits) to handle highly fluctuating traffic patterns smoothly.

• Benchmark and profile model inference workloads , identifying infrastructure bottlenecks between compute, memory, and network layers.

Cloud Infrastructure & Platform Engineering

• Build and orchestrate enterprise-grade Kubernetes clusters on AWS using EKS , ensuring robust network routing, service mesh integration, and strict security compliance.

• Develop and maintain Infrastructure as Code (IaC) using tools like Terraform or CloudFormation to ensure reproducible, predictable environments across Dev, Staging, and Production.

• Design CI/CD pipelines optimized for MLOps, automating the automated testing, packaging, and seamless canary/blue-green deployment of both application code and heavy AI weights.
• Establish comprehensive observability frameworks (Prometheus, Grafana, ELK stack, or equivalent) tracking system health, cluster performance, and specialized GPU/model telemetry.

Education & Background

• Bachelor’s degree in Computer Science, Software Engineering, Information Technology, or a related technical discipline.

• AWS Certified DevOps Engineer or Kubernetes certifications (CKA/CKAD) are highly advantageous.

Work Experience

• 5+ years of experience in DevOps, Site Reliability Engineering (SRE), or Infrastructure Engineering.

• 2+ years of hands-on experience specifically in MLOps roles, deploying and maintaining large-scale AI/ML models in production.

• Proven track record of managing production-grade clusters on AWS (EKS) handling high-throughput, low-latency traffic.

Technical Knowledge & Expertise

• In-depth expertise in AWS & EKS : Master of VPC networking, IAM policies, EKS node groups (including GPU-accelerated instances like p4/g5 families), and cluster security.

• Advanced Model Serving : Proficiency in configuring and tuning vLLM and Triton Inference Server for optimal concurrent execution.

• Deep GPU Infrastructure Mastery : Solid understanding of NVIDIA CUDA environments, driver management, multi-instance GPUs (MIG), and hardware-level performance tuning.

• CI/CD & Automation : Strong expertise in modern pipeline engines (GitLab CI, GitHub Actions, or ArgoCD) and container management.

• Scripting & Frameworks : Strong proficiency in Python and Bash for infrastructure automation, workflow orchestration, and tooling development.