The Role
We are looking for a Senior Software Engineer to join the DIAL (Data Integration & Analytics Layer) team, responsible for building scalable, high-performance enterprise applications that power data preprocessing, observability, and data product pipelines. The role involves designing and developing API-driven platforms using FastAPI, integrating with Azure data services, and contributing to reliable, observable, and production-grade data systems.
Key Responsibilities
- Design and develop high-performance backend services using FastAPI, Pydantic, and SQLAlchemy
- Build and maintain API-driven data processing and orchestration frameworks within DIAL
- Implement asynchronous and concurrent processing using Python (asyncio) for scalable workloads
- Integrate with Azure services such as ADLS, ADF, Databricks, and related data platforms
- Develop robust data models, validation layers, and persistence mechanisms
- Ensure observability, logging, and monitoring for enterprise-grade applications
- Write unit and integration tests using Pytest to ensure code quality and reliability
- Collaborate with data engineers, architects, and product owners to deliver end-to-end solutions
- Participate in code reviews, design discussions, and performance optimization initiatives
- Contribute to CI/CD pipelines and containerized deployments
Core Engineering
- Strong experience in Python backend development
- Hands‑on experience with FastAPI, Pydantic, SQLAlchemy
- Good understanding of REST API design and microservices architecture
Cloud & Data Platforms
- Experience working with Microsoft Azure
- Familiarity with ADLS (Azure Data Lake Storage), Azure Data Factory / Databricks (preferred)
Concurrency & Performance
- Working knowledge of Python Asyncio
- Understanding of high‑throughput and low‑latency system design
Testing
- Practical experience with Pytest
- Experience in unit, integration, and API testing
DevOps & Deployment
- Experience with containerization (Docker / Kubernetes)
- Familiarity with CI/CD practices
Preferred Technical And Professional Experience
- Experience with performance testing and tuning
- Knowledge of Terraform / Infrastructure as Code (IaC)
- Exposure to observability frameworks (OpenTelemetry, logging, tracing)
- Experience in data engineering or data platform ecosystems
Soft Skills
- Strong problem‑solving and analytical thinking
- Ability to work in cross‑functional teams (engineering, product, operations)
- Good communication skills for enterprise stakeholder interactions
- Ownership mindset with focus on delivery and reliability
#J-18808-Ljbffr