Experience: - 10+ Years
Location: - Remote
As a Senior Python Data Engineer with 10+ years of experience in Data Engineering, Data Warehousing, Cloud Data Platforms, API Development, and Data Modernization. The ideal candidate will have extensive experience in Enterprise Data Warehouse (EDW) migration projects, building scalable data pipelines, ingesting and transforming large datasets into Snowflake, and developing data services and APIs that enable enterprise-wide data consumption. The candidate should possess strong expertise in Python, Apache Spark, Scala, Snowflake, REST APIs, and Cloud Data Engineering, along with deep healthcare payer domain knowledge. The role requires hands-on technical leadership, active participation in architecture and design discussions, client engagement, work allocation, mentoring team members, and delivering high-quality, scalable data solutions.
Responsibilities: -
Design, develop, and maintain scalable data ingestion, transformation, and processing pipelines.
Build enterprise-grade ETL/ELT frameworks using Python, Spark, and Snowflake.
Develop reusable data engineering components and automation frameworks.
Handle structured, semi-structured, and unstructured data processing workloads.
Implement data cleansing, enrichment, standardization, and validation frameworks.
Optimize data processing pipelines for performance, scalability, and reliability.
Support batch and near real-time data processing requirements. Enterprise Data Warehouse Migration & Modernization
- Participate in large-scale migration initiatives from legacy EDW platforms to Snowflake.
- Analyze source systems, data models, ETL processes, and reporting structures.
Support migrations from: -
Teradata
Netezza.
Oracle.
SQL Server.
Hadoop.
Other Enterprise Data Warehouses.
Develop source-to-target mappings and transformation logic.
Implement migration validation and reconciliation processes.
Ensure high-quality data migration with minimal business disruption. Snowflake Data Engineering
Design and develop Snowflake-based data solutions.
Build scalable ingestion frameworks into Snowflake.
Develop and optimize:
Snowflake Data Pipelines
Data Warehouses
Data Marts
Data Sharing Solutions
Secure Data Access Layers
Work with Snowflake features including:
Snowpipe
Streams & Tasks
Time Travel
Clustering
Secure Views.
Data Sharing
Zero-Copy Cloning
Optimize Snowflake performance, storage, and compute utilization.
Python Development
Develop high-performance data processing applications using Python.
Create reusable libraries, frameworks, and utilities.
Build automation tools supporting migration and operational activities.
Implement data validation and reconciliation utilities.
Develop unit testing frameworks and code quality checks.
Follow secure coding standards and engineering best practices.
Spark & Scala Development
Develop distributed data processing solutions using Apache Spark.
Create high-performance transformations using:
Spark SQL
PySpark
Scala
Optimize Spark workloads for large-scale healthcare datasets.
Troubleshoot complex performance bottlenecks.
Implement partitioning, caching, and optimization strategies.
Support batch and streaming data processing workloads. API Development & Integration.
Design, develop, and maintain RESTful APIs and microservices.
Build APIs supporting:
Data Access
Data Exchange o Provider Integrations o Claims Data Services o Analytics Services
Implement API security, authentication, and authorization controls.
Manage API versioning and lifecycle management.
Collaborate with application and integration teams to support enterprise-wide data consumption requirements. Healthcare Payer Data Expertise Develop and support solutions across: Membership & Enrollment.
Member Demographics.
Eligibility .
Enrollment Data.
Coverage Information Claims Processing.
Medical Claims.
Institutional Claims.
Professional Claims.
Claims Adjudication Data Provider Management.
Provider Networks.
Provider Master Data .
Provider Contracts Care Management .
Case Management
Utilization Management Regulatory & Quality Reporting .
HEDIS .
STAR Ratings
Risk Adjustment
CMS Reporting
Value-Based Care Programs Pharmacy & Clinical Data
Pharmacy Claims
Clinical Quality Data
Medication Adherence Metrics Architecture & Design Participation
Participate actively in solution architecture and design discussions.
Collaborate with Architects and Tech Leads on technical approaches.
Review design specifications and recommend improvements.
Contribute to data architecture, integration patterns, and engineering standards.
Educational Qualifications: -
- Engineering Degree BE/ME/BTech/MTech/BSc/MSc.
Technical certification in multiple technologies is desirable.
Sign in
To continue your applicationor continue with email
By continuing you agree to our Terms & Privacy Policy.
