Who we are
Artmac Soft is a technology consulting and service-oriented IT company dedicated to providing innovative technology solutions and services to customers.
Job Description:
Job Title : Senior Azure Data Engineer (Python, SQL)
Job Type : W2/C2C
Experience : 8-15 years
Location : Plano, Texas
Responsibilities:
- 8+ years of experience in data engineering, cloud data engineering, or related roles.
- Strong programming experience with Python.
- Advanced SQL skills, including complex queries, joins, CTEs, window functions, optimization, and data transformations.
- Strong experience designing and developing ETL/ELT pipelines.
- Hands-on experience with cloud-based data engineering platforms.
- Experience working with REST APIs, JSON, and API-based data integration.
- Experience with relational and cloud databases.
- Experience with one or more of: Snowflake, Databricks, Google BigQuery, and Azure Data Factory (ADF).
- Strong understanding of data ingestion, transformation, integration, and orchestration.
- Strong understanding of data quality, validation, reconciliation, and error handling.
- Knowledge of data warehousing concepts, dimensional modeling, and data architecture.
- Strong troubleshooting, analytical, and problem-solving skills.
- Cloud Data Engineer Certification is preferred.
- Design, develop, and maintain scalable ETL/ELT data pipelines for batch and real-time data processing.
- Develop robust data engineering solutions using Python and SQL.
- Implement data transformation, cleansing, validation, and enrichment processes.
- Work with platforms such as Snowflake, Databricks, BigQuery, and Azure Data Factory (ADF).
- Develop reusable frameworks and components for data ingestion and transformation.
- Implement data quality checks, validation rules, monitoring, and exception handling.
- Troubleshoot pipeline failures, data issues, performance bottlenecks, and production incidents.
- Work with cross-functional teams to translate business requirements into technical data solutions.