Senior Python Data Engineer (AI-Assisted Data Migration)
We are looking for a Senior Python Data Engineer to support the migration of legacy SAS-based ETL processes to a modern Python data platform using Parquet, PyArrow, Pandas, Polars, and Apache Spark. You will play a key role in developing AI-assisted migration solutions, optimizing agent-driven workflows, and ensuring high-quality, scalable data transformation processes.
Key Responsibilities
- Design, develop, and validate Python-based ETL and data transformation solutions.
- Review and optimize AI-generated Python code for performance, quality, and maintainability.
- Build and enhance data pipelines using Pandas, Polars, PyArrow, Parquet, and PySpark.
- Improve ETL/ELT processes, data quality, schema management, and performance.
- Contribute to AI-assisted software development and multi-agent orchestration workflows.
- Enhance workflow automation, validation processes, and human-in-the-loop quality assurance.
- Collaborate with architects, data engineers, and SAS experts to support complex migration scenarios.
- Ensure robust testing, documentation, and operational reliability of migration solutions.
Required Skills & Experience
- 5+ years of experience in Python Data Engineering.
- Strong expertise in Python, Pandas, Polars, PyArrow, Parquet, Apache Spark/PySpark, and Python performance tuning.
- Experience with ETL/ELT, data engineering, data quality, schema management, and testing frameworks.
- Experience using AI-assisted development tools (e.g., GitHub Copilot or similar).
- Knowledge of agentic workflows, multi-agent systems, workflow orchestration, and AI-driven automation.
- Familiarity with SAS Base (DATA Step, PROC SQL, Macros, ETL patterns) is a strong advantage.
Languages
- Active knowledge of Dutch, French, and English.
Location
- Brussels, Belgium
- Hybrid working model.