Job Description Purpose of the role To drive technical excellence and innovation by leading the design and implementation of robust software solutions, providing mentorship to engineering teams, fostering cross-functional collaboration, and contributing to strategic planning to
Responsibilities: Architect and build scalable, fault-tolerant data pipelines using Apache Spark (Java) Lead design of batch and streaming ETL/ELT systems handling large data volumes Deep-dive performance tuning: partitioning strategy, memory management, shuffle/skew optimization, job cost reduction Set