About SPAN Digital
We're a premium software consultancy partnering with startups to global brands in tech, fintech, and digital media. We build category‐defining products and help engineering teams deliver exceptional digital solutions across three continents. Join our expert team executing critical enterprise data retention, migration, and privacy enhancement projects at petabyte scale. This role combines robust software engineering capabilities with technical leadership; you'll design production‐quality solutions while mentoring teams and driving complex data initiatives from concept to deployment.
8+ years data/software engineering | 4‐7 years technical leadership
Data Engineering & Migration Leadership
Design and implement large‐scale data migration strategies for identity transformation across multi‐petabyte datasets
Build comprehensive data lineage mapping and validation systems ensuring migration accuracy and data integrity
Develop scalable data transformation solutions supporting batch and streaming processing with parallel pipeline orchestration
Execute JDK and Apache Spark upgrades while maintaining production stability
Implement advanced monitoring and observability for data pipeline performance and system health tracking
Create testing and validation frameworks for complex migration scenarios
Provide technical leadership for data migration initiatives, taking ownership of critical system components
Lead technical design discussions for complex data migrations meeting enterprise requirements
Demonstrate deep expertise across the full data engineering lifecycle—from migration planning through operational support
Collaborate effectively with stakeholders across disciplines to ensure alignment and project success
Minimum 8 years in data engineering or related engineering roles
Bachelor's/Master's in Computer Science, Engineering, or equivalent experience
Proven expertise in large‐scale data migration and ETL pipeline development
Advanced proficiency in Scala and Java with modern build systems (Gradle or Maven)
Deep experience with Apache Spark and distributed file systems (HDFS) or cloud object storage (S3, GCS)
Production experience with cloud data platforms (AWS, GCP, Azure, or Databricks)
Hands‐on AWS EKS (Kubernetes) for containerized data processing environments
Understanding of data privacy, security, and compliance requirements (GDPR experience preferred)
Strong knowledge of data structures, algorithms, and distributed systems design
Data lineage analysis, dependency mapping, and validation frameworks
Modern data formats: Apache Iceberg, Parquet, ORC, Avro
Apache Kafka or AWS Kinesis
Prometheus, Grafana, Spark UI
This role requires expertise across technical and leadership areas including Software Design, Programming/Software Development, Testing, Solution Architecture, Requirements Management, Release and Deployment, and Technology Monitoring. Why SPAN Digital
Work on cutting‐edge data engineering projects at petabyte scale
Professional development with clear career progression paths
Flexible work arrangements across our offices
Access to latest technologies and tools in data engineering and cloud platforms
If you're passionate about large‐scale data engineering, technical leadership, and delivering world‐class solutions, we'd love to hear from you.
Prepare examples of your data engineering leadership experience
Sign in
To continue your applicationor continue with email
By continuing you agree to our Terms & Privacy Policy.
