About SPAN DigitalWe're a premium software consulting company with offices in San Francisco, Cape Town, and Guadalajara.
We partner with startups to global brands in tech, fintech, and digital media, building category-defining products and helping engineering teams deliver exceptional digital solutions.It's not about grinding, it's about thriving.We are seeking a Senior Java Engineer with Data Engineering expertise to join our expert team focused on executing critical enterprise data retention, migration, and privacy enhancement projects.
This role combines robust software engineering capabilities with technical leadership skills to deliver production-quality solutions at petabyte scale.As a Senior Engineer, you will design and deliver robust software solutions while providing technical leadership to engineering teams.
You'll combine strong technical capabilities with emerging leadership skills to build production-quality systems that meet our clients' business requirements.Experience Level: 8+ years in data engineering/software engineering with 4-7 years technical leadershipData Engineering & Migration LeadershipDesign and implement large-scale data migration strategies for identity transformation across multi-petabyte datasetsBuild comprehensive data lineage mapping and validation systems to ensure migration accuracy and data integrityDevelop scalable data transformation solutions supporting both batch and streaming processing with parallel pipeline orchestrationImplement advanced monitoring and observability solutions for data pipeline performance and system health trackingCreate testing and validation frameworks to ensure data accuracy and consistency during complex migrationsTechnical Leadership & Engineering ExcellenceProvide technical leadership for data migration initiatives, taking responsibility for critical system components and project phasesMentor engineers through pair programming, code reviews, and collaborative data pipeline developmentLead technical design discussions for complex data migrations and create solutions meeting enterprise requirementsDemonstrate deep expertise in data engineering lifecycle management, from migration planning through deployment and operational supportCollaborate effectively with stakeholders across disciplines, ensuring alignment and successful project outcomesMinimum 8 years of experience in data engineering or related engineering roleBachelor's or Master's degree or equivalent experience in Computer Science, Engineering, or related fieldProven expertise in large-scale data migration and ETL pipeline developmentAdvanced proficiency in Java programming language with modern build systems (Gradle or Maven)Expertise in distributed file systems (HDFS) or cloud object storage (S3, GCS)Experience with cloud data platforms (AWS, GCP, Azure, or Databricks)Hands-on experience with AWS EKS (Kubernetes) for containerized data processing environmentsUnderstanding of data privacy, security, and compliance requirements (GDPR experience preferred)Strong knowledge of data structures, algorithms, and distributed systems design principlesExperience with Scala or Python for data processing applicationsExperience with Apache Spark or Py Spark for large-scale data processing and analyticsExperience with Hadoop ecosystem including HDFS, Map Reduce, and related toolsExperience working in enterprise engineering environments with large-scale tools and development processesExperience with data lineage analysis , dependency mapping, and data validation frameworksExperience with modern data formats like Apache Iceberg, Parquet, ORC, or AvroProficiency in streaming platforms like Apache Kafka or AWS KinesisHands-on experience with observability tools (Prometheus, Grafana, Spark UI)Opportunity to work on cutting-edge data engineering projects at petabyte scaleProfessional development opportunities with clear career progression pathsFlexible hybrid work arrangements across our global offices, with 2 days in-office per weekAccess to latest technologies and tools in data engineering and cloud platformsIf you're passionate about large-scale data engineering, technical leadership, and delivering world-class solutions, we'd love to hear from you.
Join SPAN Digital and help shape the future of data processing at enterprise scale.SPAN Digital is an equal opportunity employer committed to diversity and inclusion.
#
Sign in
To continue your applicationor continue with email
By continuing you agree to our Terms & Privacy Policy.
