About SPAN DigitalWe're a premium software consulting company with offices in San Francisco, Cape Town, and Guadalajara.
We partner with startups to global brands in tech, fintech, and digital media, building category-defining products and helping engineering teams deliver exceptional digital solutions.At SPAN, we balance structure with flexibility, autonomy with accountability, and learning with doing.
It's not about grinding, it's about thriving.Role OverviewWe are seeking a Senior Java Engineer with Data Engineering expertise to join our expert team focused on executing critical enterprise data retention, migration, and privacy enhancement projects.
This role combines robust software engineering capabilities with technical leadership skills to deliver production-quality solutions at petabyte scale.As a Senior Engineer, you will design and deliver robust software solutions while providing technical leadership to engineering teams.
You'll combine strong technical capabilities with emerging leadership skills to build production-quality systems that meet our clients' business requirements.Experience Level:8+ years in data engineering/software engineering with 4-7 years technical leadershipKey ResponsibilitiesData Engineering & Migration LeadershipDesign and implement large-scale data migration strategiesfor identity transformation across multi-petabyte datasetsBuild comprehensive data lineage mapping and validation systemsto ensure migration accuracy and data integrityDevelop scalable data transformation solutionssupporting both batch and streaming processing with parallel pipeline orchestrationImplement advanced monitoring and observability solutionsfor data pipeline performance and system health trackingCreate testing and validation frameworksto ensure data accuracy and consistency during complex migrationsTechnical Leadership & Engineering ExcellenceProvide technical leadershipfor data migration initiatives, taking responsibility for critical system components and project phasesMentor engineersthrough pair programming, code reviews, and collaborative data pipeline developmentLead technical design discussionsfor complex data migrations and create solutions meeting enterprise requirementsDemonstrate deep expertisein data engineering lifecycle management, from migration planning through deployment and operational supportDrive technical work forwardby identifying and removing blockers, enabling continuous delivery of valueCollaborate effectivelywith stakeholders across disciplines, ensuring alignment and successful project outcomesRequired QualificationsEducation & ExperienceMinimum 8 years of experiencein data engineering or related engineering roleBachelor's or Master's degreeorequivalent experience in Computer Science, Engineering, or related fieldTechnical ExpertiseProven expertisein large-scale data migration and ETL pipeline developmentAdvanced proficiencyin Java programming language with modern build systems (Gradle or Maven)Expertisein distributed file systems (HDFS) or cloud object storage (S3, GCS)Experience with cloud data platforms(AWS, GCP, Azure, or Databricks)Hands-on experiencewith AWS EKS (Kubernetes) for containerized data processing environmentsUnderstandingof data privacy, security, and compliance requirements (GDPR experience preferred)Strong knowledgeof data structures, algorithms, and distributed systems design principlesPreferred SkillsExperience with Scala or Pythonfor data processing applicationsExperience with Apache Sparkor PySparkfor large-scale data processing and analyticsExperience with Hadoop ecosystem includingHDFS, MapReduce, and related toolsExperience working in enterprise engineering environmentswith large-scale tools and development processesExperience with data lineage analysis, dependency mapping, and data validation frameworksIdentity management experiencein large-scale distributed systemsExperience with modern data formatslike Apache Iceberg, Parquet, ORC, or AvroProficiency in streaming platformslike Apache Kafka or AWS KinesisHands-on experience with observability tools(Prometheus, Grafana, Spark UI)What We OfferOpportunity to work on cutting-edge data engineering projectsat petabyte scaleTechnical leadership opportunitieswith mentorship responsibilitiesCollaborative work environmentfocused on continuous learning and growthExposure to enterprise clientsin entertainment, technology, and medical industriesProfessional development opportunitieswith clear career progression pathsFlexible hybrid work arrangementsacross our global offices, with 2 days in-office per weekCompetitive compensation and benefits packageAccess to latest technologies and toolsin data engineering and cloud platformsReady to Join Our Team?
If you're passionate about large-scale data engineering, technical leadership, and delivering world-class solutions, we'd love to hear from you.
Join SPAN Digital and help shape the future of data processing at enterprise scale.SPAN Digital is an equal opportunity employer committed to diversity and inclusion.
#J- *-Ljbffr
By continuing you agree to our Terms & Privacy Policy.