We're a premium software consulting company with offices in San Francisco, Cape Town, and Guadalajara. We partner with startups to global brands in tech, fintech, and digital media, building category-defining products and helping engineering teams deliver exceptional digital solutions.
At SPAN, we balance structure with flexibility, autonomy with accountability, and learning with doing. It's not about grinding, it's about thriving.
Role OverviewWe are seeking a Senior Java Engineer with Data Engineering expertise to join our expert team focused on executing critical enterprise data retention, migration, and privacy enhancement projects. This role combines robust software engineering capabilities with technical leadership skills to deliver production-quality solutions at petabyte scale.
As a Senior Engineer, you will design and deliver robust software solutions while providing technical leadership to engineering teams. You'll combine strong technical capabilities with emerging leadership skills to build production-quality systems that meet our clients' business requirements.
Experience Level:8+ years in data engineering/software engineering with 4-7 years technical leadership
Key ResponsibilitiesDesign and implement large-scale data migration strategiesfor identity transformation across multi-petabyte datasets
Build comprehensive data lineage mapping and validation systemsto ensure migration accuracy and data integrity
Develop scalable data transformation solutionssupporting both batch and streaming processing with parallel pipeline orchestration
Implement advanced monitoring and observability solutionsfor data pipeline performance and system health tracking
Create testing and validation frameworksto ensure data accuracy and consistency during complex migrations
Provide technical leadershipfor data migration initiatives, taking responsibility for critical system components and project phases
Mentor engineersthrough pair programming, code reviews, and collaborative data pipeline development
Lead technical design discussionsfor complex data migrations and create solutions meeting enterprise requirements
Demonstrate deep expertisein data engineering lifecycle management, from migration planning through deployment and operational support
Drive technical work forwardby identifying and removing blockers, enabling continuous delivery of value
Collaborate effectivelywith stakeholders across disciplines, ensuring alignment and successful project outcomes
Minimum 8 years of experiencein data engineering or related engineering role
Bachelor's or Master's degreeorequivalent experience in Computer Science, Engineering, or related field
Proven expertisein large-scale data migration and ETL pipeline development
Advanced proficiencyin Java programming language with modern build systems (Gradle or Maven)
Expertisein distributed file systems (HDFS) or cloud object storage (S3, GCS)
Experience with cloud data platforms(AWS, GCP, Azure, or Databricks)
Hands-on experiencewith AWS EKS (Kubernetes) for containerized data processing environments
Understandingof data privacy, security, and compliance requirements (GDPR experience preferred)
Strong knowledgeof data structures, algorithms, and distributed systems design principles
Experience with Scala or Pythonfor data processing applications
Experience with Apache Sparkor PySparkfor large-scale data processing and analytics
Experience with Hadoop ecosystem includingHDFS, MapReduce, and related tools
Experience working in enterprise engineering environmentswith large-scale tools and development processes
Experience with data lineage analysis, dependency mapping, and data validation frameworks
Identity management experiencein large-scale distributed systems
Experience with modern data formatslike Apache Iceberg, Parquet, ORC, or Avro
Proficiency in streaming platformslike Apache Kafka or AWS Kinesis
Hands-on experience with observability tools(Prometheus, Grafana, Spark UI)
Opportunity to work on cutting-edge data engineering projectsat petabyte scale
Technical leadership opportunitieswith mentorship responsibilities
Collaborative work environmentfocused on continuous learning and growth
Exposure to enterprise clientsin entertainment, technology, and medical industries
Professional development opportunitieswith clear career progression paths
Flexible hybrid work arrangementsacross our global offices, with 2 days in-office per week
Competitive compensation and benefits package
Access to latest technologies and toolsin data engineering and cloud platforms
If you're passionate about large-scale data engineering, technical leadership, and delivering world-class solutions, we'd love to hear from you. Join SPAN Digital and help shape the future of data processing at enterprise scale.
SPAN Digital is an equal opportunity employer committed to diversity and inclusion.
#J-18808-LjbffrBy continuing you agree to our Terms & Privacy Policy.