Senior Data Engineer Databricks / SQL / Snowflake
Location: Spring, Texas 100% Onsite
Duration: 2+ Years Expected
Interview: Virtual and in-person meet up round
Recruiter Notes
- Local candidates required with DL copy
- LinkedIn with location (before 2022)
- Recent or recent second project must be at the current location
- Strong Databricks + SQL experience is essential.
- Snowflake is highly preferred.
- Oil & Gas / Energy / Upstream experience is a strong plus.
- AI/GenAI exposure is beneficial but not the primary requirement.
Project Lifecycle
- The initial development phase is expected to run for approximately one year. Once the AFE data product moves into production, the Data Engineer will transition with the solution into the organization responsible for its ongoing support, maintenance, and enhancements.
- The overall engagement is therefore expected to continue for approximately two years or potentially longer.
Position Overview
Our client is seeking an experienced Senior Data Engineer to join a small, high-impact team building a new Authorization for Expenditure (AFE) data product supporting Project Nexus, an upstream data harmonization initiative.
The engineer will design and develop a data solution that integrates multiple enterprise datasets to provide a comprehensive view of major capital project spending, including budgeted/projected expenditure, actual expenditure, spending variances, and the business factors driving those variances.
The ideal candidate will have strong hands-on experience with Databricks, Databricks Notebooks, and advanced SQL. Snowflake experience is highly preferred, as the semantic/data consumption layer will reside in Snowflake. Exposure to AI-enabled data engineering or Databricks AI capabilities is a plus.
Required Qualifications
- Strong professional experience as a Data Engineer.
- Advanced hands-on experience with Databricks.
- Strong development experience with Databricks Notebooks.
- Advanced SQL skills.
- Experience developing and maintaining enterprise-scale data pipelines.
- Strong experience integrating data from multiple heterogeneous sources.
- Experience with data transformation, data modeling, and data quality.
- Ability to troubleshoot and optimize complex data workloads.
- Strong communication and collaboration skills.
- Ability to work effectively within a small, high-impact engineering team.
- Must be able to work onsite in Spring, Texas, 5 days per week.
Other Qualifications
- Hands-on Snowflake experience.
- Experience integrating Databricks with Snowflake.
- Experience with semantic/data consumption layers.
- Experience working with financial, budgeting, expenditure, or capital project data.
- Experience in Oil & Gas, Energy, or Upstream environments - Preferred.
- Experience with enterprise-scale data platforms.
- Exposure to AI, Generative AI, or ML-enabled data engineering.
- Experience using AI capabilities available within Databricks.
- Experience supporting production data products after initial development.