Data Platform Engineer
Location: Charleston, SC
Clearance Level: Active Secret Security Clearance Required
Direct-Hire & Full-Time
Hybrid: Schedule 2 days remote, 3 days in office per week
We are seeking a Data Platform Engineer to support the development and operation of secure, mission-critical data environments for a U.S. Department of Defense customer.
This position combines data engineering, platform infrastructure and DevSecOps responsibilities. The engineer will help build and maintain the systems used to ingest, process, store, monitor and distribute data across complex technical environments.
The ideal candidate has hands-on experience with modern data platforms, containerized applications, event-streaming technologies and open-source infrastructure tools. This person should also be comfortable collaborating with multiple engineering teams, documenting technical solutions and recommending improvements to existing platforms and processes.
Technology Environment:
- Event streaming and data flow: Apache Kafka and Apache NiFi
- Containers and orchestration: Docker and Kubernetes
- Monitoring and observability: Grafana, Loki, Tempo, Mimir, Prometheus and the Elastic Stack
- Databases, storage and caching: PostgreSQL, Redis and MinIO
- API and networking infrastructure: Nginx and Apache APISIX
- Continuous integration and deployment: Jenkins, GitLab CI/CD, Azure DevOps or GitHub Actions
- Configuration management and automation: Ansible, Chef or Puppet
- Programming and scripting: Python, PowerShell, Bash or Go
- Version control and collaboration: Git-based development environments
- API design and documentation: OpenAPI/Swagger
Required Qualifications:
- 3+ years of experience in data engineering, platform engineering, DevOps, DevSecOps or a closely related discipline.
- Experience supporting data platforms, pipelines, integration services or distributed applications.
- Hands-on knowledge of Apache Kafka or a comparable event-streaming technology.
- Experience using Apache NiFi or another data-flow and orchestration platform.
- Familiarity with Docker and Kubernetes.
- Experience working with relational databases and open-source data services.
- Understanding of Agile software-development practices and DevOps principles.
- Ability to produce clear technical documentation and communicate architectural concepts.
- Strong troubleshooting, analytical and problem-solving abilities.
- Ability to collaborate across engineering disciplines and manage competing priorities.
- Bachelor’s degree in computer science, engineering or a related technical discipline, or an equivalent combination of education and relevant professional experience.
Preferred Qualifications:
- 5+ years of relevant data-platform, DevSecOps or infrastructure-engineering experience.
- Experience building or operating production Kubernetes environments.
- Working knowledge of microservices and distributed-system architectures.
- Experience implementing CI/CD pipelines and infrastructure automation.
- Familiarity with API gateways, reverse proxies and service-to-service communication.
- Understanding of serverless computing concepts.
- Experience developing architecture recommendations for complex technical platforms.
- Familiarity with secure software-development and deployment practices.
Essential Duties:
- Design, build and maintain scalable platforms for collecting, processing, storing and delivering data.
- Support the deployment and operation of data services within containerized environments.
- Develop and improve data-ingestion, transformation and orchestration workflows.
- Assist with the integration of event-streaming platforms, databases, APIs and distributed services.
- Evaluate existing data-engineering practices and recommend technical or procedural improvements.
- Implement monitoring, logging and observability solutions across platform components.
- Collaborate with software, infrastructure, cybersecurity and systems-engineering teams to understand technical requirements.
- Translate mission and operational requirements into practical platform capabilities.
- Support automated software builds, testing, integration and deployment processes.
- Create architecture diagrams, configuration guides, operating procedures and other technical documentation.
- Present proposed architectures and technical recommendations to engineering teams and program leadership.
- Troubleshoot platform, application, networking and data-flow issues.
- Balance multiple technical priorities in a fast-moving, collaborative environment.
Education:
- Bachelor’s degree in computer science, engineering or a related field preferred; equivalent relevant professional experience may be considered.
Sign in
To continue your applicationor continue with email
By continuing you agree to our Terms & Privacy Policy.
