Security Clearance: Secret (TS/SCI preferred)
Program Overview and Responsibilities:
Data Engineer- Cyber Analytics Platform will support a long-term, cutting-edge research and development program for one of the country?s highest priority cyber initiatives. He or she will have the opportunity to work with technical leaders in threat hunting, computer science, machine learning, and data analytics to develop the next generation of analytic-driven cyber defense platforms.
Individuals in this role will have the opportunity to:
+ Experience with building both batch and real-time data pipelines and interfaces; Strong J2EE / Java background.
+ Strong background in streaming tools such as Kafka, Apace NiFi, Spark. Strong database background / SQL and Hadoop Big Data Ecosystem. Strong background in scaling big data jobs for data ingestion.
+ Experience with big data tools: Hadoop, Spark, Kafka, NiFi. experience with object-oriented/object
+ Strong experience with and managing data across relational SQL and NoSQL databases like MySQL, Postgres, Cassandra, HDFS.
+ Strong experience working in a Linux environment, designing REST APIs, designing/developing platform components like caching, messaging, event processing, automation, transformation and tooling frameworks.
+ Experience developing data ingest workflows with stream-processing systems: Spark-Streaming, Kafka Streams and/or Flink.
+ Experience transforming data in various formats, including JSON, XML, CSV, and zipped files.
+ Experience with performance tuning of ETL jobs.
+ Experience developing flexible ontologies to fit data from multiple sources and implementing the ontology in the form of database mappings / schemas.
+ Experience with Microservices architecture components, including Docker and Kubernetes.
+ Experience developing microservices to fit data cleansing, transformation and enrichment needs.
+ Experience with AWS cloud services: EC2, S3, EMR, RDS, Redshift, Athena and/or Glue.
+ Experience with Jira, Confluence and extensive experience with Agile methodologies.
+ Knowledge about security and best practices.
+ Experience developing flexible data ingest and enrichment pipelines, to easily accommodate new and existing data sources.
+ Experience with software configuration management tools such as Git/Gitlab, Salt, Confluence, etc.
+ Experience with continuous integration and deployment (CI/CD) pipelines and their enabling tools such as Jenkins, Nexus, etc.
+ Bachelor of Science in Computer Science (or related field)
+ Secret Clearance
+ Excellent spoken and written communication skills
+ DHS Suitability
+ Excellent organizational skills and attention to detail
+ Ability to work in fast paced environment
+ Ability to juggle multiple tasks simultaneously
+ Ability to work well in a distributed/remote team environment
+ Drive to be a self-starter and promote change when necessary
Business Computers Management Consulting Group, LLC (BCMC) is a small business specializing in Information Technology (IT), Cybersecurity, Information Assurance (IA), SOA, Big Data Management, Program Management, and more for Federal, State, and Local agencies. We possess highly skilled engineers, providing innovative solutions backed by strong past performances. We are ISO 9001:2008 certified and registered promising highest quality to all of our clients.