Senior Data Engineer

Senior Data Engineer
Secret Security Clearance required
Program Overview and Responsibilities:
BS in Computer Science, Systems Engineering, or a related technical field or equivalent experience.  Strong interpersonal and communication skills necessary to work effectively with customers and other team members. Detailed oriented/self-motivated with the ability to learn and deploy new technology quickly.  
Individuals in this role will have the opportunity to:

• Build both batch and real-time data pipelines and interfaces.
• Experience with big data tools: Hadoop, Spark, Kafka, NiFi.
• Strong experience with and managing data across relational SQL and NoSQL databases like MySQL, Postgres, Cassandra, HDFS.
• Work in a Linux environment, designing REST APIs, designing/developing platform components like caching, messaging, event processing, automation, transformation and tooling frameworks.
• Develop data ingest workflows with stream-processing systems: Spark-Streaming, Kafka Streams and/or Flink.
• Transform data in various formats, including JSON, XML, CSV, and zipped files.
• Experience with performance tuning of ETL jobs.
• Develop flexible ontologies to fit data from multiple sources and implementing the ontology in the form of database mappings / schemas.
•  Strong J2EE / Java background.  Strong background in streaming tools such as Kafka, Apace NiFi, Spark. 
• Strong database background / SQL and Hadoop Big Data Ecosystem.  Strong background in scaling big data jobs for data ingestion.
• Experience with Microservices architecture components, including Docker and Kubernetes.
• Experience developing microservices to fit data cleansing, transformation and enrichment needs.
• Experience with AWS cloud services: EC2, S3, EMR, RDS, Redshift, Athena and/or Glue.
• Experience with Jira, Confluence and extensive experience with Agile methodologies.
• Knowledge about security and best practices.
• Experience developing flexible data ingest and enrichment pipelines, to easily accommodate new and existing data sources.
• Experience with software configuration management tools such as Git/Gitlab, Salt, Confluence, etc.
• Experience with continuous integration and deployment (CI/CD) pipelines and their enabling tools such as Jenkins, Nexus, etc.

• Bachelor of Science in Computer Science 
• Proficient in Java
• Working knowledge of the following Atlassian products: JIRA, Confluence, Bitbucket and Github 
• Working knowledge of current software testing methodologies 
• Working knowledge of Agile software development frameworks (Scrum) 

• Excellent spoken and written communication skills 
• Excellent organizational skills and attention to detail 
• Ability to work in fast paced environment 
• Ability to juggle multiple tasks simultaneously 
• Ability to work well in a distributed/remote team environment 
• Drive to be a self-starter and promote change when necessary

Company Overview:
Business Computers Management Consulting Group, LLC (BCMC) is a small business specializing in Information Technology (IT), Cybersecurity, Information Assurance (IA), SOA, Big Data Management, Program Management, and more for Federal, State, and Local agencies. We possess highly skilled engineers, providing innovative solutions backed by strong past performances. We are ISO 9001:2008, 27001:2018, 20000:2013, and CMMI L3 certified and registered promising highest quality to all of our clients.
Benefits:
Extremely competitive salary 
95% employer paid for employee medical, dental, & vison coverages 
100% employer paid for employee life, STD & LTD disability coverages 
401k with company match and profit sharing 
Flexible Spending Account (FSA) for dependent & health care 
11 standard holidays & 3 weeks of annual leave
 

Powered by JazzHR

Va0bLWQkBg