Data Engineer

Buchanan & Edwards is looking for a Data Engineer to work on a mission critical application for the Department of Justice. As a Data Engineer in this role, you will be responsible for:

In this role you will:

• Understanding of programming and Data Engineering concepts and best practice.
• Manage and organize data while identifying trends and inconsistencies that will impact downstream analytics.
• Provide architecting solutions.
• Design and implement automated build and deployment pipelines.
• Troubleshoot files against an architecture to see where the upload process is failing.
• Understand unit tests and add to them to increase stability to the entire pipeline.
• Utilize GIT, JIRA, Confluence, Anaconda, Spyder, and Microsoft tools.
• Be prepared to express ideas and solutions and walk together with teammates through coding challenges.

Required:

• Bachelor’s degree with eight (8) years of relevant experience; master’s degree with six (6) years of experience PhD with three (3) years of experience.
• Experience in:
  • Architecting solutions based on customer requirements.
  • 5 Years of experience leading teams
  • 3 years of experience designing and deploying CI/CD Pipelines
  • Experience with Python, SQL, and/or Spark.
  • Experience working with both structured, semi-structured, and unstructured data to include data parsing, transformation, schema definition, and query/analysis.
• An active TS/SCI eligibility and the ability to obtain a polygraph.

Desired:

• Knowledge of Splunk
• AWS Experience
• Neo4J or any Graph database experience
• MySQL Experience
• Agile Methodologies