Database Engineer

Red Arch Solutions (RAS) is building a DIA Enterprise Data Platform (EDP) that will facilitate the transition and retirement of duplicative and legacy data services and provide an automated, modernized, enterprise data hub within a secure environment. EDP will enable DIA to expose its data to a wider audience through a zero-trust based, data centric architecture. Based on a robust data governance policy approach, EDP will free data from siloes and allow more users to gain valuable insights from DIA data assets. RAS will maintain and improve the EDP to ensure DIA has high data availability, accessibility, veracity, integration, and discoverability while enabling data analytics, visualization, security, governance, and management across the enterprise.

Basic Job Responsibilities:

• Data Onboarding Architecture: Data Engineers design and create the overall data onboarding architecture for DDH. They work closely with stakeholders to understand their data requirements and translate them into scalable data models and structures.

• Data Analysis: Inspect data with the goal of discovering useful information needed to create data schemas.

• Data Pipeline Development: Data Engineers build data pipelines to extract, transform, and load (ETL) data from various sources into data warehouses. They develop efficient and reliable ETL processes to ensure data quality, integrity, and timeliness.

• Data Integration: Data Engineers integrate disparate data sources and systems, both internal and external, to enable seamless data flow across different platforms. They may work with APIs, databases, cloud services, and third-party tools to establish data connections and ensure smooth data integration.

• Data Transformation and Processing: Data Engineers transform raw data into a format suitable for analysis or consumption. This involves cleaning, filtering, aggregating, and structuring the data using tools like SQL, Python.

• Data Quality and Governance: Ensuring data quality and integrity is a crucial responsibility of Data Engineers. They implement data quality checks, data validation rules, and data governance practices to maintain accurate and consistent data throughout the data lifecycle.

• Scalability and Performance: Data Engineers optimize data pipelines and infrastructure for scalability and performance.

• Data Security: Data Engineers play a role in securing data assets by validating security policies are implemented for the data.

• Monitoring and Troubleshooting: Data Engineers monitor data pipelines and systems to identify and resolve issues proactively.

• Collaboration: Data Engineers collaborate with internal DDH teams and cross-functional teams (CDO, MARs).

• Customer Engagement: Engage in regular meetings and communication channels with Data Stewards and Data Steward Representatives to gather information needed to appropriately understand and secure their data in preparation for data onboarding.

• Provide “white glove” service to Data Stewards for data onboarding questionnaire assistance.

• Training and User Support: Provide training to Data Stewards and end users on DDH UI.

• Documentation: Author or update documentation such as the Data Onboarding Execution Plan, data onboarding Standard Operating Procedure, and any associated DDH documentation (CONOPS, CDD).

Data Engineering Skills:

• Data Modeling and Database Design: Proficiency in designing efficient and scalable data models, understanding relational and non-relational databases, and knowledge of SQL
• ETL and Data Integration: Experience with Extract, Transform, Load (ETL) processes, data integration techniques, and tools like Apache NiFi.
• Programming and Scripting: Strong programming skills in languages such as Python.
• Data Warehousing: Understanding of data warehousing concepts and experience with data warehouse technologies.
• Data Pipeline and Workflow Tools: Proficiency in tools for building and managing data pipelines and workflows.
• Data Streaming: Knowledge of real-time data streaming technologies such as Apache Kafka for processing and analyzing streaming data.
• Data Quality and Governance: Understanding of data quality frameworks, data validation techniques, and experience implementing data governance practices.
• Cloud Platforms: Familiarity with cloud platforms like Amazon Web Services (AWS and their relevant data services.
• Data Security: Knowledge of data security best practices, data encryption techniques, and understanding of privacy regulations.
• Data Visualization: Ability to work with data visualization tools like Tableau, Power BI, or QlikView to create meaningful visualizations and reports.
• Problem Solving and Troubleshooting: Strong analytical and problem-solving skills to identify and resolve issues in data pipelines, databases, or data infrastructure.
• Collaboration and Communication: Effective communication skills to collaborate with cross-functional teams, understand requirements, and present technical solutions to non-technical individuals.
• Continuous Learning: A mindset of continuous learning and keeping up-to-date with evolving technologies, tools, and industry trends in the field of data engineering.

. Qualifications:

• Bachelor Degree + 12 years or Master Degree + 10 years experience or 16 years of experience.
• Experience developing requirements based on needs obtained from users.
• Experience building scripts to manipulate data for ingestion into databases.

**TS/SCI with Poly is required for this position**

All Red Arch Solutions openings require US Citizenship.

Red Arch Solutions is a proven and effective small business integrator and consultant, recognized as a leading provider of IT development to the Federal Government. We offer excellent benefits, including 20 days PTO, 10 holidays, up to 10% 401k contribution, and reimbursement for tuition/certifications. Top of the line PPO Medical, Dental, Vision, and Short and Long-Term disability are also offered.

Red Arch Solutions is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment and will not be discriminated against on the basis of race, color, religion, sex, sexual orientation, national origin, age, marital status, disability, or protected veteran status. Red Arch Solutions takes affirmative action in support of its policy to advance in employment individuals who are minorities, women, protected veterans and individuals with disabilities.

09kC53NTiZ