Data Engineer
Owing Mills, MD
Long Term
General Responsibilities:
Architect, design, develop, implement, and maintain code, information architecture, and conceptual models to support data processing, and flows thru data lake
o Landing Zone - data ingestion of raw data or capture of streaming data
o Discovery Zone - evaluate data quality, transform raw data, and cleanse data
o Enterprise Zone - transform into data model for external consumption by reporting & self-service BI
Develop data & metadata policies and procedures
Review and evaluate database performance, risk and financial analysis feasibility studies
Investigate and repair application defects regardless of component including platform, business logic, data process logic, or database (SQL and data modeling).
All other duties as assigned or directed
Qualifications:
Bachelors of Science (or higher) in computer science or related field
8+ years of systems/application analysis & design experience
5+ years of combined experience ETL (Talend, Informatica, or other ETL tool)
o At least 3 years of experience with Talend
Technical Skills
Excellent knowledge of relational databases (PostgreSQL, Oracle, RDS) including SQL, stored procedures, data modeling
Excellent knowledge of SQL, complex SQL tuning, and data warehouse best practices
Basic knowledge of Unix/Linux commands especially in processing data files
Preferred experience with ATTD and associated technologies (Fitnesse, DBSlim, Junit)
Preferred experience with delivering code using Continuous Integration and Continuous Delivery (CI/CD) best practices and DevOps
Preferred experience with AWS or other cloud platforms.
Preferred experience with Big Data (Cloudera) & Java integration