The Data Engineer is responsible for collecting, managing, and converting raw data into information that can be interpreted by Data Scientists and Business Analysts. Data accessibility is the ultimate goal; which enables our organization to utilize data for performance evaluation and optimization.
What you'll be doing:
- Implement pipelines to move raw data in Azure Synapse using spark, python, SQL and C# in line with well-established architectural standards related to Data Warehouse and Data Lakehouse modeling standards.
- Develop machine learning and regression analysis skills in spark-python-pandas, openai and Azure ML.
- Employ Azure Devops and Git in line with the Software Development Life Cycle best practices.
- Interpret requirements provided by Business and Data Analysts.
- Act as a liaison with Business Analysts and Testing teams to promote smooth development execution.
- Triage and troubleshoot perceived data aberrations submitted by the user community.
- Other duties as assigned.
What we're looking for:
- 2+ years of practical or collegiate experience (or equivalent) in Python related to Data Engineering (spark, pandas, etc).
- 2+ years of practical or collegiate experience (or equivalent) in SQL related to Data Engineering (or equivalent collegiate experience / certifications).
- Solid understanding of the Software Development Life Cycle.
- Good data analytics background.
- Motivated individual looking to expand their knowledge in all areas of Data Engineering, Analytics and AI.
Bonus Points:
- Microsoft Cloud Certification
- Familiarity with machine Learning and AI
Education:
- Bachelor's Degree or Relevant Certifications & equivalent years of experience
Travel:
- <10%
Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities
The contractor will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with the contractor's legal duty to furnish information. 41 CFR 60-1.35(c)