Data Engineer

• Job Type: Officer of Administration
• Regular/Temporary: Regular
• Hours Per Week: 35
• Salary Range: $85K - $110K

Position Summary

Reporting to the Assistant Director of CUIMC Analytics Data Engineering Team, the Data Engineer collaboratively supports and expands CUIMC Analytics' data infrastructure. This involves developing and managing numerous data processes, including, but not limited to, ETL (Extract, Transfer, Load), file movement, Cognos cube builds, and associated supporting technologies. This position works closely with the development team to deploy and test code in a SQL Server based dev/test/prod data warehouse environment. This position will create, schedule, and monitor complex data workflows using automation software, working with internal and external colleagues to quickly troubleshoot and resolve any issues that arise. This individual must be team oriented and possess strong customer service, communication, problem solving, and critical thinking skills.

Responsibilities

• 
  Automation: Develop and maintain complex data workflows that keep our data warehouse environment up to date, secure, and accessible using automation and scheduling software, as well as scripting and other technologies - 25%
• 
  Process Monitoring and Troubleshooting: Monitor the data infrastructure, including all automated processes, for any issues that arise, such as process or system error/failure, quickly addressing the problem as needed - 25%
• 
  DevOps: Work closely with the Development team to deploy code using GitLab version control in dev/test/prod environment - 15%
• 
  ETL Development: Develop new and maintain legacy ETL workflows - 15%
• 
  Database Administration: Develop and maintain SQL Server instances in a dev/test/prod data warehouse environment - 10%
• 
  Continuous Improvement: Seeks out additional training to improve skills in the team's technologies and new technologies, and to improve soft skills for better client and team relations - 5%
• 
  Other Duties as Assigned - 5%

Minimum Qualifications

• Requires a bachelor's degree in a quantitative discipline, plus 3 years of experience or the equivalent in education and experience.
• Proficiency in writing and tuning SQL queries and creating SQL objects.
• Knowledge of a scripting language, such as PowerShell or Python.
• Experience with ETL applications, such as IBM DataStage, Microsoft SSIS, or others.
• Experience with automation/scheduling applications, such as Fortra Automate, Automize, or others.
• Ability to think logically and troubleshoot expeditiously.

Preferred Qualifications

• Excellent decision making, critical thinking, and problem-solving skills.
• Strong organizational skills with an emphasis on communication, detail, and follow-up.
• Experience in academic or hospital environments.
• Process improvement and efficiency mindset.
• Experience with SQL Server.
• Experience with Docker or other containers.
• Experience with AWS services, such as EC2, Lambda, IAM.
• Experience using APIs.

Equal Opportunity Employer / Disability / Veteran

Columbia University is committed to the hiring of qualified local residents.