Address
Form of workThe (Sr.) Data Engineer/Architect is responsible for implementing methods to improve data reliability and quality. They combine raw information from different sources to create consistent and machine-readable formats. They also develop, test and build algorithms, architectures and infrastructure that enable data extraction and transformation for various modeling needs for example predictive or prescriptive modeling. Other functions can include organizing large datasets, automating manual data analysis and management processes, and integration of data and business operations into data systems.
Applicants for this position must be fully vaccinated against COVID-19 as a condition of employment.
This position may be eligible for flexible work arrangements. Please consult with your manager to confirm options for flexibility. Business needs and/or on-call responsibilities may require you to report to campus.
Essential Functions:
Characteristics & Qualifications:
Required:
Preferred:
Applicants for this position must be fully vaccinated against COVID-19 as a condition of employment.
This position may be eligible for flexible work arrangements. Please consult with your manager to confirm options for flexibility. Business needs and/or on-call responsibilities may require you to report to campus.
Essential Functions:
- Identifying, creating, and preparing data required for modern Business Intelligence /Machine Learning solutions
- Building data architectures, and data pipelines to collectively bring together data
- Designing solutions using Microsoft Azure services and other tools
- Assuring that data is cleansed, mapped, transformed, and optimized for storage and use according to business and technical requirements
- Automating tasks and deploying production standard code (with unit testing, continuous integration, versioning, etc.)
- Loading transformed data into storage and reporting structures such as data warehouses, data lakes, real-time reporting systems and analytics applications
- Data Architect Role (in addition to previously mentioned)
- Analyzing, planning, and defining data architecture framework, including security, reference data, metadata, and master data
- Collaborating with other teams within the organization to devise and implement data strategies, build models, and assess shareholder needs and goals
Characteristics & Qualifications:
Required:
- BS degree in Computer Science, Management Information Systems or equivalent work experience
- 0-5 years of experience Knowledge of SQL
- 0-5 years of experience Experience in data engineering and cloud data processing services (e.g Azure ,Google or AWS Cloud Platforms)
- 0-5 years of experience Hands on Experience in Data Warehousing & ETL tools
- 0-5 years of experience Experience in Big Data technologies (e.g. Hadoop, Spark, Databricks, Snowflake)
- 0-5 years of experience Experience building and optimizing 'big data' data pipelines, architectures, and data sets
- 0-5 years of experience Knowledge of Programming e.g. Python, PySpark, R, Oracle PL/ SQL
- Ability to produce high-quality work products with attention to detail
- Ability to visualize and solve complex problems
- Ability to apply analytical and mathematical solutions
- Experience with conceptual and logical data modeling including developing and maintaining data model diagrams (ERD), facilitating structured data modeling meetings
- Experience designing and building business intelligence architectures including data marts, data warehouses, and reporting and analysis applications
- Experience with SQL Tools, such as SQL Navigator, TOAD, SQL*Plus
Preferred:
- MS degree in Computer Science, Computer Engineering or equivalent work experience
- 0-5 years of experience Performance/security-oriented data modeling and data design, including partitions, different type of indexes, views, and most effective data management practices.
- 0-5 years of experience Experience with Azure Synapse Analytics, Azure DevOps
- 0-5 years of experience Experience with Purview, Snowflake, Alteryx, Qlik, or Tableau
- 0-5 years of experience Experience with data warehousing concepts, data governance and data structures
- 0-5 years of experience Experience with support and data modelling tools including but not limited to: Oracle Enterprise Manager (OEM), SQL*Plus, Toad.
- Experience with PJM operations, markets, and planning functions
- Experience with Alteryx and SAS Experience with visualization and reporting tools such as Tableau, SAS Visual Analytics, Qlik etc
- Experience in end to end delivery and lifecycle of analytical business solutions
