Data Engineer

GCP Data Engineer in Houston, TX or Evansville, IN
The Select Group is seeking a Data Engineer to join one of our top clients in the utilities industry. This role will be hybrid in either Houston, TX or Evansville, IN.

Required Qualifications:
• Requires a minimum of five (5) years of related experience in Data Engineering, data analysis, ETL or similar role delivering data pipelines.

• • Experience with Google Big Query.
• • Strong proficiency in SQL with direct working experience leveraging this skill.
• • Experience with data exploration tools like KNIME/Alteryx
• • Understanding of data modeling concepts and experience with data modeling tools.
• • Proficiency in ETL processes, data warehousing, and database management systems.
• Experience working with the following tools: Dataflow, DataStream, Google Cloud Functions, Spark, Google Cloud Run, Google Pub Sub, etc. to integrate systems and data pipelines.

Roles and Responsibilities:
• Develop, construct, test and maintain data acquisition pipelines for large volumes of structed and unstructured data. This includes batch and real-time processing.
• Build large and complex datasets based on business requirements.
• Construct ‘big data’ pipeline architecture
• Identifies opportunities for data acquisition via collaborating with stakeholders and business clients.
• Leverages a variety of tools such as Python, SAP Data Services, Dataflow, DataStream, Google Cloud Functions, Spark, Google Cloud Run, SAP SLT, Google Pub Sub, etc. to integrate systems and data pipelines.
• Recommends ways to improve data quality, reliability, and efficiency.
• Develop JSON messaging structure for integrating with various applications.
• Drive a Data Engineering strategy focused on delivering data in near real-time using server less technologies.
• Develop data architecture to optimize performance for dashboards and digital applications.
• Lead the integration track of various strategic projects.
• Leverage DevOps and CI/CD practices to ensure the reliability and scalability of data pipelines.
• Assist in the development and maintenance of data models, data dictionaries, and data documentation to ensure data integrity and consistency.

TSG is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

Array