Job Description
- Position Name:Director of Data Engineering
- Location:St. Louis, MO or Forth Worth, TX (Remote option available)
- Minimum Experience Required: 10 years
- Job Type: Permanent
Thinking Minds Inc. is seeking a seasoned Director of Data Engineering to lead our client's data strategy team and architect a robust data platform that meets their diverse business needs. This pivotal role involves crafting analytics-ready data products, developing data pipelines, and guiding a dedicated team towards building a modern data infrastructure on cloud platforms. Ideal candidates will have a strong technical foundation, leadership skills, and a passion for fostering junior talent. While this position offers the flexibility of remote work, proximity to our collaborative hubs in St. Louis or Dallas/Ft. Worth is preferred for regular team engagements.
- Architect and implement scalable data pipelines and analytics solutions, ensuring high performance and efficiency.
- Design and manage data warehouses utilizing platforms like Amazon Redshift, Google BigQuery, or Snowflake, with an emphasis on performance optimization and cost management.
- Develop ELT processes for effective data integration from diverse sources, employing big data technologies (Hadoop, Apache Kafka, Apache Flink) for comprehensive data processing and real-time analytics.
- Utilize programming languages (Python, Scala, Java) for crafting maintainable code aimed at data processing and automation tasks.
- Uphold data governance standards, ensuring compliance with data privacy regulations (HIPAA, GDPR, CCPA) and securing sensitive information.
- Mentor and lead a team of Data engineers, fostering internal and contracted talent while translating technical concepts for wider understanding and decision-making.
- Identify and solve complex Data Engineering challenges with innovative solutions, supporting data-driven decisions to enhance processes and systems.
- Keep abreast of the latest in Data Engineering and cloud technologies, adjusting to technological and business developments.
- Implement quality controls, departmental standards, and educational plans to uphold quality and regulatory compliance.
- Anticipate and address future demands related to people, technology, budget, and business, crafting solutions that meet these evolving needs.
- Communicate the business impact of technical initiatives to stakeholders both within and outside the organization.
- A decade of experience in Data Engineering, including 5+ years in deploying cloud-based data infrastructure solutions.
- Proficiency in cloud platforms (AWS, Azure, GCP), with comprehensive knowledge of their services (computing, storage, networking, databases).
- Experience in developing data pipelines for AI/ML models using tools like PySpark or Python, and familiarity with modern data pipeline tools (Data Bricks, Fivetran, dbt, etc.).
- A solid understanding of lakehouse architecture and delta lake.
- A Bachelor's degree in Computer Science, Engineering, Statistics, Informatics, Information Systems, or another quantitative field. A Master’s degree is preferred.