Address
Form of workOur Opportunity:
We are looking for a Data Engineer III at our facility in Plantation, Florida to design, develop, and maintain data architecture and pipelines to extract sales data and economic data required for machine learning models.
What You'll Do:
- Optimize data extraction and feature engineering runtimes to enable near real time availability of high-quality feature data.
- Solve complex data problems to deliver insights that help supply chain teams use forecasting data to meet business goals.
- Evolve new data products for analytics and data scientist team members to improve their productivity.
- Design and implement a data governance framework with automated monitoring and alerting for economic forecasting models.
- Assist in creating Proof of Concepts and advise, consult, mentor and coach other data and analytic professionals on data standards and practices.
- Lead the evaluation, implementation and deployment of emerging tools and process for analytic Data Engineering in order to improve our productivity as a team.
- Develop and deliver communication and education plans on analytic Data Engineering capabilities, standards, and processes.
- Code, test, and document new or modified data systems to create robust and scalable applications for data analytics.
- Collaborate with Data Science Leads and developers to make sure that data solutions are consistent across all forecasting models.
- Partner with Business Analysts and Solutions Architects to develop technical architectures for strategic enterprise projects and initiatives.
- Ensure all automated processes preserve data by managing the alignment of data availability and integration processes.
- Develop technical documentation for new data products and pipelines.
- 10% domestic travel required.
What You'll Need:
- Bachelor's degree in Computer Science, Engineering, Information Systems, or a related field and 5 years of experience
- Alternatively, a Master's degree and 3 years of experience.
- Experience must include 3 years in the following: Data Engineering or Business Intelligence roles working with ETL, Data Modeling, and Data Architecture; and
- Developing modern data pipelines and applications for analytics (BI, reporting, and dashboards).
- Experience must also include the following: advanced analytics (machine learning, deep learning, and mathematical optimization) use cases;
- Setting up end to end Data pipelines in an Enterprise environment;
- Software development processes, including building, unit testing, code analysis, release process, and code coverage;
- Analyzing and problem-solving in a 'big data' environment;
- ETL and SQL;
- Data extraction, transformation, and loading in a large Data Warehouse environment;
- Python and R;
- Managing time series data sets with various native frequencies;
- Developing solutions on cloud computing services and infrastructure with AWS, GCP, or Azure;
- Database development using a variety of relational (Oracle), NoSQL, and cloud database technologies, including Snowflake;
- Designing and implementing data pipelines using modern Data Engineering approach and tools: Spark, PySpark, Scala, Docker, Databricks, Glue, cloud-native DWH (Snowflake, Redshift), Kafka/Confluence, and Prest/Dremio/Athena;
- CI/CD process and platforms, including Airflow; working with development teams;
- SQL and Python;
- AWS (Amazon web services) and Terraform; Data Engineering and ETL architecture;
- Jenkins or alternative CI/CD tools;
- Developing Data quality test cases and automating data quality monitoring;
- Big data solutions, including Amazon RedShift, Snowflake, Apache Spark, and AWS glue;
- Debugging and optimizing complex SQL queries and database stored procedures/functions; and
- Generating and modifying application code in YML and JSON.
- 10% domestic travel required.
- The position is eligible for the Employee Referral Program.
