- Be the subject matter expert for data processing and integration solutions.
- Architect end-to-end data integration solutions for internal and external customers, ensuring efficient and secure data flow.
- Collaborate with internal and external customers to understand their data integration and access requirements.
- Implement solutions that meet customer needs while adhering to best practices and security standards.
- Collaborate with DevOps teams for seamless integration and deployment of data solutions.
- Create and maintain comprehensive documentation for Data Engineering processes and workflows.
- Work closely with engineering teams and other stakeholders to understand data requirements and deliver effective data solutions.
- Utilize Athena for interactive query execution and Redshift (or Snowflake) for high-performance data warehousing.
- Design, implement, and optimize ETL processes for seamless data integration and transformation.
- Ensure data quality and consistency throughout the ETL workflow.
- 6-12+ years of experience in software Data Engineering.
- Proficient in Go, Scala, Python, SQL, and optionally Typescript.
- Currently working with with cross-functional teams to develop and maintain data solutions using these languages.
- Extensive experience with AWS services, including but not limited to ECS (Elastic Container Service).
- Design, implement, and maintain data pipelines using AWS services to ensure optimal performance and scalability.
- Hands-on experience with data processing tools like EMR (or MapReduce) and Spark for efficient and scalable data analysis.
- Experience working with data warehouse solutions such as Redshift or Snowflake for efficient storage, retrieval, and analysis of large datasets.
- Familiarity with build tools like Bazel for efficient project build and deployment processes.
- Informed and updated on industry best practices and incorporate them into the development and maintenance of data solutions.
- Flexible, fun start-up environment and culture.
- An approachable and accessible C-Suite.
- Comprehensive health benefits.
- 401k + match.
- Quarterly Lifestyle Stipend.
- Unlimited PTO and summer Fridays.
- Company-wide and team specific entertainment budgets for both in-person and virtual team building.
- A flexible hybrid work environment, with a fully stocked kitchen, weekly catered lunches, and casual attire while in office.
- Sponsored Volunteer Events and Vistar Gives Back program.
- An awesome and supportive bunch of people to work with and learn from.
PI235876802