Data Engineer

Do you have a passion for building the pipelines that transform raw data into actionable insights? Are you a skilled developer eager to collaborate and contribute to a data-driven future? If so, [Company Name] in Greenville, SC is seeking a talented Data Engineer to join our growing team!

Play a pivotal role in building and maintaining the infrastructure that empowers our data-driven decision-making. As a Data Engineer, you'll leverage your expertise in Data Engineering and programming to design, develop, and maintain data pipelines that efficiently collect, transform, and deliver data to our data scientists, analysts, and business users.

What You'll Do:

·        Design and develop scalable data pipelines using technologies like Python, SQL, and frameworks such as Spark and Airflow.

·        Extract, transform, and load (ETL) data from various sources (databases, APIs, log files, etc.) ensuring data quality and consistency.

·        Design and implement data warehousing and data lake solutions for efficient data storage and retrieval.

·        Develop and maintain automated data pipelines for continuous data flow and integration.

·        Monitor and optimize data pipelines for performance and scalability.

·        Collaborate with data scientists, analysts, and other stakeholders to understand data needs and implement effective solutions.

·        Stay up-to-date with the latest advancements in Data Engineering technologies and best practices.

SSIS ETL, SSIS Packages, PL/SQL Development, MS Dynamics AX, Database Performance

A strong foundation in SQL, database development and administration, data mining, and analytical skills. Experience with OLAP and cube technologies, SSIS packages, and SSRS reporting is essential. Experience with Microsoft Dynamics AX2009 data schema and X++ coding a definite plus

This role requires a blend of technical proficiency, a passion for data-driven decision making, and the ability to design and implement scalable data solutions.

Database Development and Administration: Design, develop, and maintain robust database systems. Optimize database performance through tuning, indexing, replication, and query optimization. Ensure data integrity and security.

Data Pipeline Construction: Develop and maintain ETL processes using SSIS packages to ingest data from various sources, including Microsoft Dynamics AX2009, transform it according to business rules, and load it into data warehouses.

Data Mining and OLAP: Design and build OLAP cubes for multidimensional data analysis.

Data Analysis and Reporting: Utilize SSRS and other tools to create and manage complex reports and dashboards that provide actionable insights to business stakeholders.

Performance Tuning: Monitor and optimize the performance of data processing and storage systems. Ensure efficient data flow between databases, servers, and storage environments.