AddressPOSITION DESCRIPTION:
The Data Engineer ensures that the infrastructure handles diverse sources of data seamlessly, understands data analysis, end-user requirements analysis, and business requirements analysis to develop a clear understanding of the business needs and to incorporate these needs into technical solutions. S/he will design, develop, and maintain data pipelines, integrate with new technologies, and oversee the development of new data managed processes that support key customer facing functions. This role will ensure data pipelines are scalable, repeatable, and secure, and can serve multiple business units within the organization. You will facilitate data collection and movement between a variety of different sources, analyze data from the various sources and produce meaningful reports and/or presentations. Delivery from this team will be based on DevOps model where it is not only about delivering business value but also about reliability, agility, and scalability.
THIS POSITION CAN BE REMOTE/HYBRID/ON-SITE.
PRIMARY RESPONSIBILITIES:
- Implement data integration projects, including developing a data model, maintaining a data warehouse and analytics environment, and writing scripts for data integration and analysis.
- Build and maintain optimized and highly available data pipelines that facilitate deeper analysis and reporting by the Data and Analytics department.
- Analyze, transform, and prepare data for large scale migration projects.
- Identify and work on master data consolidation and management as part of the migration exercise.
- Develop automated workflows to perform data migrations using both on-premise and cloud-based technologies
- Create complex stored procedures, views, materialized views, functions, and other database objects using TSQL as required.
- Design, implement, test, deploy, and maintain stable, secure, and scalable data engineering solutions and pipelines in support of data and analytics projects, including integrating new sources of data into the central data warehouse, and moving data out to applications and affiliates.
- Produce scalable, replicable code and engineering solutions that help automate repetitive data management tasks.
- Perform one-off data manipulation and analysis
- Implement and monitor best in class security measures in our data warehouse and analytics environment, with an eye towards the evolving threat landscape.
- Design robust integration solution error handling, monitoring, and reporting ensuring early detection and resolution of issues.
- Perform in-depth data analysis to validate system behavior, identify problems, and support business users
- Collaborate with application and IT system administration teams as required and make recommendations on SQL Server sizing and configuration, database design and features, or T-SQL query tuning/best practices
REQUIRED SKILLS/EXPERIENCE:
- Bachelor's degree in computer science, computer engineering, or similar technical discipline or equivalent work experience.
- 3-5 years of extensive experience on MS SQL Server, writing complex stored procedures and functions and working on ETL solution using SSIS.
- Proficiency with Python, especially for data manipulation and analysis, and ability to build, maintain and deploy sequences of automated processes.
- Advanced level of knowledge of relational databases, database structures and design, systems design, data management, data warehouse a plus.
- Advanced knowledge of data modeling and understanding of different data structures and their benefits and limitations under particular use cases.
- Proven experience working hands-on with big data systems.
- Extensive experience on writing complex SQL Queries to analyze and transform data sets
- Experience in data analysis and transformation of large data sets using SQL Server
- Experience in gap analysis, data mappings
- Experience in master data management for large scale implementations
- Experience in debugging and identifying gaps in data elements
- Experience in working on data migration projects with large data sets
- Experience in developing automated workflows
- Extensive experience using SSIS as an ETL tool to perform data cleansing, data blending, data validation, data transformation, data normalization, and possibly multi-dimensional modeling after some time in the role
- Experience and high proficiency in
- Microsoft SQL Server
- T-SQL query language
- Python Programming Language a must
- PowerShell
- SQL Monitoring tools/utilities experience (Solarwinds)
- SQL Server virtualization
- SQL Server Integration Services (SSIS)
- SQL Server Management Studio (SSMS)
- SQL Server Reporting Services (SSRS)
- Experience with Power BI a plus.
- Experience with Microsoft Azure a plus.
- Experience with advanced data visualization and mapping a plus
- Excellent communication skills
- Strong logical, analytical, and problem-solving skills
- Can work in a fast paced, ever changing environment with a growth mindset
BENEFITS:
We value our employees and in addition to our competitive salaries, we offer a competitive benefit package to our talented team members including:
- Comprehensive Health Care, Vision & Dental Plan
- Flexible Spending Account
- Disability Plans
- Basic & Supplemental Life Insurance
- Additional Supplemental Benefits
- Paid Vacation, Paid Time Off (PTO) days, Holidays
- 401(k) Retirement Saving Plan including a generous Company match
Bethlehem Shared Services, LLC. is an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability status, protected veteran status, or any other characteristic protected by law. Please note that candidates must be eligible to work in the United States and that only qualified candidates will be contacted.
#LI-Remote
