Data Engineer

Data Engineer - (Google Cloud Platform/Python/SQL/SQLServer/SSIS/SSRS)

At Castlight, our mission is to empower people to make the best choices for their health and to help companies make the most of their health benefits. We offer a health benefits platform that engages employees to make better healthcare decisions and can guide them to the right program, care, and provider.

The platform also enables benefit leaders to communicate and measure their programs while driving employee engagement with targeted, relevant communications. 

To date, Castlight has partnered with more than 240 large enterprise customers, spanning millions of lives, to improve healthcare outcomes, lower costs, and increase benefits satisfaction.

WHAT YOU'LL BE DOING:

Castlight’s Data Engineering Team is responsible for the end-to-end management of data lifecycle for both batch & streaming data – from data acquisition (inbound), ingestion & validation, warehousing (reporting and analytics) and data distribution (outbound).  

We are looking for seasoned Data Engineers who have a penchant for problem-solving with a passion for data processing innovations, supportability & data quality to join our Data Engineering Team.  The candidate must be comfortable dealing with large sets of data, disparate data sources, imperfect data sets and can drive data automation that will remove frictions in data processing. 

As data volume increases, the candidate must apply deep knowledge in data modeling, query performance tuning, scalability and optimization to implement best practices and create solutions. 

To succeed in this role, you'll need to be a versatile engineer. You must have an innate desire to build things the right way.  You should be pain-averse -- if some process or system isn't as streamlined as it could be, you want to fix it!  You will have a lot of interaction with the Customer Success team and other externally facing groups hence verbal and written communications skills are required.  You must be a champion of standardizing and maturing the business process to support scalability.

You will be working with cross-functional teams within and outside of the engineering department and with team members in SF and India.  This is a full-time position at our San Francisco headquarters.

RESPONSIBILITIES:

• Data Discovery- analyzing data values and data patterns to identify the relationships that link disparate data elements into logical units of information, or “business objects” (such as customer, patient or claim). Identify the transformation rules that have been applied to a source system to populate a target such as transactional entities, operational data store or data warehouse

• Data Architecture and Modeling- Create logical and physical data models, including conceptual models. Define data attributes, including domain constraints and privacy attributes. Discover, explore, and visualize the structure of data sources. Discover or identify relationships between disparate data sources. Compare and synchronize the structure of two data sources

• Data Governance/Stewardship– Record the business use for defined data. Identify opportunities to share and re-use data. Monitors the progress towards, and tuning of, data quality and data security target metrics. Ensures the quality, completeness, and accuracy of data definitions. Identifies and manages the resolution of data quality and data security issues, such as uniqueness, integrity, accuracy, consistency, privacy and completeness in a cost-effective and timely fashion. Identify procedures for disaster recovery and data archiving to ensure effective protection and integrity of data assets.

• Data quality- Ensure the stability, integrity and efficiency of data access and data quality across the organization via ongoing database support and maintenance.

• Database architecture, administration and development- Work with application development staff to develop database architectures, coding standards, and quality assurance policies and procedures. Participate in testing and implementing database design and functionality and tuning for performance.

• Metadata -support information governance by providing reporting and traceability on data movement, modeling and business intelligence applications, as required by regulatory requirements. Analyze and view the impact of changes to the current information model, avoiding potentially disruptive modifications to existing processes.

• Customer Implementation and Production Support– Assist Customer Implementation and Production support teams as DM SME during troubleshooting issues.

• Data warehouse – Knowledge in developing queries against Enterprise Data Warehouse star schema is a nice to have. Participate in research and development of recommendations regarding database components, including hardware, database systems, ETL software, metadata management tools and database design solutions. 

QUALIFICATIONS:

• Minimum 2 years experience building data pipelines with Google Cloud Platform. Working knowledge of Cloud Data Flow, Cloud Data Fusion, Cloud Dataproc, Pubsub. 

• Minimum of 2 years of experience with Python/Java.

• Minimum of 2 years of experience writing SQL for querying databases. Ability to extract information from databases using complex query statements and advanced database tools.

• Minimum of 2 years of experience analyzing and developing data requirements and data specifications; hands-on experience documenting understanding and analysis of databases and data models.

• Minimum of 2 years of experience developing backend data sources for the reporting and analytics platform.

• Minimum of 2 years of technical experience with designing, building, installing, configuring and supporting database servers including database tuning and troubleshooting experience.

• Experience with Informatica.

• Experience with version control tools & release management.

• BS in Computer Science or related Degree, or equivalent work experience.