Software Engineer Ii - Data Services

Verana Health, a digital health company that delivers quality drug lifecycle and medical practice insights from an exclusive real-world data network, recently secured a $150 million Series E led by Johnson & Johnson Innovation - JJDC, Inc. (JJDC) and Novo Growth, the growth-stage investment arm of Novo Holdings.
Existing Verana Health investors GV (formerly Google Ventures), Casdin Capital, and Brook Byers also joined the round, as well as notable new investors, including the Merck Global Health Innovation Fund, THVC, and Breyer Capital.
We are driven to create quality real-world data in ophthalmology, neurology and urology to accelerate quality insights across the drug lifecycle and within medical practices. Additionally, we are driven to advance the quality of care and quality of life for patients. DRIVE defines our internal purpose and is the galvanizing force that helps ground us in a shared corporate culture. DRIVE is: Diversity, Responsibility, Integrity, Voice-of-Customer and End-Results. Click here to read more about our culture and values.
Our headquarters are located in San Francisco and we have additional offices in Knoxville, TN and New York City with employees working remotely in AZ, CA, CO, CT, FL, GA, IL, LA, MA, NC, NJ, NV, NY, OH, PA, SC, TN, TX, UT , VA, WA, Washington, D.C . All employees are required to have permanent residency in one of these states. Candidates who are willing to relocate are also encouraged to apply.
Job Title: Software Engineer II - Data Services
As a Data/Software Engineer at Verana Health, you will be responsible for extending a set of tools used for data pipeline development. You will have strong hands-on experience in design & development of cloud services. Deep understanding of data quality metadata management, data ingestion, and curation. Generate software solutions using Apache Spark, Hive, Presto, and other big data frameworks. Analyzing the systems and requirements to provide the best technical solutions with regard to flexibility, scalability, and reliability of underlying architecture. Document and improve software testing and release processes across the entire data team.
Job Duties and Responsibilities:

• Build scalable data engineering pipelines with Pyspark, AWS and Databricks.
• Provide and receive meaningful feedback during code reviews.
• Design solutions to solving problems related to ingestion of highly variable data structures in a highly concurrent cloud environment.
• Design hands on development and implementation of automated data pipelines to enable ETL of big data with Pyspark, Apache Airflow, Docker on AWS/Databricks.
• Build microservices for providing abstraction to data ingestion related processes and information.
• Development of secure Data Services using RESTful API's(oauth/saml), scalable(containerized using Docker), observable (using monitoring tools like datadog, elk stack, Cloudwatch), documented using OpenAPI/Swagger by using frameworks in python/java and automated CI/CD deployment using Github actions.
• Retain metadata for tracking of execution details to reproducibility and providing operational metrics.
• Work closely with Extraction and Normalization teams to plan new features and define requirements to the system to support the ingestion and normalization of data assets.
• Work closely with technology teams to understand processes and policies driving team goals.
• Research and perform proof-of-concept and leverage performant database technologies(like Aurora Postgres, Elasticsearch, Redshift) to support end user applications that need sub second response time.

Basic Requirements:

• A minimum of a BS degree in computer science, Software Engineering, or related scientific discipline.
• A minimum of 3 years of experience in software development
• Demonstrated ability to build software tools in a collaborative, team oriented environment that are product and customer driven.
• Experience in ETL design, implementation and maintenance, preferably in Pyspark and Airflow.
• Experience with OOP or FPin a production setting, preferably Python.
• 1 year of experience working in AWS cloud computing environment, preferably with S3, SNS, SQS.
• Solid SQL comprehension..
• Version control with Git/Github.
• Hands-on experience with Docker containers and container orchestration.

Bonus:

• Healthcare and medical data experience is a plus.
• Additional experience with modern compiled programming languages (C#, NodeJS, React)
• Experience building HTTP/REST APIs using popular frameworks
• Building out extensive automated test suites

Benefits:

• We provide health, vision, and dental coverage for employees
  • Verana pays 100% of employee insurance coverage and 90% of family

• • Plus an additional monthly $100 individual / $200 HSA contribution with HDHP

• 401k Match - 3% match paid year end, up to $1000/year
• A generous parental leave policy and family building support through the Cleo Family
• Flexible vacation plans
• $700 Learning & Wellness stipend
• $25/wk in Doordash credit
• Spring Health mental health support

Final note:
You do not need to match every listed expectation to apply for this position. Here at Verana, we know that diverse perspectives foster the innovation we need to be successful, and we are committed to building a team that encompasses a variety of backgrounds, experiences, and skills.
#LI-Remote
#BI-Remote
Verana Health is committed to complying with all applicable pay transparency laws and supports equitable pay practices. We pay based on a market-based approach, supported with robust data and in alignment with the compensation of our existing team. We construct our compensation ranges based on the US national average but your pay may vary depending on your location and the cost of living index for that geographic area. In determining an offer, base salary will also be based on experience, qualifications, skills and market conditions.
Please note pay ranges for major metropolitan areas may be different.
National Pay Range
$125,000 - $140,000 USD