Parallel Works - High Performance Computing Platform Lead Engineer

About Us

Parallel Works is a Chicago-based startup focused on technical computing for science, engineering and business applications. The Parallel Works SaaS platform makes HPC workflows easy, fast and collaborative on hybrid cloud and supercomputing environments. Our customers range from small and nimble startups creating innovative computing and ML pipelines to the world’s leading flood modelling engineers to scientific weather / climate agencies to global suppliers to the automotive industry.

The Role

This position involves development and enhancement of the Parallel Works platform, which runs on all three leading public cloud platforms: AWS, Azure and Google Cloud. You’ll work with cloud APIs, workflow management frameworks, container systems, resource management tools, and parallel programming tools and libraries, OS performance measurement and monitoring tools, HPC schedulers and debuggers. The platform acts as a middleware between these wide ranges of computing resources and allows organizations to leverage the resources, billing and user hierarchies in a uniform way.

Required Experience

• BSci in Computer Science or related field.
• 5+ years of programming experience with Python, Java and/or C.
• Thorough knowledge of the Linux operating system services.
• Familiarity with command-line shell interpreters and scripting techniques Familiarity with HPC schedulers including Slurm and PBS.
• Resource and data management automation on one or more public cloud, ideally AWS, Azure or GCP, using APIs and CLIS.
• Understanding of parallel programming models including MPI and OpenMP.
• Compiling and building software.
• Git revision control, branching and merging techniques using GitHub.
• Network service programming including tunneling and port forwarding.
• Experience with container management services, in particular Docker and Singularity.

Requirements

Desired Experience

• Advanced degree (MSci or PhD) in Computer Science
• Web-based Node.js portals with frameworks like React, Backbone or Angular.
• OAuth authentication and authorization protocols.
• Experience with parallel profiling and debugging.
• Jupyter Notebook experience.
• Some basic familiarity with machine learning concepts, tools and libraries.
• Workflow programming experience.
• Database experience with SQL and JSON/NoSQL databases, ideally PostgreSQL and MongoDB.
• Distributed parallel filesystems such as Lustre and data management services such as Globus.
• High speed data movement and parallel IO techniques.
• Performance profiling techniques.

Parallel Works is an Affirmative Action, Equal Opportunity Employer. As part of our standard hiring process for new employees, employment with Parallel Works will be contingent upon successful completion of a comprehensive background check and technical evaluation.