Our Client:

Our client is at the forefront at revolutionizing computing with our cutting-edge decentralized platform. Our mission is to deliver unparalleled high-performance services with heterogeneous trust to anyone worldwide. Their platform is uniquely designed to support services with diverse requirements in terms of performance demand, trust model, and fault tolerance. Currently, their focus is on launching our first use cases: a decentralized AI inference service that leverages globally contributed GPUs, and an advanced web3 social app, both seamlessly integrated with our expansive internet-scale mesh network.

The company is led by co-founders with PhDs in AI, Blockchain, Math and Systems, is ready to redefine computing. They are currently seed stage.

Location: Hybrid in San Francisco Bay Area

About The Role:

They are on the lookout for a Founding AI Engineer to join us in shaping the future of decentralized AI. In this crucial role, you'll work alongside the co-founders to architect and develop a decentralized AI platform. This platform will empower anyone with GPU capabilities to contribute to AI inference and fine-tuning, catering to a diverse range of applications.

Who You Are:

You are the ideal candidate if you:

• Have a strong foundation in software engineering and a history of leading or significantly contributing to machine learning system projects.
• Have worked on distributed inference/fine-tuning for LLMs and diffusion models
• Have practical skills in training, fine-tuning, and deploying neural networks.
• Understand ML performance profiling and optimization, including graph-level optimizations.
• Are familiar with common neural network architectures and operators.

Preferred Qualifications:

• Experience with or willingness to learn Rust.
• Knowledge of ML compilers, with TVM experience being a significant advantage.
• Experience with GPU kernels, CUDA, NCCL, Pytorch, Tensorflow.
• Understanding P2P networks or worked with distributed cloud services and microservices

Our Client:

Redefining Trust in Decentralization: The traditional belief that trust in decentralization hinges solely on consensus/blockchain is evolving. While this method provides strong transaction security, it's not suited for applications requiring low latency and high performance, like AI, streaming, or gaming.

Revolutionizing Decentralized Systems : At its core, the platform is designed with innovation as a two-layer architecture. The first layer is an Internet-scale mesh network that delivers data with high speed, utilizing a smart routing protocol. The second layer consists of a dynamic set of nodes in the network that render services following our innovative Invoke-Return-Combine paradigm. This architecture enables developers to create their services using a familiar client-server model, serving millions of clients without concerns about the decentralized nature.

Pioneering Decentralized AI: Their first product is a decentralized AI service pipeline, marks the start of our transformative journey. This innovation is our response to pressing industry challenges like the GPU shortage and the high costs associated with extensive AI systems. Our focus is on delivering scalable, cost-effective, and reliable AI solutions that empower users with true ownership and control. This approach is not just a step forward in AI technology; it's a leap towards user-centric, democratized AI.

Collaborative and Visionary Culture: Our client is where collaboration meets innovation. We're not just a team; we're a collective of thinkers, creators, and visionaries. Our culture is built on the belief that every team member brings unique ideas and expertise to the table.