Senior Staff Software Engineer, Streaming

We are looking for a highly motivated Senior Staff Software Engineerto play a pivotal role in realizing Voltron Data’s streaming data vision within the composable data ecosystem. As a key member of the team, you will be entrusted with making strategic architecture decisions, evaluating technical feasibility for proof of concepts, crafting meticulous component designs, and driving executions to completion. You will collaborate alongside highly competent product engineering experts. You will also have the opportunity to work across open-source stacks (e.g., Ibis, Arrow, Substrait) and proprietary implementations.

Your contributions will directly impact the advancement of our unified data processing capabilities, driving innovation and setting new benchmarks within the industry. Join us in shaping the future of data analytics.

Why work at Voltron Data?

• We are Going for Impact: We are a Series A, venture-backed startup assembling a global team to build a new foundation for data analytics with Apache Arrow. This foundation will usher in a wave of innovation in data processing that can take full advantage of the speed and efficiency offered by modern hardware. 

• We are Committed to Bridging Open Source Communities: We are a collection of open source maintainers who have been driving open source ecosystems over the last 15 years, particularly in the C++, Python, and R programming ecosystems.

• We are Building a Diverse, Inclusive Company:  We are creating a representative, equitable, and respectful workplace that prioritizes employee growth. Everyone at Voltron Data is bought into the company’s success; all voices are critical to shaping the organization’s future. 

Timeline:

Below is a rough timeline of where you can expect to be at different points during your career path starting in this position.

Upon joining:

• Spending time learning about the Ibis and Apache Arrow, the open-source software we support as critical building blocks in the composable data ecosystem.

• Getting exposed to accelerated computing concepts such as GPUs and DPUs.

• Learning and embracing the software development culture at Voltron Data.

Within a month:

• Engage actively in building a proof of concept, collaborating with peers to assess its engineering feasibility against our business objectives.

• Work closely with open-source tools such as Ibis, Arrow, Kafka, DuckDb, Flink, and RAPIDS/cuDF in a GPU-accelerated environment.

• Analyze and interpret results meticulously to inform various distributed system design tradeoffs.

• Contribute to bug fixing efforts and propose areas for improvement in conjunction with the team.

Within 6 months:

• Iterate and evolve the proof of concept into a more crafted offering, leveraging feedback and insights gained along the way.

• Foster cross-organizational and cross-functional collaboration with co-design partners to turn the PoC into an offering deployable at an internet scale.

• Demonstrate unwavering commitment to engineering excellence, setting high standards for execution quality and velocity.

• Ship an MVP use case.

Within 12 months:

• Mature the technology to be ready for broader adoption.

• Establish an efficient engineering process for fast iteration with high engineering qualities.

• Become one of the company's streaming go-to experts and strategic technical advisors.

Previous experience that could be helpful (not all required):

• You have built large-scale distributed systems that can handle throughput greater than 10-100GB/s.

• You have worked with batch processing and stream processing systems. You are opinionated about data platform evolution and a strong thought leader.

• You have good intuitions about distributed system challenges and failure characteristics.

• You have experience running capacity planning and estimations in cloud-native or on-premise data centers.

• You love building at a scale that most companies don’t even imagine.

• You have experience with hardware like GPUs, DPUs, FPGAs, and associated software.

US Compensation - The salary range for this role is between $170,000.00 - $250,000.00. We have a global market-based pay structure which varies by location. Please note that the base pay range is a guideline, and for candidates who receive an offer, the exact base pay will vary based on factors such as actual work location, skills and experience of the candidate. This position is also eligible for additional incentives such as equity awards.

#LISM1