Staff Engineer - Open Source Data Platform (ODP)

About the role

Acceldata is the market leader in Enterprise Data Observability. Founded in 2018 and backed by top investors including Insight Partners, March Capital, Lightspeed, Sorenson Ventures, Industry Ventures, and Emergent Ventures, we are a Series-C funded company headquartered in Silicon Valley. Our Enterprise Data Observability Platform-the first of its kind-helps enterprises build and operate world-class data products by ensuring data is reliable, trusted, and ready to power today's most critical technologies, including AI, LLMs, Analytics, and DataOps. Delivered as a SaaS solution, Acceldata is trusted by leading global organizations such as HPE, HSBC, Visa, Freddie Mac, Manulife, Workday, Oracle, PubMatic, PhonePe (Walmart), Hershey's, Dun & Bradstreet, and many more. We are seeking a Staff Engineer with at least 9 years of experience in distributed systems or data platform development. In this role, you will be a technical leader responsible for architecting and driving the technical direction of critical components within the Acceldata Open Data Platform (ODP). You will work on solving the most challenging distributed systems problems, contribute to open-source communities, and mentor senior engineers while shaping the future of large-scale data infrastructure. You'll lead high-impact initiatives that directly influence how petabyte-scale data is managed, observed, and optimized across hybrid and cloud ecosystems. You'll collaborate with industry experts, Apache committers, and seasoned engineers who share your passion for distributed systems and open-source innovation. WHY JOIN US At Acceldata, you won't just be writing code; you'll be defining the architecture and technical vision for modern data platforms used by some of the world's largest enterprises. Your technical decisions will shape mission-critical systems, and your contributions will be visible across the global data ecosystem. If you're ready to take ownership of complex technical challenges and drive innovation at scale, Acceldata is where you belong. At Acceldata, we are committed to providing equal employment opportunities regardless of job history, disability, gender identity, religion, race, color, caste, marital/parental status, veteran status, or any other special status. We stand against the discrimination of employees and individuals and are proud to be an equitable workplace that welcomes individuals from all walks of life if they fit the designated roles and responsibilities. #LifeAtAcceldata is all about working with some of the best minds in the industry and experiencing a culture that values an 'out-of-the-box' mindset. If you want to push boundaries, learn continuously, and grow to be the best version of yourself, Acceldata is the place to be! We also believe in providing our employees with the right tools and resources to help them excel at their jobs. We offer: - PTO Plan with unlimited negative balance - RRSP Plan - Up to 100% employer-paid benefit options for health, dental, and vision coverage - Supplemental Benefits - Apple Air Mac Equipment - Office gym access (includes workout equipment, basketball court, and showers) - Becoming part of the team that coined the term "Data Observability"!

Requirements

• 9+ years of hands-on software development experience with at least 5 years focused on distributed systems or big data platforms.
• Expert-level proficiency in Java or Scala, with strong Python skills. Experience with systems languages is a plus.
• Deep understanding of distributed computing principles, including consensus algorithms, data partitioning, replication, fault tolerance, and consistency models.
• Extensive hands-on experience with multiple components of the big data stack (Hadoop, Spark, Hive, Trino, Kafka, Flink, NiFi or similar).
• Expert-level Linux proficiency, including kernel tuning, performance analysis, and debugging at the system level.
• Strong experience with Kubernetes, Docker, and cloud platforms (AWS, GCP, or Azure).
• Deep expertise with Maven, Gradle, or SBT; experienced in CI/CD pipelines, GitHub, and artifact management (Nexus).
• Proven ability to diagnose and resolve complex issues, including memory leaks, deadlocks, GC tuning, and distributed system failures.
• Strong understanding of architectural patterns for scalable, fault-tolerant distributed systems.
• Excellent written and verbal communication skills; ability to articulate complex technical concepts to diverse audiences, including senior leadership.
• Demonstrated ability to work effectively with cross-functional teams, external contributors, and the open-source community.
• PREFERRED SKILLS
• History of significant contributions or committer status in Apache projects (e.g., Spark, Kafka, Hive, Iceberg, Flink, etc.).
• Experience with modern table formats (Apache Iceberg, Delta Lake, Hudi) and data lake architectures.
• Experience developing or optimizing query engines, query planners, or execution frameworks.

Your Match

How well this role fits your profile.

Company Intel

What employees say

Worked at acceldata? Share your experience