Design, develop, test, and maintain scalable data processing applications and distributed systems.
Build and optimize large-scale batch and streaming data pipelines.
Develop high-performance solutions using Java and/or Scala for data-intensive workloads.
Work with big data ecosystems to process, transform, and analyze large datasets efficiently.
Participate in system design discussions and contribute to High-Level Design (HLD) and Low-Level Design (LLD) activities.
Implement software engineering best practices including Test-Driven Development (TDD), code reviews, CI/CD, and automated testing.
Troubleshoot production issues and drive performance optimization initiatives.
Collaborate with data engineers, architects, product managers, and business stakeholders to deliver data-driven solutions.
Ensure reliability, scalability, security, and maintainability of data platforms and applications.
Contribute to technical documentation, architecture reviews, and knowledge-sharing initiatives.
About You :
Professional Experience: 3-5 years of experience in software development with a focus on big data platforms and analytics systems
Foundational Knowledge: Strong academic background in Data Structures & Algorithms, Operating Systems, Database Management Systems, Computer Networks, and Object-Oriented Programming.
Core Competencies: Ability to build scalable and reliable distributed applications, strong problem-solving and analytical skills, experience in Agile environments, excellent communication and stakeholder collaboration, and a proven ability to learn new technologies quickly.
Big Data & Analytics: Apache Spark, Hadoop, MapReduce, Apache HBase, data pipeline development, and large-scale data processing.
Programming: Expert-level proficiency in Java and Scala; strong foundation in data structures, algorithms, and concurrency.
Cloud & Platform: Experience with AWS, Amazon EMR, Amazon EKS, and Kubernetes.
Data Streaming & Orchestration: Proficient with Apache Kafka, Apache Oozie, and Hue.
DevOps & Tools: CI/CD pipeline implementation, GitHub, and SVN.
Architecture & Engineering: Expertise in HLD/LLD, Microservices design patterns, and TDD practices.
Education: Bachelor's degree (BE/B.Tech) in Computer Science, IT, or Software Engineering from a reputed university.
Company Benefits and Perks:
Retirement Plans
Medi
Benefits
Flexible schedule
Additional Information
Job Title:
Software development Engineer - Java | Hadoop | Apache Spark | AWS | 3y to 5y
About Skyhigh Security:
Skyhigh Security is a dynamic, fast-paced, cloud company that is a leader in the security industry. Our mission is to protect the world's data, and because of this, we live and breathe security. We value learning at our core, underpinned by openness and transparency.
Since 2011, organizations have trusted us to provide them with a complete, market-leading security platform built on a modern cloud stack. Our industry-leading suite of products radically simplifies data security through easy-to-use, cloud-based, Zero Trust solutions that are managed in a single dashboard, powered by hundreds of employees across the world. With offices in Santa Clara, Aylesbury, Paderborn, Bengaluru, Sydney, Tokyo and more, our employees are the heart and soul of our company.
Skyhigh Security Is more than a company; here, when you invest your career with us, we commit to investing in you. We embrace a hybrid work model, creating the flexibility and freedom you need from your work environment to reach your potential. From our employee recognition program, to our 'Blast Talks' learning series, and team celebrations (we love to have fun!), we strive to be an interactive and engaging place where you can be your authentic self.
We are on these too! Follow us on LinkedIn and Twitter @SkyhighSecurity .
Role Overview:
We are looking for a highly motivated Software Development Engineer (SDE) with 3-5 years of experience in Big Data Engineering and Data Analytics to design, develop, and optimize scalable data platforms and distributed processing systems. The ideal candidate should have strong expertise in Java/Scala-based backend development, big data technologies, and cloud-native data processing frameworks. The role involves building high-performance data pipelines, processing large-scale datasets, and contributing to the architecture and implementation of modern data platforms.
The candidate will collaborate with cross-functional teams including product, analytics, platform engineering, and operations teams to deliver reliable, scalable, and efficient data solutions that power critical business insights and applications.
Trellix · Bangalore, India