This role is for one of the Weekday's clients
Min Experience: 15 years
Location: India
JobType: full-time
We are looking for a highly accomplished Principal Engineer to lead the architecture and design of large-scale, high-performance data platforms. This role requires deep expertise in distributed systems, real-time data processing, and cloud-native infrastructure, along with the ability to influence technical direction and simplify complex engineering challenges into scalable, elegant solutions.
Requirements
Key Responsibilities & Expertise
- Architect and design highly scalable, fault-tolerant data pipelines supporting near real-time and real-time data processing use cases.
- Lead the design of high-throughput, low-latency data services, including gRPC-based streaming systems with advanced performance optimizations.
- Diagnose complex system-level issues and drive root-cause analysis across distributed environments.
- Simplify complex technical problems into robust, maintainable, and efficient system architectures.
- Design and optimize systems using modern serialization formats such as Protocol Buffers and Avro.
- Apply deep knowledge of network protocols (TCP/IP, HTTP/2) and distributed system security, including TLS, authentication, and authorization mechanisms.
- Architect and optimize solutions leveraging distributed object storage systems (e.g., S3, GCS), with strong understanding of their architecture, consistency models, and scalability characteristics.
- Drive performance optimization for analytical data formats such as Parquet and Iceberg, including partitioning strategies, sorting, compression, and read efficiency.
- Collaborate closely with platform, infrastructure, and data teams to build cloud-native data solutions on AWS, GCP, or similar environments.
- Influence engineering best practices, architectural standards, and long-term technical strategy across teams.
- Communicate complex technical concepts clearly to diverse stakeholders, including engineers, product leaders, and executives.
- Work effectively with globally distributed engineering teams across multiple time zones.
Technical Skills
- Expert proficiency in Golang, Java, or similar systems-level programming languages.
- Deep understanding of concurrency, distributed computing, and performance optimization.
- Strong experience with gRPC, streaming architectures, and real-time systems.
- Hands-on expertise in distributed data storage and cloud-native architectures.
Skills
Principal Engineering · Distributed Systems · Data Architecture · Golang · Java · gRPC · Cloud Infrastructure · Data Storage · System Design