System Architect - Kafka Chennai, India
System Architect - Kafka Description
EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.
We are seeking a seasoned Kafka System Architect to join our team.
The selected candidate will be pivotal in installing, monitoring, troubleshooting, and maintaining our Kafka platform while ensuring optimal performance and security. This role demands a proactive approach to developing new features, automations, and integrations to continually enhance system capabilities.
#LI-DNI#EasyApply
Responsibilities
- Manage installation and provisioning of new Kafka clusters and support components
- Conduct regular monitoring to assess the health and performance of the Kafka platform and associated data pipelines
- Troubleshoot and resolve platform issues related to data pipelines, network problems, and cloud or containerization resources failures
- Implement performance tuning for Kafka platform components
- Monitor and adjust the Kafka clusters to optimize cost and performance
- Plan, test, and execute upgrades to newer versions of the Kafka platform
- Enhance the security of the Kafka platform through access control, encryption, and regular security audits
- Carry out regular backups and develop disaster recovery plans
- Oversee capacity management for the Kafka platform, including scalability planning
- Document system procedures, configurations, and troubleshooting guides
- Coordinate with Confluent Support for unresolved issues
- Maintain and enhance automated scripts for platform management and maintenance
- Provide support to application teams with Kafka consumers, producers, connectors, and streams setup
- Handle team support requests effectively, utilizing Slack and converting complex issues into CLOUD Tickets
Requirements
- Proven experience in Confluent Platform implementation and maintenance
- Minimum 10 years of experience in Kafka administration
- Skilled in using Helm and Kubernetes for deploying Kafka
- Background in programming with Python or Shell Scripting
- Proficiency in Cloud technologies across AWS or GCP covering compute, networking, storage, and IAM aspects
Nice to have
- Previous experience with infrastructure as code (IaC) and configuration management (CM) tools
- Capability to streamline team processes through enhanced automation scripts and self-service tools
We offer
- Opportunity to work on technical challenges that may impact across geographies
- Vast opportunities for self-development: online university, knowledge sharing opportunities globally, learning opportunities through external certifications
- Opportunity to share your ideas on international platforms
- Sponsored Tech Talks & Hackathons
- Unlimited access to LinkedIn learning solutions
- Possibility to relocate to any EPAM office for short and long-term projects
- Focused individual development
- Benefit package:
- Health benefits
- Retirement benefits
- Paid time off
- Flexible benefits
- Forums to explore beyond work passion (CSR, photography, painting, sports, etc.)
