Senior Kafka Engineer (GCP, AWS) Ukraine or Remote
Senior Kafka Engineer (GCP, AWS) Description
We are looking for a Senior Kafka Engineer with proficiency in GCP and AWS to join our team.
Our client is a leading provider of property insights and innovative solutions. Their work is directly involved with the largest asset class in the world: property.
We are building a Kafka platform support team. The candidate will be responsible for installing, monitoring, troubleshooting, and maintaining the Kafka platform, ensuring optimal performance and security, and developing new features/automation/integration. Kafka Platform team are also involved into supporting PagerDuty and Uptrends SaaS including automation of these platforms support.
This role requires participation in an on-call support rota, including up to 8 hours on one weekend day (Saturday or Sunday).
The remote option applies only to the Candidates who will be working from any location in Ukraine.
#LI-DNI#LI-IK2
Responsibilities
- Install and provision new Kafka clusters and supporting components; regularly monitor the health and performance of the Kafka platform and data pipelines
- Identify and fix issues related to the platform, including data pipelines, network problems, cloud or containerization resources failures, or software bugs
- Perform regular performance tuning of Kafka platform components
- Monitor and optimize the cost and performance of Kafka clusters
- Upgrade the Kafka platform to newer versions, including planning, testing, and implementation
- Manage the security of the Kafka platform, including access control lists, encryption, and regular security reviews
- Perform regular backups and disaster recovery procedures
- Manage the capacity of the Kafka platform, including projecting future growth and scaling needs
- Work with Confluent Support for issues that cannot be resolved in-house
- Support existing Infrastructure as Code (IaC) and Configuration Management (CM) automations/pipelines for Kafka platform management and maintenance
- Maintain and enhance onboarding automation scripts
- Support Kafka self-service automations for Topic, RBAC, Schema, Connectors management; support application teams in setting up and onboarding Kafka consumers, producers, connectors, and streams
- Provide support for team requests in Slack and convert to CLOUD Tickets if complexity is high
- Implement new features released by the vendor as part of their product roadmap, in coordination with the Platform owner team
- Implement and enhance automation scripts and processes to reduce the number of tickets via self-service
Requirements
- 4+ years of strong proficiency in DevOps
- 3+ years of experience with Cloud GCP+AWS (compute, networking, storage, IAM)
- Proven experience in the implementation and maintenance of Confluent Platform
- Python/Shell scripting and automation experience, HELM Kubernetes/Containers, Docker
- Excellent problem-solving skills and the ability to troubleshoot complex issues
- Experience in automating processes and maintaining automated scripts
- Understanding of networking, and capability to coordinate with different teams including the Networking team, and CI/CD team, among others
- Strong English written and verbal communication skills (B2+ or higher)
Nice to have
- Familiarity with PagerDuty, Uptrends, and Terraform
We offer
- Work on a flexible schedule remotely or from any of our comfortable offices or coworking spaces in Ukraine
- Receive the necessary equipment to perform your work tasks
- Change projects and technology stacks within EPAM
- Gain experience in various business domains (Insurance, E-commerce, Healthcare, Finance, Travelling, Media, Artificial Intelligence, and more)
- Consider relocation options in over 30 countries worldwide
- Participate in volunteer, charity programs and communities (both technical and interest-based)
- You can plan your individual career path together with your manager
- Receive regular feedback from colleagues
- Improve your English for free with certified teachers (Speaking Clubs, client interview preparation courses, etc.)
- Get the opportunity to undergo free training and certification in AWS, GCP, or Azure Clouds
- Use the internal E-learn training program (18,200+ specialized training and mentoring programs)
- Access corporate accounts on LinkedIn Learning, Get Abstract and other partner resources
- Study at EPAM Solution Architecture School with the instructors who are practicing architects
- Develop as a leader, join Delivery Management, Resource Management, Leadership Essentials school and more
- Participate in internal communities (500+ meetups, technical discussions, brainstorming sessions, online events and conferences annually)
- Vacation and sick leave (including a sick leave without a medical certificate)
- A wide range of Voluntary Medical Insurance programs providing both medical treatment and various preventive options (including sports activities)
- Medical insurance for family members at corporate rates
- Company support during significant life events (childbirth or adoption, marriage, etc.)
- Support for psychological comfort: discounts on services from mental health specialists or coaches, thematic training
- E-kids program - a free programming language training program for EPAMers' children
EPAM strives to provide its global team of over 52,800+ professionals in more than 55 countries with opportunities for professional growth from day one of collaboration. Our colleagues are the source of EPAM's success, so we value cooperation, strive to always understand our clients' business and aim for the highest quality standards. No matter where you are, you will join a dedicated, diverse community that will help you realize your potential to the fullest.
