Senior Big Data Engineer Remote
Senior Big Data Engineer Description
We are seeking a skilled Senior Big Data Engineer to join our dynamic team.
Collaboration with product and engineering teams to understand requirements and drive decisions will be a key aspect of this role. Additionally, you will work closely with architects, technical leads, and other functional groups to deliver high-quality technical solutions.
#LI-DNI#LI-AP13
Responsibilities
- Implement innovative analytical solution using Spark/PySpark, NoSQL and other Big Data related technologies, applying new features in Cloud solutions
- Work with product and engineering teams to understand requirement and help drive decisions
- Maintain collaboration with architects, technical leads and key individuals within other functional groups
- Perform analysis of business problems and technical environments and use this in implementation of quality technical solutions
- Participate in code review and test solutions to ensure it meets best practice specifications
- Write project documentation
Requirements
- 3+ years of experience in software development with Big Data technologies (e.g. administration, configuration management, monitoring, debugging and performance tuning)
- Engineering experience and practice in Data Management, Data Storage, Data Visualization, Operation, Security
- Familiar with concepts of data ingestion pipelines, Data Warehousing, Data Lakes
- Experience with data modeling; development experience with modern Big Data components
- Knowledge and practical experience in development of scalable, available and fault tolerant systems
- Understanding of CI/CD principles and best practices
- Knowledge of Containers and Resource Management systems: Docker, Kubernetes, Yarn
- Experience in direct customer communications
