Senior Data Engineer Minsk, Belarus
Senior Data Engineer Description
Job #: 47229
EPAM is committed to providing our global team of 36,700+ EPAMers with inspiring careers from day one. EPAMers lead with passion and honesty and think creatively. Our people are the source of our success and we value collaboration, try to always understand our customers’ business, and strive for the highest standards of excellence. In today’s new market conditions we continue to support operations for hundreds of clients around the world remotely, with the vast majority of our teams working from home. No matter where you are located, you’ll join a dedicated, diverse community that will help you discover your fullest potential.
We are seeking a Senior Data Engineer to help build and manage our big data streaming technologies. You'll be deeply involved with optimizing our existing streaming services, evaluating new technologies, managing cloud infrastructure and more. Our ingestion pipelines peak at over 90GB per minute. If you’re interested in working with data at massive scale, let’s chat.
Our client is a global leader in developing cutting-edge gaming and cross-platform game engine technology. The company designs and produces high-end action games for consoles, personal computers, and mobile devices with their most popular title (currently №1 in the world) attracting 200M+ players worldwide.
#LI-DNI
#LI-DNP
DESCRIPTION
We are seeking a Senior Data Engineer to help build and manage our big data streaming technologies. You'll be deeply involved with optimizing our existing streaming services, evaluating new technologies, managing cloud infrastructure and more. Our ingestion pipelines peak at over 90GB per minute. If you’re interested in working with data at massive scale, let’s chat.
ABOUT THE CUSTOMER
Our client is a global leader in developing cutting-edge gaming and cross-platform game engine technology. The company designs and produces high-end action games for consoles, personal computers, and mobile devices with their most popular title (currently №1 in the world) attracting 200M+ players worldwide.
#LI-DNI
#LI-DNP
Responsibilities
- Building and supporting highly available streaming services, written in Java/Scala using Apache Flink
- Operating and developing applications on distributed NoSQL key-value stores such as HBase, DynamoDB or FoundationDB
- Managing cloud infrastructure launched in AWS via Terraform
- Participating in an on-call rotation for customer streaming tech stack
- Evaluating new technologies and components of the big data ecosystem that are not yet part of our environment
Requirements
- Experience building high throughput Java/Scala streaming services using technologies such as Flink or Spark
- Strong understanding of distributed message brokers such as Kafka and Kinesis
- Experience with performance tuning of distributed computing technologies at massive scale
- Experience working with AWS services such as Kinesis, EC2, EMR, RDS via infrastructure as code technologies
- Experience working with high throughput, distributed NoSQL databases
- Capable of independently performing root cause analysis on high throughput systems
We offer
- Innovative solutions delivery to the world’s digital changes
- Experience exchange with colleagues all around the world
- Opportunities for self-realization
- Friendly team and enjoyable working environment
- Engineering, corporate and social events
- Social package: professional & soft skills trainings, medical & family care programs, sports
- Free English classes
- Flexible working schedule
