Skip navigation EPAM

Senior Big Data DevOps Engineer Remote

  • hot

Senior Big Data DevOps Engineer Description

Job #: 51004
Striving for excellence is in our DNA. Since 1993, we have been helping the world’s leading companies imagine, design, engineer, and deliver software and digital experiences that change the world. We are more than just specialists, we are experts.

DESCRIPTION


We’re looking for a Senior Big Data DevOps Engineer who will be responsible for developing and maintaining the development operations environment for one of our projects. You will work on continuous integration process improvements to make deploys consistently successful, fast, simpler to maintain as well as streamlining/automating content migration from Prod to DEV/QA environments. This is a great opportunity to join early and influence the technology selection, design, and have ownership of the infrastructure.

This position is a part of the new innovative program EPAM Anywhere, which gives an opportunity to work remotely in multidisciplinary teams on global projects that define the future – of technology, collaboration and learning. Join us and take the best of two worlds: full-time employment and remote work.

Project technologies and tools

  • Operating Systems: Debian/Ubuntu, RedHat/Centos, Windows

Responsibilities

  • Design, build and maintain highly available production systems
  • Integrate solutions with other applications and platforms outside the framework
  • Provide consulting services to application teams looking to build Cloud-based applications
  • Design and implement build, deployment, and configuration management systems
  • Analyze, organize, and provide in-depth code reviews to improve applications dynamically and ensure the timely completion of projectsPerform script updates due to changes in requirements or implementations
  • Design, implement and improve monitoring and alerting system
  • Troubleshoot production issues and coordinate with the development team to streamline code deployment
  • Optimize system performance, availability and scalability
  • Assist in production support
  • Collaborate with team members to improve developed tools, systems and procedures, and data security
  • Brainstorm for new ideas and ways to improve development delivery
  • Create Infrastructure diagrams
  • Create Procedures and Plocies
  • Manage the Data DevOPs team
  • Write the project documentation and conduct knowledge transfers

Requirements

  • 6 years of professional experience
  • 4 years hands-on experience with a variety of Amazon AWS services
  • Intermediate skill in one cloud platform: GCP, Azure
  • Solid Linux/Unix systems administration background
  • General network administration related knowledge and skills
  • Expert in infrastructure troubleshooting, performance tuning, optimization and bottleneck problem analysis
  • 3 years of hands-on experience with Python
  • 3 years of hands-on experience in one scripting language: Bash, Perl, Groovy;Expert in Hadoop HDFS and YARN
  • Advanced skill in one of Hadoop distributions(Cloudera, Hortonworks)
  • Advanced skill in Hadoop managing tools(Ambari, Cloudera Manager)
  • Advanced skill in HUE, Hive, Spark
  • Advanced skill in Hadoop Security;Expert in Kafka
  • Advanced skill in ElasticSearch
  • Solid experience in managing production infrastructure with Terraform, AWS CloudFormation, etc
  • Expert in one configuration management tool: Chef, Puppet, Ansible or similar
  • Advanced skill in one build automation tool: Jenkins, TeamCity, Bamboo, GoCD, etc
  • Solid knowledge of Monitoring Best Practices
  • Advanced skill in one monitoring tool and dashboard: Zabbix, Nagios, DataDog, Prometheus, Grafana, etc
  • Solid knowledge of Security Best Practices;Expert in one Authentication and Authorization protocols: LDAP, Kerberos, SAML, etc
  • Solid organizational, analytical and problem solving skills
  • Ability to present and communicate the architecture in a visual form
  • English language – ability to direct communicate with customer. B2+ level is required
  • Bachelor’s degree in Computer Science or a related technical field, or equivalent work experience

We offer

  • Competitive compensation depending on experience and skills
  • Work in enterprise-level projects on a long-term basis
  • Full-time remote work (you can work from anywhere you are)
  • Unlimited access to learning courses (LinkedIn learning, EPAM training courses, English regular classes, Internal Library)
  • Community of 36,700+ industry’s top professionals

Наши сотрудники

ИЛЬЯ ПРИТУЛА
Ресурсный менеджер
Санкт-Петербург, Россия

ОЛЬГА КАЗАКОВА 
Руководитель проектов
Москва, Россия

ИЛЬЯ РОМАНОВ
Глава практики e-commerce
Москва, Россия

АЛЕКСЕЙ УДАЛОВ
Архитектор решений
Амстердам, Нидерланды

ЧЕМ МЫ МОЖЕМ ВАМ ПОМОЧЬ?


Наши офисы