Skip navigation EPAM

Senior Big Data Engineer

  • Krakow, Poland
Job #: 29256
Striving for excellence is in our DNA. Since 1993, we have been helping the world’s leading companies imagine, design, engineer, and deliver software and digital experiences that change the world. We are more than just specialists, we are experts.

DESCRIPTION


Currently we are looking for a Senior Big Data Engineer for our Krakow office to make the team even stronger.

Our customer is looking for talented Full-Stack Software Engineers, technologists with a passion. That's a number of positions within D&A (Analytics & Data Science) Team, where our employees work on various Big Data/ML projects.

Essential expectation all the candidates is to possess essential engineering knowledge/skills:
- Software development concepts & practices: code quality, code/peer reviews, trunk-based development, CI/CD;
- Agile concepts & practices: DoD/DoR, collective code ownership, technical debt, refactoring, pair-programming;
- Test concepts & practices: TDD/BDD, test-automation, test coverage, defect lifecycle.

Responsibilities

  • Build big data pipelines for batch and real-time data processing
  • Develop, load and run robust, scalable predictive models based on prototype algorithms developed in Python or R in machine learning platforms
  • Build and run data analytics environments, etc
  • Iterate, and innovate on Machine Learning algorithms in collaboration with Machine Learning Engineers and Software Engineers
  • Analyze existing ETLs (particular parts of complex process) and design new solution based on Spark
  • Collect, process and cleanse data from a wide variety of sources. Transform and convert unstructured data set into structured data for algorithm input
  • Evaluate the effectiveness of user experiences, determining what data is needed and how to collect it
  • Integrate ML models into production
  • Implement the solution, cover with unit and integration tests, write documentation and present results to customer
  • Design and use validation tools to compare results of original and new solution

Requirements

  • Strong experience of working in an object-oriented language (Java, Scala, C++ or other OO complied language)
  • Strong knowledge of scripting languages (Python, Ruby, Perl, etc.)
  • Knowledge of Big Data stack: Spark, Hadoop, Hive
  • Experience in SQL and NoSQL databases
  • Engineering practices: code review, pair programming, CI/CD

Nice to have

  • Java/Scala/Python
  • Apache Spark (Core, Streaming, SQL)
  • Apache Hadoop Hive, HBase, HDFS
  • CI/CD (Docker, Jenkins, Git)
  • Various machine learning tools
  • Some Teradata, Looker, sciPy
  • Some REST API web-services
  • SQL and NoSQL DBs
  • Some Kafka, IBM MQ
  • Linux

We offer

  • Possibility to be involved in an international project (Canada, China, Hong Kong, Mexico, USA, Switzerland, Germany, Sweden, United Kingdom, Russia, Belarus, Ukraine, Hungary, etc.)
  • Language classes (English and Polish)
  • Vast opportunities for self-development: online courses and library, experience exchange with colleagues around the world, partial grant of certification
  • Career development center
  • Unlimited access to LinkedIn learning solutions
  • Possibility to take part in both: corporate and startup environment
  • Possibility to relocate for short and long-term projects
  • Relocation package for those who relocates to Krakow, Wroclaw, Katowice or Gdansk from other locations
  • Benefit package (health care, multisport, lunch tickets, petrol vouchers and shopping vouchers, etc.)
  • Fruits on a weekly basis
  • Sponsored sport activities, E-sport program
  • We kindly ask you to include the following clause in your application: "Wyrażam zgodę na przetwarzanie danych osobowych zawartych w niniejszym dokumencie do realizacji procesu rekrutacji zgodnie z ustawą z dnia 10 maja 2018 roku o ochronie danych osobowych (Dz. Ustaw z 2018, poz. 1000) oraz zgodnie z Rozporządzeniem Parlamentu Europejskiego i Rady (UE) 2016/679 z dnia 27 kwietnia 2016 r. w sprawie ochrony osób fizycznych w związku z przetwarzaniem danych osobowych i w sprawie swobodnego przepływu takich danych oraz uchylenia dyrektywy 95/46/WE (RODO)"
  • Please note that only selected candidates will be contacted
Узнать больше о EPAM Польша

Наши сотрудники

ИЛЬЯ ПРИТУЛА
Ресурсный менеджер
Санкт-Петербург, Россия

ОЛЬГА КАЗАКОВА 
Руководитель проектов
Москва, Россия

ИЛЬЯ РОМАНОВ
Глава практики e-commerce
Москва, Россия

АЛЕКСЕЙ УДАЛОВ
Архитектор решений
Амстердам, Нидерланды

ЧЕМ МЫ МОЖЕМ ВАМ ПОМОЧЬ?


Наши офисы