Full-timeRemote allowed

We’re opening the position of Data Engineer to extend the existing team to develop new functionality for our customers. They provide SAAS solutions that help companies to optimize their businesses. These solutions include business planning & execution, processes automation and optimization. The Customer’s platform leverages industry-leading artificial intelligence (AI) and machine learning (ML) for better predictions and prevention of disruptions across the businesses. Customer value our experience , and want to extend a team to develop a new functionality.

The output API allows the customers to retrieve order proposals on a large scale.

Their workflows require various kinds of filters on the output API. We therefore need a data reshuffler. Until now, we have been using dask as a reshuffler. However, this doesn’t scale up to the data volumes we need for the world’s largest retailers.

All our customer data is currently stored in an Exasol payload DB. While Exasol provides excellent capabilities for analyzing data, it does scale up to the data volumes we need for the world’s largest retailers. So we need to start migration to Snowflake.

Responsibilities:

  • Ingesting order proposals from partitioned flat parquet files into snowflake on a large scale
  • Setting up snowflake as a query engine behind an API for data retrieval on a large scale
  • Performance optimization of data ingestion into and data retrieval from snowflake (including the data warehouse settings in snowflake)
  • Adapting SQL queries for data retrieval to work with snowflake
  • Performance optimization of the queries (including the data warehouse settings in snowflake)

Requirements:

  • 3+ years of data engineering experience, retail setting preferred
  • Python programming experience desirable
  • Experience with SQL, Datasets/Databases, Azure
  • Bachelor’s Degree in Computer Science or related fields
  • Familiarity with Snowflake, Exasol will be a plus
  • English level – Upper-Intermediate or higher

We offer:

  • Career and professional growth
  • Competitive salary
  • Friendly and highly professional teams
  • Big and comfortable office, own parking area, restaurants nearby
  • Medical insurance coverage for employees (Сovid-19 included), plus an option for family insurance coverage at a corporate rate
  • Paid 12 sick leaves and all holidays
  • Paid 18 working vacation days
  • English/German language courses
  • Ability to work remotely (we provide all equipment)

You May Also Be Interested In

To Apply for this Job, Fill in the Form and Upload Your Resume

    This is a required field
    This is a required field
    This is a required field
    This is a required field
    The telephone number is invalid