Data Engineer - Intermediate

Position Background

In the GTM analytics COE our mission is to deliver impact by building machine learning products to optimize pricing and marketing investments and provide guidance to our sales organization.

As a Big Data Engineer, you will be in a unique position to support the development one of our internal assets. You will work together with the project and asset team to understand the end state in which the data must be delivered and you will model the data using Big Data technologies like Spark.

We offer an international experience, collaborative culture, top rate experience in AI and ML and opportunity to create significant real-world impact.

Responsibilities

• Create / Maintain ETL pipelines.
• Ensure that processes are optimized.
• Use Spark to model big volumes of data.
• Contribute to the database architecture, design and implementation.
  
  

Requirements

• Bachelor’s in computer engineering, Computer Science, Electrical Engineering, Robotics or a related field
• 2+ years on a similar role.Ability to work independently under a fast-paced environment, comfortable to deliver results under pressure.
• You have strong problem-solving skills including Agile experience.
• Experience with modern application life-cycle management tools (Git, Visual Studio, Intellij, Code Reviews).
• Proficient in at least one of the following languages: Python, PySpark, Scala, Spark, SparkR.
• Experience with SQL & NoSQL databases is preferred (PostgreSQL, MongoDB, Elastic Search).
• Experience in working with Databricks platform.
• Strong analytical skills with demonstrated problem solving ability.