The Data Engineer

The Data Engineer is the data-driven IT development professional! Their mission is to implement the collection and provision of data within a company, issued by the Data Science teams.

Responsabilities

  • Participate in the design and planning of functionalities to be implemented
  • Collaborate with business teams
  • Draw up technical specifications based on requirements analysis
  • Report activities to the project manager
  • Develop data archiving and storage (Hadoop)
  • Develop technical solutions for data collection via APIs, using programming languages such as Python, TensorFlow, PyTorch, etc.
  • Facilitate and accelerate data processing
  • Design project architecture

Required Skills

  • Good command of statistical modeling and machine learning techniques
  • Proficiency in programming languages such as C++, Scala, Java, Python, etc.
  • Technological, legal and ethical watch.
  • Expertise in Hadoop/Hive/Spark environments (local or in the cloud)
  • Knowledge of databases and database management (SQL/NoSQL)
  • Mastery of a flow management tool (Kafka, Flink…)
  • Knowledge of RGPD and cybersecurity principles
  • Knowledge of operating systems (Unix, Windows, etc.)
  • Knowledge of ETL/LET data manipulation solutions

Required Qualities

  • Organizational skills
  • Ability to make proposals
  • Ability to synthesize and analyze information
  • Methodological
  • Rigorous
  • Pragmatic
  • Ability to work in a team
  • Ability to manage work time

Average salary

Salaries are influenced by a number of factors, such as years of experience, seniority and company structure, all of which determine compensation levels.

Between €30,000 and €40,000

gross per year for a junior

Up to €65,000

gross per year for an expert