Architect/Developer Python/Hadoop

For our well known customer we are currently looking for an  Architect/Developer with : Python/Hadoop.

 

Mission :

 

Design the new information system using Hadoop and its open source components. The different components will be integrated using Python and will be running on a MAPR Cluster.

The flows need to be resilient and performant.

Proof of concept on the new platform supporting complex ETL flows both batch based and continuous(message based).

 

Technical Prerequisite :

 

Hadoop with its open source components Technical Architecture : Define the blueprint for the Information system, define the different components and how these interact. Take hardware limitations and security requirements into consideration.

Python: Hands-on development experience Execution place.

Technical Skills: 

  • Technical Architecture
  • Python
  • Apache Hadoop: Spark
  • PySpark
  • KAFKA
  • MongoDB or other NoSQL database

As part of this role a lot of interactions will be required with various teams and profiles: Functional/Technical architecture, IS Security, developers, application owners, ... New Architecture and design decisions will have to be presented and defended. Strong communication skills are therefore a must

Want to know more? 

Hit that button and send your CV .