Data Engineer Cloudera DATA Platform (Streaming - Kafka)
As Data Engineer you will interact with the business and IT colleagues (architects, functional analysts, project managers, data scientists, developers) and participate in the data transformation program.
Skills:
You are an IT professional with proven experience in big data engineering.
You have experience with the Cloudera products (HDFS, Ozone, Hive, Impala, Spark, Oozie, Atlas, Ranger).
Experience in real-time technologies is mandatory (Nifi, Kafka, Flink, Spark Streaming, High Availability setup).
Specifically on Kafka:
* Design and implement broker and partition architecture
* Develop consumable topics and corresponding API/microservices to render data consumable.
* Integration with Flink and Nifi
* Stream processing knowledge Kafka with Flink
* Know-how of a Kafka administration profile is a plus
Nice to have:
Experience in NoSQL databases (CouchBase, MongoDB, …) is an advantage.
You have experience with CI/CD (Git, Jenkins / Gitlab CI, Ansible, Nexus)
You have experience in Java and/or Python programming languages.
Experience in PowerBI, Scala, Docker and Kubernetes are an advantage.
You are fluent in English, both spoken and written.
Knowledge of Dutch and/or French is an advantage
Must be able to be on site in Brussels 2 days per week
LA International is a HMG approved ICT Recruitment and Project Solutions Consultancy, operating globally from the largest single site in the UK as an IT Consultancy or as an Employment Business & Agency depending upon the precise nature of the work, for security cleared jobs or non-clearance vacancies, LA International welcome applications from all sections of the community and from people with diverse experience and backgrounds.
Award Winning LA International, winner of the Recruiter Awards for Excellence, Best IT Recruitment Company, Best Public Sector Recruitment Company and overall Gold Award winner, has now secured the most prestigious business award that any business can receive, The Queens Award for Enterprise: International Trade, for the second consecutive period.
