For our prestigious client, we are currently looking for a Kafka Data Engineer.

Tasks:

Design and Architecture:

• Design and develop scalable, high-performance streaming architectures using tools like Apache Kafka and Apache Flink.
• Implement Infrastructure as Code (IaC) to manage and deploy cloud resources on Azure Cloud
• Collaborate with software engineers, data engineers, and cloud architects to integrate streaming solutions into the overall system architecture

Implementation and Development:

• Build real-time data pipelines using Apache Kafka with a focus on low-latency and high-throughput data flows
• Develop and maintain stream processing jobs using Java, ensuring seamless integration with SQL for querying and managing data
• Develop and expose RESTful APIs to facilitate the use of streaming data by other applications and services

Monitoring and Troubleshooting:

• Use Azure DevOps and other tools to monitor the health of streaming applications, ensuring continuous data flow
• Troubleshoot and resolve issues in streaming pipelines, including latency, data loss, or processing bottlenecks
• Set up proactive alerting and monitoring mechanisms to ensure smooth operation of the streaming infrastructure

If you have  the required skills and interested to join, please send your CV now for immediate consideration.