Senior Software/Data Engineer Streaming (m/w/d)

Germany / Slovakia / Czech Republic / Greece

The Adastra Group is an international IT consulting company with 23 international offices around the globe. We provide leading companies with a full range of consulting services in information management – from conception to implementation and application of innovative and efficient solutions in the areas of Data Warehousing, Business Intelligence, Big Data Analytics, and Cloud solutions. Our 2000+ experts bridge the gap between business departments and IT to increase the operational efficiency of our customers. For more information, please visit www.adastracorp.com

Are you looking to put your expertise in Software/Data Engineering to use in challenging projects for renowned clients in the Automotive & Manufacturing industries? If you are eager to join a group of dedicated experts who have a passion for their work, and if you are excited to grow personally and professionally by sharing knowledge and bringing new ideas to the table, this opportunity might be perfect for you!

We are seeking a highly skilled and experienced Streaming Expert to join our team at Adastra. The ideal candidate will have over 4 years of experience designing and implementing scalable streaming solutions, with proficiency in Java, Kafka, Azure Cloud, Azure DevOps, and other key technologies. You will play a critical role in building and optimizing streaming architectures that handle real-time vehicle data, helping our clients make data-driven decisions quickly and effectively.

Location: all Adastra offices in Europe, hybrid working mode

Your Responsibilities:

Design and Architecture:

  • Design and develop scalable, high-performance streaming architectures using tools like Apache Kafka and Apache Flink.
  • Implement Infrastructure as Code (IaC) to manage and deploy cloud resources on Azure Cloud
  • Collaborate with software engineers, data engineers, and cloud architects to integrate streaming solutions into the overall system architecture

Implementation and Development:

  • Build real-time data pipelines using Apache Kafka with a focus on low-latency and high-throughput data flows
  • Develop and maintain stream processing jobs using Java, ensuring seamless integration with SQL/KQL for querying and managing data
  • Develop and expose RESTful APIs to facilitate the use of streaming data by other applications and services

Monitoring and Troubleshooting:

  • Use Azure DevOps and other tools to monitor the health of streaming applications, ensuring continuous data flow
  • Troubleshoot and resolve issues in streaming pipelines, including latency, data loss, or processing bottlenecks
  • Set up proactive alerting and monitoring mechanisms to ensure smooth operation of the streaming infrastructure

Required Skills, Education, Knowledge and Experience:

  • A degree in Computer Science, Information Technology, or a related field
  • 4+ years of experience designing and implementing streaming solutions, particularly in Cloud environments
  • Strong proficiency in Java, Azure Cloud, Azure DevOps, and Infrastructure as Code (IaC) as well as good understanding of software design patterns
  • Experience with SQL/KQL, databases, REST APIs, and version control systems like Git
  • Expertise in DevOps principles with a hands-on approach to automating CI/CD pipelines
  • Knowledge of Apache Kafka is essential, and familiarity with Apache Flink is considered a plus
  • Strong problem-solving capabilities with experience troubleshooting distributed systems
  • Excellent communication and collaboration skills
  • Ability to work effectively in fast-paced environments and adapt to changing needs

What we offer:

  • The opportunity to contribute to our team in an international work environment full of exciting projects and actively participate in the company's success
  • Opportunities for cross-functional collaboration and skill development Access to ongoing professional development and growth opportunities (training and further education, participation in conferences, etc.)
  • A collegial working atmosphere with an employer with an appreciative corporate culture 
  • Flat hierarchies, open communication, feedback, and constructive dialogue, ensuring a cohesive and productive working atmosphere
  • Ability to balance your professional commitments with personal pursuits effectively