AWS Data Engineer (m/w/d)
The Adastra Group is an international IT consulting company with 23 international offices and headquartered in Toronto, Canada. Adastra provides leading companies with the full range of consulting services in information management - from conception to implementation and application of innovative Data & Analytics solutions. With over 2600 experts worldwide we bridge the gap between business departments and IT to increase the operational efficiency of our customers. For more information, please check www.adastragrp.com
Are you looking for the opportunity to become "the expert" when it comes to Big Data on cloud? Do you want to become proficient in building data pipelines and data lakes on Amazon Web Services and to work on a variety of game changing projects ? Then this role as a Data Engineer is the job for you!
Your responsibilities:
- Identification of big data use cases and classification of suitable technologies considering customer specifics
- Design, develop, and deploy scalable end to end big data solutions using latest relevant cloud technology
- Implement extract, transform, and load data from a wide variety of data sources present on-premise and in the cloud
- Build processes supporting data transformation, data structures, metadata, dependency and workload management
- Research opportunities for data acquisition and new uses for existing data
- Creation and support of batch and real-time data pipelines built on AWS technologies including EMR, Glue, Kinesis, Redshift/Spectrum and Athena
- Promote best practices that enable teams to accelerate their consumption and understanding of data
Required Skills, Education, Knowledge and Experience:
- A university degree in computer science, business informatics, business administration with an IT focus or in a a comparable course of study
- 3+ years of industry experience in software development, data engineering, business intelligence, data science, or related field with a track record of manipulating, processing, and extracting value from large datasets
- 2+ years of working experience with AWS or other public Cloud experience primarily on DWH, ETL, Big Data and Analytics Services on the cloud
- Demonstrated strength in data modeling, ETL development, and data warehousing
- Experience using big data technologies (Hadoop, Hive, Hbase, Spark etc.)
- Knowledge of data management fundamentals and data storage principles
- Proficiency in one programming language – Python, Scala or Java
- Comfortable writing complex SQL queries in DWH/RDMS/Big Data environments
- Working knowledge of Linux/Unix
- At least one of the following AWS Certification: AWS Solution Architect Associate, AWS Developer Associate or AWS Big Data Speciality Certified
- Clear and succinct verbal and written communication skills in English and preferably also German
What we offer:
- Working in an international team of Business Analysts, DWH and BI experts
- A work environment where knowledge-sharing is coveted and which has an open feedback culture
- Excellent opportunities for professional growth through industry-recognized projects for internationally-known clients
- Support to fulfill your personal potential and individual career planning (Training and further education, participation in conferences, etc.)
- Opportunities to take responsibility at an early stage
- Flat hierarchies and an attractive salary package