AYAN InfoTech is looking for Data Engineer Acquisition to join an exciting project based in Melbourne. The role offers you the opportunity to contribute towards an extremely well structured and mature environment, working on sophisticated enhancement projects.
Role: Data Engineer Acquisition
Location: Melbourne
Contract Duration: 12 Months with high possible extensions
Experience: 6+ Years
Required Skills & Experience:
- 6+ years of hands-on experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable, resilient, and distributed data pipelines.
- Expertise with big data technologies
- Solid understanding of batch and streaming data processing techniques.
- Proficient knowledge of the Data Lifecycle Management process, including data collection, access, use, storage, transfer, and deletion.
- Expert-level ability to write complex, optimized SQL queries across extensive data volumes.
- Familiarity with Agile methodologies.
- Proven experience as a Data Engineer in a large enterprise environment.
- Background in data warehouse design (e.g. dimensional modelling) and data mining
- In-depth understanding of database management systems, online analytical processing (OLAP) and ETL framework
- Knowledge of SQL queries, SQL Server Reporting Services (SSRS) and SQL Server Integration Services (SSIS)
- Expertise in SQL and Data Warehousing on Cloud - Redshift and Databricks
- Data transformation and ELT experience using DBT
- Programming languages - Python and Pyspark
- DevOps - Bitbucket and Jenkins
- Orchestration - Control-M
- Expertise with big data technologies and Fivetran is nice to have
Contact: 02 9412 4178 for more details.
www.ayaninfotech.com
