Ayan Infotech has an urgent and immediate requirement for an Apache Spark\Hadoop Developer for a long term contract (6-12 months to start with) job opportunity in Sydney.
All applicants must have full work rights in Australia.
Title: Apache Spark\Hadoop Developer
Type: Contract (6-12 months + possible extension)
Required Skills and Experience:
- Should have minimum of 4-10 years of experience in Apache Spark, proficient in Scala coding.
- Assist in integrating Spark SQL developed and tested on Zeplinn notebooks to be integrated into an existing Scala framework for S3 ingestion and transformation into Redshift.
- Assisting in the development of historical loads into the data warehouse.
- Defect testing and support for implementation.
- Must have working experience in Cloud based technologies like S3, EC2, EMR and other AWS services
- Hands-on experience in building data solutions using SparkSQL,Hive,Hbase,Kafka
- Experience in CI/CD Gitlab,Jenkins,Airflow
We will be able to contact only shortlisted candidates. We thank you in advance.
Contact: 02 9412 4178 for more details.