Data Engineer
Engineering Team
Yellow Canary is a rapidly growing Australian tech company looking for a skilled Data Engineer with a strong focus on building, automating and optimising multiple pipelines.
The Yellow Canary platform calculates wages and superannuation in accordance with awards and enterprise agreements to ensure employees are paid correctly - an issue that is becoming increasingly topical for all employers and industries in Australia.
A little about the role:
- Working with the senior development team across multiple client projects;
- Designing, building and optimising client data pipelines for ingestion;
- Work closely with the analytics team in building, optimising and productionising data extraction and integration solutions;
- Involvement in identifying trends and innovation in data platforms to inform the future development of solutions for our clients and evolving our data analytics platform
A little about you:
- 2-4 years of data integration experience
- 3+ years of experience with programming languages (Java / .NET / Python / Scala)
- Hands on experience in building ETL/ELT solutions for large scale data pipelines
- Attention to detail with strong problem solving skills
- Working knowledge of data platform concepts - big data cloud storage (Azure Blob Store / Data Lake Store), data warehouse (Azure DW, Synapse, Snowflake, etc.), big data processing (e.g. Spark, Databricks, Redshift, Delta Lake, Dremio, Presto, etc.), real time processing architecture for data platforms, scheduling and monitoring of ETL/ELT jobs
- Extensive and proficient SQL skills within cloud architecture
- Entrepreneurial and collaborative spirit, comfortable working in a fast-past start-up/scale-up environment.
You will have the opportunity to grow the responsibilities of this role as the business grows and as you build your skillset with the guidance of our senior development team. There will also be the opportunity to contribute to the development of new tools, products and services that Yellow Canary builds for the market.
Engineering at Yellow Canary
At Yellow Canary our Engineering division is made up of two groups: Data Analysts and Software Engineers.
Our Data Analytics team build out our data platforms and services which automate and streamline how Yellow Canary consumes and processes data. Our Analysts review data, undertake experiments and prototypes and provide accurate and actionable insights for our customers so they can understand their compliance position.
Our Software Engineers build the core platform and operate in a greenfield cloud-based environment using the latest technologies. With a flat structure where everyone’s input is recognised and valued, they work with a high degree of autonomy to develop new tools, products and services.