Staff Data Engineer - At CommBank, we never lose sight of the role we play in other people’s financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas and energy all contribute to the impact that we can make with our work. Together we can achieve great things. Your business: CDAO has a vision building a brighter future for all. Using data, analytics and AI. We’re delivering on this by working hand-in-hand with our business colleagues to jointly solve problems with customer centricity and technical innovation, cultivating a world-class team of empowered people, and building technology solutions for the future. Your impact: As a Specialist Engineer you are: Empathetic and self-aware. You think and care deeply about how you might interact with your team, stakeholders and customers. A Mentor, harbouring a passion to nurture, grow and influence those around you to think differently and always maintain a growth mindset. Innovative. You continually seek to improve the status quo for our customers. You inspire your team to do the same and remain resilient through change. Promoting quality and delivering at pace through the maximization of automation is one of the key focus areas of the role Ownership, you take responsibility for the software design, engineering processes and quality standards of yours as well as your team members as you work in a collaborative environment. Your responsibilities: As a Specialist/Staff Engineer, Proven track record of Agile delivery including leading and working on a project from pre-inception through to business and technical delivery, including the support and maintenance of delivered systems. Ability to lead, direct, coach and guide software developers. Driving pragmatic and fit for purpose solutions of high technical quality. Act as "Quality Advocate" for the squad, encourage critical thinking mindset and drive prevention of defects over detection of defect. Identify, define, document and advocate for the most appropriate approaches to achieve stated business goals objectives and deliver the product vision, whilst remaining aligned with organizational target architectures and roadmaps Provide tools, expertise, and knowledge to help squad gain a shared understanding of outcome and shared ownership of quality. Pro-actively looking for ways to provide faster feedback, including uplift in test automation maturity in the squad. Support the team in delivering quality outcomes within committed time frames. Follow secure code practice. Stakeholder Management - communication with a range of stakeholders, both technical and non-technical at all levels, including explaining complex technical issues to a non-technical audience. Your skills experience: Minimum 12-15 years of experience with expert level knowledge, with more than 2 years technical leadership experience, working with the following languages. Spark, Scala, Hive, Kafka and other big data technologies. Experience in building and working with Spark ETL frameworks with Scala. Experience working with Cloudera Data Platform. Strong experience with Spark SQL and ANSI SQL. Experience with building spark-based pipelines. AWS Cloud (working experience with some of the core services EMR, EC2, S3, Auto-scaling, etc.) Experience with large migration programs and automating things to scale up migrations from on-prem to cloud. Experience working with the following Tools: Cloudera Hadoop ecosystem Source Control systems such as Git Build Deployment tools such as Jenkins, TeamCity, Octopus Deploy Database – SQL, PL/SQL Monitoring tools such as Splunk, AppDynamics Awareness of the following Software Development Concepts: Strong design skills around big data frameworks AWS Architecture Secure Coding Practices CI/CD and DevOps If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career. We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696. Advertising End Date: 01/04/2024 Whether you’re passionate about customer service, driven by data, or called by creativity, a career with CommBank is for you. Our people bring their diverse backgrounds and unique perspectives to build a respectful, inclusive and flexible workplace. One where we’re driven by our values, and supported to share ideas, initiatives, and energy. One where making a positive impact for customers, communities and each other is part of our every day. Here, you’ll thrive. You’ll be supported when faced with challenges, and empowered to tackle new opportunities. We really love working here, and we think you will too.