The Singapore Public Service plays a key role in the economic growth, progress and stability of Singapore by formulating and implementing government policies, as well as providing key public services. Whether you are a fresh graduate joining the workforce or an experienced professional, the Singapore Public Service offers a great variety of job opportunities for you. The work in the Public Service can be broadly categorised into the following sectors: Economic, Social, Security External Relations, and Administration Corporate Development. Be part of the team that shapes the future of Singapore. Log on and take your first step towards a career that matters! You will join the Statistics and Data Systems Department to drive MPA-wide statistical and data science initiatives, deliver data products to support policy formulation, decision-making and operations, as well as to ensure that MPA’s data strategy, governance and processes conform to WOG data policies. You will support the development, operations and maintenance of MPA’s Data Discovery Platform and the data products. The Data Discovery Platform provides an integrated experience for MPA officers in finding, interpreting and using data with access to data catalogue, meta data and advanced analytic tools through a centralised computational environment. Responsibilities 1.Support the development of Data Discovery Platform. 2.Develop data pipelines and data jobs to enable the automated collection and processing of data from the data sources 3.Engage data users to study and understand data needs and build data use cases 4.Collaborate with application development teams to capture data knowledge to build data pipelines and data sets. 5.Responsible for the end-to-end management of MPA’s Cloudera Big Data Platform including design, prototyping, productising, optimising and maintaining data pipelines and data sets to support data use cases. 6.Build data products and ensure good data quality and interoperability 7.Curate meta data of data products to improve data usability Requirements 1.Background in IT, Engineering, Computing, Data Science or other related disciplines (eg. Computer Engineering, Computer Science, Engineering, Information Systems). 2.At least 3+ years of experience in a data engineering role. 3.Strong technical ability to build and interact with medium to large data processing pipelines, distributed data stores and distributed file systems. 4.Experience and advanced proficiency working with Cloud-based data platforms on Microsoft Azure. 5.Knowledge or experience in any of the following areas will be an advantage: a.Experience and proficiency working with Cloudera ecosystem (HDFS, MapReduce, Kafka, Spark, Hive). b.Experience in developing near real-time big data infrastructure and deploying high performance production systems. c.Experience in Python programming for performing ETL jobs. d.Experience working on Talend Data Integration System. e.Familiar with data visualisation tools (Tableau, Qlik, Power BI). f.Familiar with API frameworks and development. g.Strong communication skills with ability to articulate and present complex data insights and information for broad range of audience. 6.Experienced candidates may be considered for Principal Engineer / Senior Principal Engineer position.