Connecting...

Data Engineer

Job details

Location: Singapore
Job Type: Permanent
Discipline:
Reference: IT/DE/SP/06032019/CH
Posted: 15 days ago
Consultant: Shyam Prabhakaran
Consultant Email: email Shyam
Consultant Phone: +65 6950 0395

Job description

Job Role Description

The Data Engineer supports the implementation of data structure and architecture, master/meta-data management approach and data quality programme to facilitate access to data and information. He/she support the design, implementation and maintenance of data flow channels and data processing systems that support the collection, storage, batch and real-time processing, and analysis of information from structured and unstructured sources in a scalable, repeatable and secure manner. He/she implements data management standards and practices.

Responsibilities

  • Work with stakeholders to understand needs for data structure, availability, scalability and accessibility

  • Support translation of data business needs into technical system requirements

  • Identify opportunities for improvements and optimisation

  • Build data flow channels and processing systems to extract, transform, load and integrate data from various sources

  • Develop complex code, scripts and data pipelines to process structured and unstructured data

  • Work with data analysts, data scientists and other analytics stakeholders to implement models to support analytics use cases

  • Make data science code production ready to ensure it is maintainable, scalable and debuggable. Deploy machine learning models to production and build the framework to monitor the performance of the model.

  • Assist with integration of data systems into existing infrastructure

  • Test data system configurations to increase efficiency

  • Support the handling and logging of errors

  • Monitor data system performance

  • Automate data collection and analysis processes

  • Develop tools to improve data flows between internal/external systems and the data lake/warehouse

  • Contribute to defining data retention policies

  • Able to administer, design, develop, validate, deploy and maintain ETL tool such as Informatica, IBM Datastage, Talend

     

Requirements

  • Degree/Master in Computer Science, Information Technology, Computer Engineering or equivalent.

  • At least seven (3) years’ experience in providing data warehouse or advanced analytics solutions, especially in designing large Big Data technologies or analytics solutions.

  • Demonstrate good, in-depth knowledge in relevant Extract-Transform-Load (ETL) hardware/software products, frameworks and methodologies.

  • Experience with at least two of the following areas:

  • Databases (e.g. Oracle, MS SQL, MySQL, Teradata)

  • Big data (e.g. Hadoop ecosystem)

  • ETL development using ETL tools (e.g. Informatica, IBM Datastage, Talend)

  • Data repository design (e.g. operational data stores, dimensional data stores, data marts)

  • Data interrogation techniques (e.g. SQL, NoSQL).

  • Structured and unstructured data analytics.

  • Batch and real-time data ingestion and processing

  • Data quality tools and processes.

  • Data transformation and terminology equivalence mapping.

  • Experience in data modelling for analytics (e.g. star schemas, snowflake schemas).

  • Experience with data acquisition tools (e.g., ETL, real-time data capture, and change data capture).

  • Experience in interacting with analytics stakeholders (economists, statisticians, clinicians, policy makers) on a business or domain level

  • Deep understanding of analytical models and methodologies – especially in the context of health analytics for clinical use and clinical safety (e.g. data mining, predictive analytics) would be preferred.

  • Comfortable working independently to carry out data analysis, estimate data quality and sufficiency. Understanding and analysing huge volumes of data drawn from heterogeneous sources / repositories. Experience in working with Big Data technologies / solutions would be preferred.

  • Good interpersonal skills, a detail-oriented & flexible person who can work across different areas within the team.

  • A good understanding of Singapore Healthcare System would be preferred.

  • Familiarity or experience with health informatics would be preferred.

  • An understanding of healthcare data governance, data acquisition and data management would be an advantage.

 

EA License no.: 16S8066 I Reg no.: R1331695

Please send your resume in word format with your current and expected salary to ShyamP@charterhouse.com.sg