Data Engineers are responsible for laying the foundations for the acquisition, storage, transformation, (data pipeline) and management of data in an organization. They in charge of developing and maintaining the data platform architecture and data processing systems. They have to with IT infra team, IT security team and Enterprise Architect team about data technologies adoption to ensure that the development of high-level data applications, such as data visualization, and the deployment of machine learning models is carried out in a seamless, secure, and effective way.
Responsibility
- Developing systems that collect, manage, and convert raw data into usable information for data scientists and business analysts to interpret
- Making data accessible so that organizations can use it to evaluate and optimize their performance
- Transforming source data and target data by ETL tool as well as transform target data to source data
- Using programming language and tools, identify ways to improve data reliability, efficiency and quality
- Ensuring data management and governance to maintain the data integrity
Requirements
- Bachelor's Degree in Computer Engineering, Computer Science, Management Information System, Information Technology or any related fields
- 3-5 years experience for senior candidates
- Experience in Banking and Financial Services Industry will be preferred
- Deep expertise in analyzing complex database query
- Experience in processing ETL design and development standards and techniques
- Good knowledge of ETL tools (Extract, Transform and Load)
- Good knowledge of Azure, AWS, cloud data platform
- Very good analytical, problem-solving and interpersonal skills
- Good English communications and writing skills are a plus
