Data Engineer

Roles and Responsibilities

• Develop new applications using existing data sets to create new products or improve existing services.

• Maintaining existing applications by updating existing code or adding new features to meet new requirements.

• Collaborate closely with cross-functional teams, comprising data analysts, data scientists, and IT professionals, to recognize business needs and translate them into practical data engineering solutions.

• Provide solution for total client success

• Ensure the quality, integrity, and security of data throughout the entire data lifecycle, applying robust database concepts and data modelling expertise.

• Utilize multiple data & AI technologies to achieve various solution objectives, including data integration, insight visualization, data platform & pipeline build, scientist model integration, GenAI initiative

• Flexible role to fulfil different project demand

Requirement:

• A bachelor’s degree in computer science, Information Technology, Mathematics, Statistics, Physics or related fields.

• At least one years of hands-on experience in IT technology, preferably within a consulting environment / with Data or AI technology experience

• Experience in one or multiple of the followings:

A. Programming languages: Python / Spark / Express / React / Node.js

B. AWS platform , Azure will also be considered

C. Database / SQL programming

D. Informatica / IDMC experience, other ETL/ELT platform with large scale project experience will also be considered

E. Azure ADF & Databricks

F. Visualization: Tableau / Qlik sense, Power BI will also be considered

G. Streaming: Kafka / Spark

H. Universal AI / ML platform product / ML engineering

I. Chatbot on AWS/Azure platform, prompt engineering, VectorDB

• Technology enthusiast with business mindset

• Excellent communication and interpersonal skills

• Ability to work independently and as part of a team

• Experience with software development methodologies and tools.

• Fluent in Cantonese and English