Location:On-Site (Hong Kong / Macau)

Job Summary:

We are seeking a skilledData Integration Specialistto implement, and maintain robust data integration solutions across multiple databases and systems. The ideal candidate will have hands-on experience withApache Kafka,ETL/ELT pipelines,monitoring tools (Prometheus, Grafana, ElasticSearch), and supportingBI tools(e.g., Power BI, Tableau). Basic understanding onPython scriptingand familiarity withJupyter Notebooksfor data analysis will be a plus.

This role may requireon-call supportfor critical data integration systems, ensuring high availability, quick incident response, and minimal downtime. You will ensure seamless data flow, optimize performance, and enable real-time analytics to support business decision-making.

Key Responsibilities:

· Design & implement data integration solutionsacross heterogeneous databases (SQL, NoSQL, cloud data warehouses).

· Develop and maintainreal-time data pipelinesusingApache Kafka(Kafka Connect, Kafka Streams).

· OptimizeETL/ELT workflowsfor performance, scalability, and reliability.

· Monitor data pipelines and infrastructure usingPrometheus, Grafana, and ElasticSearch.

· Provide supportwith a structured on-call rotation for critical data integration systems, including incident response and troubleshooting, to resume the 24/7 business if required.

· Collaborate with BI teams to ensuredata availability and accuracyfor reporting and analytics.

· Troubleshoot and resolve data integration issues (latency, schema mismatches)in real-time.

· Work with cloud platforms (Azure, AliCloud) for data storage and processing.

· Implementdata governance and securitybest practices.

· Document data flows, integration processes, and system architectures.

· UtilizePython scriptingandJupyter Notebooksfor ad-hoc data analysis and automation.

Required Skills & Qualifications:

· 3+ yearsin data integration, ETL development, or data engineering.

· Strong experience withApache Kafka(setup, configuration, producers/consumers).

· Proficiency inSQLandNoSQL databases(PostgreSQL, MySQL, MongoDB, MSSQL, Clickhouse, etc.).

· Hands-on experience withETL tools(Airflow, SSIS) or custom scripting (Python).

· Experience withmonitoring & observability tools(Prometheus, Grafana, ElasticSearch).

· Ability to provide support for critical production systems.

· Knowledge ofBI tools(Power BI, Tableau, Looker) and data modeling for analytics.

· Familiarity withcloud data services(Azure Data Factory, Pipeline, OneLake).

· Understanding ofdata warehousing concepts(star schema, dimensional modeling).

· Strong problem-solving and debugging skills under pressure.

Preferred Qualifications:

· Experience withJupyter Notebooksfor exploratory data analysis.

· Knowledge ofCDC (Change Data Capture)tools (e.g. Debezium, Attunity Replicate).

· Familiarity withstream processing frameworks(e.g. Flink, Spark Streaming).

· Certifications in Kafka, cloud platforms, or data engineering are preferable.