Data Engineer
100000-150000元
香港
8年以上
碩士



- 補(bǔ)充醫(yī)療保險(xiǎn)
- 創(chuàng)業(yè)公司
- 強(qiáng)積金
職位描述
該職位還未進(jìn)行加V認(rèn)證,請(qǐng)仔細(xì)了解后再進(jìn)行投遞!
Position Overview
We are seeking a skilled Data Engineer to design, build, and optimize our data pipelines and infrastructure. The ideal candidate will have strong experience in handling large-scale video datasets and building efficient data processing systems for machine learning applications.
Key Responsibilities
?Design and implement scalable data pipelines for processing, storing, and managing large-scale video datasets
?Build and maintain data infrastructure for training data preparation and feature engineering
?Develop efficient ETL processes for various data sources including videos, images, and metadata
?Create and optimize data storage solutions for high-performance data access
?Implement data quality monitoring and validation systems
?Collaborate with ML researchers to support model training and evaluation needs
?Ensure data security and compliance across all data operations
Required Qualifications
?Master's degree in Computer Science, Software Engineering, or related field
?8+ years of experience in data engineering roles at tech companies
?Strong programming skills in Python, Java, SQL and Shell
?Experience with big data technologies (Spark, Hadoop ecosystem)
?Proven track record in building and maintaining data pipelines
?Experience with cloud platforms (AWS/GCP/Azure or Alibaba Cloud/Tencent Cloud)
?Strong understanding of data modeling and database design
Preferred Qualifications
?Experience with video processing and storage systems
?Knowledge of ML/AI data pipeline requirements
?Familiarity with distributed computing systems and high-performance computing
?Experience with streaming data processing
?Understanding of data privacy and security best practices
?Experience with Cloud services and data infrastructure
?Bilingual proficiency (English/Chinese)
Technical Skills
Data Processing & Storage
?Databases: PostgreSQL, MongoDB, Redis
?Big Data: Spark, Hadoop, Hive
?Data Warehousing: Snowflake, Amazon Redshift
?Stream Processing: Kafka, Apache Flink
Cloud & Infrastructure
?Cloud Platforms: AWS/GCP/Azure, Alibaba Cloud/Tencent Cloud
?Container Orchestration: Docker, Kubernetes
?Infrastructure as Code: Terraform, Ansible
Programming & Tools
?Languages: Python, SQL, Shell scripting
?ETL Tools: Airflow, Luigi
?Version Control: Git
?Monitoring: Prometheus, Grafana
Video Processing
?FFmpeg, OpenCV
?Video compression and optimization techniques
?Video metadata extraction and management
What We Offer
?Opportunity to build critical infrastructure for cutting-edge AI technology
?Competitive salary and equity package
?Flexible work arrangements
?Professional development opportunities
?Modern tech stack and tools
?Collaborative and innovative work environment
?Health and wellness benefits
Location
?Hong Kong (on-site, Hong Kong Science and Technology Park)
Expected Impact
?Shape the foundation of our data infrastructure
?Influence architectural decisions
?Build and mentor a world-class technology team
工作地點(diǎn)
地址:香港香港香港沙田區(qū)香港科學(xué)園10W棟317-318


職位發(fā)布者
張先生HR
Video Rebirth Limited

-
計(jì)算機(jī)軟件
-
11-20人
-
外商獨(dú)資·外企辦事處
-
香港科學(xué)園10W棟317-318
相似職位
-
電腦運(yùn)維工程師 面議古塔區(qū) 應(yīng)屆畢業(yè)生 不限廣州宇翊鑫醫(yī)療科技有限公司
-
項(xiàng)目質(zhì)量工程師 面議凌河區(qū) 應(yīng)屆畢業(yè)生 不限東北電力煙塔工程有限公司
-
網(wǎng)絡(luò)工程師-錦洲 面議應(yīng)屆畢業(yè)生 不限北京響起來(lái)信息科技有限公司
-
移動(dòng)端測(cè)試員 100-150元古塔區(qū) 不限 不限錦州市銘宇企業(yè)管理信息咨詢有限責(zé)任公司
-
新媒體運(yùn)營(yíng) 3000-6000元太和區(qū) 應(yīng)屆畢業(yè)生 不限瀾鯨企業(yè)管理(錦州)有限公司
-
新媒體運(yùn)營(yíng)/ 國(guó)際站運(yùn)營(yíng) 面議義縣 應(yīng)屆畢業(yè)生 不限東莞市華和激光科技有限公司