車電Senior Data Engineer(內湖)
職務說明:
1. Design, develop, and maintain ETL / ELT data pipelines, including data ingestion, parsing, transformation, validation, and export.
2. Modularize, standardize, and automate existing script-based or manual processes, and define clear pipeline interfaces, dependencies, and processing flows.
3. Establish monitoring, logging, error handling, retry, failure recovery, and data validation mechanisms to ensure pipeline reliability and data quality.
4. Analyze and optimize data processing performance, reliability, and scalability.
5. Collaborate with Database Engineers and Automation / DevOps Engineers to integrate databases, NAS / file storage, and workflow orchestration platforms.
6. Create and maintain relevant architecture, interface, operation, and troubleshooting documentation.
專長條件:
1. 3+ years of experience as a Data Engineer, Data Platform Engineer, Backend Engineer, or in a related role.
2. Strong proficiency in Python, SQL, and Linux, with hands-on experience in production-level data processing.
3. Hands-on experience in ETL / ELT, data pipeline architecture, and data processing workflow design and implementation.
4. Hands-on experience with Airflow, Dagster, Prefect, or other workflow orchestration frameworks.
5. Practical experience with pipeline monitoring, logging, error handling, retry, failure recovery, and data validation / data quality mechanisms.
6. Ability to independently perform system design, debugging, root cause analysis, performance optimization, and production issue handling.
7. Familiarity with Git, Shell scripting, and software engineering practices, with the ability to build maintainable and scalable data pipelines.
8. Ability to communicate effectively in English in technical discussions, meetings, and cross-functional collaboration.
【Preferred Qualifications】
1. Experience processing large volumes of image, video, sensor / IoT, metadata, or other unstructured data.
2. Experience with Docker, REST APIs, message queues, event-driven architecture, or other system integration technologies.
3. Experience with Spark / PySpark, Kafka, or other distributed data processing frameworks.
4. Experience with Data Modeling, Data Governance, Data Lineage, Dataset Versioning, or Data Traceability.
5. Experience with Pandas, NumPy, data analysis, Machine Learning, or Computer Vision.
6. Experience in automotive product development, or familiarity with standards and development processes such as Automotive SPICE, ISO 26262, or ISO/SAE 21434.
法定權益:
享勞、健保、勞工退休金提撥 / 其它依勞動基準法、性別平等工作法、全民健康保險法等規定之相關福利
其他福利:
◆一年四季提供優渥獎金(年終/端午/中秋/分紅)
◆內部推薦獎金
◆提供婚喪喜慶補助
◆生育補助
◆年節禮卷
◆生活娛樂/藝文補助
- 如果您已是 HiHunter 的求職會員,請輸入您的身份證字號和密碼:
- 如您尚未在本站填寫您的線上履歷,請先
- 您也可以直接將履歷寄給我們:線上投遞履歷給負責顧問