As a Senior Data Engineer, you'll play a crucial role in designing, developing, and maintaining our data platforms, constructing efficient, automated, and scalable data pipelines for processing both batch and real-time data that power our products and analytics.
Responsibilities:
Develop and maintain automated real-time and batch data pipelines, build automation solutions for diverse data services, and contribute to the development of tools for Data Profiling and Anomaly detection.
Collaborate closely with Engineering Teams to address their software and deployment requirements while driving innovation in Data Platform architecture and the software stack.
The Requirement
Bachelor’s degree in Computer Science or related field with 5+ years of data engineering experience. Strong Python skills, expertise in relational DBMS, distributed systems, big data tools (Hadoop, Spark, Kafka), SQL, and fluency in English.
Knowledge of columnar/NoSQL databases, experience with AWS services, PySpark/Scala expertise, familiarity with ClickHouse, and proficiency in GPU-accelerated databases (e.g., HeavyDB, Kinetica).
NOTICE: Please provide profile in English and Chinese.
Comments