Gate · China
Skills: Python, Java, SQL
Position Overview 1. The company has established a relatively complete data warehouse and real-time data system with capabilities in data collection, computing, storage and services. With the growth of business scale and increased real-time application scenarios, we are looking to recruit two mid to senior-level data development engineers responsible for real-time data requirement delivery, task optimization and engineering governance. 2. This position focuses primarily on real-time data development, while also participating in offline data warehouse construction. You will focus on solving data latency, state expansion, resource consumption, data quality and consistency issues in the real-time data pipeline, driving the real-time data system toward greater stability, efficiency and standardization. 【岗位职责】 1. Responsible for analysis, solution design and development delivery of real-time data requirements, building real-time data processing pipelines based on technologies such as Flink and Kafka, providing data support for real-time analysis, monitoring, metrics and business decision-making scenarios. 2. Participate in real-time data warehouse construction and model design, complete data stratification, metric caliber, dimensional model and data service design and implementation based on business requirements. 3. Continuously optimize existing real-time tasks, addressing data latency, backpressure, Checkpoint exceptions, state expansion, unreasonable resource utilization and data inconsistency issues, improving task stability and computing efficiency. 4. Participate in data governance and engineering quality construction, including task dependency clarification, metadata management, data quality monitoring, alerting mechanisms, development standards and problem diagnosis system construction. 5. Participate in daily maintenance and issue handling of big data platforms and computing engines, coordinating with upstream and downstream teams to ensure stability, accuracy…
Sign in to see the original posting
Browse more developer jobs on RoleBurst