Big Data Developer

CLPS • Python • Apache NiFi • 1 day ago
Smart Apply
Similar jobs
1,826,675open jobs
106,511companies
259,417added this week
Browse all
Salary
$22k – $36k per year
Location
In office (Guangzhou)
Employment
Full-Time

First seen by Alion on Oct 19, 2026.

Overview
Company
Impact
Profile match

CLPS

HQ: Guangzhou, China

负责与数据管理、数据提取、数据加载到目标系统、异常管理相关的分析、架构和实现任务，并支持生产流程和系统。 该职位需要在整个项目生命周期内与项目经理、技术主管、系统架构主管、开发人员、QA工程师和业务分析师密切合作。 具有大数据开发、设计和架构方面的专业知识  熟悉Ab Initio等tansformation工具
熟悉Hadoop, Hive, Sqoop, Nifi, Knox, Oozie等大数据技术  
优秀的SQL和Linux shell脚本知识  
-对分布式系统，数据管道，ETL有良好的理解  
在项目的任何阶段提供优先级，计划，评估，工作分配，质量保证和指导。  
识别和开发技术设计文件。 开发并记录高级概念数据流程设计，供数据分析人员审阅。  
为客户提供支持业务流程和业务目标的解决方案。  
为团队成员提供培训、指导、帮助和知识转移。  
具备敏捷交付和Scrum团队的丰富知识和经验。
基本技能:  
-熟练掌握Hadoop、Sqoop、Hive、NiFi、Knox、Oozie等大数据技术  
强有力的SQL技能  
熟悉Devops技术，如Jenkins, Ansible, Nexus, Sonarqube  
熟悉Unix Shell脚本和一般管理  
在金融服务/银行领域有经验  
优秀的沟通技巧  
有用的技能/知识:  
-BMC Control M(版本7.0或以上)  
-云技术，尤其是GCP  
-大数据管道设计  
-大数据湖的性能优化  
Python

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
1,826,675 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Data Science
Similar stack
Same company
Guangzhou
≈ $19k – $39k per year (Estimated) • Remote (India) • 5+ years exp • Hyderabad
Databases
Snowflake
DevOps
Azure
AWS
Cybersecurity
GDPR
Analytics
Tableau
Power BI
Looker
Collibra
Apply
Senior Data Engineer 2 hours ago
≈ $69k – $177k per year (Estimated) • Remote (Colombia) • 5+ years exp • Bachelor's Degree • Colombia
Python
JavaScript
SQL
AI/ML
AI Agents
DevOps
GCP
Analytics
ETL/ELT
Apply
Hybrid • 2+ years exp • Master's Degree • Sofia
SQL
Databases
Databricks
AI/ML
Machine Learning
Analytics
QlikSense
Apply
≈ $18k – $48k per year (Estimated) • In office • Bachelor's Degree • Bengaluru
Python
JavaScript
SQL
Python
pySpark
Databases
Databricks
Delta Lake
AI/ML
Spark
MLFlow
LLM
Streamlit
DevOps
Rest API
Azure DevOps
Azure
CI/CD
Git
GitHub
Cybersecurity
Least Privilege
Management
Agile
Scrum
Apply
≈ $159k – $273k per year (Estimated) • Remote (United States)
Python
SQL
Databases
Snowflake
Databricks
AI/ML
Claude
dbt
Fine-tuning
AI Agents
LLM
RAG
Streamlit
Semantic Search
Anthropic
Semantic Search
Machine Learning
DevOps
GCP
Azure
CI/CD
AWS
Analytics
ETL/ELT
Apply
$32k – $45k per year • In office • Full-Time • 2+ years exp • Guangzhou
Python
C++
AI/ML
Spark
Apply
$27k – $36k per year • In office • Full-Time • Guangzhou
Java
SQL
Scala
Databases
Presto
Google BigQuery
Amazon Redshift
BigQuery
DevOps
GCP
CI/CD
Kubernetes
Analytics
Power BI
Management
Jira
Agile
Apply
$27k – $43k per year • In office • Full-Time • Guangzhou
JavaScript
SQL
Node JS
Scala
Databases
PostgreSQL
Apache Kafka
Amazon Redshift
DevOps
Rest API
Amazon S3
Amazon Kinesis
SOAP
Analytics
Power BI
Apply
$32k – $47k per year • In office • Full-Time • Guangzhou
Scala
Databases
MySQL
ClickHouse
RabbitMQ
ElasticSearch
Apply
≈ $34k – $85k per year (Estimated) • In office • Full-Time • 3+ years exp • Guangzhou
Apply
See all jobs
This is one of many
1,826,675 more open roles from verified company boards, updated every day.
Browse all jobs Get matched roles