Big Data Engineer

Cognine • Python • Java • ETL/ELT • 6 months ago
Smart Apply
Similar jobs
1,809,914open jobs
104,148companies
274,655added this week
Browse all
Salary
≈ $22k – $44k per year (Estimated)
Location
In office (Hyderabad)
Seniority
Senior · 5+ years exp
Employment
Full-Time

Confirmed on the employer's own hiring board on Oct 17, 2026. First seen by Alion on Apr 28, 2026.

Overview
Company
Impact
Profile match

Cognine

Discover the power of AI with Cognine. We specialize in AI development, data engineering, and digital transformation to drive growth and efficiency. Software solutions in Hyderabad.
cognine.com • Hyderabad • UTC+05:30 • Data Engineering & Migration Services
Tech stack of Cognine

Job Summary:

We are looking for a skilled Big Data Engineer with strong experience in PySpark and data engineering. The ideal candidate will have hands-on experience in building scalable data pipelines, working with streaming data, and cloud platforms. Experience with Palantir Foundry is highly preferred

Experience Required: 5 - 10 years

Key Responsibilities:

  • Design, develop, and maintain ETL/data pipelines using Python and PySpark
  • Work with real-time/streaming data systems
  • Build and optimize data processing solutions on cloud platforms
  • Collaborate with cross-functional teams to understand business requirements
  • Develop and maintain CI/CD pipelines
  • Ensure data quality, performance, and scalability

Required Skills:

  • 5-10+ years of experience in Data Engineering
  • Strong expertise in Python and PySpark
  • Experience with Kafka, Flink, and Kubernetes
  • Hands-on with Big Data technologies (Hadoop, Spark, MongoDB)
  • Experience with cloud platforms (Azure, AWS, or GCP)
  • Good understanding of data architecture and pipeline design

Preferred Skills:

  • Experience with Palantir Foundry
  • Knowledge of Java
  • Experience in consulting or Utilities domain
Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
1,809,914 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Data Science
Similar stack
Same company
Hyderabad
≈ $16k – $38k per year (Estimated) • In office • Full-Time • 6+ years exp • Bachelor's Degree • Bengaluru
Python
Python
pySpark
Databases
Databricks
AI/ML
Polars
Spark
MLFlow
Scikit-learn
NLP
TensorFlow
Pandas
PyTorch
Time Series Forecasting
Machine Learning
DevOps
GCP
Azure
CI/CD
AWS
Cybersecurity
GDPR
Analytics
A/B Testing
Management
Telegram
WhatsApp
Agile
Apply
≈ $16k – $39k per year (Estimated) • Hybrid • Full-Time • 6+ years exp • Bachelor's Degree • Bengaluru
Python
Java
Scala
AI/ML
LangGraph
LangChain
Model Context Protocol
Embeddings
Scikit-learn
Function Calling
AI Agents
NLP
TensorFlow
PyTorch
LLM
RAG
OpenAI
LLMOps
LLM Guardrails
Agentic Workflows
Tool Use
Machine Learning
DevOps
GCP
Azure
CI/CD
AWS
Docker
Kubernetes
Management
Telegram
WhatsApp
Agile
Scrum
Apply
≈ $21k – $43k per year (Estimated) • In office • Full-Time • 7+ years exp • Bachelor's Degree • Chennai
Python
Java
Databases
Snowflake
Apply
≈ $19k – $39k per year (Estimated) • Hybrid • 6+ years exp • Pune
SQL
Databases
MySQL
DevOps
Azure
Analytics
Power BI
Azure Data Factory
Apply
≈ $21k – $42k per year (Estimated) • Hybrid • 6+ years exp • Bachelor's Degree • India
SQL
Databases
PostgreSQL
Snowflake
Databricks
Apache Kafka
AI/ML
Spark
DevOps
Azure
CI/CD
AWS
Configuration Management
Incident Management
Analytics
ETL/ELT
Management
ServiceNow
Agile
Apply
$117k – $160k per year • In office • 5+ years exp • Chicago
Python
AI/ML
Computer Vision
NLP
TensorFlow
PyTorch
Time Series Forecasting
Amazon SageMaker
Machine Learning
DevOps
GCP
Azure
CI/CD
AWS
Docker
Kubernetes
Management
Agile
Apply
≈ $42k – $95k per year (Estimated) • Equity • In office • Suffield
Python
MATLAB
MATLAB
Simulink
Robotics
PID Control
Apply
≈ $89k – $253k per year (Estimated) • In office • Internship • Bachelor's Degree • Suffield
Python
C++
MATLAB
MATLAB
Simulink
Apply
≈ $39k – $79k per year (Estimated) • In office • Internship • Bachelor's Degree • Suffield
Python
MATLAB
Design
SolidWorks
Apply
≈ $44k – $73k per year (Estimated) • In office • Internship • Bachelor's Degree • Suffield
Python
MATLAB
MATLAB
Simulink
Apply
≈ $16k – $36k per year (Estimated) • In office • Full-Time • 6+ years exp • Hyderabad
JavaScript
C#
C#
.NET
AI/ML
Claude
Copilot Studio
Frontend
React.js
DevOps
Azure DevOps
Azure
CI/CD
Management
Jira
Power Automate
Agile
Scrum
Apply
In office • Full-Time • 5+ years exp • Master's Degree
Python
Databases
Amazon Redshift
AI/ML
Hadoop
Spark
Computer Vision
TensorFlow
Keras
Amazon SageMaker
Machine Learning
DevOps
Terraform
Azure DevOps
Azure
AWS
GitHub
Analytics
AWS Glue
Apply
≈ $22k – $48k per year (Estimated) • In office • Full-Time • 5+ years exp • Hyderabad
Python
Databases
Google BigQuery
BigQuery
AI/ML
Vertex AI
Machine Learning
DevOps
GCP
GitHub Actions
CI/CD
Google Cloud Run
Apply
≈ $17k – $39k per year (Estimated) • In office • Full-Time • 5+ years exp • Bachelor's Degree • Hyderabad
JavaScript
Java
TypeScript
SQL
AI/ML
OpenAI
Frontend
React.js
DevOps
gRPC
Terraform
Azure
CI/CD
Git
AWS
QA
Playwright
Apply
In office • Full-Time • Hyderabad
Python
JavaScript
TypeScript
Node JS
Python
Flask
FastAPI
Django
Databases
MySQL
PostgreSQL
Frontend
Angular
React.js
DevOps
GCP
Azure
AWS
Apply
≈ $32k – $59k per year (Estimated) • Hybrid • Full-Time • 10+ years exp • Bachelor's Degree • Hyderabad
Python
Java
SQL
Databases
Databricks
Delta Lake
Apache Kafka
Amazon Redshift
Amazon Neptune
AI/ML
Spark
DevOps
Terraform
GitLab CI
Azure
CI/CD
Jenkins
AWS
Docker
Kubernetes
GitHub
Amazon Kinesis
Analytics
ETL/ELT
Matillion
Management
Agile
Scrum
Kanban
Apply
≈ $21k – $43k per year (Estimated) • Hybrid • 5+ years exp • Bachelor's Degree • Hyderabad
Python
SQL
AI/ML
Hadoop
Spark
Machine Learning
DevOps
GCP
CI/CD
Analytics
ETL/ELT
Apply
≈ $17k – $45k per year (Estimated) • In office • Full-Time • Bachelor's Degree • Hyderabad
Python
SQL
Python
pySpark
Databases
Snowflake
Databricks
Delta Lake
Azure SQL Database
Microsoft Fabric
AI/ML
Spark
DevOps
Azure DevOps
Azure
CI/CD
Jenkins
Git
AWS
GitHub
Cybersecurity
GDPR
Analytics
Power BI
ETL/ELT
Azure Data Factory
Dimensional Modeling
Apply
Data Engineer 1 day ago
≈ $21k – $57k per year (Estimated) • In office • Full-Time • Bachelor's Degree • Hyderabad
Python
SQL
Python
pySpark
Databases
Databricks
AI/ML
Copilot
Spark
Prompt Engineering
RAG
Tokenization
Amazon SageMaker
OpenAI Codex
Machine Learning
DevOps
AWS
Analytics
ETL/ELT
Apply
≈ $16k – $37k per year (Estimated) • In office • Full-Time • 5+ years exp • Bachelor's Degree • Hyderabad
Databases
Databricks
AI/ML
Time Series Forecasting
Machine Learning
Apply
See all jobs
This is one of many
1,809,914 more open roles from verified company boards, updated every day.
Browse all jobs Get matched roles