2,298,056open jobs
145,848companies
270,309added this week
Browse all
Location
In office (India)
Seniority
Senior · 5+ years exp
Employment
Full-Time

First seen by Alion on Nov 12, 2026.

Overview
Company
Impact
Profile match
Innovya Technologies is a technology services company in Pasadena. Its job advert seeks a senior data engineer to design, build and maintain scalable data pipelines, ETL workflows and cloud data solutions using Databricks, PySpark and Python. The company is based in Pasadena, California, United States.

Job Title: Data Engineer - Python | PySpark

Experience: 5+ years

Job Type: India, Full-Time, Remote

Timings: 4pm-1am IST

Innovya Technologies is a fast‑growing software consulting firm specializing in business automation and modern digital solutions. We enable organizations to accelerate value realization from their technology and transformation initiatives through expert, context‑driven product development and high‑quality engineering services.

About the Role:

The ideal candidate will have a strong background in building scalable, fault-tolerant, and high-performance ELT applications, with a keen interest in AI enabled development.

You will work closely with cross-functional teams to design, analyse, build and deploy complex systems, providing technical direction and expertise to ensure the delivery of robust, efficient, and scalable solutions.

Key Responsibilities:

  • Design, develop, and optimize scalable data pipelines using PySpark
  • Process and analyze large datasets in distributed environments
  • Collaborate with data engineers, analysts, and stakeholders to deliver data solutions
  • Write efficient, reusable, and reliable PySpark code
  • Perform data cleansing, transformation, and validation
  • Optimize Spark jobs for performance and cost efficiency
  • Integrate data from various sources (databases, APIs, streaming platforms, etc.)
  • Troubleshoot and debug data pipeline issues
  • Maintain documentation for data workflows and processes

Required Skills:

  • 5+ years of total experience in Python development, with at least 4 years in Apache Spark (PySpark).
  • Hands-on experience with Python and PySpark in production data engineering environments.
  • Use Spark DataFrames for large-scale data transformation and processing.
  • Experience with complex aggregations, window functions, conditional aggregations, and performance tuning in Spark.
  • Good understanding of Spark execution concepts such as partitions, shuffles, join behavior, and optimization techniques.
  • Experience with API integrations, including pagination, request handling, response transformation, and fault tolerance.
  • Working knowledge of AWS, preferably with services such as S3, Lambda, Glue, EMR, Athena, Step Functions, or similar.
  • Experience handling JSON and schema-based parsing in distributed data pipelines.
  • Familiarity with SQL-based data extraction and transformation.
  • Ability to write production-quality, maintainable, and testable code.
  • Good analytical and problem-solving skills, with the ability to understand complex data flows and business rules.
  • Experience identifying bugs, troubleshooting processing issues, performing root cause analysis, and implementing fixes in distributed systems.
  • Ability to create and maintain unit tests to improve code quality and reduce regressions.
  • Preferred - 2+ years of DataBricks and Data Lake development experience
Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,298,056 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Data Science
Similar stack
Same company
India
In office · 5+ years exp · Navi Mumbai
Python
C++
SpaceTech
STAR-CCM+
OpenFOAM
Apply
In office · 12+ years exp · Bengaluru · Mumbai
Databases
Snowflake
DevOps
GCP
Azure
AWS
Analytics
Power BI
ETL/ELT
Informatica
Talend
Collibra
Apply
In office · 13+ years exp · Bengaluru · Mumbai
Python
SQL
Python
pySpark
Databases
Databricks
Microsoft Fabric
AI/ML
Spark
DevOps
Azure DevOps
GitHub Actions
Azure
CI/CD
Git
Analytics
Power BI
Azure Data Factory
Apply
In office · 3+ years exp · Pune
SQL
Databases
Teradata
AI/ML
Machine Learning
DevOps
Linux
Unix
Analytics
ETL/ELT
Informatica
Apply
In office · 8+ years exp · Greater Noida
Databases
Databricks
Apply
Remote (United Arab Emirates) · Full-Time · 8+ years exp · India
AI/ML
AI Agents
Apply
In office · Full-Time · 8+ years exp · India
SQL
DevOps
Rest API
Azure DevOps
Azure
GitHub
SOAP
Analytics
ETL/ELT
Management
Confluence
Apply
Data Scientist 2 days ago
In office · Full-Time · India
AI/ML
Scikit-learn
NumPy
Machine Learning
Apply
Remote (India) · 5+ years exp · India
Python
Databases
MySQL
DevOps
Terraform
Helm
GitHub Actions
Istio
CloudFormation
Linkerd
Prometheus
CI/CD
ArgoCD
Jenkins
Git
AWS
Docker
Kubernetes
Grafana
Service Mesh
Amazon EKS
AWS Lambda
Amazon EC2
GitHub
Amazon S3
IAM
Amazon CloudWatch
DNS
Management
Confluence
Jira
Apply
Remote (India) · Full-Time · 1+ year exp · High School Diploma · India
Management
Notion
Jira
n8n
Zapier
Apply
See all jobs
This is one of many
2,298,056 more open roles from verified company boards, updated every day.