Location
In office (Bengaluru)
Seniority
Senior · 1+ year exp
Visa
Sponsors visas in United States; no register of this country names it
Employment
Full-Time
First seen by Alion on Nov 20, 2026.
Overview
Company
Impact
Profile match
D. E. Shaw is an investment and technology development firm headquartered in New York City and founded in 1988 by David E. Shaw. The firm runs quantitative and discretionary strategies across equities, credit, macro, and private markets, building its own research and trading systems in house. It manages tens of billions of dollars, is known for hiring heavily from mathematics and computer science, and has spun out several notable technology founders.
The D. E. Shaw group is a global investment and technology development firm with more than $115 billion in investment capital as of September 1, 2026, and offices in North America, Europe, and Asia. Since our founding in 1988, our firm has earned an international reputation for successful investing based on innovation, careful risk management, and the quality and depth of our staff. We have a significant presence in the world's capital markets, investing in a wide range of companies and financial instruments in both developed and developing economies.
We are looking for resourceful and exceptional candidates for the Data Engineer role within our product development teams based out of Hyderabad, Bengaluru, and Gurugram. At DESIS, the Data Engineers develop Web Robots, or Web Spiders, that crawl through the web and retrieve data in the form of HTML, plain text, PDFs, Excel, and any other format that is either structured or unstructured. The job functions of the engineer also include scraping the website data into a structured format and building automated and custom reports on the downloaded data that are used as knowledge for business purposes. The team also works on automating end-to-end data pipelines.
WHAT YOU'LL DO DAY-TO-DAY:
As a member of the Data Engineering team, you will be responsible for various aspects of data extraction, such as understanding the data requirements of the business group, reverse-engineering the website, its technology, and the data retrieval process, re-engineering by developing web robots to automate the extraction of the data, and building monitoring systems to ensure the integrity and quality of the extracted data. You will also be responsible for managing the changes to the website's dynamics and layout to ensure clean downloads, building scraping and parsing systems to transform raw data into a structured form, and offering operations support to ensure high availability and zero data losses. Additionally, you will be involved in other tasks such as storing the extracted data in the recommended databases, building high-performing, scalable data extraction systems, and automating data pipelines.
WHO WE'RE LOOKING FOR:
The ideal candidate should hold-
Basic qualifications:
We encourage candidates with relevant experience looking to restart their careers after a break to apply for this position. Learn about Recommence, our gender-neutral return-to-work initiative.
The Firm offers excellent benefits, a casual, collegial working environment, and an attractive compensation package. For further information about our recruitment process, including how applicant data will be processed, please visit https://www.deshawindia.com/careers
Members of the D. E. Shaw group do not discriminate in employment matters on the basis of sex, race, colour, caste, creed, religion, pregnancy, national origin, age, military service eligibility, veteran status, sexual orientation, marital status, disability, or any other protected class.
We are looking for resourceful and exceptional candidates for the Data Engineer role within our product development teams based out of Hyderabad, Bengaluru, and Gurugram. At DESIS, the Data Engineers develop Web Robots, or Web Spiders, that crawl through the web and retrieve data in the form of HTML, plain text, PDFs, Excel, and any other format that is either structured or unstructured. The job functions of the engineer also include scraping the website data into a structured format and building automated and custom reports on the downloaded data that are used as knowledge for business purposes. The team also works on automating end-to-end data pipelines.
WHAT YOU'LL DO DAY-TO-DAY:
As a member of the Data Engineering team, you will be responsible for various aspects of data extraction, such as understanding the data requirements of the business group, reverse-engineering the website, its technology, and the data retrieval process, re-engineering by developing web robots to automate the extraction of the data, and building monitoring systems to ensure the integrity and quality of the extracted data. You will also be responsible for managing the changes to the website's dynamics and layout to ensure clean downloads, building scraping and parsing systems to transform raw data into a structured form, and offering operations support to ensure high availability and zero data losses. Additionally, you will be involved in other tasks such as storing the extracted data in the recommended databases, building high-performing, scalable data extraction systems, and automating data pipelines.
WHO WE'RE LOOKING FOR:
The ideal candidate should hold-
Basic qualifications:
- 1-6 years of experience in website data extraction and scraping
- Good knowledge of relational databases, writing complex queries in SQL, and dealing with ETL operations on databases
- Proficiency in Python for performing operations on data
- Expertise in Python frameworks like Requests, UrlLib2, Selenium, Beautiful Soup, and Scrapy
- A good understanding of HTTP requests and responses, HTML, CSS, XML, JSON, and JavaScript
- Expertise with debugging tools in Chrome to reverse engineer website dynamics
- A good academic background and accomplishments
- A BCA/MCA/BS/MS degree with a good foundation and practical application of knowledge in data structures and algorithms
- Problem-solving and analytical skills
- Good debugging skills
We encourage candidates with relevant experience looking to restart their careers after a break to apply for this position. Learn about Recommence, our gender-neutral return-to-work initiative.
The Firm offers excellent benefits, a casual, collegial working environment, and an attractive compensation package. For further information about our recruitment process, including how applicant data will be processed, please visit https://www.deshawindia.com/careers
Members of the D. E. Shaw group do not discriminate in employment matters on the basis of sex, race, colour, caste, creed, religion, pregnancy, national origin, age, military service eligibility, veteran status, sexual orientation, marital status, disability, or any other protected class.
Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,450,636 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Free forever. No card. Under a minute.
Your match
How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.
Recommended for you based on this role
Data Science
Similar stack
Same company
Bengaluru
Data Scientist
1 hour ago
In office · 3+ years exp · Master's Degree · Pune
Python
AI/ML
Computer Vision
AI Agents
NLP
TensorFlow
Keras
PyTorch
RAG
Anomaly Detection
Machine Learning
Apply
Domain Information Architect (Data Engineering)
8 hours ago
In office · Full-Time · 10+ years exp · Hyderabad
Python
SQL
Databases
Snowflake
Databricks
Apache Iceberg
Delta Lake
Apache Kafka
Apache Hudi
AI/ML
Spark
DevOps
AWS
Platform Engineering
Amazon S3
Amazon Kinesis
Apply
Data - Senior Engineer
8 hours ago
In office · Full-Time · Noida
Python
Python
pySpark
Databases
Snowflake
Databricks
Delta Lake
Apache Kafka
AI/ML
Spark
Airflow
DevOps
Azure
Platform Engineering
Amazon Kinesis
Apply
Remote (likely India) · Full-Time · 4+ years exp · Mumbai
Python
PHP
SQL
PHP
Magento
Databases
Google BigQuery
AI/ML
AI Agents
LLM
DevOps
CI/CD
Git
Analytics
ETL/ELT
Apply
Sr Data Engineer
8 hours ago
In office · Full-Time · 3+ years exp · Bengaluru
Python
SQL
Databases
Snowflake
DevOps
GCP
Azure
AWS
Amazon S3
Analytics
ETL/ELT
Management
Confluence
Apply
Apply
Data Engineer
10 hours ago
In office · Full-Time · Bengaluru
Python
SQL
Python
pySpark
Databases
Databricks
DynamoDB
AI/ML
Spark
Machine Learning
DevOps
Terraform
CloudFormation
GitLab CI
CI/CD
Jenkins
Git
AWS
Bitbucket
AWS Lambda
Amazon EC2
GitHub
Amazon S3
IAM
Amazon CloudWatch
Analytics
ETL/ELT
Management
Agile
Apply
In office · 7+ years exp · Bachelor's Degree · Bengaluru
Python
SQL
AI/ML
MLFlow
XGBoost
Vertex AI
Scikit-learn
LightGBM
Kubeflow
TensorFlow
NumPy
PyTorch
Time Series
Amazon SageMaker
DevOps
GCP
Azure
CI/CD
AWS
Docker
Analytics
Tableau
Power BI
A/B Testing
Looker
Apply
In office · Full-Time · 10+ years exp · Bengaluru
SQL
Databases
Databricks
Delta Lake
Microsoft Fabric
AI/ML
Spark
Time Series
Knowledge Graph
DevOps
Azure
Robotics
Digital Twin
Analytics
Power BI
Apply
In office · Full-Time · 7+ years exp · Bengaluru
Python
SQL
Python
pySpark
Databases
Databricks
Delta Lake
Microsoft Fabric
AI/ML
Spark
Knowledge Graph
DevOps
Azure
CI/CD
Platform Engineering
Robotics
Digital Twin
Analytics
Power BI
Apply
This is one of many
2,450,636 more open roles from verified company boards, updated every day.

