Data Engineer
First seen by Alion on Sep 10, 2026.
Role Overview :
As a Data Engineer within our AEP (Adobe Experience Platform) Competency team, you will be responsible for designing and maintaining robust data pipelines that power high-scale marketing and customer experience solutions. You will collaborate closely with cross-functional teams, including data scientists, product managers, and client stakeholders, to transform raw data into actionable insights. Your work will directly influence how our clients leverage their data ecosystems to drive personalized customer journeys and optimize business outcomes across global platforms.
Key Responsibilities :
- Architect and develop scalable ETL pipelines using PySpark to process large-scale datasets, ensuring high data availability and integrity for downstream analytics.
- Design and optimize data models within NoSQL and SQL environments to support complex reporting requirements and real-time data ingestion.
- Deploy and manage containerized data applications using Kubernetes to ensure high availability and efficient resource utilization across cloud environments.
- Integrate data services with external platforms through the development and maintenance of secure RESTful APIs.
- Collaborate with stakeholders to translate business requirements into technical specifications, ensuring data solutions align with organizational goals.
- Implement best practices for data governance, security, and performance tuning to maintain the reliability of the AEP ecosystem.
Required Skillset :
- Demonstrated expertise in building high-performance data pipelines using Python and PySpark within AWS cloud environments.
- Proven ability to manage and query large-scale datasets using both SQL and NoSQL databases, with a focus on performance optimization.
- Strong proficiency in container orchestration using Kubernetes to manage and scale data-intensive workloads.
- Experience in designing and consuming RESTful APIs to facilitate seamless data exchange between disparate systems.
- Excellent communication skills with the ability to articulate complex technical concepts to non-technical stakeholders and work effectively in a collaborative team environment.
- A minimum of 6 - 10 years of professional experience in data engineering roles, with a track record of delivering end-to-end data solutions.
- Ability to work effectively in a hybrid or office-based model across Bangalore, Hyderabad, Pune, Noida, or Gurgaon, demonstrating high adaptability to evolving project needs.
Skills
Data Engineering, PySpark, AWS, SQL, NoSQL, Python, RESTful, AEM