{"id":4014813,"url":"https://alion.io/job/pdi-technologies-data-engineer-iii","title":"Data Engineer III","company":{"id":7295,"name":"PDI Technologies","domain":"pditechnologies.com","url":"https://alion.io/company/pditechnologies","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Lever","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"middle","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Chennai, India","Hyderabad, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":7,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"Airflow","optional":false},{"name":"Amazon Aurora","optional":false},{"name":"Amazon EC2","optional":false},{"name":"Amazon Redshift","optional":false},{"name":"Amazon S3","optional":false},{"name":"Apache Hudi","optional":false},{"name":"Apache Iceberg","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"Dimensional Modeling","optional":false},{"name":"ETL/ELT","optional":false},{"name":"GCP","optional":false},{"name":"Hadoop","optional":false},{"name":"Java","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false}],"status":"live","first_seen_at":"2026-11-10T09:37:30Z","employer_posted_date":"2026-11-10","last_verified_at":"2026-11-10T12:09:26Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"For nearly 40 years, PDI has helped convenience retailers and petroleum wholesalers adapt to changes in the industry by leveraging the latest technologies. Simplifying the complexity in your world is our main focus. That's why we're delivering an integrated portfolio of global, cloud-based solutions and services to meet our customers needs today and well into the future. From the back office to fuel logistics, and the latest wave of consumer demands and digital commerce, PDI solutions and services are designed to give you a competitive edge. Our deep domain knowledge is backed by our industry-specific software offerings and a people-first approach. Serving the entire supply chain means that we’ve had to solve a wide range of industry challenges and deliver measurable value. To address the increasingly dynamic convenience retail and petroleum wholesale industry, PDI leads the way with converged digital, cloud-optimized, secure, and scalable solutions including ERP, Loyalty, Fuel Pricing, Point-of-Sale and Logistics to create a broader industry ecosystem. The result is unparalleled insights, simplified operations, and higher profitability for your employees and business. We’re dedicated to helping our more than 1,500 customers in over 50 countries, providing solutions and services to over 200,000 sites.\nThe Opportunity:\nIf you love to develop great quality software and are eager to learn new technologies and develop new skills, then we have a great opportunity for you: join our PDI family and work closely with other talented PDI engineers to deliver solutions that delight our customers every day!\nAs a Data Engineer III, you will be part of an agile data services team responsible for developing and maintaining our industry-leading cloud-based big data and data analytics infrastructure serving major global fortune 500 companies. The candidate will help with design, development, unit testing, performance testing, deployment, troubleshooting, defect resolution, and support of our\nJob Responsibilities:\nUtilize architectural and design skills for a variety of data-oriented tasks.\nEstablish and maintain strong relationships with business stakeholders.\nBuild highly reliable & scalable data systems with good data governance that provide complete, secure, accurate and timely data for analytics. \nExpertise in data & dimensional modeling with good business acumen in supporting new product features and services - including financial reporting. \nAssist development and analytics organization to meet its delivery goals with regards to data design, flow and infrastructure. \nPerform Data Modeling, Big data architecture design, support and implementation of OLTP, real time OLAP/data warehouse systems and ETL pipelines. \nTrack/Build & monitor data/system KPI’s like storage, performance & usage \nHands on administration of big data databases/compute engines (Redshift, EMR, Spark or similar) and optimization/tuning techniques \nPrepare required documentation as outlined by departmental standards. \nIdentify, analyze and back track data problems as needed. \nProvide recommendations for application and system improvements. \nMentor other team members \nWork with business users to understand business requirements, issues and business and/or client processes. \nDevelop, test, and maintain high-performance of our data systems to meet the requirements of the business and/clients while adhering to departmental standards. \nPerform quality assurance testing for all work performed. \nMeet with agile teams as required to define and document application requirements. \nFollow project development, deployment process & maintain industry standards and best coding practices. \nMaintain security and organization of the company’s data. \nProvide off-hour support as assigned. \nGather business requirements/features, estimate the tasks, design & develop scalable solutions. \nWork with manager to ascertain the company’s data requirements. \nPlan work to meet project deadlines, accommodate demands by development teams, set priorities and escalate issues appropriately. \n Provide recommendations to development teams for data restructuring and performing complex maintenance.\nDeploy and manage changes in development, staging and production.\nAssist development and dev ops teams on SQL queries and tuning. \nRequired Skills & Experience:\nAt least 7 years’ experience in data engineering, Data modeling, SQL, ETL, Big database, Data warehousing & basic-level administration of data infrastructure\nAt least 7 years coding experience in Java, Python, R or other equivalent programming language\nAt least 4 years big data experience \nAt least 2 years’ experience as technical lead architecting data lake/data warehouse/lake house systems & mentoring team of Data Engineers / DBAs \nProficient in a variety of big-data tools and technologies, including Hadoop, Spark, etc., handling different storage formats like Parquet, Delta/Apache Hudi/Apache Iceberg, & managing/working with different OLTP systems & data ingestion mechanisms. \nExperience building large scale data lakes & warehouse systems leveraging cloud environments including AWS technologies -S3, Redshift, Aurora/RDS, DMS, EC2, Glue spark, Cloud watch, & EMR \nExperience with data orchestration tools like Airflow \nExperience in building pipelines, ingesting data from heterogeneous systems onto data lake environments in real time \nProficient in Python, SQL and PL-SQL, query tuning, optimization, ETL, ELT, and Data Warehousing \nProficient in Business Intelligence (BI), analytic database and products, able to take business requirements and translate into database tables, pipeline design and tasks. \nGeneral data-specific concepts, frameworks and processes \nAgile development practices \nWorking within an SDLC \nDesigning data warehouses including definition, structure, documentation, maintenance, long-range requirements, operational guidelines, and protection \nData governance, meta data management, data security measures, retention & archival across data lake layers \nOther Skills and Experience\nCloud experience, such as AWS, GCP or Azure\nBuilding/Managing data lake & lake house architectures. \nExperience working on different data lake storage formats. \nExcellent oral and written communication \nMulti-tasking and managing multiple priorities. \nWorking well in a team-oriented, collaborative environment with people from different disciplines and varying degrees of technical experience \nWorking in an Agile team environment. \nBehavioral Competencies:\nCultivates Innovation\nDecision Quality\nManages Complexity\nDrives Results\nBusiness Insight","description_format":"text","description_chars":6623,"description_truncated":false,"requirements":{"experience_years_min":7,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["ERP & Business Management Software","Retail & Shop Systems","Supply Chain & Logistics Software"],"lifecycle":[{"event":"open","at":"2026-11-10T12:09:26Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":21,"reasons":["conf:1","win:early"],"computed_at":"2026-11-10T13:49:43Z"},"pay":null,"html_url":"https://alion.io/job/pdi-technologies-data-engineer-iii","json_url":"https://alion.io/job/pdi-technologies-data-engineer-iii.json","meta":{"generated_at":"2026-11-10T13:49:43Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":32151,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-11T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":7295},"rest":"https://alion.io/mcp/rest/get_company?id=7295"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fpdi-technologies-data-engineer-iii"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":2,"usd":0.2},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fpdi-technologies-data-engineer-iii"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fpdi-technologies-data-engineer-iii"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/pdi-technologies-data-engineer-iii\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fpdi-technologies-data-engineer-iii"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4014813}},{"tool":"search_jobs","arguments":{"company":"pditechnologies.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4014813},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}