{"id":3299692,"url":"https://alion.io/job/vivantify-technology-solutions-india-pvt-ltd-contractor-python-pyspark-developer","title":"Contractor - Python & PySpark Developer","company":{"id":4478772,"name":"vivantify technology solutions india pvt. ltd.","domain":"vivantify.com","url":"https://alion.io/company/vivantify-technology-solutions-india-pvt-ltd","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Backend","role_family":"Backend","seniority":"senior","employment_type":"contractor","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"explicit","locations":["Hyderabad, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":16000,"max_usd":38000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":168},"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"ChatGPT","optional":false},{"name":"Copilot","optional":false},{"name":"Delta Lake","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Prompt Engineering","optional":false},{"name":"pySpark","optional":false},{"name":"Pytest","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false}],"status":"live","first_seen_at":"2026-10-26T21:35:44Z","employer_posted_date":null,"last_verified_at":"2026-10-26T21:35:44Z","board_verified":false,"closed_at":null,"days_open":8,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":8},"description":"Location: Pan India\n\nExperience: 5–7 Years\n\nAbout The Role\n\nWe are looking for an experienced Python and PySpark Developer with strong hands-on expertise in PySpark ETL, Python, Spark SQL, DataFrames, and Delta Lake. The role focuses on developing, enhancing, testing, and supporting data processing pipelines, with an emphasis on using GenAI tools to improve development, debugging, testing, documentation, and code quality.\n\nJob Description\n\nThe role involves maintaining and enhancing PySpark ETL jobs and troubleshooting data processing using Spark DataFrames, Spark SQL, and Delta Lake. You will work with file ingestion processes, including CSV, XML, and Hyper extracts, along with reporting-date handling and SQL-to-PySpark integration.\n\nYou will also develop and execute PyTest-based unit and integration tests and troubleshoot production issues using Python logging and exception handling. The position requires effective use of AI coding assistants such as GitHub Copilot, ChatGPT, or similar tools for code development, analysis, testing, debugging, documentation, and code reviews.\n\nThe role also emphasizes responsible AI usage, including data privacy, secure handling of production data, validation of AI-generated outputs, and awareness of prompt engineering for technical tasks.\n\nKey Responsibilities\n\nMaintain and enhance PySpark ETL jobs and data processing pipelines\nDevelop and troubleshoot Spark DataFrame, Spark SQL, and Delta Lake processing\nImplement file ingestion for CSV, XML, and Hyper extracts\nWork with SQL-to-PySpark integration and reporting-date handling\nDevelop and execute PyTest-based unit and integration tests\nTroubleshoot production issues using Python logging and exception handling\nUse AI coding assistants to accelerate development, debugging, testing, code review, and documentation\nAnalyze legacy code, perform impact assessments, and support root-cause analysis using AI-assisted techniques\n\nRequired Skills\n\nPython\nPySpark\nSpark DataFrames and Spark SQL\nDelta Lake\nETL development\nPython debugging, logging, and exception handling\nSQL-to-PySpark integration\nFile ingestion and processing\nPython packaging and runtime dependencies\nPyTest-based testing\nCode quality tools such as Pylint\nAI coding assistants such as GitHub Copilot or ChatGPT\nGenAI-assisted code analysis, testing, debugging, and documentation\nPrompt engineering for technical tasks\nResponsible AI practices and production data privacy\n\nGood to Have\n\nExposure to ML/AI concepts\nEmbeddings\nVector search\nRAG\nLLM-based knowledge assistants for internal documentation and search\n\nMandatory Skills\n\nPython\n\nCandidate Profile\n\nThe ideal candidate should have 5–7 years of experience in Python and PySpark development, with strong hands-on expertise in ETL processing, Spark, Delta Lake, testing, and production troubleshooting. The candidate should also be comfortable using GenAI and AI coding assistants for development, analysis, testing, documentation, and code-quality improvement, with strong communication skills.\n\nBenefits Package\n\nCompetitive salary and benefits package\nOpportunities for professional growth and development\nA collaborative and inclusive work environment\nThe opportunity to work on exciting and challenging projects with leading clients","description_format":"text","description_chars":3267,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"India","iso":"IN","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-10-26T23:09:45Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":7,"expected_fill_days":29,"reasons":["seen:7","velocity","win:early"],"computed_at":"2026-11-03T05:54:40Z"},"pay":null,"html_url":"https://alion.io/job/vivantify-technology-solutions-india-pvt-ltd-contractor-python-pyspark-developer","json_url":"https://alion.io/job/vivantify-technology-solutions-india-pvt-ltd-contractor-python-pyspark-developer.json","meta":{"generated_at":"2026-11-04T01:09:11Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":1741,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-05T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4478772},"rest":"https://alion.io/mcp/rest/get_company?id=4478772"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fvivantify-technology-solutions-india-pvt-ltd-contractor-python-pyspark-developer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fvivantify-technology-solutions-india-pvt-ltd-contractor-python-pyspark-developer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fvivantify-technology-solutions-india-pvt-ltd-contractor-python-pyspark-developer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/vivantify-technology-solutions-india-pvt-ltd-contractor-python-pyspark-developer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fvivantify-technology-solutions-india-pvt-ltd-contractor-python-pyspark-developer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3299692}},{"tool":"search_jobs","arguments":{"company":"vivantify.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3299692},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}