{"id":3974924,"url":"https://alion.io/job/devsu-data-engineer-python-pyspark-databricks-2","title":"Data Engineer (Python, PySpark & Databricks)","company":{"id":178732,"name":"Devsu","domain":"devsu.com","url":"https://alion.io/company/devsu","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workable","truth_index":{"grade":"A","score":91,"open_postings":18,"ghost_share":0,"stale_share":0.5,"repost_share":0.111,"time_to_fill_p50_days":21,"computed_at":"2026-11-09T06:03:00Z"}},"role":"Data Science","role_family":"Data Science","seniority":null,"employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"inferred","locations":[],"countries":[],"hiring_countries":["AR","CO","PE"],"hiring_countries_total":3,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Git","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Rest API","optional":false},{"name":"SharePoint","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Azure","optional":true},{"name":"Copilot","optional":true},{"name":"OpenAI Codex","optional":true}],"status":"live","first_seen_at":"2026-11-08T16:28:12Z","employer_posted_date":null,"last_verified_at":"2026-11-08T16:28:12Z","board_verified":false,"closed_at":null,"days_open":1,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":1},"description":"We are looking for a Data Engineer to design, build, modernize, and operate scalable data pipelines supporting Tax technology platforms. This role focuses on developing and enhancing data processing workloads using Python, Apache Spark, PySpark, and Databricks, while ensuring reliable, secure, and maintainable data solutions. The ideal candidate has strong hands-on engineering skills, experience with production ETL/ELT pipelines, data ingestion, APIs, data quality, and cloud-based data platforms, along with strong problem-solving and collaboration skills.\nResponsibilities\nDesign, build, and support scalable data pipelines using Python, Apache Spark, PySpark, and Databricks.\n\nModernize and migrate legacy data processing workloads to secure, cloud-native platforms.\n\nBuild and maintain batch data ingestion pipelines from structured and unstructured sources.\n\nIntegrate data from REST APIs, SharePoint, document repositories, enterprise applications, and cloud platforms.\n\nImplement data quality, monitoring, observability, and operational controls.\n\nOptimize data workloads for performance, scalability, reliability, and cost efficiency.\n\nDevelop document extraction, classification, metadata enrichment, and automation pipelines.\n\nApply software engineering practices including Git, CI/CD, automated testing, and code reviews.\n\nBuild, deploy, troubleshoot, and maintain production ETL/ELT pipelines.\n\nCollaborate with architects, developers, tax subject matter experts, and platform teams.\n\nAnalyze existing codebases and identify opportunities to improve maintainability, security, and reliability.\n\nUse AI-assisted development tools to build, review, test, and maintain data pipeline code.\n\nRequirementsMust Have\n3+ years of experience in data engineering.\n\nStrong Python development experience.\n\nStrong Apache Spark and PySpark experience.\n\nHands-on experience with Databricks.\n\nStrong SQL and data modelling skills.\n\nExperience building, testing, deploying, and troubleshooting production ETL/ELT pipelines.\n\nExperience with Git-based source control and CI/CD pipelines.\n\nExperience consuming REST APIs for data ingestion, including authentication, pagination, and failure handling.\n\nExperience writing automated tests for data pipelines.\n\nStrong understanding of data quality, reliability, and data engineering best practices.\n\nStrong problem-solving, communication, and collaboration skills. \n\nNice to have\nExperience with Azure cloud services and modernising legacy data pipelines.\n\nExperience with document processing, intelligent document extraction, or unstructured data.\n\nFamiliarity with AI-assisted development tools such as Codex, GitHub Copilot, or similar.\n\nExperience with streaming data pipelines or large-scale data repositories.\n\nStrong problem-solving and collaboration skills, with the ability to analyse unfamiliar codebases, identify gaps and trade-offs, and propose practical improvements.\n\nBenefitsA stable, long-term contract. Continuous Training. Private Health insurance. Flexible schedule. Work with some of the most talented software engineers in Latin America and the US, doing challenging work and world-class software for clients in the US and around the world.\nAt Devsu, we believe in creating an environment where you can thrive both personally and professionally. By joining our team, you’ll enjoy:\n• A stable, long-term contract with opportunities for career growth\n• Private health insurance• A remote-friendly culture that promotes work-life balance\n• Continuous training, mentorship, and learning programs to keep you at the forefront of the industry\n• Free access to AI training resources and state-of-the-art AI tools to elevate your daily work\n• A flexible Paid Time Off (PTO) policy as well as paid holiday days\n• Challenging, world-class software projects for clients in the US and LatAm\n• Collaboration with some of the most talented software engineers in Latin America and the US, in a diverse work environment\nJoin Devsu and discover a workplace that values your growth, supports your well-being, and empowers you to make a global impact.\nOriginally posted on Himalayas","description_format":"text","description_chars":4128,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Flexible schedule","Health insurance"],"hiring_locations":[{"name":"Argentina","iso":"AR","kind":"country"},{"name":"Colombia","iso":"CO","kind":"country"},{"name":"Peru","iso":"PE","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Outsourcing & Dedicated Teams","Custom Software Development"],"lifecycle":[{"event":"open","at":"2026-11-09T17:28:20Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":1,"expected_fill_days":21,"reasons":["seen:1","win:early"],"computed_at":"2026-11-09T19:03:45Z"},"pay":null,"html_url":"https://alion.io/job/devsu-data-engineer-python-pyspark-databricks-2","json_url":"https://alion.io/job/devsu-data-engineer-python-pyspark-databricks-2.json","meta":{"generated_at":"2026-11-09T19:03:45Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":4477,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-10T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":178732},"rest":"https://alion.io/mcp/rest/get_company?id=178732"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fdevsu-data-engineer-python-pyspark-databricks-2"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":2,"usd":0.2},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fdevsu-data-engineer-python-pyspark-databricks-2"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fdevsu-data-engineer-python-pyspark-databricks-2"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/devsu-data-engineer-python-pyspark-databricks-2\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fdevsu-data-engineer-python-pyspark-databricks-2"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3974924}},{"tool":"search_jobs","arguments":{"company":"devsu.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3974924},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}