{"id":4579137,"url":"https://alion.io/job/page-matrix-data-engineer-2","title":"Data engineer","company":{"id":4430251,"name":"page - Matrix","domain":"matrix-ifs.com","url":"https://alion.io/company/matrix-ifs","size_band":"5000+","is_staffing_agency":false,"employer_type":"services","is_intermediary":false,"listed_via":null,"ats_vendor":"Comeet","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":null,"employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"inferred_payroll_markers","remote_working_hours":null,"hiring_geo_confidence":"inferred","locations":[],"countries":[],"hiring_countries":["BR"],"hiring_countries_total":1,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"Airflow","optional":false},{"name":"Git","optional":false},{"name":"Hadoop","optional":false},{"name":"Kubernetes","optional":false},{"name":"LLM","optional":false},{"name":"Machine Learning","optional":false},{"name":"Pandas","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false}],"status":"live","first_seen_at":"2026-11-18T23:04:13Z","employer_posted_date":"2026-11-18","last_verified_at":"2026-11-19T04:29:48Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"Description\nData Engineer\nBrazil or Argentina\nWe are seeking an experienced Data Pipeline Engineer to develop, implement, and maintain production-grade data pipelines within the platform. The role involves building scalable data flows, supporting machine learning and analytics use cases, and optimizing large-scale data processing environments.\nThe ideal candidate will have strong hands-on experience with Python, PySpark, Apache Spark, SQL, and big-data technologies, along with an understanding of data pipeline architecture and production operations. The candidate will collaborate closely with customers and internal technical teams to deliver reliable, business-focused data solutions.\nKey Responsibilities\nImplement, maintain, and support production data pipeline flows within the platform based on solution designs and business requirements.\nDesign and develop use-case-specific data flows, machine learning pipelines, and data tools for analytics and data science teams.\nBuild and optimize data processing workflows using Apache Spark, PySpark, Python (Pandas), SQL, Git, and Apache Airflow.\nWork with Hadoop ecosystem technologies, including Hive, Impala, HDFS, and Sqoop.\nAnalyze structured and semi-structured datasets to understand data characteristics and support pipeline design and implementation.\nOptimize big-data pipelines, processing architectures, and datasets to improve performance, scalability, and reliability.\nDeploy and manage data processing workloads in Kubernetes-based environments.\nCollaborate with customers and cross-functional teams to understand requirements and deliver effective technical solutions.\nApply a business-oriented approach when designing and implementing data workflows.\nLeverage Large Language Models (LLMs), agentic coding, LLM cost optimization, and AI agent development to accelerate delivery and build data tools for internal and external use cases.\nRequired Skills and Experience\nStrong hands-on experience with Python, including Pandas.\nExperience with Apache Spark and PySpark for distributed data processing.\nStrong SQL skills and experience analyzing large datasets.\nPractical experience with Apache Airflow and workflow orchestration.\nFamiliarity with Hadoop ecosystem technologies such as Hive, Impala, HDFS, and Sqoop.\nExperience with Git and production data pipeline development.\nUnderstanding of structured and semi-structured data formats.\nExperience optimizing data pipelines and workloads in Kubernetes environments.\nExposure to LLMs, agentic coding, AI agents, and LLM cost optimization.\nStrong problem-solving and customer collaboration skills.\nWhy Join Us?\nYou’ll work with a talented global team, contribute to meaningful technical initiatives, and help shape a high performing DevOps culture.\nMatrix is a global, dynamic, and fast growing technology services and consulting company with over 17,000 employees worldwide. Founded in 2001, Matrix has grown through significant organic expansion and strategic acquisitions, executing some of the largest and most impactful technology projects in the market.\nWe specialize in the design, development, and implementation of advanced technologies, software solutions, and digital products. Our services include infrastructure and consulting, IT outsourcing and offshore delivery, training and assimilation programs, and acting as a trusted implementation and delivery partner for the world’s leading software vendors.\nWith deep expertise across both the private and public sectors-spanning Finance, Telecom, Healthcare, Hi Tech, Education, Defense, and Security-Matrix serves a strong customer base in Israel alongside a continuously expanding global client portfolio.\nAt Matrix, our people are at the heart of our success. We are a community of talented, creative, and dedicated professionals who are passionate about innovation and excellence. We actively attract, develop, and retain top talent, recognizing that every employee’s contribution is critical to our continued growth and future success.\nMatrix’s success is built on a challenging and engaging work environment, competitive compensation and benefits, and meaningful career development opportunities. We foster a diverse, inclusive culture that encourages collaboration, continuous learning, and growth-together.\nJoin the winning team. Be challenged, grow your career, and enjoy the journey in a highly respected global organization.\nTo learn more, visit: www.matrix-ifs.com","description_format":"text","description_chars":4454,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Continuous learning"],"hiring_locations":[{"name":"Brazil","iso":"BR","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Consulting & Digital Transformation"],"lifecycle":[{"event":"open","at":"2026-11-19T04:29:48Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":29,"reasons":["conf:1","win:early"],"computed_at":"2026-11-19T06:16:11Z"},"pay":null,"html_url":"https://alion.io/job/page-matrix-data-engineer-2","json_url":"https://alion.io/job/page-matrix-data-engineer-2.json","meta":{"generated_at":"2026-11-19T06:16:11Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":10731,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-20T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4430251},"rest":"https://alion.io/mcp/rest/get_company?id=4430251"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fpage-matrix-data-engineer-2"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fpage-matrix-data-engineer-2"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fpage-matrix-data-engineer-2"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/page-matrix-data-engineer-2\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fpage-matrix-data-engineer-2"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4579137}},{"tool":"search_jobs","arguments":{"company":"matrix-ifs.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4579137},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}