{"id":3111009,"url":"https://alion.io/job/applaudo-senior-data-engineer-azure-databricks","title":"Senior Data Engineer (Azure Databricks)","company":{"id":5319,"name":"Applaudo","domain":"applaudostudios.com","url":"https://alion.io/company/applaudo-studios","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"SmartRecruiters","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"part_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["San José, Costa Rica"],"countries":["CR"],"hiring_countries":["CR"],"hiring_countries_total":1,"salary":null,"salary_estimate":{"min_usd":36000,"max_usd":93000,"period":"year","method":"global_role_cell_scaled_by_country","sample_n":2491},"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Azure","optional":false},{"name":"Databricks","optional":false},{"name":"Dimensional Modeling","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Rest API","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false}],"status":"live","first_seen_at":"2026-10-22T20:39:26Z","employer_posted_date":"2026-10-22","last_verified_at":"2026-10-23T04:38:26Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"About You\nYou are a Senior Data Engineer passionate about building scalable, production-grade data pipelines and transforming complex data from multiple sources into reliable, business-ready datasets. You thrive when working with Azure Databricks, Python, and Spark to solve data integration challenges and support enterprise data ecosystems.\nYou enjoy connecting data across business platforms, optimizing data transformations, and ensuring accuracy and consistency throughout the data lifecycle. You take ownership of your work, ask the right questions early, and proactively communicate risks and blockers. You value clear documentation, technical discipline, and delivering high-quality solutions that support business needs.\nYou Bring to Applaudo the Following Competencies:\n5+ years of professional experience in Data Engineering, designing, building, and maintaining production-grade data pipelines.\nStrong hands-on experience with Azure Databricks.\nAdvanced Python skills for data processing, transformation, and pipeline development.\nSolid experience with Apache Spark, including PySpark and/or Spark SQL, for processing data at scale.\nAdvanced SQL proficiency, including complex transformations, data validation, and query performance optimization.\nStrong knowledge of data warehousing and dimensional modeling, including facts, dimensions, and data marts.\nExperience integrating data from multiple sources, including REST APIs, relational databases, cloud storage, and SFTP.\nHands-on experience with Microsoft Azure data services for data ingestion, storage, processing, and integration.\nExperience implementing data quality checks and validating consistency between source systems and target data models.\nAbility to troubleshoot pipeline failures, investigate data discrepancies, and implement reliable solutions.\nStrong problem-solving, analytical, and organizational skills.\nAbility to work autonomously, take ownership, and follow established engineering practices and documentation standards.\nStrong English communication skills, with the ability to collaborate effectively with a US-based team.\nNice to have:\nExperience migrating SQL-based data workloads to Azure Databricks.\nYou Will Be Accountable for the Following Responsibilities:\nDesign, build, and maintain reliable, production-grade data pipelines using Azure Databricks and Python.\nDevelop scalable data transformations using PySpark or Spark SQL to integrate data from multiple business systems.\nIngest and process data from APIs, relational databases, cloud storage, and SFTP sources.\nIntegrate data from ticketing, CRM, marketing, retail, and other enterprise platforms into a centralized Data Hub.\nDevelop and maintain data warehouse structures, dimensional models, and data marts aligned with business requirements.\nWrite, optimize, and maintain SQL transformations to ensure data accuracy and processing efficiency.\nImplement data quality validations and consistency checks between source systems and target models.\nBuild and maintain outbound data feeds for third-party systems according to defined specifications.\nInvestigate data discrepancies, troubleshoot pipeline issues, and implement appropriate corrective actions.\nDocument data pipelines, transformation logic, dependencies, and technical processes.\nCollaborate with team members and stakeholders to clarify requirements, identify risks early, and deliver reliable data solutions.\nCommunicate progress, blockers, and potential delays proactively, proposing clear next steps to keep deliverables on track.\n Strong proficiency in Azure Databricks, Python, and Apache Spark.\nAdvanced SQL skills and solid knowledge of data warehousing and dimensional modeling.\nProven experience developing and maintaining production data pipelines.\nHands-on experience with Microsoft Azure data services and integrating data from multiple enterprise systems.\nStrong understanding of data quality, validation, and consistency across source and target systems.\nStrong ownership, autonomy, documentation, and communication skills.\nAbility to communicate effectively in English and collaborate with a US-based enterprise team.\n About Us\nWe Are Engineered Different.\nAt Applaudo, talented people design, build, and scale meaningful, AI-powered solutions that create real business impact. As an AI-native organization, we collaborate across design, development, cloud, data, and artificial intelligence to turn ideas into scalable products that transform how companies operate, make decisions, and grow.\nWe are building a high-performance culture grounded in five values: Empowering Excellence, Collaborative Teamwork, Unsolicited Respect, Consistent Transparency, and Efficient Communication. These define how we work, how we support one another, and how we hold ourselves accountable.\nApplaudo is a place for people who want to learn fast, take ownership, and work alongside strong teams they are proud to belong to. Joining us means being part of an organization that is evolving intentionally, investing in modern ways of working, and leading AI-native transformation at scale.","description_format":"text","description_chars":5098,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[{"language":"English","level":"Upper-Intermediate (B2)","optional":false}]},"benefits":[],"hiring_locations":[{"name":"Costa Rica","iso":"CR","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["UI/UX Design","IT Outsourcing & Dedicated Teams","Mobile App Development Services","Web Development Services"],"lifecycle":[{"event":"open","at":"2026-10-22T20:41:33Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":0,"expected_fill_days":31,"reasons":["conf:1","velocity","win:early"],"computed_at":"2026-10-23T05:54:15Z"},"pay":null,"html_url":"https://alion.io/job/applaudo-senior-data-engineer-azure-databricks","json_url":"https://alion.io/job/applaudo-senior-data-engineer-azure-databricks.json","meta":{"generated_at":"2026-10-23T06:49:51Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":11078,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-24T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":5319},"rest":"https://alion.io/mcp/rest/get_company?id=5319"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fapplaudo-senior-data-engineer-azure-databricks"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fapplaudo-senior-data-engineer-azure-databricks"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fapplaudo-senior-data-engineer-azure-databricks"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/applaudo-senior-data-engineer-azure-databricks\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fapplaudo-senior-data-engineer-azure-databricks"}]}