{"id":4166350,"url":"https://alion.io/job/shopee-data-quality-engineer-mpid-team","title":"Data Quality Engineer, MPID Team","company":{"id":49909,"name":"Shopee","domain":"shopee.com","url":"https://alion.io/company/shopee","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Career site","truth_index":{"grade":"A","score":99,"open_postings":40,"ghost_share":0,"stale_share":0,"repost_share":0.05,"time_to_fill_p50_days":26,"computed_at":"2026-11-12T10:38:37Z"}},"role":"Data Science","role_family":"Data Science","seniority":null,"employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Singapore"],"countries":["SG"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"ClickHouse","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Git","optional":false},{"name":"Java","optional":false},{"name":"Linux","optional":false},{"name":"LLM","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false}],"status":"live","first_seen_at":"2026-11-12T13:27:26Z","employer_posted_date":"2026-11-12","last_verified_at":"2026-11-12T13:27:26Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"Design, build, and maintain layered Hive/Spark SQL data models across ODS, DWD, DWS and ADS, including shared dimension tables. Define each table’s grain, keys, business-date and partition logic, metric definitions, dependencies, and backfill and release procedures.\nDevelop and operate production batch ETL pipelines on Spark and Hive, including partner and source onboarding, incremental loads, scheduled runs, and historical backfills. Use staging and checkpoint patterns where needed so retries do not corrupt published data or SCD2 history.\nPlan and execute data-store or platform migrations, including Hive-to-ClickHouse migrations where required. Design partition strategies, write migration scripts, reconcile source and target data, and validate query behavior across regions.\nBuild reusable cross-region models and parameterized pipelines for onboarding markets, partners, and business lines. Standardize schemas and metric logic to reduce one-off implementations.\nBuild and maintain lightweight internal tools for data operations, such as task scaffolding, logging and monitoring, and query or configuration interfaces. Automate repetitive metadata discovery and data-quality checks, including through AI-agent or LLM-assisted workflows where appropriate.\nMaintain and optimize data ingestion pipelines by designing solutions for real-time updates, batch processing, and initial full loads to meet different data-source and business requirements.\nDevelop and maintain a Metric Insight system that meets business and BI needs by standardizing metrics, building dashboards, and integrating AI-powered analytics tools to provide a one-stop data analysis platform.\nMaster’s degree in Computer Science, Software Engineering, Artificial Intelligence from a reputable university.\nHands-on experience building and supporting production batch data pipelines with Spark/Spark SQL and Hive; familiarity with HDFS and Hive Metastore.\nPractical data-warehouse experience, including dimensional or SCD2 modeling, ETL design, partitioning, and backfill or recovery.\nStrong fundamentals in data structures, algorithms, operating systems, and relational databases.\nStrong SQL and proficiency in Python or Java; able to write complex transformations involving nested JSON, window functions, and query tuning.\nAble to diagnose Spark performance issues using the Spark UI and execution plans, including joins, shuffle, skew, and resource settings; working knowledge of Linux and Git.\nStrong ownership and communication: can trace data issues end to end, validate a repair, and explain findings and data limitations to partner teams.\nKindly note that you can only be considered for one role at a time with any of the companies within our Group. If you have applied for other jobs with the Group, you will be considered for roles in the order of your application","description_format":"text","description_chars":2851,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"master","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Marketplaces"],"lifecycle":[{"event":"open","at":"2026-11-12T13:27:26Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":26,"reasons":["conf:1","win:early","comp:brand"],"computed_at":"2026-11-12T14:50:54Z"},"pay":null,"html_url":"https://alion.io/job/shopee-data-quality-engineer-mpid-team","json_url":"https://alion.io/job/shopee-data-quality-engineer-mpid-team.json","meta":{"generated_at":"2026-11-12T14:50:54Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":30890,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-13T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":49909},"rest":"https://alion.io/mcp/rest/get_company?id=49909"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fshopee-data-quality-engineer-mpid-team"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":2,"usd":0.2},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fshopee-data-quality-engineer-mpid-team"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fshopee-data-quality-engineer-mpid-team"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/shopee-data-quality-engineer-mpid-team\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fshopee-data-quality-engineer-mpid-team"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4166350}},{"tool":"search_jobs","arguments":{"company":"shopee.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4166350},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}