{"id":1433496,"url":"https://alion.io/job/visasq-data-platform-engineer-2","title":"Data Platform Engineer","company":{"id":9641,"name":"visasQ","domain":"visasq.co.jp","url":"https://alion.io/company/visasq","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":null,"employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Tokyo, Japan"],"countries":["JP"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":7000000,"max":12000000,"currency":"JPY","period":"year","gross":null,"usd_annual":77220},"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Azure","optional":false},{"name":"BigQuery","optional":false},{"name":"C#","optional":false},{"name":"Google BigQuery","optional":false},{"name":"Python","optional":false},{"name":"TypeScript","optional":false}],"status":"live","first_seen_at":"2026-09-29T01:44:15Z","employer_posted_date":null,"last_verified_at":"2026-09-29T01:44:15Z","board_verified":false,"closed_at":null,"days_open":1,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":1},"description":"About VisasQ\nVisasQ operates one of Japan's largest knowledge platforms, connecting the knowledge of more than 800,000 people across 190 countries under the mission \"We make insightful connections possible.\" We provide a wide variety of knowledge matching services, including interviews, surveys, and hands-on project support, to more than 2,000 clients in Japan and overseas. Following the acquisition of a major U.S. company in 2021, we have expanded to 7 locations worldwide and are accelerating our growth in global markets.\nAs a challenger in the market, we value individual autonomy and team collaboration, and we keep improving our products through trial and error. To realize our mission, we are looking for colleagues who will use the power of technology to circulate knowledge and build a new market together.\nRecruitment Background\nVisasQ operates a knowledge platform dedicated to its mission: \"We make insightful connections possible.\" Connecting businesses with precisely the right expertise across 190+ countries and a network of over 800,000 experts, our Global Expert Network Service (ENS) provides high-precision matching across region and language barriers for professional clients, including management consulting firms and financial institutions.\nIn an era where generative AI has made publicly available web information easily accessible, the value of unstructured first-hand human experience and knowledge has grown exponentially. Currently, vast amounts of data continue to accumulate across multiple products and multi-cloud environments (Azure and GCP).\nHowever, the precision of AI agents relies fundamentally on the quality of the underlying data. Core elements-such as company master identity resolution, employment history accuracy, and compliance verification reliability-directly impact the quality of AI agent decision-making.\nWhile we are incrementally improving data quality within our current structures, we are looking toward building a unified master data platform that consolidates multiple data sources. We are seeking a Data Platform Engineer who can design the data platform architecture that fuels our AI products and lead complex, data-driven design decisions based on empirical evaluation.\nResponsibilities\nLead the entire technical lifecycle of our data foundation-from architectural design supporting search, analytics, and compliance, to entity resolution (deduplication), data cleansing, and building mechanisms for continuous data quality assurance.\nData Platform Architectural Design\nDesign data models across multiple products and multi-cloud environments (Azure/GCP) to ensure reliable data supply for AI products, search engines, analytics, and compliance checks.\nDefine Single Source of Truth (SSOT) strategies and integrate confidence scoring into data models based on empirical findings.\nEntity Resolution & Data Cleansing Pipeline\nDesign and implement multi-stage entity resolution pipelines combining deterministic matching, scoring models, and human-in-the-loop review workflows.\nBuild robust data cleansing processes that enforce idempotency and state rollback capabilities to maintain high data integrity over time.\nEstablish monitoring and anomaly detection mechanisms to ensure stable pipeline operations.\nData Quality Research & Problem Solving\nInvestigate data quality issues, identify root causes within data/codebases, and formulate impactful technical solutions based on business metrics.\nTechnical Decision-Making & Stakeholder Alignment\nDocument architectural designs, research findings, and Architectural Decision Records (ADRs).\nDrive consensus with the CTO, local product teams, and global engineering leaders.\nHighlights of the Role\nFundamentally Elevate AI Product Precision: Drive the foundational quality of the data architecture that directly controls the accuracy limits of autonomous AI research agents and matching engines.\nDirect Business Impact: Quality improvements in company entity resolution and career history directly drive core matching rates (revenue) while minimizing critical compliance risks.\nEnd-to-End Ownership from Investigation to CTO Decision-Making: Work directly with complex, real-world legacy and multi-cloud data setups. You will own the full lifecycle-from data investigation and architecture design to CTO alignment and implementation.\nNavigate Complex Post-Acquisition Environments: Gain rare experience solving large-scale data engineering problems arising from combining distinct tech stacks, data models, and cross-border operations following our 2021 global acquisition of Coleman.\nTech Stack\nENS Development Common Stack\nProgramming Languages: C#, Python, TypeScript\nBackend Frameworks: ASP.NET Core, FastAPI\nFrontend Framework: Angular\nInfrastructure: Microsoft Azure, Google Cloud Platform\nDatabases: SQL Server, Cosmos DB\nCommunication: Slack, Google Meet, Jira\nDocumentation: esa, Confluence\nAI Tools: Claude Code, Devin, ChatGPT\nData Platform Engineer Specific Tools\nAzure Data Factory, Microsoft Power BI, BigQuery\nRequirements\nData Engineering & DWH Experience: Proven track record of designing, building, and operating production-grade data pipelines and data warehouse architecture.\nRelational Database Expertise: Deep hands-on experience with SQL execution plan analysis, index optimization, and high-volume batch processing.\nRoot-Cause Data Investigation: Experience cross-analyzing code logic and raw data to resolve data inconsistencies, pipeline outages, and performance bottlenecks.\nTechnical Documentation & Consensus Building: Strong ability to document architectural choices (design docs, research reports, ADRs) and align technical direction with stakeholders.\nBackend Development: Hands-on experience developing backend applications in modern programming languages.\nLanguage Proficiency: Native or bilingual level Japanese proficiency (essential for analyzing complex local data schemas and collaborating with Japanese domain teams).\nNice to Have\nAI/Search Data Pipelines: Experience providing data foundations for AI/LLM products, RAG systems, or enterprise search platforms.\nMaster Data Management (MDM): Experience with record linkage, entity resolution, deduplication algorithms, and continuous data governance.\nDistributed System Data Syncing: Debugging and development experience in hybrid environments with event-driven and batch-oriented data syncs.\nCloud & Data Stack: Hands-on experience with SQL Server, Azure (AKS, Data Factory), or GCP (BigQuery, Cloud SQL).\nHigh-Precision Domains: Engineering experience in domains requiring extreme data precision (e.g., finance, healthcare, authentication, compliance).\nMaster Data Migration: Experience leading multi-source database consolidation, unified schema design, ID mapping, and zero-downtime strangler-pattern migrations.\nOur Values\nSharpen our Edge\nExcel through Swift Action\nPlace Your Pride Aside\nOur Success Starts with Me\nCollaborate without Boundaries\nEmployment Details\nEmployment type: Full-time (permanent employee)\nProbation period: 3 months after joining (same conditions as after the probation period)\nSalary: JPY 7,000,000 to JPY 12,000,000 per year (determined based on skills and experience)\nMonthly pay: JPY 517,000 to JPY 893,000\nBase salary: JPY 373,000 to JPY 681,000\nFixed overtime allowance: JPY 123,000 to JPY 252,000\nStandard time management: includes 45 hours of fixed overtime and 20 hours of fixed late-night work allowance\nDiscretionary work system (specialized work): includes 30 hours of fixed overtime and 40 hours of fixed late-night work allowance\nOvertime or late-night work exceeding the fixed allowance is paid in full separately\nWhether you are placed under the standard time management or the discretionary work system is determined based on your skills, experience, and job responsibilities\nSalary review: determined based on skills, experience, and ability (reviewed twice a year)\nBonus: once a year (based on performance)\nLocation: Sumitomo Fudosan Aobadai Hills 1F/9F, 4-7-7 Aobadai, Meguro-ku, Tokyo\nImmediately after hiring: Tokyo headquarters and the employee's home\nScope of change: the headquarters, locations designated by the company such as group companies, and the employee's home\nWorking hours: standard time management or the discretionary work system for specialized work (determined based on skills, experience, responsibilities, and revisions to internal systems)\nStandard time management: 10:00 to 19:00 (prescribed working hours: 8 hours 00 minutes / break: 60 minutes)\nDiscretionary work system: deemed working hours of 8 hours per day / break: 1 hour. Average working hours: 160 hours per month (average of development organization members, second half of 2022)\nHolidays and leave: 127 days off per year\nTwo days off every week (Saturdays, Sundays, and national holidays)\nYear-end and New Year holidays\nAnnual paid leave (granted from 3 months after joining)\nSelf-development leave (up to 5 consecutive days once a year, separate from annual paid leave)\nMaternity and parental leave (with a track record of use)\nInsurance: health insurance, employees' pension insurance, employment insurance, and workers' accident compensation insurance\nBenefits\nCommuting allowance (with an upper limit)\nPerformance benefit of up to JPY 10,000 per month (body maintenance, housekeeping services, learning expenses, etc.)\nSubsidy for attending external seminars\nCoverage of book purchase costs\nInfluenza vaccinations\nCoverage of health checkup costs and subsidy for optional health checkup costs\nBenefits through health insurance (use of resort and sports facilities, restaurant discounts, etc.)\nCompany-leased housing program\nRelocation cost subsidy for hires moving from distant areas (at the time of hiring only)\nSubsidy for study sessions and internal social events\nSubsidy for internal club activities\nLunch subsidy for welcoming new employees and internal networking\nWork style\nSide jobs: allowed (prior approval required)\nRemote work: allowed (in the office at least once a week). The office and remote work frequency may change in the future due to changes in company policy.\nDress code: free\nOffice: free-address seating, monitors and standing desks, free coffee and snacks, in-house library, space for study sessions, and social gatherings allowed in the office\nSmoking: no smoking indoors (no smoking room); smoking is prohibited on the entire premises\nScope of duties: immediately after hiring, as described in this job description; scope of change, all duties of the company\nSelection Process\nScreening / Casual Interview\n1st Interview\n2nd Interview\nFinal Interview\nA reference check may be conducted during the selection process. Details, including the timing, will be shared with you during the process.","description_format":"text","description_chars":10755,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[{"language":"Japanese","level":"Advanced (C1)","optional":false}]},"benefits":["Health insurance","Parental leave"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Professional Services","Sales & Marketing","Business Development","Market Research"],"lifecycle":[{"event":"open","at":"2026-09-29T02:12:17Z"}],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":13,"reasons":["seen:0","win:early"],"computed_at":"2026-09-29T05:45:00Z"},"pay":{"stated_usd_annual":77220,"is_top_pay":false},"html_url":"https://alion.io/job/visasq-data-platform-engineer-2","json_url":"https://alion.io/job/visasq-data-platform-engineer-2.json","meta":{"generated_at":"2026-09-30T03:24:05Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","usage":{"tier":"crawler","counted_by":"address","units_charged":1,"used_today":2424,"day_limit":5000,"remaining_today":2576,"minute_limit":60,"resets_at":"2026-10-01T00:00:00Z"}}}