{"id":1984406,"url":"https://alion.io/job/ncs-eg-senior-ai-data-engineer","title":"#EG Senior AI Data Engineer","company":{"id":8907,"name":"NCS","domain":"ncs.co","url":"https://alion.io/company/ncs-co","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"SmartRecruiters","truth_index":{"grade":"B","score":79,"open_postings":128,"ghost_share":0,"stale_share":0.836,"repost_share":0,"time_to_fill_p50_days":47,"computed_at":"2026-10-09T06:01:00Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Singapore"],"countries":["SG"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":55000,"max_usd":113000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":31},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"Apache Iceberg","optional":false},{"name":"CI/CD","optional":false},{"name":"dbt","optional":false},{"name":"DuckDB","optional":false},{"name":"FastAPI","optional":false},{"name":"Function Calling","optional":false},{"name":"LangChain","optional":false},{"name":"LangGraph","optional":false},{"name":"LLM","optional":false},{"name":"Multi-Agent Systems","optional":false},{"name":"Pandas","optional":false},{"name":"Pydantic","optional":false},{"name":"Python","optional":false},{"name":"Rest API","optional":false},{"name":"SQL","optional":false},{"name":"Trino","optional":false}],"status":"live","first_seen_at":"2026-10-07T00:42:30Z","employer_posted_date":"2026-10-07","last_verified_at":"2026-10-10T00:45:25Z","board_verified":true,"closed_at":null,"days_open":3,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":3},"description":"NCS is a leading technology services firm that operates across the Asia Pacific region in over 20 cities, providing consulting, digital services, technology solutions, and more. We believe in harnessing the power of technology to achieve extraordinary things, creating lasting value and impact for our communities, partners, and people. Our diverse workforce of 15,000 has delivered large-scale, mission-critical, and multi-platform projects for governments and enterprises in Singapore and the APAC region.\n Role Summary\nYou are an autonomous AI Engineer, responsible for creating the harness for designing and building the AI harness, agent framework, and reusable engineering components required to operate a modern data platform based on Apache Iceberg, Trino, and Parquet.\nYour primary responsibility is not only to build data pipelines, but also to establish the agentic execution framework (AI Harness) that enables multiple specialized agents to collaborate, execute tasks, maintain state, orchestrate workflows, and deliver end-to-end data engineering capabilities.\nDepending on your level of experience, your focus in the team will be on either task execution, independent delivery, or technical leadership.\nKey Responsibilities\nAI Harness Development\nDesign and implement the foundational agent framework that provides:\nAgent orchestration and coordination\nWorkflow execution and state management\nMemory and context handling\nTool and function calling\nAgent-to-agent communication\nHuman approval workflows\nLogging and audit trails\nError handling and recovery\nSecurity and access controls\nObservability and monitoring\nThe harness must support autonomous and multi-agent execution patterns.\nSpecialized Agents Creation\nThe agents will need to perform the following:\nDiscover Iceberg catalogs and schemas\nProfile datasets\nGenerate metadata and lineage\nIngest data from databases, APIs, files, and streams\nCreate Parquet datasets\nRegister and maintain Iceberg tables\nGenerate Trino SQL\nBuild transformation workflows\nCreate curated and business-ready datasets\nValidate schemas and data integrity\nDetect anomalies\nGenerate reconciliation reports\nAnalyze Trino workloads\nRecommend partitioning strategies\nOptimize Iceberg tables and Parquet files\nClassify sensitive information\nManage metadata and lineage\nApply retention and compliance policies\nMonitor pipelines and agent activities\nDetect failures and bottlenecks\nGenerate alerts and operational insights\nExpected Deliverables\nIceberg table definitions and schemas\nTrino SQL scripts and views\nPython data pipeline code\nData quality validation suites\nMetadata and lineage documentation\nCI/CD deployment artifacts\nMonitoring and observability configurations\nTechnical documentation and runbooks\n Skills and Experience\nThe candidate should demonstrate expertise in:\nExperience with Generative AI, Agentic AI, or LLM-based solutions.\nProficiency in Python, including FastAPI, Pydantic and Pandas.\nExperience designing and implementing AI Harness or multi-agent frameworks.\nHands-on experience with LangChain & LangGraph.\nExperience with Apache Iceberg, Trino, and Parquet-based lakehouse architectures.\nExperience building data ingestion, transformation, and orchestration pipelines.\nStrong knowledge of metadata management, data lineage, and data governance practices.\nExperience developing REST APIs, SDKs, and reusable engineering frameworks.\nExperience with observability, monitoring, tracing, and operational support practices.\nStrong understanding of distributed systems, event-driven architectures, and microservices patterns.\nProven ability to design, develop, and operationalize enterprise-grade AI agents for data discovery, ingestion, transformation, optimization, governance, and observability.\nFamiliar with modern data engineering technologies, including DuckDB, dbt, and related engineering tools for data transformation, modelling, and pipeline development.\nSenior engineers will be expected to have demonstrated evidence of leading technical designs, guiding junior engineering team members, working independently with clients and delivery teams, and translating AI/data requirements into scalable, secure, and deployable solutions.\n We are driven by our AEIOU beliefs-Adventure, Excellence, Integrity, Ownership, and Unity-and we seek individuals who embody these values in both their professional and personal lives. We are committed to our Impact: Valuing our clients, Growing our people, and Creating our future.\nTogether, we make the extraordinary happen.\nLearn more about us at ncs.co and visit our LinkedIn career site.\nScam Alert\nWe are aware of fraudulent job offers and impersonations of NCS recruiters. Phishing emails using convincing-looking but fake addresses are also commonly used to trick you into thinking that they come from official NCS sources.\nPlease note that all official communications from NCS Group will only be sent from verified corporate email addresses. Always check that the sender’s email address ends with the genuine NCS domain, @ncs.com.sg and beware of extra letters, symbols or misspellings. When in doubt, verify the sender’s identity by contacting us at .","description_format":"text","description_chars":5183,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[{"language":"English","level":"All levels","optional":false}]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Managed Security","IT Consulting & Digital Transformation","Systems Integrators","AI Consulting & Integration"],"lifecycle":[{"event":"open","at":"2026-10-07T01:25:40Z"}],"visa":[],"liveness":{"score":63,"band":"ok","label":"Likely open","p_open":1,"p_active":0.632,"p_room":1,"age_days":2,"expected_fill_days":47,"reasons":["conf:0","stale_co","velocity","win:early","comp:brand"],"computed_at":"2026-10-09T06:01:00Z"},"pay":null,"html_url":"https://alion.io/job/ncs-eg-senior-ai-data-engineer","json_url":"https://alion.io/job/ncs-eg-senior-ai-data-engineer.json","meta":{"generated_at":"2026-10-10T01:34:09Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler","counted_by":"address","units_charged":1,"used_today":2809,"day_limit":5000,"remaining_today":2191,"minute_limit":60,"resets_at":"2026-10-11T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":8907},"rest":"https://alion.io/mcp/rest/get_company?id=8907"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fncs-eg-senior-ai-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fncs-eg-senior-ai-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fncs-eg-senior-ai-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/ncs-eg-senior-ai-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fncs-eg-senior-ai-data-engineer"}]}