{"id":1062690,"url":"https://alion.io/job/ncs-ex-data-engineer-databricks-2","title":"#EX Data Engineer (Databricks)","company":{"id":8907,"name":"NCS","domain":"ncs.co","url":"https://alion.io/company/ncs-co","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"SmartRecruiters","truth_index":{"grade":"B","score":82,"open_postings":353,"ghost_share":0.3,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":48,"computed_at":"2026-10-10T05:45:15Z"}},"role":"Data Science","role_family":"Data Science","seniority":"middle","employment_type":"contractor","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Singapore"],"countries":["SG"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":43000,"max_usd":89000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":18},"experience_years_min":3,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Airflow","optional":false},{"name":"Amazon Kinesis","optional":false},{"name":"Apache Kafka","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Flink","optional":false},{"name":"Git","optional":false},{"name":"Machine Learning","optional":false},{"name":"pySpark","optional":false},{"name":"Scrum","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Python","optional":true}],"status":"live","first_seen_at":"2026-09-17T02:15:05Z","employer_posted_date":"2026-09-17","last_verified_at":"2026-10-11T00:15:47Z","board_verified":true,"closed_at":null,"days_open":23,"trust":{"level":"ok","repost_count":0,"flags":["company_stale"],"days_open":23},"description":"NCS is a leading AI Tech Services company. With a 15,000-strong team across the Asia Pacific, NCS scales its platforms and capabilities to provide clients with greater agility and AI expertise across a range of Industries. Embracing a strong ecosystem of global partners, NCS transforms technology services delivery combining AI with digital resilience to drive real business impact. NCS is a subsidiary of the Singtel Group.\n The Data Engineer will be responsible for designing, developing, and maintaining scalable and reliable data pipelines on Databricks and cloud platforms. The role requires integrating diverse data sources, ensuring high-quality data processing, and supporting analytics, reporting, and machine learning workloads. The role involves collaborating closely with analytics, product, and infrastructure teams to enhance the company’s data platform while adhering to best practices for governance, monitoring, and reliability.\nWhat will you do?\nDevelop and maintain ETL pipelines for centralized data storage systems (e.g. Delta Lake).\nIntegrate data from databases, APIs, log files, streaming platforms, and external providers\nDevelop data transformation routines to clean, normalize, and aggregate data\nApply data processing techniques to handle complex or inconsistent datasets\nContribute to frameworks and best practices for code development and deployment\nImplement data governance in alignment with company standards\nPartner with analytics and product leaders to design and operationalize pipelines\nCollaborate with infrastructure leaders to advance cloud-based data platforms\nExplore new tools and techniques leveraging Azure, Databricks, or related platforms\nMonitor data pipelines to detect and resolve issues promptly\nDevelop monitoring tools, alerts, and automated error-handling mechanisms\nAnalyse business requirements and identify data extraction requirements\nAttend requirement grooming and refinement sessions with users\nDevelop and maintain ETL pipelines for ingestion, transformation, validation, and loading\nOptimise performance and batch scheduling\nDevelop dashboards, reports, scorecards, and data visualizations\nPerform SIT, data validation, data profiling and confirm data accuracy\nValidate completeness and consistency of ETL Loads\nSupport UAT and production implementation\n The ideal candidate should possess:\n3 or more years of experience in data engineering with scalable pipelines\nStrong experience designing data solutions including data modelling and distributed computing architectures\nHands-on experience with data processing jobs using PySpark, Spark SQL, and Databricks notebooks/jobs\nExperience orchestrating data pipelines with ADF, Airflow, or similar tools\nExperience with both real-time and batch data processing\nExperience building pipelines on Azure, with AWS experience beneficial\nProficiency in SQL including window functions and performance optimization\nUnderstanding of DevOps tools, Git workflows, and CI/CD pipelines\nFamiliarity with Scrum methodology and experience working in Scrum teams\nAbility to apply Scrum practices in a practical project context\nStrong problem-solving and collaborative mindset\nExperience with streaming technologies such as Apache Kafka, Apache Flink, or AWS Kinesis\nAbility to design and implement real-time data processing pipelines\nMust have Databricks Certified Data Engineer Associate and Databricks Certified Data Engineer Professional is strongly preferred\n We are driven by our AEIOU beliefs-Adventure, Excellence, Integrity, Ownership, and Unity-and we seek individuals who embody these values in both their professional and personal lives. We are committed to our Impact: Valuing our clients, Growing our people, and Creating our future.\nTogether, we make the extraordinary happen.\nLearn more about us at ncs.co and visit our LinkedIn career site.\nScam Alert\nWe are aware of fraudulent job offers and impersonations of NCS recruiters. Phishing emails using convincing-looking but fake addresses are also commonly used to trick you into thinking that they come from official NCS sources.\nPlease note that all official communications from NCS Group will only be sent from verified corporate email addresses. Always check that the sender’s email address ends with the genuine NCS domain, @ncs.com.sg and beware of extra letters, symbols or misspellings. When in doubt, verify the sender’s identity by contacting us at .","description_format":"text","description_chars":4437,"description_truncated":false,"requirements":{"experience_years_min":3,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[{"language":"English","level":"All levels","optional":false}]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Managed Security","IT Consulting & Digital Transformation","Systems Integrators","AI Consulting & Integration"],"lifecycle":[{"event":"open","at":"2026-09-19T10:34:31Z"}],"visa":[],"liveness":{"score":76,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.842,"p_room":0.9,"age_days":23,"expected_fill_days":48,"reasons":["conf:1","velocity","win:mid","comp:brand"],"computed_at":"2026-10-10T05:45:15Z"},"pay":null,"html_url":"https://alion.io/job/ncs-ex-data-engineer-databricks-2","json_url":"https://alion.io/job/ncs-ex-data-engineer-databricks-2.json","meta":{"generated_at":"2026-10-11T01:01:05Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler","counted_by":"address","units_charged":1,"used_today":1374,"day_limit":5000,"remaining_today":3626,"minute_limit":60,"resets_at":"2026-10-12T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":8907},"rest":"https://alion.io/mcp/rest/get_company?id=8907"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fncs-ex-data-engineer-databricks-2"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fncs-ex-data-engineer-databricks-2"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fncs-ex-data-engineer-databricks-2"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/ncs-ex-data-engineer-databricks-2\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fncs-ex-data-engineer-databricks-2"}]}