{"id":3855417,"url":"https://alion.io/job/propylon-senior-data-engineer","title":"Senior Data Engineer","company":{"id":1902709,"name":"Propylon","domain":"propylon.com","url":"https://alion.io/company/propylon","size_band":"201-500","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"iCIMS","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":null,"work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Dublin, Ireland"],"countries":["IE"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AWS","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"Dimensional Modeling","optional":false},{"name":"Fine-tuning","optional":false},{"name":"GCP","optional":false},{"name":"Git","optional":false},{"name":"Human-in-the-Loop","optional":false},{"name":"IAM","optional":false},{"name":"Machine Learning","optional":false},{"name":"Prompt Engineering","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Red Teaming","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"GitHub Actions","optional":true},{"name":"Google BigQuery","optional":true},{"name":"Terraform","optional":true}],"status":"live","first_seen_at":"2026-11-06T06:04:51Z","employer_posted_date":"2026-11-06","last_verified_at":"2026-11-06T14:43:50Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"Job Purpose\nAbout RWS\nRWS is a global leader in content, translation, and intellectual property services. With more than 60 years of experience, RWS helps the world’s top brands grow by ensuring they are understood anywhere, in any language. The company combines proprietary technology with deep human expertise to deliver high-quality, compliant, and scalable solutions across industries such as life sciences, technology, finance, and legal.\nAbout TrainAI\nTraining or fine-tuning artificial intelligence (AI) requires data. LOTS of data. However, not just any data will do - our clients need responsible AI data that’s targeted, accurate and reliable to ensure machine learning (ML) success. But preparing AI training data is a monumental task that can take up the vast majority of AI project time, leaving AI teams with precious little time to focus on developing, deploying and evaluating ML models. TrainAI by RWS helps our clients address this challenge head-on.\nWith a seamless blend of technological understanding and human intelligence, TrainAI provides complete, end-to-end data collection and content generation, data annotation or labelling, human-in-the-loop data validation and generative AI data services for all types of AI, in any language, at any scale, based on the principles of responsible AI. Today, TrainAI supports four of the world’s top five technology companies, enhancing the performance of their generative AI by providing services such as prompt engineering, response refinement and red teaming with locale-specific domain experts across a broad range of topic areas and educational levels.\nJob Purpose\nAs a Senior Data Engineer in TrainAI, you will own the data platform that tracks and powers our AI data services, built on Databricks. Our data comes from the TrainAI platform, partner systems and third-party services. We bring it together in a Databricks lakehouse and serve it to product, operations, finance and analytics teams.\nYou’ll have end-to-end ownership of our Databricks pipelines, from raw ingestion through curated bronze, silver and gold layers to monitoring in production. You’ll also be the team’s Databricks expert, setting the standards for how we build, test and deploy data workloads. You’ll work inside a product engineering team rather than a separate data function, so you’ll be close to the people who use your data.\nJob Overview\nResponsibilities\nOwn the Databricks lakehouse: Design, build and run our Databricks platform end to end, including workspaces, clusters and SQL warehouses, jobs and Unity Catalog. \nBuild medallion pipelines: Build reliable ingestion and transformation pipelines through bronze, silver and gold layers on Delta Lake, using PySpark, Spark SQL and Delta Live Tables / Lakeflow where they fit. \nIntegrate source systems: Ingest data from our platform databases, SaaS APIs and partner feeds, including incremental loads, change data capture and backfills of historical data. \nOrchestrate and monitor: Schedule and monitor multi-stage workflows with Databricks Workflows/Jobs. Troubleshoot failures and keep data fresh and complete. \n Optimise performance and cost: Tune Delta tables (partitioning, Z-ordering / liquid clustering, file compaction), cluster sizing and job design to keep queries fast and spend under control. \nGovern and secure data: Manage access, lineage and data quality through Unity Catalog, and handle sensitive and personal data safely. \nEngineer it like software: Treat pipelines as code, with Git, code review, automated tests, CI/CD and Databricks Asset Bundles. \nCollaborate across teams: Work with engineers, analysts and business stakeholders to turn their questions into well-modelled, trustworthy datasets. \nRequirements\nHands-on Databricks experience: Commercial experience building and running production pipelines on Databricks, including Delta Lake, Workflows/Jobs and Unity Catalog. This is the core of the role. \nSpark expertise: Strong PySpark and Spark SQL, with a working understanding of how Spark executes jobs and how to tune them. \n Lakehouse design: Experience designing medallion (bronze/silver/gold) architectures and dimensional models that analysts can use directly. \nFull pipeline ownership: Has owned data pipelines from ingestion to production support, including incremental loading, backfills and data quality checks. \nPython and SQL: Strong Python for pipelines, API integrations and tooling, and advanced SQL. \nCloud fundamentals: Experience running data workloads on AWS or GCP, such as object storage, IAM and networking basics. \nEngineering practices: Git, code review, automated testing and CI/CD for data code. \nNice to have\nDatabricks certification (Data Engineer Associate or Professional). \nDatabricks Asset Bundles, the Databricks Terraform provider, or other infrastructure-as-code for data platforms. \nDelta Live Tables / Lakeflow declarative pipelines, Auto Loader or structured streaming. \nCross-cloud setups, for example Databricks on AWS reading from or publishing to GCP (BigQuery, GCS). \nGitHub Actions for CI/CD. \nExperience building data products, or supporting ML/AI workloads with feature or evaluation datasets. \nWhy Is This Role Different?\nYou own the platform. You’ll be TrainAI’s dedicated data engineer, with real ownership of how our Databricks platform is designed and run, not just a ticket queue. \nYou’re part of the product team. You’ll sit with the engineers building the TrainAI platform, so you’ll see how your data is used and help shape what we build. \nYour work has an impact. TrainAI supports four of the world’s top five technology companies, and the data you build drives decisions across delivery, quality and finance.\nLife at RWS\nLife at RWS- If you like the idea of working with smart people who are passionate about growing the value of ideas, data and content by making sure organizations are understood, then you’ll love life at RWS.\nOur purpose is to unlock global understanding. This means our work fundamentally recognizes the value of every language and culture. So, we celebrate difference, we are inclusive and believe that diversity makes us strong. We want every employee to grow as an individual and excel in their career.\nIn return, we expect all our people to live by the values that unite us: to partner, putting clients fist and winning together, to pioneer, innovating fearlessly and leading with vision and courage, to progress, aiming high and growing through actions and to deliver, owning the outcome and building trust with our colleagues and clients.\nRWS embraces DEI and promotes equal opportunity, we are an Equal Opportunity Employer and prohibit discrimination and harassment of any kind. RWS is committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment. All employment decisions at RWS are based on business needs, job requirements and individual qualifications, without regard to race, religion, nationality, ethnicity, sex, age, disability, or sexual orientation. RWS will not tolerate discrimination based on any of these characteristics.\nRWS Values\nGet the 3Ps right - Partner, Pioneer, Progress - and we´ll Deliver together as RWS.\nRecruitment Agencies: RWS Holdings PLC does not accept agency resumes. Please do not forward any unsolicited resumes to any RWS employees. Any unsolicited resume received will be treated as the property of RWS and Terms & Conditions associated with the use of such resume will be considered null and void.#LI-MS1, #LI-Hybrid","description_format":"text","description_chars":7577,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"Ireland","iso":"IE","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Digital Government","RegTech, AML & Compliance","Legal Software"],"lifecycle":[{"event":"open","at":"2026-11-06T06:04:51Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":36,"reasons":["conf:4","win:early"],"computed_at":"2026-11-06T19:03:45Z"},"pay":null,"html_url":"https://alion.io/job/propylon-senior-data-engineer","json_url":"https://alion.io/job/propylon-senior-data-engineer.json","meta":{"generated_at":"2026-11-06T19:03:45Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":2088,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-07T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":1902709},"rest":"https://alion.io/mcp/rest/get_company?id=1902709"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fpropylon-senior-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fpropylon-senior-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fpropylon-senior-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/propylon-senior-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fpropylon-senior-data-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3855417}},{"tool":"search_jobs","arguments":{"company":"propylon.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3855417},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}