{"id":2216607,"url":"https://alion.io/job/testtriangle-data-engineer","title":"Data Engineer","company":{"id":4380438,"name":"Test Triangle","domain":"testtriangle.com","url":"https://alion.io/company/testtriangle","size_band":null,"is_staffing_agency":true,"employer_type":"agency","is_intermediary":false,"listed_via":null,"ats_vendor":"Zoho Recruit","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":null,"employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Dublin, Ireland"],"countries":["IE"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":63000,"max_usd":157000,"period":"year","method":"role_country_seniority_unknown","sample_n":15},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Airflow","optional":false},{"name":"Amazon Redshift","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"CI/CD","optional":false},{"name":"ClickHouse","optional":false},{"name":"Databricks","optional":false},{"name":"Docker","optional":false},{"name":"ETL/ELT","optional":false},{"name":"GCP","optional":false},{"name":"Hadoop","optional":false},{"name":"Java","optional":false},{"name":"Kubernetes","optional":false},{"name":"Linux","optional":false},{"name":"Python","optional":false},{"name":"Scala","optional":false},{"name":"Snowflake","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Vertica","optional":false},{"name":"Agile","optional":true},{"name":"Apache Kafka","optional":true},{"name":"Azure Data Factory","optional":true},{"name":"HIPAA","optional":true},{"name":"pySpark","optional":true},{"name":"Scrum","optional":true},{"name":"Terraform","optional":true},{"name":"Tokenization","optional":true}],"status":"live","first_seen_at":"2026-10-10T08:37:28Z","employer_posted_date":"2026-10-10","last_verified_at":"2026-10-12T03:42:56Z","board_verified":true,"closed_at":null,"days_open":1,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":1},"description":"Data Engineer\nAs a Principal Data\nEngineer, your responsibilities will include:\nDesign and build data pipelinesto process terabytes of data\n\nOrchestrate in Airflow the datatasks to run on Kubernetes/Hadoop for the ingestion, processing and\ncleaning of data.\n\nCreate Docker images forvarious applications and deploy them on Kubernetes\n\nDesign and build best in classprocesses to clean and standardize data.\n\nTroubleshoot production issues inour Elastic Environment\n\nTuning and optimizing dataprocesses\n\n· Advancing the team’s DataOps culture (CI/CD,\nOrchestration, Testing, Monitoring) and building out standard development\npatterns\nDrive innovation bytesting new technology and approaches to continually advance the\ncapability of the data engineering function.\n\nDrive efficiencies incurrent engineering processes via standardization and migration of\nexisting on-premise processes to the cloud\n\nEnsuring DataQuality - building best in class data quality monitoring that\nensure that all data products exceed customer expectations.\n\nRequired Qualifications:\nComputer Science bachelor’sdegree or similar.\n\nGood understanding of Data Modelling techniques i.e.DataVault, Kimble Star\n\nExcellent understanding of Column-Store RDBMS(DataBricks, Snowflake, Redshift, Vertica, Clickhouse)\n\nGood experience handling real-time, near real-timeand batch data ingestions\n\nHands on experience on thefollowing technologies:\n\nDeveloping processes in Spark\nWriting complex SQL queries f\nBuilding ETL/data pipelines\nExposure to Kubernetes andLinux containers (i.e. Docker)\n\nRelated/complementary opensource software platforms and languages (e.g. Scala, Python, Java, Linux)\n\nProven trackrecord of designing effective data strategies and leveraging modern data\narchitectures that resulted in business value\n\nExperiencebuilding cloud-native data pipelines on either AWS, Azure or GCP,\nfollowing best practices in cloud deployments\n\n·Strong DataOps experience (CI/CD,\nOrchestration, Testing, Monitoring)\nStrongexperience leading and developing data engineering teams\n\n·Demonstrated effective interpersonal,\ninfluence, collaboration and listening skills\n·Strong stakeholder management skills\n·Excellent time management, organizational and\nprioritization skills with ability to balance multiple priorities.\nPreferred Qualifications:\n·Experience with data tokenization and different techniques and\ntools i.e. DataVant, Protegrity\n·Experience with Azure Data Factory, Databricks and Snowflake\nExperiencewith Apache Spark and related Big Data stack and technologies, PySpark\nScala\n\n·Experience working with Apache Kafka, building appropriate\nproducer/consumer apps\n·Experience working with Kubernetes and Docker, and knowledgeable\nabout cloud infrastructure automation and management (e.g., Terraform)\n·Experience working in projects with agile/scrum methodologies\n·Familiarity with production quality ML and/or AI model development\nand deployment.\n·Healthcare industry knowledge and experience with exposure to EDI,\nHIPAA, HL7 and FHIR integration standards","description_format":"text","description_chars":3029,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-10-10T08:37:28Z"}],"visa":[],"liveness":{"score":52,"band":"ok","label":"Likely open","p_open":1,"p_active":0.516,"p_room":1,"age_days":1,"expected_fill_days":20,"reasons":["conf:2","agency","win:early"],"computed_at":"2026-10-12T05:48:59Z"},"pay":null,"html_url":"https://alion.io/job/testtriangle-data-engineer","json_url":"https://alion.io/job/testtriangle-data-engineer.json","meta":{"generated_at":"2026-10-12T05:48:59Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":9284,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-13T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4380438},"rest":"https://alion.io/mcp/rest/get_company?id=4380438"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Ftesttriangle-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Ftesttriangle-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Ftesttriangle-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/testtriangle-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Ftesttriangle-data-engineer"}]}