{"id":4153042,"url":"https://alion.io/job/kairos-data-engineer","title":"Data Engineer","company":{"id":1937754,"name":"Kairos","domain":"kairos-project.org","url":"https://alion.io/company/kairos-project","size_band":"11-50","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":{"grade":"B","score":70,"open_postings":14,"ghost_share":0.5,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":null,"computed_at":"2026-11-12T10:38:37Z"}},"role":"Data Science","role_family":"Data Science","seniority":null,"employment_type":"contractor","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Irving, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Airflow","optional":false},{"name":"Anomaly Detection","optional":false},{"name":"Apache Kafka","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Git","optional":false},{"name":"Machine Learning","optional":false},{"name":"Multimodal AI","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false}],"status":"live","first_seen_at":"2026-11-11T23:19:08Z","employer_posted_date":null,"last_verified_at":"2026-11-11T23:19:08Z","board_verified":false,"closed_at":null,"days_open":0,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":0},"description":"Data Engineer\n\nLocation: Irving , TX ----- Hybrid \nDuration: 12+ Months\nLocals Only \n\nData engineers, AI/ML engineers, data scientists, and product partners building enterprise data and AI solutions. In this role, you’ll build reliable data foundations that power AI-enabled products, operational intelligence, and business decision-making. You’ll integrate enterprise data with AI-generated insights and contribute reusable data capabilities across Enterprise AI initiatives. This is a hands-on individual contributor role. You’ll own well-defined data engineering components from development through production, working with senior engineers and architects on solution design and technical direction.\n\nKey Responsibilities\n• Build, maintain, and enhance scalable batch and near-real-time data pipelines using Python, SQL, and Spark/PySpark.\n• Integrate data from enterprise applications, operational systems, APIs, event streams, and AI inference outputs into reliable, analysis-ready datasets.\n• Develop transformations that combine structured and semi-structured data across sources using consistent identifiers and timestamps; handle time zones, duplicate records, and late-arriving events.\n• Create and maintain data models and curated datasets for business analytics, AI model development and evaluation, and AI-enabled application workflows.\n• Partner with AI/ML engineers to deliver data interfaces for inference workflows and capture model outputs, confidence scores, and user feedback for analysis and continuous improvement.\n• Implement data quality checks, reconciliation, pipeline monitoring, and alerting to ensure completeness, accuracy, freshness, and traceability.\n• Troubleshoot pipeline failures and performance issues; implement reliable retries, backfills, and incremental processing while optimizing compute and storage costs.\n• Collaborate with product managers, data scientists, analysts, and engineering partners to translate business requirements into practical data solutions.\n• Follow data security, privacy, access-control, and retention requirements when handling enterprise data and AI-generated outputs.\n• Write maintainable, tested code; participate in code reviews and CI/CD practices; document schemas, data lineage, dependencies, and operational runbooks.\n\nBasic Qualifications\n• Bachelor’s degree in Computer Science, Software Engineering, Information Systems, Engineering, Mathematics, Statistics, or a related quantitative discipline, or equivalent practical experience.\n• 10 years of relevant experience in data engineering or a closely related software engineering role.\n• Strong hands-on proficiency in Python and SQL, including complex queries, transformations, and troubleshooting.\n• Experience with Spark/PySpark and distributed data processing.\n• Experience building and supporting ETL/ELT pipelines on a cloud platform such as Azure or AWS.\n• Understanding of data modeling, relational databases, data lakes, data warehouses, and incremental processing patterns.\n• Experience with workflow orchestration tools such as Apache Airflow or Databricks Workflows.\n• Familiarity with event-driven or streaming data processing concepts, including event time, deduplication, and reliable delivery.\n• Experience with Git, automated testing, and production monitoring or troubleshooting.\n• Ability to independently deliver scoped work, communicate technical concepts clearly, and collaborate with technical and business stakeholders.\n\n• Hands-on experience with Databricks, Delta Lake, or lakehouse architectures.\n• Experience with Databricks Asset Bundles / Declarative Automation Bundles to define, version, and deploy Databricks jobs and pipelines across environments through CI/CD.\n• Experience with streaming technologies such as Kafka, Azure Event Hubs, or Spark Structured Streaming.\n• Experience with retail, customer, inventory, or operational datasets.\n• Experience preparing datasets for machine learning, anomaly detection, or AI model evaluation.\n• Familiarity with multimodal data, unstructured data processing, or time-based event correlation.\n• Exposure to edge-to-cloud data integration, containerized workloads, or infrastructure as code.","description_format":"text","description_chars":4193,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Artificial Intelligence","Cybersecurity AI","AI Safety & Alignment"],"lifecycle":[{"event":"open","at":"2026-11-12T09:39:18Z"}],"visa":[],"liveness":{"score":60,"band":"ok","label":"Likely open","p_open":1,"p_active":0.602,"p_room":1,"age_days":0,"expected_fill_days":30,"reasons":["seen:0","stale_co","win:early"],"computed_at":"2026-11-12T10:38:37Z"},"pay":null,"html_url":"https://alion.io/job/kairos-data-engineer","json_url":"https://alion.io/job/kairos-data-engineer.json","meta":{"generated_at":"2026-11-12T21:06:12Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":44628,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-13T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":1937754},"rest":"https://alion.io/mcp/rest/get_company?id=1937754"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fkairos-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fkairos-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fkairos-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/kairos-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fkairos-data-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4153042}},{"tool":"search_jobs","arguments":{"company":"kairos-project.org","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4153042},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}