{"id":2597453,"url":"https://alion.io/job/photon-data-engineer-dallas-tx","title":"Data Engineer - Dallas, TX","company":{"id":3186451,"name":"Photon","domain":"photon.com","url":"https://alion.io/company/photon-com","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Oracle","truth_index":{"grade":"D","score":44,"open_postings":582,"ghost_share":0.938,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":null,"computed_at":"2026-10-16T05:45:00Z"}},"role":"Data Science","role_family":"Data Science","seniority":"middle","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Dallas, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":38000,"max":null,"currency":"USD","period":"year","gross":null,"usd_annual":38000},"salary_estimate":null,"experience_years_min":4,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"Apache Kafka","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"Dagster","optional":false},{"name":"Databricks","optional":false},{"name":"dbt","optional":false},{"name":"ElasticSearch","optional":false},{"name":"ETL/ELT","optional":false},{"name":"FastAPI","optional":false},{"name":"Flink","optional":false},{"name":"GCP","optional":false},{"name":"Hybrid Search","optional":false},{"name":"LLM","optional":false},{"name":"Milvus","optional":false},{"name":"Pandas","optional":false},{"name":"Pinecone","optional":false},{"name":"Pydantic","optional":false},{"name":"Python","optional":false},{"name":"Qdrant","optional":false},{"name":"RAG","optional":false},{"name":"Semantic Search","optional":false},{"name":"Semantic Search","optional":false},{"name":"Snowflake","optional":false},{"name":"SQL","optional":false},{"name":"Weaviate","optional":false},{"name":"LangChain","optional":true},{"name":"LlamaIndex","optional":true},{"name":"Neo4j","optional":true}],"status":"live","first_seen_at":"2026-04-15T00:46:30Z","employer_posted_date":"2026-04-15","last_verified_at":"2026-10-16T21:50:07Z","board_verified":true,"closed_at":null,"days_open":185,"trust":{"level":"ghost","repost_count":0,"flags":["stale","company_stale"],"days_open":184},"description":"We are seeking a Data Engineer who will be responsible for the \"Ingestion-to-Insight\" pipeline that allows autonomous agents to access, search, and reason over vast amounts of proprietary and public data.\nYour role is critical: you will design the RAG (Retrieval-Augmented Generation) architectures and data pipelines that ensure our agents have the right context at the right time to make accurate decisions.\nKey Responsibilities\n AI-Ready Data Pipelines: Design and implement scalable ETL/ELT pipelines that process both structured (SQL, logs) and unstructured (PDFs, emails, docs) data specifically for LLM consumption.\nVector Database Management: Architect and optimize Vector Databases (e.g., Pinecone, Weaviate, Milvus, or Qdrant) to ensure high-speed, relevant similarity searches for agentic retrieval.\nChunking & Embedding Strategies: Collaborate with AI Engineers to optimize data chunking strategies and embedding models to improve the \"recall\" and \"precision\" of the agent's knowledge retrieval.\n Data Quality for AI: Develop automated \"Data Cleaning\" workflows to remove noise, PII (Personally Identifiable Information), and toxicity from training/context datasets.\nMetadata Engineering: Enrich raw data with advanced metadata tagging to help agents filter and prioritize information during multi-step reasoning tasks.\n Real-time Data Streaming: Build low-latency data streams (using Kafka or Flink) to provide agents with \"fresh\" data, enabling them to act on real-time market or operational changes.\nEvaluation Frameworks: Construct \"Gold Datasets\" and versioned data snapshots to help the team benchmark agent performance over time.\nRequired Skills & Qualifications\nExperience: 4+ years in Data Engineering, with at least 1 year focusing on data for LLMs or AI/ML applications.\nPython Mastery: Deep expertise in Python (Pandas, Pydantic, FastAPI) for data manipulation and API integration.\n Data Tooling: Strong experience with modern data stack tools (e.g., dbt, Airflow, Dagster, Snowflake, or Databricks).\nVector Expertise: Hands-on experience with at least one major Vector Database and knowledge of similarity search algorithms (HNSW, Cosine Similarity).\n Search Knowledge: Familiarity with hybrid search techniques (combining semantic search with traditional keyword search like Elasticsearch/BM25).\nCloud Infrastructure: Proficiency in managing data workloads on AWS, Azure, or GCP.\nPreferred Qualifications\nExperience with LlamaIndex or LangChain for data ingestion.\nKnowledge of Graph Databases (e.g., Neo4j) to help agents understand complex relationships between data points.\nFamiliarity with \"Data-Centric AI\" principles-prioritizing data quality over model size.\nCompensation, Benefits and Duration\nMinimum Compensation: USD 38,000\nMaximum Compensation: USD 133,000\nCompensation is based on actual experience and qualifications of the candidate. The above is a reasonable and a good faith estimate for the role.\nMedical, vision, and dental benefits, 401k retirement plan, variable pay/incentives, paid time off, and paid holidays are available for full time employees.\nThis position is not available for independent contractors\nNo applications will be considered if received more than 120 days after the date of this post","description_format":"text","description_chars":3250,"description_truncated":false,"requirements":{"experience_years_min":4,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["401k plan","Retirement plans"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Consulting & Digital Transformation"],"lifecycle":[{"event":"open","at":"2026-10-15T07:30:57Z"}],"visa":[],"liveness":{"score":3,"band":"cold","label":"Long shot","p_open":1,"p_active":0.091,"p_room":0.28,"age_days":184,"expected_fill_days":18,"reasons":["conf:3","stale_co","velocity","ghost","win:tail","crowd:brand"],"computed_at":"2026-10-16T05:45:00Z"},"pay":{"stated_usd_annual":38000,"is_top_pay":false},"html_url":"https://alion.io/job/photon-data-engineer-dallas-tx","json_url":"https://alion.io/job/photon-data-engineer-dallas-tx.json","meta":{"generated_at":"2026-10-17T02:14:00Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":3173,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-18T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3186451},"rest":"https://alion.io/mcp/rest/get_company?id=3186451"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fphoton-data-engineer-dallas-tx"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fphoton-data-engineer-dallas-tx"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fphoton-data-engineer-dallas-tx"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/photon-data-engineer-dallas-tx\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fphoton-data-engineer-dallas-tx"}]}