{"id":4718789,"url":"https://alion.io/job/moolya-software-testing-private-limited-senior-data-engineer","title":"Senior Data Engineer","company":{"id":3800960,"name":"Moolya Software Testing Private Limited","domain":"moolya.com","url":"https://alion.io/company/moolya-software-testing-private-limited","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Freshteam","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Hyderabad, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":6,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"Apache Kafka","optional":false},{"name":"Collibra","optional":false},{"name":"Data Vault","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"Dimensional Modeling","optional":false},{"name":"Embeddings","optional":false},{"name":"LangGraph","optional":false},{"name":"Model Context Protocol","optional":false},{"name":"Python","optional":false},{"name":"Scala","optional":false},{"name":"Snowflake","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"AWS","optional":true},{"name":"Azure","optional":true},{"name":"Feature Store","optional":true},{"name":"Great Expectations","optional":true},{"name":"LangChain","optional":true},{"name":"RAG","optional":true},{"name":"Time Series","optional":true}],"status":"live","first_seen_at":"2026-11-20T21:35:00Z","employer_posted_date":null,"last_verified_at":"2026-11-20T21:35:00Z","board_verified":false,"closed_at":null,"days_open":0,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":0},"description":"You will own the data model for our lakehouse. Your models are the contract that batch pipelines, Kafka event streams, AI agents and MCP tools read from and write to. You will design for structured, semi-structured and unstructured data, set the standards and governance around it, and keep the model evolving without breaking its consumers.\n\nThe Role:\n\nRole type: Individual contributor, hands-on.\n\nReports to: Director, Data Platform & AI.\n\nWhat You Will Do:\nDesign and own the canonical data model across batch and event-driven systems within the lakehouse architecture (Bronze, Silver, Gold or equivalent layers), using Databricks, Snowflake and Delta Lake.\nModel structured entities, semi-structured data (JSON, Kafka events) and unstructured assets (documents, text, embeddings and associated metadata).\nDefine schema evolution and versioning standards to ensure incremental changes, including new fields, sources and events, do not break downstream pipelines, AI agents or MCP tools.\nEstablish enterprise-wide data modelling standards covering naming conventions, data types, keys, SCD patterns, partitioning, clustering and data contracts.\nImplement end-to-end data governance, including data cataloguing, column-level lineage, business and technical data dictionaries, ownership, classification and access policies.\nEnsure data is AI-ready through stable identifiers, semantically meaningful entities, well-documented columns and metadata that LangGraph agents and FastMCP tools can reliably discover and query.\nReview data pipeline designs and pull requests to ensure compliance with established data models and standards.\nCollaborate with Data Engineering, Platform, Analytics and AI teams to drive data modelling initiatives.\nMaintain logical and physical data model documentation, conduct model reviews and manage the deprecation and migration of legacy data structures.\n\nMust-Have Qualifications:\n6+ years of experience in Data Engineering, including at least 3 years designing and implementing production-grade data models used by multiple consuming teams.\nProven experience evolving canonical data models incrementally, ensuring backward and forward compatibility, versioned contracts and controlled deprecation without disrupting downstream systems.\nStrong expertise in dimensional modelling, Data Vault, 3NF and event/entity modelling, with the ability to select the appropriate approach based on business requirements.\nHands-on experience with Delta Lake on Spark or Databricks, along with Snowflake or an equivalent data warehouse.\nExperience designing data models for both batch and streaming architectures, including Kafka, CDC and event schemas (Avro, Protobuf or JSON Schema).\nStrong programming skills in Python or Scala with Spark, along with expert-level SQL. Ability to independently prototype, implement and validate data models.\nHands-on experience with data cataloguing and lineage tools such as Unity Catalog, OpenLineage, DataHub, Collibra, Atlan or equivalent platforms.\nProven ownership of data dictionaries and governance standards, with demonstrated adoption across engineering teams.\n\nGood to Have:\nExperience modelling data for AI applications, including vector databases, embedding metadata, RAG corpora, semantic layers and feature stores.\nExposure to LangGraph agents, FastMCP servers, tool schemas and agent-facing data access patterns.\nExperience working with high-volume time-series, metering, IoT or sensor data.\nFamiliarity with data quality and data contract tools such as Great Expectations, Deequ or Soda.\nExperience with cross-cloud or cross-organisation data sharing, such as Delta Sharing, along with AWS or Azure cloud platforms.\nPrior experience in the Energy and Utilities domain.\n\nTechnology Stack:\nPlatforms - Databricks and Snowflake\nTable format - Delta\nStreaming - Kafka\nProcessing - Spark, in Python or Scala\nAgents - LangGraph\nAgent tool access - MCP servers built with FastMCP\n\nExpected Outcomes - First 12 Months:\nPublish the canonical data model and drive its adoption across all core data pipelines.\nEstablish a live data catalog, lineage framework and data dictionary with agreed coverage for critical datasets.\nImplement a structured schema change management process, reducing breaking changes impacting downstream consumers to near zero.\nEnable AI agents and MCP tools to consume governed, documented datasets without relying on ad-hoc table access.\n\nThis Role May Not Be the Right Fit If:\nYou primarily create data model diagrams without hands-on SQL or coding experience.\nYou have experience administering data cataloguing tools but have not owned data models through multiple schema evolution and breaking-change cycles.\nSkills\n3NF, Avro, CDC, Data Modeling, Data Vault, Databricks, Delta Lake, Dimensional Modeling, Kafka, Protobuf, Python, SQL, Schema, Snowflake, Spark","description_format":"text","description_chars":4844,"description_truncated":false,"requirements":{"experience_years_min":6,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Software Testing & QA"],"lifecycle":[{"event":"open","at":"2026-11-20T21:35:00Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":31,"reasons":["seen:0","win:early"],"computed_at":"2026-11-21T00:05:56Z"},"pay":null,"html_url":"https://alion.io/job/moolya-software-testing-private-limited-senior-data-engineer","json_url":"https://alion.io/job/moolya-software-testing-private-limited-senior-data-engineer.json","meta":{"generated_at":"2026-11-21T00:05:56Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":141,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-22T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3800960},"rest":"https://alion.io/mcp/rest/get_company?id=3800960"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fmoolya-software-testing-private-limited-senior-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fmoolya-software-testing-private-limited-senior-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fmoolya-software-testing-private-limited-senior-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/moolya-software-testing-private-limited-senior-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fmoolya-software-testing-private-limited-senior-data-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4718789}},{"tool":"search_jobs","arguments":{"company":"moolya.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4718789},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}