{"id":2687523,"url":"https://alion.io/job/softobiz-technologies-eh-1521-data-engineer","title":"TE-1521- Data Engineer","company":{"id":3806732,"name":"Softobiz Technologies","domain":"softobiz.com","url":"https://alion.io/company/softobiz-technologies-pvt-ltd","size_band":"201-500","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Keka","truth_index":{"grade":"B","score":81,"open_postings":9,"ghost_share":0,"stale_share":0.556,"repost_share":0,"time_to_fill_p50_days":64,"computed_at":"2026-10-19T05:45:15Z"}},"role":"Data Science","role_family":"Data Science","seniority":"staff","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Hyderabad, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":29000,"max_usd":54000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":16},"experience_years_min":8,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Amazon Redshift","optional":false},{"name":"BigQuery","optional":false},{"name":"CI/CD","optional":false},{"name":"Confluence","optional":false},{"name":"Dagster","optional":false},{"name":"dbt","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Fivetran","optional":false},{"name":"GCP","optional":false},{"name":"Git","optional":false},{"name":"GitHub","optional":false},{"name":"GitLab","optional":false},{"name":"Google BigQuery","optional":false},{"name":"Google Cloud Run","optional":false},{"name":"Google Docs","optional":false},{"name":"IAM","optional":false},{"name":"Linear","optional":false},{"name":"Looker","optional":false},{"name":"Metabase","optional":false},{"name":"Notion","optional":false},{"name":"Prefect","optional":false},{"name":"Python","optional":false},{"name":"Slack","optional":false},{"name":"Snowflake","optional":false},{"name":"SQL","optional":false},{"name":"Tableau","optional":false},{"name":"A/B Testing","optional":true},{"name":"Amazon Kinesis","optional":true},{"name":"Apache Kafka","optional":true},{"name":"Machine Learning","optional":true}],"status":"live","first_seen_at":"2026-10-16T05:44:05Z","employer_posted_date":"2026-10-16","last_verified_at":"2026-10-19T07:17:22Z","board_verified":true,"closed_at":null,"days_open":3,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":3},"description":"Job Title: Data Engineer\nLocation: Hyderabad\nExperience: 8 - 12 Years\nEmployment Type: Full-Time\nShift: Overlap with US Team (evening IST preferred)\nStaff Data Engineer\nData Platform & Analytics Engineering · Hyderabad (On-site, Softobiz office)\nAbout the Role\nWe are looking for a Staff Data Engineer to own our end-to-end data platform - from raw event ingestion, through the warehouse, to the analytics marts that the business, product and marketing teams rely on every day. You will be the person who makes sure the numbers we make decisions on are accurate, fresh, reproducible and trusted.\nThis is a hands-on individual-contributor role. You will partner daily with engineering, analytics, product, growth and external data partners. Success looks like: one canonical patient or customer key across every system, a well-modelled warehouse that answers business questions in SQL rather than spreadsheets, and a data platform that product, marketing and leadership genuinely trust.\nScope note: this role owns warehouse architecture, pipelines and data modelling. The sister MarTech Engineering role owns event capture at the edge and the delivery of conversion signals to ad platforms. Both roles share one source of truth (the warehouse) and collaborate on the hand-off between event streams and warehouse tables.\nWhat You'll Own\nWarehouse architecture and modelling - BigQuery (or equivalent) as the single source of truth, designed to serve both analytics and activation use cases.\ndbt project ownership - model layering (staging → intermediate → marts), naming conventions, tests, documentation, exposures, and the promotion workflow from dev to production.\nIngestion pipelines - event streams from the CDP (Segment or equivalent) landing cleanly in the warehouse, plus structured loads from the product database, billing / payments, ad platforms and third-party SaaS systems.\nIdentity resolution in the warehouse - stitching anonymous, edge-level and identified user records into one canonical key, and publishing that key to downstream consumers.\nCore marts - revenue, orders, subscriptions, cohorts, LTV, funnel conversion, channel performance, clinical or operational metrics as the business requires.\nReverse-ETL / activation models - warehouse tables purpose-built to feed ad-platform conversions APIs, lifecycle marketing, audiences and experimentation tools.\nData quality and observability - dbt tests, freshness monitors, row-count alerts, reconciliation checks between systems (for example: warehouse orders vs payment processor, warehouse conversions vs ad-platform reports).\nData governance - PII / PHI handling, column-level masking, row-level security where required, access policies, and the documentation that makes those policies auditable.\nOrchestration and CI/CD - scheduled runs, retries, incremental strategies, pull-request-based dbt reviews, automated tests in CI.\nPartnership with external data partners and the sister MarTech Engineering function - clear ownership lines, shared conventions, joint on-call for pipeline incidents.\nRequired Experience\n8-12 years in data engineering or analytics engineering at consumer-facing digital businesses - ideally including at least one direct-to-consumer, e-commerce, subscription or marketplace product.\nDeep, hands-on experience designing and maintaining a warehouse on BigQuery, Snowflake or Redshift. You can explain partitioning, clustering, materialised views, and cost / performance trade-offs from memory.\nProduction experience with dbt - Core or Cloud - including model layering, incremental strategies, snapshots, tests, documentation, exposures, and managing a multi-contributor repo through pull requests.\nFluent SQL - advanced window functions, CTEs, pivoting, session stitching, slowly-changing-dimension patterns. You can read a 200-line query and tell us what is wrong with it.\nExperience designing identity resolution in the warehouse - merging anonymous, cookie-level, logged-in and server-generated identifiers into one canonical customer key, and publishing that key for downstream systems to join on.\nHands-on experience building marts for revenue, orders, subscriptions, cohorts, LTV and funnel analysis - and reconciling those marts against authoritative systems (payment processors, billing, ad platforms).\nPython for data work - transformations, orchestration DAGs, small internal tools, and scripting around the warehouse. You do not need to be a backend engineer.\nWorking knowledge of at least one workflow orchestrator - Airflow, Prefect, Dagster, or equivalent - and the operational discipline that goes with it (idempotency, backfills, retries, alerting).\nComfort integrating warehouse output into reverse-ETL tooling (Polytomic, Hightouch or Census) so that audiences, conversion events and customer traits can be activated in ad platforms, lifecycle tools and experimentation systems.\nA bias for data contracts and tests over heroics - you treat a broken dashboard as a platform failure to be prevented, not a one-off to be patched.\nExperience operating under ambiguity - a platform migration, re-platforming, or a major tracking overhaul where the \"right\" schema had to be invented mid-flight.\nTools and Technologies\nThe following stack describes what you will work with day-to-day. You do not need hands-on experience with every single tool - depth in 60-70% of this list is what we are looking for, along with the pattern-matching to pick up the rest quickly.\nCategory ToolsData WarehouseBigQuery (required), Snowflake or Redshift. Strong grasp of partitioning, clustering, cost controls.Transformationdbt Core or dbt Cloud (required), dbt tests, snapshots, exposures, packages.OrchestrationAirflow, Prefect, Dagster, or an equivalent DAG runner. dbt Cloud scheduling for dbt-only pipelines.IngestionSegment (CDP → warehouse), Fivetran or Airbyte (SaaS → warehouse), custom Python ingestion where needed.Reverse-ETL / ActivationPolytomic (preferred), Hightouch, Census - mapping marts to ad-platform, lifecycle and experimentation destinations.Product Analytics (consumer)Mixpanel, Amplitude, or Heap - you will not own these tools, but you will land their events and feed their user properties from the warehouse.BI / VisualisationOmni, Looker, Mode, Metabase, Tableau - warehouse-native semantic modelling preferred.LanguagesSQL (advanced), Python (fluent), Jinja (dbt); shell scripting as needed.Storage & CloudGoogle Cloud Platform primary (Cloud Storage, IAM, Pub/Sub, Cloud Run / Cloud Functions).Governance & PIIColumn-level security, masking policies, row-level access, data-classification tagging, audit logging.Dev workflowGit, GitHub / GitLab, pull-request reviews, dbt CI, unit and schema tests, dbt docs.CollaborationLinear, Slack, Google Docs & Sheets, Confluence or Notion.Nice to Have\nHealthcare, fintech, or other privacy-sensitive domain experience - designing a warehouse that respects PII / PHI boundaries and survives audit.\nExperience operating a dbt repo shared between an internal team and an external data partner (or vendor) - conventions, code review, ownership boundaries.\nExperience with Segment Unify, identity-graph services, or custom identity-resolution frameworks.\nHands-on with experimentation data - building the exposures, assignment and outcome tables that power A/B test readouts and feeding them to an experimentation platform.\nHands-on with LTV or propensity modelling (regression, survival or tree-based), and with getting those predictions into the warehouse as first-class tables.\nFamiliarity with streaming patterns - Pub/Sub, Kafka, Kinesis - and when to prefer them over batch.\nPrior early-hire data platform experience at a growth-stage product company, where you set the conventions rather than inherited them.\nHow You Work\nYou treat the warehouse as a product - versioned, documented, tested, with clear ownership of every model and every downstream exposure.\nYou are as comfortable debugging a BigQuery cost regression as you are explaining an attribution or LTV model to senior leadership.\nYou write dbt tests before you write dashboards. You would rather catch the problem in CI than in a Monday standup.\nYou draw scope lines honestly - you know where your layer ends and the MarTech, product or ML layer begins, and you document the hand-off.\nYou reconcile aggressively - warehouse vs payment processor, warehouse vs ad platforms, warehouse vs the product UI. Anything that does not tie out is a ticket, not a footnote.\nYou write things down. The team should not need to re-learn a modelling decision you have already made.\nCompensation and Logistics\nLocation: On-site at our Hyderabad (Softobiz) office. This is not a remote role.\nReporting: Reports to the Engineering Owner, with regular working interactions across product, analytics, growth and external data partners.\nCompensation: Competitive base salary plus performance bonus and standard benefits.\nSchedule: Full-time, with some overlap expected with partner teams in other time zones.\nHow to Apply\nSend your resume and a short note (5-10 sentences) describing the most complex data platform or warehouse migration you have personally led - what you inherited, what you shipped, and what you would do differently. Links to open-source contributions, dbt packages, public writing or talks are welcome.\nAbout Softobiz:\nInnovation begins with like-minded people aiming to transform the world together. At Softobiz, we invite you to become a part of an organization that has been helping clients transform their business by fusing insights, creativity, and technology. With a team of 300+ technology enthusiasts, we have been trusted by leading enterprises around the globe for over 12+ years.\nAt Softobiz, we foster a culture of equality, learning, collaboration, and creative freedom, empowering our employees to grow and excel in their careers. Our technical craftsmen are pioneers in the latest technologies like AI, machine learning, and product development.\nWhy Should You Join Softobiz?\n- Work with technical craftsmen who are pioneers in the latest technologies.\n- Access training sessions and skill-enhancement courses for personal and professional growth.\n- Be rewarded for exceptional performance and celebrate success through engaging parties.\n- Experience a culture that embraces diversity and creates an inclusive environment for all employees.\nSoftobiz is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will be afforded equal employment opportunities without discrimination based on race, creed, color, national origin, sex, age, disability, or marital status.\nFor more information about our solutions and organization, visit www.softobiz.com,\nFollow us\non LinkedIn, Twitter,and Facebook for more updates.\nAI-led Software Engineering with Greenlight | Softobiz\nAI-led software engineering with independent verification and human control. Explore Greenlight for software delivery, enterprise AI and operations.","description_format":"text","description_chars":11048,"description_truncated":false,"requirements":{"experience_years_min":8,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"phd","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Consulting & Digital Transformation","Custom Software Development"],"lifecycle":[{"event":"open","at":"2026-10-16T08:03:10Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":3,"expected_fill_days":64,"reasons":["conf:2","velocity","win:early"],"computed_at":"2026-10-19T05:45:15Z"},"pay":null,"html_url":"https://alion.io/job/softobiz-technologies-eh-1521-data-engineer","json_url":"https://alion.io/job/softobiz-technologies-eh-1521-data-engineer.json","meta":{"generated_at":"2026-10-19T11:26:48Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":8034,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-20T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3806732},"rest":"https://alion.io/mcp/rest/get_company?id=3806732"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fsoftobiz-technologies-eh-1521-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fsoftobiz-technologies-eh-1521-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fsoftobiz-technologies-eh-1521-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/softobiz-technologies-eh-1521-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fsoftobiz-technologies-eh-1521-data-engineer"}]}