{"id":3151814,"url":"https://alion.io/job/mobedo-consulting-data-quality-engineer","title":"Data Quality Engineer","company":{"id":4465906,"name":"MOBEDO Consulting","domain":"mobedoconsulting.com","url":"https://alion.io/company/mobedo-consulting","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Hyderabad, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":20000,"max_usd":43000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":75},"experience_years_min":6,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Amazon CloudWatch","optional":false},{"name":"Amazon Kinesis","optional":false},{"name":"Amazon Redshift","optional":false},{"name":"Amazon S3","optional":false},{"name":"Apache Kafka","optional":false},{"name":"AWS","optional":false},{"name":"AWS Lambda","optional":false},{"name":"AWS Step Functions","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"DynamoDB","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Grafana","optional":false},{"name":"IAM","optional":false},{"name":"Prometheus","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Scala","optional":false},{"name":"SLI/SLO/SLA","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false}],"status":"live","first_seen_at":"2026-10-23T12:35:00Z","employer_posted_date":null,"last_verified_at":"2026-10-23T12:35:00Z","board_verified":false,"closed_at":null,"days_open":4,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":4},"description":"Responsibilities: \nValidate batch and streaming data pipelines for correctness, completeness, consistency, and timeliness.\nCreate and maintain data quality checks (nulls, duplicates, schema drift, and referential integrity).\nVerify business rules and transformations using SQL-based validations.\nDesign, develop, and executetest strategiesfor Databricks-based data pipelines and analytics workflows\nEstablish data reconciliation and end-to-end traceability between source and downstream systems.\nTest ETL/ELT pipelines built using AWS services (Glue, Lambda, EMR, Step Functions).\nValidate transformations written in SQL and Python. Ensure correctness across data ingestion, enrichment, aggregation, and publishing layers.\nTest reprocessing, backfills, and historical data loads.\nValidate ETL/ELT processes built using Apache Spark (PySpark/Scala) in Databricks.\nValidate Kafka-based streaming pipelines for data integrity, ordering, and exactly-once/at-least-once semantics.\nTest producer and consumer logic and serialization formats (Avro, JSON, Protobuf).\nValidate topic configurations, partitions, offsets, retention policies, and schema changes.\nSimulate and test late arrivals, duplicate events, and consumer failures.\nTest data workflows using AWS S3 Glue, Lambda, Redshift, Athena, Kinesis, DynamoDB, or similar services.\nValidate IAM roles, permissions, and secure data access.\nVerify data lifecycle policies, encryption, and storage optimizations.\nBuild and maintain automated data testing frameworks using Python.\nDevelop reusable test utilities, fixtures, and synthetic datasets. Integrate data tests into CI/CD pipelines for pre-merge, scheduled, and post-deployment validation.\nEnable automated alerts for data quality failures.\nValidate pipeline performance for large-scale datasets.\nTest throughput, latency, and concurrency under peak workloads.\nValidate retry logic, error handling, idempotency, and recovery mechanisms.\nPerform soak, regression, and failover testing Validate data pipeline metrics, logs, and alerts using CloudWatch, Prometheus, Grafana, or equivalent tools.\nPartner with teams to define data SLAs and SLOs. Participate in incident response, root-cause analysis, and postmortems related to data quality issues.\n\nRequirements: \n7+ years of experience in QA, SDET, or data quality engineering roles.\nStrong hands-on experience with SQL for complex data validation and analysis.\nProficiency in Python for test automation and data validation.\nExperience testing data pipelines and ETL/ELT workflows.\nHands-on experience with Kafka or other streaming platforms.\nSolid understanding of AWS data services (S3 Glue, Redshift, Lambda, Athena, etc. ).\nExperience working with large datasets and distributed systems.\nStrong debugging, analytical, and problem-solving skills.\nSkills\nPython, QA, SDET, SQL, data quality","description_format":"text","description_chars":2842,"description_truncated":false,"requirements":{"experience_years_min":6,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-10-23T12:35:00Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":4,"expected_fill_days":28,"reasons":["seen:4","win:early"],"computed_at":"2026-10-28T05:59:10Z"},"pay":null,"html_url":"https://alion.io/job/mobedo-consulting-data-quality-engineer","json_url":"https://alion.io/job/mobedo-consulting-data-quality-engineer.json","meta":{"generated_at":"2026-10-28T08:25:09Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":10893,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-29T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4465906},"rest":"https://alion.io/mcp/rest/get_company?id=4465906"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fmobedo-consulting-data-quality-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fmobedo-consulting-data-quality-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fmobedo-consulting-data-quality-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/mobedo-consulting-data-quality-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fmobedo-consulting-data-quality-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3151814}},{"tool":"search_jobs","arguments":{"company":"mobedoconsulting.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3151814},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}