{"id":2924446,"url":"https://alion.io/job/wissen-technology-senior-data-engineer","title":"Senior Data Engineer","company":{"id":412,"name":"Wissen Technology","domain":"wissen.com","url":"https://alion.io/company/wissen-technology","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Zoho Recruit","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":23000,"max_usd":47000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":71},"experience_years_min":7,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Airflow","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"Databricks","optional":false},{"name":"dbt","optional":false},{"name":"Delta Lake","optional":false},{"name":"Dimensional Modeling","optional":false},{"name":"ETL/ELT","optional":false},{"name":"GCP","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Azure DevOps","optional":true},{"name":"CI/CD","optional":true},{"name":"Claude Code","optional":true},{"name":"CloudFormation","optional":true},{"name":"Copilot","optional":true},{"name":"Docker","optional":true},{"name":"GitHub Actions","optional":true},{"name":"GitLab CI","optional":true},{"name":"Jenkins","optional":true},{"name":"Kubernetes","optional":true},{"name":"Microsoft Fabric","optional":true},{"name":"Terraform","optional":true}],"status":"live","first_seen_at":"2026-08-18T00:00:00Z","employer_posted_date":"2026-08-18","last_verified_at":"2026-10-21T19:53:26Z","board_verified":true,"closed_at":null,"days_open":64,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":64},"description":"Wissen Technology is hiring for Senior Data Engineer\nAbout Wissen Technology:\nAt Wissen Technology, we deliver niche, custom-built products that solve complex business challenges across industries worldwide. Founded in 2015, our core philosophy is built around a strong product engineering mindset-ensuring every solution is architected and delivered right the first time. Today, Wissen Technology has a global footprint with 2000+ employees across offices in the US, UK, UAE, India, and Australia. Our commitment to excellence translates into delivering 2X impact compared to traditional service providers. How do we achieve this? Through a combination of deep domain knowledge, cutting-edge technology expertise, and a relentless focus on quality. We don’t just meet expectations-we exceed them by ensuring faster time-to-market, reduced rework, and greater alignment with client objectives. We have a proven track record of building mission-critical systems across industries, including financial services, healthcare, retail, manufacturing, and more. Wissen stands apart through its unique delivery models. Our outcome-based projects ensure predictable costs and timelines, while our agile pods provide clients with the flexibility to adapt to their evolving business needs. Wissen leverages its thought leadership and technology prowess to drive superior business outcomes. Our success is powered by top-tier talent. Our mission is clear: to be the partner of choice for building world-class custom products that deliver exceptional impact-the first time, every time.\nJob Summary:\nWe are hiring a Senior Data Engineer to design, build, and optimize enterprise scale data platforms using Databricks, Python, and PySpark. This role focuses on developing high-performance batch and real-time data pipelines, implementing modern data engineering frameworks, and delivering reliable, governed data solutions that power analytics, reporting, and AI-driven applications across financial services ecosystems.\nExperience: 7 - 12 Years \nLocation: Bangalore\nMode of Work: Hybrid \nMust Have Skills:\nPython (7+ years) for developing scalable, modular, and production-ready data engineering applications\nPySpark & Apache Spark (5+ years) including DataFrame API, Spark SQL, Structured\nStreaming, performance optimization, partitioning strategies, joins, caching, and handling data skew\nDatabricks (4+ years) including Delta Lake, Unity Catalog, Databricks Workflows, notebooks, jobs, and end-to-end data engineering capabilities\nETL/Data Engineering/Data Pipeline Development (7+ years) building large-scale batch and real-time data processing solutions\nAdvanced SQL & Data Modeling including dimensional modeling, slowly changing dimensions (SCD), schema evolution, and query optimization\nApache Airflow (3+ years) for workflow orchestration, DAG development, dependency management, scheduling, monitoring, retries, and backfills\ndbt (Data Build Tool) including layered architecture, incremental models, snapshots, macros (Jinja), testing, documentation, and deployment best practices\nCloud Platforms (AWS/Azure/GCP) with hands-on experience building and operating cloud native data solutions.\nGood to Have:\nMicrosoft Fabric for data integration, engineering, and analytics workloads\nAI-assisted development tools such as GitHub Copilot, Claude Code, or equivalent code generation platforms\nDelta Lake advanced optimization techniques and Lakehouse architecture expertise\nCI/CD pipeline implementation using Jenkins, GitHub Actions, Azure DevOps, or GitLab CI\nContainerization and orchestration using Docker and Kubernetes\nInfrastructure as Code (Terraform, CloudFormation, ARM Templates, or equivalent)\nFinancial Services, Banking, Capital Markets, or AML domain expertise\nData Quality, Data Observability, and Data Governance frameworks Professional Attributes & Qualifications:\n\nEducation: BE/BTech/ME/MTech in Computer Science, Information Technology, Engineering, or a related discipline\nLeadership: Experience mentoring junior engineers, conducting code reviews, and contributing to technical design discussions\nOwnership: Strong track record of driving end-to-end delivery of data engineering solutions from architecture through production deployment\nProblem Solving: Excellent analytical and troubleshooting skills for distributed systems, large-scale data processing, and performance optimization\nQuality Focus: Commitment to engineering excellence, coding standards, testing automation, reliability, security, and maintainability\nCommunication: Strong verbal and written communication skills with the ability to collaborate effectively with business, analytics, and engineering stakeholders\nCollaboration: Proven ability to work in cross-functional, globally distributed teams while influencing technical decisions\nKey Responsibilities:\nDesign, develop, and optimize large-scale batch and streaming data pipelines using Python, PySpark, Databricks, and cloud-native technologies\nBuild and maintain scalable data processing workloads in Databricks with a strong focus on performance, reliability, cost optimization, and maintainability\nDevelop robust dbt models using layered architecture, incremental processing, snapshots, macros, testing frameworks, and documentation standards\nDesign and maintain Apache Airflow DAGs for workflow orchestration, operational monitoring, dependency management, retries, and observability\nImplement data governance, lineage, access controls, data quality validation, monitoring, and privacy standards across enterprise data platforms\nOptimize Databricks and Spark workloads through partitioning strategies, query tuning, caching, file optimization, join optimization, and efficient compute utilization\nCollaborate closely with analytics teams, product owners, architects, and business stakeholders to transform requirements into high-quality, trusted datasets\nConduct code reviews, mentor junior engineers, and drive adoption of engineering best practices and architectural standards\nBuild and enhance CI/CD pipelines to automate testing, deployment, monitoring, and operational readiness of data platforms.\nWissen Sites: \nWebsite: www.wissen.com\nLinkedIn: https://www.linkedin.com/company/wissen-technology\nWissen Leadership: Leadership Team | Wissen\nWissen Live: https://www.linkedin.com/company/wissen-technology/posts/feedView=All\nWissen Thought Leadership: https://www.wissen.com/articles/","description_format":"text","description_chars":6429,"description_truncated":false,"requirements":{"experience_years_min":7,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Consulting & Digital Transformation","IT Outsourcing & Dedicated Teams","Custom Software Development"],"lifecycle":[{"event":"open","at":"2026-10-20T13:05:44Z"}],"visa":[],"liveness":{"score":16,"band":"cold","label":"Long shot","p_open":1,"p_active":0.567,"p_room":0.28,"age_days":64,"expected_fill_days":28,"reasons":["conf:0","velocity","win:tail","crowd:"],"computed_at":"2026-10-21T05:46:15Z"},"pay":null,"html_url":"https://alion.io/job/wissen-technology-senior-data-engineer","json_url":"https://alion.io/job/wissen-technology-senior-data-engineer.json","meta":{"generated_at":"2026-10-21T22:09:18Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":31470,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-22T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":412},"rest":"https://alion.io/mcp/rest/get_company?id=412"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fwissen-technology-senior-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fwissen-technology-senior-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fwissen-technology-senior-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/wissen-technology-senior-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fwissen-technology-senior-data-engineer"}]}