{"id":1547417,"url":"https://alion.io/job/bits-in-glass-sr-data-engineer","title":"Sr. Data Engineer","company":{"id":3845206,"name":"Bitsinglass","domain":"bitsinglass.ai","url":"https://alion.io/company/bitsinglass","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"BambooHR","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"inferred","locations":[],"countries":[],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Amazon Redshift","optional":false},{"name":"Apache Kafka","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"Azure DevOps","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"ETL/ELT","optional":false},{"name":"GitHub Actions","optional":false},{"name":"GitLab CI","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Scala","optional":false},{"name":"Snowflake","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Apex","optional":true},{"name":"MuleSoft","optional":true}],"status":"live","first_seen_at":"2026-09-01T00:00:00Z","employer_posted_date":"2026-09-01","last_verified_at":"2026-10-09T22:38:23Z","board_verified":true,"closed_at":null,"days_open":39,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":39},"description":"Join a company that’s leading the way in AI and automation consulting. Our portfolio spans 10+ top technologies across business applications, data, process, cloud, and AI. At Bits In Glass, you’ll do meaningful work with a supportive, driven team that loves to collaborate and celebrate wins together. Whether you’re coding, consulting or bringing bold ideas to the table, you’ll tackle real business challenges, grow your skills, and make a BIG impact.\nOur growing team has earned global recognition as a Great Place to Work and received multiple industry partner awards-while keeping things fun and people-focused. If you’re looking to deepen your expertise and solve real-world problems, Bits In Glass could be the place for you.\nWe’re seeking a Senior Data Engineer to join our Delivery Team. In this role, you’ll design and implement modern data architectures that enable our clients to make data-driven decisions. You’ll lead the strategy, design, and technical direction of scalable data ecosystems across cloud platforms - ensuring integration, performance, and compliance.\nAs a Senior Data Engineer, you’ll work closely with business stakeholders, data engineers, and analytics teams to design data solutions that align with client goals.\nResponsibilities:\nDesign and implement end-to-end data architectures, including data lakes, data warehouses, and analytics platforms.\nDefine data integration and transformation strategies, ensuring scalability, security, and performance.\nCollaborate with stakeholders to translate business requirements into technical solutions that support analytics, reporting, and AI initiatives.\nDevelop data models, ETL/ELT pipelines, and frameworks for structured and unstructured data.\nProvide technical leadership and mentorship to data engineers and developers, promoting best practices in data management and governance.\nEnsure compliance with data governance, security, and privacy standards across platforms.\nOptimize existing data architectures and processes for improved performance and reliability.\nStay current with industry trends, cloud data services, and emerging technologies such as Databricks, Snowflake, Azure Synapse, and AWS Redshift.\nAct as a trusted advisor to clients, guiding them on architecture decisions and best practices for data modernization.\nRequired Skills & Experience\n5+ years of experience in data architecture, data engineering, or analytics solution design.\nHands-on experience with data lake and warehouse technologies (e.g., Databricks, Snowflake, Redshift, Synapse).\nDeep understanding of data modeling, data integration, and ETL/ELT design.\nProficiency in SQL and one or more programming languages (Pyspark/Python, Scala), particularly for complex data transformations and optimization within Spark\nSolid understanding of data governance, security, and privacy best practices.\nProven experience in designing, implementing, and optimizing large-scale ingestion pipelines using Databricks Autoloader\nDeep practical knowledge of building and managing reliable, self-managing ETL/ELT pipelines using Delta Live Tables\nExperience in building high-throughput, low-latency streaming data ingestion solutions using Apache Kafka, Spark Structured Streaming, and Databricks Streaming\nExtensive experience in successfully applying and enforcing the Medallion architecture (Bronze, Silver, Gold layers) within a Databricks environment\nExperience in designing and implementing CI/CD pipelines (using tools like Azure DevOps, GitHub Actions, GitLab CI) specifically tailored for Databricks workflows, notebooks, and cluster configurations, enabling automated deployment and testing\nExperience in planning and executing data migration projects from traditional data warehouses into the Databricks Lakehouse\nStrong working knowledge of at least one major cloud provider (AWS, Azure) regarding data storage, networking, and security concepts relevant to Databricks deployment.\nProven ability to engage with clients, present technical solutions, and communicate complex ideas clearly.\nBachelor’s or Master’s degree in Computer Science, Information Systems, Engineering, or a related field.\nExcellent problem-solving, communication, and collaboration skills.\nNice to Have:\nExperience with AI/ML integration and data science workflows.\nKnowledge of data cataloging and metadata management tools.\nPrior consulting or client-facing experience in a technology services firm.\nBIG is a high growth Cloud Consulting firm with offices in Edmonton, Calgary, Toronto, Denver, India and the United Kingdom. Our clients are in Canada, UK, India and the US. We are a team of experienced IT professionals who specialize in providing business value to organizations looking at leveraging modern platforms such as Pega, Appian, MuleSoft and Boomi. Our vast experience in the IT industry and our current track record in enterprise software development, allow us to provide a full range of services to our clients. Bits In Glass helps organizations of all sizes to automate their businesses and leverage the power of the web and mobile technologies.","description_format":"text","description_chars":5090,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-09-30T22:30:59Z"}],"visa":[],"liveness":{"score":27,"band":"fade","label":"Fading","p_open":1,"p_active":0.605,"p_room":0.45,"age_days":38,"expected_fill_days":22,"reasons":["conf:3","velocity","win:tail"],"computed_at":"2026-10-09T06:01:00Z"},"pay":null,"html_url":"https://alion.io/job/bits-in-glass-sr-data-engineer","json_url":"https://alion.io/job/bits-in-glass-sr-data-engineer.json","meta":{"generated_at":"2026-10-10T00:38:00Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler","counted_by":"address","units_charged":1,"used_today":1024,"day_limit":5000,"remaining_today":3976,"minute_limit":60,"resets_at":"2026-10-11T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3845206},"rest":"https://alion.io/mcp/rest/get_company?id=3845206"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fbits-in-glass-sr-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fbits-in-glass-sr-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fbits-in-glass-sr-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/bits-in-glass-sr-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fbits-in-glass-sr-data-engineer"}]}