{"id":2841190,"url":"https://alion.io/job/southern-data-engineer-azure-databricks-and-cloud-data-solutions-safety","title":"Data Engineer – Azure Databricks and Cloud Data Solutions (Safety)","company":{"id":2607898,"name":"Southern","domain":"southern.com","url":"https://alion.io/company/southern-com","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Oracle","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":null,"employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Birmingham, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":88000,"max_usd":191000,"period":"year","method":"role_country_seniority_unknown","sample_n":3718},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"Azure","optional":false},{"name":"Azure Cosmos DB","optional":false},{"name":"Azure Data Factory","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"ETL/ELT","optional":false},{"name":"MLFlow","optional":false},{"name":"Spark","optional":false}],"status":"live","first_seen_at":"2026-10-19T04:00:00Z","employer_posted_date":"2026-10-19","last_verified_at":"2026-10-26T16:56:21Z","board_verified":true,"closed_at":null,"days_open":7,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":7},"description":"Job Title: Data Engineer - Azure Databricks and Cloud Data Solutions (Safety)\nWhy this role\nSouthern Company’s Operations Data Analytics team supports the data foundations and integration capabilities needed to deliver reliable analytics and reporting across multiple organizations. This Data Engineer role will focus on Safety data and be responsible for creating data pipelines, curating source schemas, and supporting data product development in the Azure Databricks lakehouse platform.\nThe role is important in creating secure, reusable, and high-performing data services that align with business needs, Technology Organization strategy, and enterprise standards. You will work directly with business and technology stakeholders to turn data requirements into practical solutions while improving performance, resource utilization, capacity planning, and application and data security. This role will support multiple business units and work in multiple lakehouse environments with data provisioned through Unity catalog, to create a unified foundation of safety and human performance data.\nAbout the role\nAs part of this team, you will design, develop, implement, integrate, and support cloud and data solutions, with hands-on responsibility for data pipelines, data models, ETL processes, lakehouse capabilities, and data storage layers.\nYou will partner with stakeholders, developers, and infrastructure teams to align solutions across technology platforms. The role also serves as a subject matter expert for data architecture and Databricks, supports operational issue resolution, and helps ensure that project documentation and change management requirements are met.\nWhat you will do\nDesign and develop robust data pipelines to ingest, store, and process data from multiple sources for analytics and reporting.\n\nCreate and maintain logical and physical data models that organize data for efficient querying, analysis, and visualization.\n\nBuild and maintain Extract, Transform, Load (ETL) processes that move data between systems while supporting data quality and consistency.\n\nImplement and support lakehouse solutions using medallion architecture, including data engineering pipelines and data storage layers.\n\nOptimize data lake storage, retrieval, performance, and resource utilization for analytical workloads.\n\nDevelop dynamic, metadata-driven frameworks and scalable data ingestion patterns.\n\nSupport streaming datasets and Databricks Delta Live Tables.\n\nApply lakehouse performance-tuning techniques such as partitioning, aggregations, and materialized views.\n\nArchitect, develop, implement, integrate, and support cloud technology solutions that meet business partner expectations for quality, cost, and timeliness.\n\nWork closely with developers and infrastructure teams to optimize application code, create reusable services, plan capacity, and protect application and data security.\n\nBecome the team’s subject matter expert for data architecture and Databricks.\n\nCommunicate effectively and promptly with customers, team members, and management, and build strong relationships with peers and business partners.\n\nDevelop required project documentation, follow Change Management policies and procedures, and respond quickly and effectively to operational problems.\n\nBuild a strong understanding of the company’s business challenges and goals and exhibit Our Values.\n\nWhat success looks like\nReliable, efficient data pipelines that support analytics and reporting needs.\n\nReusable and well-aligned solutions across on-premises and Azure technology platforms.\n\nConsistent, high-quality data movement through maintainable ETL and lakehouse processes.\n\nOptimized application code, cloud resources, performance, and capacity utilization.\n\nSecure data and application solutions supported by complete project documentation and disciplined change management.\n\nStrong working relationships and timely communication with business partners, technology teams, and management.\n\nFast, effective resolution of operational problems and growing team expertise in data architecture and Databricks.\n\nWhat you bring (required)\nEducation: Bachelor’s degree required, preferably in Computer Science, Management Information Systems, Engineering, or another technology-related field.\nDatabricks: Experience with Databricks, including notebooks, clusters, and jobs.\nCloud platforms: Experience with a major cloud platform, preferably Microsoft Azure, and services including Cosmos DB, Storage Application Services, and Azure Data Factory.\nArchitecture: Experience architecting data-oriented solutions using cloud data architecture platforms and patterns, preferably Azure.\nLakehouse engineering: Experience implementing lakehouses with medallion architecture, data engineering pipelines, and data storage layers.\nData ingestion: Experience with dynamic metadata-driven frameworks and large-scale data ingestion patterns.\nData modeling: Experience developing complex logical and physical data models.\nPerformance and cost: Experience optimizing cloud PaaS resources to follow best practices and reduce cost, plus lakehouse performance tuning using partitioning, aggregations, materialized views, or similar techniques.\nDelivery practices: Experience with Agile, DevOps, and CI/CD methodologies.\nData technologies: Familiarity with Apache Spark, Delta Lake, and MLflow, plus knowledge of structured and unstructured data across databases, data warehouses, and data lakes.\nSoftware development: Knowledge of software development technologies, methodologies, and associated tools.\nProblem solving: Excellent root cause analysis and problem-solving skills.\nWhat sets you apart (preferred)\nHands-on experience with Microsoft Azure data services and cloud PaaS architecture and resources.\n\nFamiliarity with streaming datasets and Databricks Delta Live Tables.\n\nStrong technical writing skills.\n\nWhat we value\nCustomer focus: You deliver cloud and data solutions that meet or exceed business partner expectations for quality, cost, and timeliness.\nOwnership and responsiveness: You take responsibility for documentation, change management, and rapid resolution of operational problems.\nCollaboration: You communicate effectively and build productive relationships with customers, peers, management, developers, infrastructure teams, and business partners.\nContinuous learning: You become a subject matter expert, stay close to the business, and seek to understand the company’s challenges and goals.\nEnterprise mindset: You design secure, reusable, aligned solutions and exhibit Our Values.","description_format":"text","description_chars":6575,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":true},"security_clearance":false,"languages":[]},"benefits":["Continuous learning"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Energy & Utilities","Power Grid"],"lifecycle":[{"event":"open","at":"2026-10-19T09:05:23Z"}],"visa":[],"liveness":{"score":79,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.839,"p_room":0.945,"age_days":7,"expected_fill_days":15,"reasons":["conf:9","velocity","win:mid"],"computed_at":"2026-10-26T05:57:25Z"},"pay":null,"html_url":"https://alion.io/job/southern-data-engineer-azure-databricks-and-cloud-data-solutions-safety","json_url":"https://alion.io/job/southern-data-engineer-azure-databricks-and-cloud-data-solutions-safety.json","meta":{"generated_at":"2026-10-26T22:27:23Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":30462,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-27T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":2607898},"rest":"https://alion.io/mcp/rest/get_company?id=2607898"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fsouthern-data-engineer-azure-databricks-and-cloud-data-solutions-safety"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fsouthern-data-engineer-azure-databricks-and-cloud-data-solutions-safety"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fsouthern-data-engineer-azure-databricks-and-cloud-data-solutions-safety"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/southern-data-engineer-azure-databricks-and-cloud-data-solutions-safety\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fsouthern-data-engineer-azure-databricks-and-cloud-data-solutions-safety"}]}