{"id":2903022,"url":"https://alion.io/job/bp-senior-data-engineer-4","title":"Senior Data Engineer","company":{"id":2557,"name":"BP","domain":"bp.com","url":"https://alion.io/company/bp-com","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"A","score":86,"open_postings":26,"ghost_share":0,"stale_share":0.769,"repost_share":0,"time_to_fill_p50_days":11,"computed_at":"2026-10-20T05:45:00Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Kuala Lumpur, Malaysia"],"countries":["MY"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":17500,"max_usd":45000,"period":"year","method":"global_role_cell_scaled_by_country","sample_n":2491},"experience_years_min":8,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Amazon EventBridge","optional":false},{"name":"Amazon Redshift","optional":false},{"name":"Amazon S3","optional":false},{"name":"AWS","optional":false},{"name":"AWS Lambda","optional":false},{"name":"Azure","optional":false},{"name":"CI/CD","optional":false},{"name":"Configuration Management","optional":false},{"name":"Databricks","optional":false},{"name":"Git","optional":false},{"name":"Incident Management","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"SQL","optional":false},{"name":"Spark","optional":true}],"status":"live","first_seen_at":"2026-10-15T00:00:00Z","employer_posted_date":"2026-10-15","last_verified_at":"2026-10-21T03:12:05Z","board_verified":true,"closed_at":null,"days_open":6,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":6},"description":"Entity:\nTechnologyJob Family Group:\nIT&S GroupJob Description:\nLet me tell you about the role\nAt the heart of bp's technological endeavors is the Innovation & Engineering (I&E) organization. We are the driving force behind the technology that fuels bp's operations, from upstream energy production to downstream delivery to our esteemed customers.\nOur diverse teams cater to a broad spectrum of interests, encompassing everything from infrastructure and backend services to customer-centric web and native applications.\nWith a keen emphasis on agility, we foster using native AWS and Azure services as our infrastructure foundation, including serverless architectures. Our ethos is not just about using the best tech for the task but also encouraging an environment where our software and platform engineers thrive, learn, and continuously evolve.\nKey Responsibilities\nDrive engineering best practices through code reviews, technical standards, CI/CD practices, and automation\n\nLead source control, release management, and deployment processes for data engineering solutions.\n\nFacilitate technical discussions, architecture reviews, and technology decision-making across teams.\n\nMentor engineers and contribute to building a high-performing engineering culture through knowledge sharing and technical leadership.\n\nEnsure compliance with information security, governance, and operational standard methodologies.\n\nSupport the reliability, resilience, and continuous improvement of data platforms and services.\n\nDesign, build, and operate scalable, secure, reliable, and efficient data products, pipelines, and platforms.\n\nOwn the end-to-end lifecycle of data solutions, ensuring operational accountability, supportability, and continuous improvement.\n\nCollaborate with business stakeholders, engineers, architects, analysts, and data scientists to deliver high-quality data solutions.\n\nDesign and maintain data models, ingestion frameworks, and transformation pipelines that ensure data quality, integrity, and performance.\n\nImplement DataOps best practices including CI/CD, Infrastructure as Code, automated testing, monitoring, and deployment automation.\n\nBuild observability, alerting, and automated data quality controls to ensure platform reliability and rapid issue detection.\n\nMaintain metadata, lineage, documentation, runbooks, and support processes to improve governance and operational readiness.\n\nLead incident resolution, root cause analysis, and reliability improvements to reduce recurring issues and improve service outcomes.\n\nEnsure compliance with security, privacy, governance, and enterprise architecture standards.\n\nProvide technical leadership through architecture guidance, mentoring, code reviews, and engineering best practices, including good team work\n\n What you will need to be successful (experience and qualifications)\n8+ years of experience in Data Engineering, Software Engineering, or related disciplines.\n\n5+ years of hands-on Python development experience.\n\n3+ years of experience with PySpark and large-scale distributed data processing.\n\nShown experience delivering and operating enterprise-scale data platforms and pipelines.\n\nExperience working in DataOps, DevOps, SRE, or production support environments.\n\nTechnical Skills\nStrong expertise in SQL, database design, and data modelling.\n\nExperience designing end-to-end data architectures including ingestion, transformation, storage, governance, and consumption layers.\n\nStrong AWS experience, including services such as S3, Glue, Lambda, Athena, Redshift, and EventBridge.\n\nHands-on experience with Databricks and modern Lakehouse architectures.\n\nExperience with Git, CI/CD, Infrastructure as Code, and deployment automation.\n\nOperational Excellence\nStrong understanding of observability, monitoring, alerting, and platform reliability.\n\nExperience implementing data quality controls, lineage, metadata, and governance practices.\n\nExperience with incident management, root cause analysis, and continuous service improvement.\n\nKnowledge of security, privacy, compliance, and operational risk management.\n\nLeadership\nExcellent stakeholder management and communication skills.\n\nShown ability to influence technical decisions, mentor engineers, and drive engineering excellence.\n\nDemonstrated ownership mindset with a focus on reliability, quality, and business outcomes.\n\nAbout bp\nAt bp, we provide the following environment and benefits to you:\nA company culture where we respect our diverse and unified teams, where we are proud of our achievements and where fun and the attitude of giving back to our environment are highly valued.\n\nPossibility to join our social communities and networks\n\nLearning opportunities and other development opportunities to craft your career path\n\nLife and health insurance, medical care package\n\nAnd many other benefits. We are an equal opportunity employer and value diversity at our company. We do not discriminate based on race, religion, colour, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, perform crucial job functions, and receive other benefits and privileges of employment.\nTravel Requirement\nNo travel is expected with this roleRelocation Assistance:\nThis role is not eligible for relocationRemote Type:\nThis position is a hybrid of office/remote workingSkills:\nCloud Platforms, Cloud Platforms, Collaboration, Communication, Configuration management and release, Continuous deployment and release, Creating a high performing team, Database Design, Digital Project Management, Documentation and knowledge sharing, Emerging technology monitoring, Facilitation, Information Security, Mentoring, Metrics definition and instrumentation, NoSql data modelling, Problem Solving, Relational Data Modeling, Risk Management, Scripting, Secure development, Service operations and resiliency, Software Design and Development, Solution Architecture, Source control and code management {+ 5 more}.\n\n Legal Disclaimer:\nWe are an equal opportunity employer. We do not discriminate on the basis of protected characteristics like race, religion, color, sex, national origin, sexual orientation, veteran status or disability status. Individualswith an accessibility need may request an adjustment/accommodationrelated to bp’s recruiting process (e.g., accessing the job application, completing required assessments, participating in telephone screenings or interviews, etc.). If you would like to request an adjustment/accommodationrelated to the recruitment process, please contact us.\nIf you are selected for a position and depending upon your role, your employment may be contingent upon adherence to local policy. This may include pre-placement drug screening, medical review of physical fitness for the role, and background checks.","description_format":"text","description_chars":6951,"description_truncated":false,"requirements":{"experience_years_min":8,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Health insurance","Relocation assistance"],"hiring_locations":[{"name":"Malaysia","iso":"MY","kind":"country"}],"hiring_excludes":[],"relocation_offered":true,"industries":["Fossil Fuels","Oil & Gas"],"lifecycle":[{"event":"open","at":"2026-10-20T07:05:57Z"}],"visa":[],"liveness":{"score":75,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.833,"p_room":0.9,"age_days":6,"expected_fill_days":11,"reasons":["conf:1","win:mid","comp:brand"],"computed_at":"2026-10-21T04:58:20Z"},"pay":null,"html_url":"https://alion.io/job/bp-senior-data-engineer-4","json_url":"https://alion.io/job/bp-senior-data-engineer-4.json","meta":{"generated_at":"2026-10-21T04:58:20Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":7329,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-22T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":2557},"rest":"https://alion.io/mcp/rest/get_company?id=2557"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fbp-senior-data-engineer-4"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fbp-senior-data-engineer-4"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fbp-senior-data-engineer-4"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/bp-senior-data-engineer-4\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fbp-senior-data-engineer-4"}]}