{"id":481376,"url":"https://alion.io/job/phaidra-phd-studentship-causal-reinforcement-learning","title":"PhD Studentship: Causal Reinforcement Learning","company":{"id":10641,"name":"Phaidra","domain":"phaidra.ai","url":"https://alion.io/company/phaidra","size_band":"51-200","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Greenhouse","truth_index":{"grade":"B","score":75,"open_postings":5,"ghost_share":0,"stale_share":1,"repost_share":0,"time_to_fill_p50_days":null,"computed_at":"2026-10-31T05:58:55Z"}},"role":"Early Careers","role_family":"Early Careers","seniority":null,"employment_type":null,"work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"posting_text","remote_working_hours":null,"hiring_geo_confidence":"explicit","locations":["Cambridge, United Kingdom"],"countries":["GB"],"hiring_countries":["US"],"hiring_countries_total":1,"salary":null,"salary_estimate":{"min_usd":38000,"max_usd":62000,"period":"year","method":"role_country_seniority_unknown","sample_n":248},"experience_years_min":null,"visa_sponsorship":true,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"Machine Learning","optional":false},{"name":"NumPy","optional":false},{"name":"Python","optional":false},{"name":"PyTorch","optional":false},{"name":"Reinforcement Learning","optional":false},{"name":"Scikit-learn","optional":false},{"name":"SciPy","optional":false},{"name":"GitLab","optional":true},{"name":"Slack","optional":true}],"status":"live","first_seen_at":"2026-07-17T20:26:02Z","employer_posted_date":"2026-07-22","last_verified_at":"2026-10-31T18:13:19Z","board_verified":true,"closed_at":null,"days_open":105,"trust":{"level":"stale","repost_count":0,"flags":["stale"],"days_open":105},"description":"About Phaidra\nPhaidra is building the future of industrial automation.\nThe world today is filled with static, monolithic infrastructure. Factories, power plants, buildings, etc. operate the same they've operated for decades - because the controls programming is hard-coded. Thousands of lines of rules and heuristics that define how the machines interact with each other. The result of all this hard-coding is that facilities are frozen in time, unable to adapt to their environment while their performance slowly degrades.\nPhaidra creates AI-powered control systems for the industrial sector, enabling industrial facilities to automatically learn and improve over time. Specifically:\nWe use reinforcement learning algorithms to provide this intelligence, converting raw sensor data into high-value actions and decisions.\nWe focus on industrial applications, which tend to be well-sensorized with measurable KPIs - perfect for reinforcement learning.\nWe enable domain experts (our users) to configure the AI control systems (i.e. agents) without writing code. They define what they want their AI agents to do, and we do it for them.\nOur team has a track record of applying AI to some of the toughest problems. From achieving superhuman performance with DeepMind's AlphaGo, to reducing the energy required to cool Google's Data Centers by 40%, we deeply understand AI and how to apply it in production for massive impact.\nPhaidra’s ability to achieve its mission is determined by our ability to work together - as defined by our core values: Agency, Velocity, Craft, and Truth. We seek individuals who embody these values, as they are instrumental in ensuring our team consistently delivers excellence and fosters an engaging and supportive culture\nPhaidra is based in the USA, but we are 100% remote with no physical office. We hire employees internationally with the help of our partner, OysterHR. Our team is currently located throughout the USA, Canada, UK, Sweden, Spain, Portugal, the Netherlands, Singapore, Australia, and India.\nAbout the Project\nPhaidra builds autonomous AI control systems for data centre and industrial infrastructure. We deploy reinforcement learning in production on some of the world's most complex physical systems. The hard, unsolved research problems are the same ones that matter in practice. This studentship is an opportunity to work on foundational RL research while staying grounded in real-world challenges.\nReinforcement Learning (RL) has emerged as a powerful framework for sequential decision-making. Yet a fundamental limitation remains: agents trained on historical data under fixed policies often exploit spurious correlations that break at deployment time, especially when the environment shifts or the new policy explores previously unseen regions of the state-action space.\nThis PhD project tackles that limitation by integrating causal reasoning into RL. Causal inference provides a formal language (causal graphs, interventional queries, counterfactuals) for distinguishing stable structural relationships from incidental correlations. The research will investigate how these tools can make RL agents more robust and generalizable, particularly in real-world industrial settings.\nThe project will proceed in three phases:\nTheoretical Foundations: formalising policy learning from biased, small datasets through a causal lens; characterising how confounding and mediators affect offline RL.\n\nAlgorithm Development: building RL algorithms that leverage known or learned causal structure to improve out-of-distribution generalisation and provide policy guarantees.\n\nBenchmarking & Evaluation: evaluating proposed methods on controlled simulated environments with known causal structure, benchmarked against standard and offline RL baselines.\n\nSupervisors\nAcademic Supervisor: Prof. Alessandro Abate, Department of Engineering, University of Cambridge\n\nIndustrial Co-supervisors: Dr. Miguel Suau and Dr. Alec Edwards, Phaidra\n\nThe student will be based primarily at the University of Cambridge, with the opportunity to spend time at Phaidra.\nFunding & Duration\nThis is a fully funded 4-year PhD studentship, expected to start January 2027, co-funded by Phaidra and administered by the University of Cambridge.\nWho You Are\nYou are a curious and technically rigorous researcher who wants to work at the intersection of causal inference and sequential decision-making. You are excited by foundational questions with real-world stakes and want your PhD to contribute both to the academic literature and to the practical deployment of intelligent systems.\nKey Qualifications\nA first-class or upper second-class honours degree (or equivalent) in Computer Science, Mathematics, Engineering, Statistics, or a related technical field.\nStrong background in at least one of: reinforcement learning, machine learning, probabilistic modelling, or control theory.\nProficiency in Python and standard ML libraries (PyTorch, NumPy, SciPy, scikit-learn).\nClear scientific writing skills and the ability to communicate research to both academic and applied audiences.\nEligibility to study at the University of Cambridge (international students welcome; English language requirements apply).\nPreferred Skills & Experience\nFamiliarity with causal inference, causal graphical models, or structural equation models.\nPrior research experience (undergraduate thesis, MSc dissertation, research internship, or publications).\nExperience with offline RL, batch RL, or safe RL.\nExposure to applying ML to real-world physical or industrial systems.\nHow to Apply\nThere are two parallel steps, both required:\nApply through Phaidra's careers portal at https://job-boards.greenhouse.io/phaidra. You will be asked to submit a CV and a short cover letter describing your research interests and motivation.\nApply to the University of Cambridge through the postgraduate application portal for the PhD in Engineering programme. Name Prof. Alessandro Abate as your proposed supervisor and reference this studentship in your application. You are also encouraged to email Prof. Abate directly at  with your CV and a one-page statement of research interest.\nBoth applications must be submitted. We encourage you to apply as soon as possible. Applications close 30 July 2026.\nThe studentship is expected to start January 2027.\nInterview Process\nTechnical and research discussion with an industrial supervisor (60 minutes)\nMeeting with the academic supervisor (60 minutes)\nBenefits & Perks\nFast-paced, team-oriented environment where your work directly shapes the company’s direction.\nWe are a 100% remote company. \nCompetitive compensation & meaningful equity.\nOutsized responsibilities & professional development.\nTraining is foundational; functional, customer immersion, and development training.\nMedical, dental, and vision insurance (exact benefits vary by region).\nUnlimited paid time off, with a required minimum of 20 days per year.\nPaid parental leave (exact benefits vary by region).\nFlexible stipends to support your workspace, well-being, and continued professional development.\nCompany MacBook.\nPlease note: Not all of Phaidra’s benefits and perks listed above apply to temporary employees such as interns.\nOn being Remote\nWe take a thoughtful and intentional approach to remote collaboration. Inspired by pioneers like GitLab, we embrace proven best practices to foster an exceptional remote work environment. Our culture is documentation-first, and we prioritize asynchronous communication to support focus and flexibility across time zones. While we value independence, we stay closely connected through tools like Slack and video conferencing. Weekly all-hands meetings help us align and build strong relationships, and we regularly host virtual team-building activities and social events to maintain a sense of camaraderie.\nEqual Opportunity Employment\nPhaidra is an Equal Opportunity Employer; employment with Phaidra is governed on the basis of merit, competence, and qualifications and will not be influenced in any manner by race, color, religion, gender, national origin/ethnicity, veteran status, disability status, age, sexual orientation, gender identity, marital status, mental or physical disability, or any other legally protected status. We welcome diversity and strive to maintain an inclusive environment for all employees. If you need assistance with completing the application process, please contact us at .\nE-Verify Notice\nPhaidra participates in E-Verify, an employment authorization database provided through the U.S. Department of Homeland Security (DHS) and Social Security Administration (SSA). As required by law, we will provide the SSA and, if necessary, the DHS, with information from each new employee’s Form I-9 to confirm work authorization for those residing in the United States.\nAdditional information about E-Verify can be found here.\n#LI-Remote\nTo be considered for any position at Phaidra, you must submit an online application. This role will remain open until it is filled.\nPhaidra only hires individuals who are legally authorized to work in the specified location(s) above. We do not provide employment sponsorship. Candidates requiring visa sponsorship, either now or in the future, are not eligible for hire.\nCandidates who advance beyond the initial screening stage will be required to sign a Non-Disclosure Agreement (NDA) in order to continue through the interview process.\nAll employment offers are contingent upon successful completion of employment authorization verification and applicable background checks, in accordance with local laws and company policies.\nWE DO NOT ACCEPT APPLICATIONS FROM RECRUITERS.","description_format":"text","description_chars":9708,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"phd","optional":false},"security_clearance":false,"languages":[{"language":"English","level":"All levels","optional":false}]},"benefits":["Apple Macbook","Equity","Parental leave","Professional development","Vision insurance"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Industrial AI","Energy AI"],"lifecycle":[{"event":"open","at":"2026-09-06T16:43:15Z"}],"visa":[{"country":"GB","licensed_sponsor":true,"evidence":"Licensed UK visa sponsor (Skilled Worker)","filings_12m":null,"filings_prev_12m":null,"green_card_filings_12m":null,"median_offered_wage_usd":null,"route":"Skilled Worker","cap_exempt":false,"checked_at":"2026-10-31T06:23:40+00:00","sources":["UK Home Office: register of licensed sponsors (workers)"],"filings_for_role_12m":0}],"liveness":{"score":10,"band":"cold","label":"Long shot","p_open":1,"p_active":0.359,"p_room":0.28,"age_days":105,"expected_fill_days":35,"reasons":["conf:2","win:tail","crowd:"],"computed_at":"2026-10-31T05:58:55Z"},"pay":null,"html_url":"https://alion.io/job/phaidra-phd-studentship-causal-reinforcement-learning","json_url":"https://alion.io/job/phaidra-phd-studentship-causal-reinforcement-learning.json","meta":{"generated_at":"2026-10-31T18:56:45Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":29695,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-01T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":10641},"rest":"https://alion.io/mcp/rest/get_company?id=10641"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fphaidra-phd-studentship-causal-reinforcement-learning"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fphaidra-phd-studentship-causal-reinforcement-learning"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fphaidra-phd-studentship-causal-reinforcement-learning"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/phaidra-phd-studentship-causal-reinforcement-learning\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fphaidra-phd-studentship-causal-reinforcement-learning"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":481376}},{"tool":"search_jobs","arguments":{"company":"phaidra.ai","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":481376},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}