Project: Bayesian Agents in a Physical World

PIs:
Nathaniel Virgo, Specially Appointed Associate Professor, ELSI

Martin Biehl, Senior Research Scientist, Cross Labs

Period:

November 1, 2021 - July 31, 2024

Project executive summery from the PIs:

We are interested in what it means for a system to be an agent. Suppose we observe a physical system interacting with its environment. When can we view that system as an agent that is using its inputs to update its knowledge about the world and choosing actions accordingly? To some extent we have a choice about this, but to some extent we do not. Some systems can be consistently interpreted as agents, perhaps in multiple ways, while others cannot. We will systematically map the relationship between the properties of a physical system and the ways in which it can be interpreted as an agent. This will not only help us to understand the workings of the brain and our role as agents in the physical world, but also to build better artificial agents. We will study this mathematically, via what we term an ‘interpretation map’: a function that takes the state of a system and interprets it in terms of an agent’s beliefs and goals, expressed in terms of Bayesian priors. In doing this we address the Big Question “What is the relationship between mind and matter?” Both brains and most machine learning agents are built up from smaller components. This leads us to the Big Question, “how can complex agents be built up from simpler components?” We will develop a compositional theory of physical agents, which will contribute to the foundations of machine learning and neuroscience, and lead to applications in artificial intelligence. Our project will contribute to the Big Question, “why do goal-directed agents exist in the physical world?”. The concept of agency is relevant in fields as diverse as physics, biology, neuroscience, artificial life, artificial intelligence and philosophy. By making the concept precise and, in principle, testable, we will provide a common language and a body of mathematical results that will allow greater transfer of knowledge between these fields.

John Templeton Foundation:

Founded in 1987, the John Templeton Foundation supports research and catalyzes conversations that inspire people with awe and wonder. We fund work on subjects ranging from black holes and evolution to creativity, forgiveness, and free will. We also encourage civil, informed dialogue among scientists, philosophers, theologians, and the public at large. Our aspiration is to help people create lives of meaning and purpose and to become a global catalyst for discoveries that contribute to human flourishing. With an endowment of $3.8 billion and annual giving of approximately $140 million, the Foundation ranks among the 25 largest grant-making foundations in the United States. Headquartered outside Philadelphia, our philanthropic activities have engaged all major faith traditions and extended to more than 57 countries around the world.