Publications

• Sorted by Date • Classified by Publication Type • Classified by Research Category •

Policy Space Response Oracles: A Survey

Ariyan Bighashdel, Yongzhao Wang, Stephen McAleer, Rahul Savani, and Frans A. Oliehoek. Policy Space Response Oracles: A Survey. In Proceedings of the 33rd International Joint Conference on Artificial Intelligence (IJCAI), International Joint Conferences on Artificial Intelligence Organization, August 2024. Survey Track

Download

pdf [301.6kB]  

Abstract

Game theory provides a mathematical way to study the interaction between multiple decision makers. However, classical game-theoretic analysis is limited in scalability due to the large number of strategies, precluding direct application to more complex scenarios. This survey provides a comprehensive overview of a framework for large games, known as Policy Space Response Oracles (PSRO), which holds promise to improve scalability by focusing attention on sufficient subsets of strategies. We first motivate PSRO and provide historical context. We then focus on the strategy exploration problem for PSRO: the challenge of assembling effective subsets of strategies that still represent the original game well with minimum computational cost. We survey current research directions for enhancing the efficiency of PSRO, and explore the applications of PSRO across various domains. We conclude by discussing open questions and future research.

BibTeX Entry

@inproceedings{Bighashdel24IJCAI,
    author =    {Bighashdel, Ariyan and 
                 Wang, Yongzhao and
                 McAleer, Stephen and
                 Savani, Rahul and
                 Oliehoek, Frans A.},
    title =     {Policy Space Response Oracles: A Survey},
    booktitle = IJCAI24,
    publisher = {International Joint Conferences on Artificial Intelligence Organization},
    note      = {Survey Track},
    year =      2024,
    month =     aug,
    keywords =   {refereed},
    abstract = {
        Game theory provides a mathematical way to study the interaction between
        multiple decision makers. However, classical game-theoretic analysis is
        limited in scalability due to the large number of strategies,
        precluding direct application to more complex scenarios. This survey
        provides a comprehensive overview of a framework for large games, known
        as Policy Space Response Oracles (PSRO), which holds promise to improve
        scalability by focusing attention on sufficient subsets of strategies.
        We first motivate PSRO and provide historical context. We then focus on
        the strategy exploration problem for PSRO: the challenge of assembling
        effective subsets of strategies that still represent the original game
        well with minimum computational cost. We survey current research
        directions for enhancing the efficiency of PSRO, and explore the
        applications of PSRO across various domains. We conclude by discussing
        open questions and future research.      
    }
}

Generated by bib2html.pl (written by Patrick Riley) on Tue Jun 25, 2024 12:39:45 UTC