Improving reinforcement learning by using case based heuristics
dc.contributor.author | Reinaldo Bianchi | |
dc.contributor.author | ROS, R. | |
dc.contributor.author | LOPES, DE M. R. | |
dc.contributor.authorOrcid | https://orcid.org/0000-0001-9097-827X | |
dc.date.accessioned | 2022-01-12T22:04:35Z | |
dc.date.available | 2022-01-12T22:04:35Z | |
dc.date.issued | 2009-07-23 | |
dc.description.abstract | This work presents a new approach that allows the use of cases in a case base as heuristics to speed up Reinforcement Learning algorithms, combining Case Based Reasoning (CBR) and Reinforcement Learning (RL) techniques. This approach, called Case Based Heuristically Accelerated Reinforcement Learning (CB-HARL), builds upon an emerging technique, the Heuristic Accelerated Reinforcement Learning (HARL), in which RL methods are accelerated by making use of heuristic information. CB-HARL is a subset of RL that makes use of a heuristic function derived from a case base, in a Case Based Reasoning manner. An algorithm that incorporates CBR techniques into the Heuristically Accelerated Q-Learning is also proposed. Empirical evaluations were conducted in a simulator for the RoboCup Four-Legged Soccer Competition, and results obtained shows that using CB-HARL, the agents learn faster than using either RL or HARL methods. © 2009 Springer Berlin Heidelberg. | |
dc.description.firstpage | 75 | |
dc.description.lastpage | 89 | |
dc.description.volume | 5650 LNAI | |
dc.identifier.citation | BIANCHI, R.; ROS, R.; LOPES, DE M. R. Improving reinforcement learning by using case based heuristics. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). p. 75-89, July, 2009. | |
dc.identifier.doi | 10.1007/978-3-642-02998-1_7 | |
dc.identifier.issn | 0302-9743 | |
dc.identifier.uri | https://repositorio.fei.edu.br/handle/FEI/4281 | |
dc.relation.ispartof | Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) | |
dc.rights | Acesso Restrito | |
dc.title | Improving reinforcement learning by using case based heuristics | |
dc.type | Artigo de evento | |
fei.scopus.citations | 34 | |
fei.scopus.eid | 2-s2.0-70350352555 | |
fei.scopus.subject | Case base | |
fei.scopus.subject | Case based | |
fei.scopus.subject | CBr | |
fei.scopus.subject | Empirical evaluations | |
fei.scopus.subject | Heuristic functions | |
fei.scopus.subject | Heuristic information | |
fei.scopus.subject | New approaches | |
fei.scopus.subject | Q-learning | |
fei.scopus.subject | Reinforcement learning techniques | |
fei.scopus.subject | RoboCup | |
fei.scopus.subject | Speed-ups | |
fei.scopus.updated | 2024-07-01 | |
fei.scopus.url | https://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=70350352555&origin=inward |