Protocols from perceptual observations

dc.contributor.authorNeedham C.J.
dc.contributor.authorSantos P.E.
dc.contributor.authorMagee D.R.
dc.contributor.authorDevin V.
dc.contributor.authorHogg D.C.
dc.contributor.authorCohn A.G.
dc.date.accessioned2019-08-19T23:45:18Z
dc.date.available2019-08-19T23:45:18Z
dc.date.issued2005
dc.description.abstractThis paper presents a cognitive vision system capable of autonomously learning protocols from perceptual observations of dynamic scenes. The work is motivated by the aim of creating a synthetic agent that can observe a scene containing interactions between unknown objects and agents, and learn models of these sufficient to act in accordance with the implicit protocols present in the scene. Discrete concepts (utterances and object properties), and temporal protocols involving these concepts, are learned in an unsupervised manner from continuous sensor input alone. Crucial to this learning process are methods for spatio-temporal attention applied to the audio and visual sensor data. These identify subsets of the sensor data relating to discrete concepts. Clustering within continuous feature spaces is used to learn object property and utterance models from processed sensor data, forming a symbolic description. The progol Inductive Logic Programming system is subsequently used to learn symbolic models of the temporal protocols presented in the presence of noise and over-representation in the symbolic data input to it. The models learned are used to drive a synthetic agent that can interact with the world in a semi-natural way. The system has been evaluated in the domain of table-top game playing and has been shown to be successful at learning protocol behaviours in such real-world audio-visual environments. © 2005 Elsevier B.V. All rights reserved.
dc.description.firstpage103
dc.description.issuenumber1-2
dc.description.lastpage136
dc.description.volume167
dc.identifier.citationNEEDHAM, Chris; SANTOS, P.;Santos, P.;P. Santos;P. E. Santos;Eduardo Santos, Paulo;Santos, Paulo E.;E Santos, Paulo;Paulo E. Santos;Paulo Santos;Santos, Paulo;SANTOS, PAULO EDUARDO; MAGGEE, Derek; V. Devin; HOGG, David; COHN, Antony. Protocols from Perceptual Observations. Artificial Intelligence, v. 167, p. 103-136, 2005.
dc.identifier.doi10.1016/j.artint.2005.04.006
dc.identifier.issn0004-3702
dc.identifier.urihttps://repositorio.fei.edu.br/handle/FEI/1193
dc.relation.ispartofArtificial Intelligence
dc.rightsAcesso Aberto
dc.subject.otherlanguageAutonomous learning
dc.subject.otherlanguageCognitive vision
dc.subject.otherlanguageInductive logic programming
dc.subject.otherlanguageSpatio-temporal reasoning
dc.subject.otherlanguageSymbol grounding
dc.subject.otherlanguageUnsupervised clustering
dc.titleProtocols from perceptual observations
dc.typeArtigo
fei.scopus.citations38
fei.scopus.eid2-s2.0-24144451788
fei.scopus.subjectAutonomous learning
fei.scopus.subjectCognitive vision
fei.scopus.subjectInductive logic programming
fei.scopus.subjectSpatio-temporal reasoning
fei.scopus.subjectSymbol grounding
fei.scopus.subjectUnsupervised clustering
fei.scopus.updated2024-03-04
fei.scopus.urlhttps://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=24144451788&origin=inward
Arquivos
Coleções