National Gallery and IDS Developed Intelligent GalleryBot Using NLP
“Chatbot Arthena” Video
The Arthena chatbot was deployed through the Facebook messenger for the National Gallery Singapore’s “Georgette Chen: At Home in the World” exhibition from 27 November 2020 to 26 September 2021. Arthena employed “evoking” questions manually crafted by Gallery experts for this exhibition. Based on a user study with Arthena, IDS designed ArtQuest, our quiz-based interactive aid for artworks that uses questions on artistic and visual elements of paintings for interacting with gallery visitors. PaintTeR, the novel algorithm used in ArtQuest effectively combines information from a paintings lexicon with large-scale word co-occurrence graphs to extract text spans from expert-written artwork passages that are subsequently used to generate art-centered questions for interactions with gallery visitors.
Below is the presentation by IDS Senior Research Fellow Dr Sujatha Das Gollapalli on “PaintTeR: Automatic Extraction of Text Spans for Generating Art-Centered Questions”, which has been published as part of the proceedings of 34th AAAI Conference on Artificial Intelligence (AAAI-22).
This research is supported by the National Research Foundation, Prime Minister’s Office, Singapore under its Industry Alignment Fund (Pre-positioning) Funding Initiative.