Chatbots and Art Critique: A Comparative Study of Chatbot and Human Experts in Traditional Chinese Painting Education

Jinyu Liu, Effie Lai-Chong Law and Hubert P. H. Shum
Proceedings of the 2024 Nordic Conference on Human-Computer Interaction (NordiCHI), 2024

Chatbots and Art Critique: A Comparative Study of Chatbot and Human Experts in Traditional Chinese Painting Education

Abstract

Driven by the recent incorporation of chatbots into art education, art critique as a key factor in this realm poses distinct challenges and opportunities for this technology intervention. This study investigates the efficacy of chatbot-generated critiques in art education and compares them to critiques from human specialists. We conducted an empirical analysis by evaluating both chatbot and human critiques of traditional Chinese paintings, focusing on "The Four Gentlemen", plum, orchid, bamboo, and chrysanthemum, representative themes in traditional Chinese art (Figure 1). Traditional Chinese paintings provide an ideal subject for this research owing to their metaphorical meanings and cultural depth, which provides a complex context for evaluating the nuanced capabilities of chatbots and human critiques. Our analysis looked into several critical dimensions of critique quality. The preliminary results suggest that while chatbot critiques are detailed and relevant, they lack the depth and emotional engagement that are characteristic in human critiques. Human critiques appeared to be way more nuanced and contextual with more emphasis on the symbolic and cultural layers of the artwork. The findings of this research signify that chatbots can play a role in art education and elevate the learning experience through immediate and structured critique. However, they are not able to replace the deeper insights offered from human critiques. Accordingly, this study recommends a hybrid approach: chatbots act as a supplementary pedagogical role, enriching art education and critique. The conclusions suggest further research into the integration of chatbots within art educational settings is needed, encouraging refinement of the design and application of chatbots in creative domains.


Downloads


YouTube


Cite This Research

Plain Text

Jinyu Liu, Effie Lai-Chong Law and Hubert P. H. Shum, "Chatbots and Art Critique: A Comparative Study of Chatbot and Human Experts in Traditional Chinese Painting Education," in NordiCHI '24: Proceedings of the 2024 Nordic Conference on Human-Computer Interaction, pp. 50, Uppsala, Sweden, ACM, 2024.

BibTeX

@inproceedings{liu24chatbots,
 author={Liu, Jinyu and Law, Effie Lai-Chong and Shum, Hubert P. H.},
 booktitle={Proceedings of the 2024 Nordic Conference on Human-Computer Interaction},
 series={NordiCHI '24},
 title={Chatbots and Art Critique: A Comparative Study of Chatbot and Human Experts in Traditional Chinese Painting Education},
 year={2024},
 pages={50},
 numpages={13},
 doi={10.1145/3679318.3685385},
 isbn={9.80E+12},
 publisher={ACM},
 location={Uppsala, Sweden},
}

RIS

TY  - CONF
AU  - Liu, Jinyu
AU  - Law, Effie Lai-Chong
AU  - Shum, Hubert P. H.
T2  - Proceedings of the 2024 Nordic Conference on Human-Computer Interaction
TI  - Chatbots and Art Critique: A Comparative Study of Chatbot and Human Experts in Traditional Chinese Painting Education
PY  - 2024
SP  - 50
EP  - 50
DO  - 10.1145/3679318.3685385
SN  - 9.80E+12
PB  - ACM
ER  - 


Supporting Grants


Similar Research

Jinyu Liu, Effie Lai-Chong Law and Hubert P. H. Shum, "Exploring Artists’ and Art Viewers' Perspectives for Art Chatbots: Implications for a Design Framework ", Proceedings of the 2025 ACM Conversational User Interfaces Conference (CUI), 2025

HomeGoogle ScholarYouTubeLinkedInTwitter/XGitHubORCIDResearchGateEmail
 
Print