Semantic Meaning & Analysis

See Related Papers and Related Projects:
## AI-based Exploration of Art and Design ## AI Anonymization ## AI Cognitive Creativity
## Sensing Humans (Bio/Brain/Face/Movement/VR) ## AI Modeling Thought & Language

Reseachers: Steve DiPaola, Suk Choi, Meehae Song, Nouf Abukhodair, Vanessa Utz

The Research: Early Deep Learning systems are trained on huge datasets including text/image pairs that while can embed simple meaning, are still mainly trained on nouns like people, things, … Our main research area is to go beyond that to deeper Semantic Meaning & Analysis work . Which parses and models more multimodal and deeper semantic meaning to AI work. We do this by both analyzing meaning space ( cognitive science of the arts, gesture, emotion, empathy, creativity, behavior, …) but also then build models from cognitively and rigorously mapping these spaces that we can then use in our new emerging systems (with application in health, the arts, and education.

Our work into a new method to understand, measure and model “aesthic emotion” (see studies and papers) Reverse engineering generative visual Ai systems to better understand current meaning making to improve them. Here an emotionally complex prompt “an angry man punching a bag in a crowded joyful gym” and diffusion based output where we then used an advanced system to reverse detect and heatmap the meaning of every word back through the system Deep studies with eye tracking, on how an art viewer perceives (cognitively) artwork where we AI redraw masterwork (switch left/right eye detail & lost and found edges near chin). See several papers and over 200 press articles on our findings - like this one Magic of Rembrandt’s Painting Technique Revealed. Additional studies on deep meaning in aesthics, emotions, creativity, empathy, … ( see papers).

—— PAPERS: Semantic Meaning & Analysis ——

by Abukhodair N; Song M; DiPaola S – Journal – 23 pages
Cognitive Systems Research (2023)

by Kitson A; DiPaola S; Riecke B – Conference – Paper LBW1322. 6 pages
ACM CHI Conference on Human Factors in Computing Systems (CHI) (2019)

by Quesnel D; DiPaola S; Rieke B – Conference – pp. 6-11
Semantic Ambient Media Experiences (SAME); Artificial Intelligence MEETS Virtual and Augmented Worlds (AIVR) with SIGGRAPH Asia (2018)

by Feldman S; Yalcin ON; DiPaola S – Conference – British Computer Society. pp. 296-303
Electronic Visualisation and the Arts (EVA) (2017)

by Salevati S; DiPaola S; Carlson K – Conference – British Computer Society. 8 pages. London
Electronic Visualisation and the Arts (EVA) (2016)

by Choi S K; DiPaola S – Conference – pp. 579-588
ACM Conf on Human Factors in Computing Systems (CHI) (2015)

by Salevati S; DiPaola S – Conference – British Computer Society. 8 pages. London
Electronic Visualisation and the Arts (EVA) (2015)

by Salevati M; DiPaola S – Conference – British Computer Society. 8 pages. London
Electronic Visualisation and the Arts (EVA) (2015)

by DiPaola S – Journal – Special Issue; Bio Inspired Cognitive Architectures. Vol 41. pp. 212-219
Procedia Computer Science (2014)

by DiPaola S – Book – Bowen. Keene. Ng. (Eds). pp. 213-227. Springer
Book Chapter. Electronic Visualisation in Arts and Culture (2013)

by Bizzocchi J; Nixon M; DiPaola S; Funk N – Conference – Atlanta. Georgia. pp. 161-197
Digital Games Research Association Conference (DIGRA) (2013)

by Choi S K; DiPaola S – Conference – British Computer Society. pp. 127-134. London
Electronic Visualisation and the Arts (EVA) (2013)

by Gabora L; DiPaola S – Conference – pp. 203-211
International Conference on Computational Creativity (ICCC) (2012)

by Seifi H; DiPaola S; Enns JT – Conference – pp. 89-97
International Symposium on Computational Aesthetics in Graphics; Visualization & Imaging (2012)

by DiPaola S; Smith A – Conference – 6 pages
Conceptual Structure; Discourse and Language (2012)

by Choi S K; DiPaola S; Schiphorst T – Conference – 6 pages
Conceptual Structure; Discourse and Language (2012)

by DiPaola S; Riebe C; Enns JT – Journal – Vol 43. No 3. pp. 145-151
Leonardo (2011)

by Riebe C; DiPaola S; Enns JT – Journal – Vol 9. No 8. pp. 368-368 (abstract)
Journal of Vision (2009)

by DiPaola S; Gabora L – Journal – Vol 10. No 2. pp. 97-110
Genetic Programming and Evolvable Machines Journal (2009)

by Riebe C; DiPaola S; Enns JT – Conference – 9th Annual Meeting.
Abstracts of the Vision Sciences Society (2009)

by DiPaola S – Conference – 6 pages
SPIE Human Vision and Imaging. Int. Society for Optical Engineering (2009)

by DiPaola S – Journal – Images of my research in computer model of evolution ? selected by the Nature editors to accompany this essay (invited - not peer reviewed). Vol 451. pp. 632-633
The Journal Nature (2008)

by DiPaola S – Conference – British Computer Society. 8 pages. London
Electronic Visualisation and the Arts (EVA) (2008)

by DiPaola S; Arya A – Conference – pp. 143-149
ACM SIGGRAPH - Symposium on Videogames (2006)

by DiPaola S – Conference – 7 pages
International Digital Media and Arts Association (IDMA) (2006)

by DiPaola S; Arya A; Chan J – Conference – 6 pages. Vancouver
E-Learn 2005 (2005)

by Tolmie J; DiPaola S; Charles A – Conference – Vancouver
Digital Games Research Association (2005)

by DiPaola S; Arya A – Conference – British Computer Society. 8 pages. London
Electronic Visualisation and the Arts (EVA) (2004)

by DiPaola S – Conference – pp. 207-207
ACM SIGGRAPH - Conference Abstracts and Applications (2002)