Home   >   CSC-OpenAccess Library   >    Manuscript Information
Full Text Available

This is an Open Access publication published under CSC-OpenAccess Policy.
Publications from CSC-OpenAccess Library are being accessed from over 74 countries worldwide.
Affect Sensing and Contextual Affect Modeling from Improvisational Interaction
Li Zhang
Pages - 45 - 60     |    Revised - 31-01-2011     |    Published - 08-02-2011
Volume - 1   Issue - 4    |    Publication Date - January / February  Table of Contents
Affect Detection, Context Profiles, An Intelligent Conversational Agent
We report work on adding an improvisational AI actor to an existing virtual improvisational environment, a text-based software system for dramatic improvisation in simple virtual scenarios, for use primarily in learning contexts. The improvisational AI actor has an affect-detection component, which is aimed at detecting affective aspects (concerning emotions, moods, value judgments, etc.) of human-controlled characters’ textual “speeches”. The AI actor will also make an appropriate response based on this affective understanding, which intends to stimulate the improvisation. The work also accompanies basic research into how affect is conveyed linguistically. A distinctive feature of the project is a focus on the metaphorical ways in which affect is conveyed. Moreover, we have also introduced affect detection using context profiles. Finally, we have reported user testing conducted for the improvisational AI actor and evaluation results of the affect detection component. Our work contributes to the journal themes on affective user interfaces, affect sensing and improvisational or dramatic natural language interaction.
CITED BY (2)  
1 Ptaszynski, M., Dybala, P., Mazur, M., Rzepka, R., Araki, K., & Momouchi, Y. (2013). Towards Computational Fronesis: Verifying Contextual Appropriateness of Emotions. International Journal of Distance Education Technologies (IJDET), 11(2), 16-47.
2 Ptaszynski, M. Taking Affect Analysis One Step Higher: The Idea of Contextual Appropriateness of Emotions and Its Perspectives.
1 Google Scholar 
2 CiteSeerX 
3 Scribd 
4 SlideShare 
5 PdfSR 
1 R.W. Picard. “Affective Computing”. The MIT Press. Cambridge MA. 2000
2 A. Ortony, G.L. Clore & A. Collins. “The Cognitive Structure of Emotions”. Cambridge U.Press. 1998
3 A. Egges, S. Kshirsagar & N. Magnenat-Thalmann. “A Model for Personality and Emotion Simulation”, In Proceedings of Knowledge-Based Intelligent Information & Engineering Systems (KES2003), Lecture Notes in AI. Springer-Verlag: Berlin. 2003
4 R.S. Aylett, J. Dias and A. Paiva. “An affectively-driven planner for synthetic characters”. In Proceedings of ICAPS. 2006
5 Nogueiras et al. “Speech emotion recognition using hidden Markov models”. In Proceedings of Eurospeech 2001, Denmark. 2001.
6 M. Pantic, A. Pentland, A. Nijholt and T. Huang. “Human Computing and Machine Understanding of Human Behavior: A Survey”. In Proc. Int’l Conf. Multimodal Interfaces, pp.239-248. 2006
7 M. Mateas. Ph.D. Thesis. “Interactive Drama, Art and Artificial Intelligence”. School of Computer Science, Carnegie Mellon University. 2002
8 X. Zhe & A.C. Boucouvalas. “Text-to-Emotion Engine for Real Time Internet Communication”.In Proceedings of International Symposium on Communication Systems, Networks and DSPs,Staffordshire University, UK, pp 164-168. 2002
9 D. Watson & A. Tellegen. “Toward a Consensual Structure of Mood”. Psychological Bulletin,98, 219-235. 1985
10 P. Ekman. “An Argument for Basic Emotions”. In Cognition and Emotion, 6, 169-200. 1992
11 L. Zhang, J.A. Barnden, R.J. Hendley & A.M. Wallington. “Developments in Affect Detection in E-drama”. In Proceedings of EACL 2006, 11th Conference of the European Chapter of the Association for Computational Linguistics, 2006, Trento, Italy. pp. 203-206. 2006
12 E. Briscoe and J. Carroll. “Robust Accurate Statistical Annotation of General Text”. In Proceedings of the 3rd International Conference on Language Resources and Evaluation, Las Palmas, Gran Canaria. 1499-1504. 2002
13 D.R. Heise. “Semantic Differential Profiles for 1,000 Most Frequent English Words”.Psychological Monographs. 70 8:(Whole 601). 1965
14 S. Fussell & M. Moss. “Figurative Language in Descriptions of Emotional States”. In S. R.Fussell and R. J. Kreuz (Eds.), Social and cognitive approaches to interpersonal communication. Lawrence Erlbaum. 1998
15 Z. Kövecses. “Are There Any Emotion-Specific Metaphors?” In Speaking of Emotions:Conceptualization and Expression. Athanasiadou, A. and Tabakowska, E. (eds.), Berlin and New York: Mouton de Gruyter, 127-151. 1998
16 J. Barnden, S. Glasbey, M. Lee & A. Wallington. “Varieties and Directions of Inter-Domain Influence in Metaphor”. Metaphor and Symbol, 19(1), 1-30. 2004
17 J.A. Barnden. “Metaphor, Semantic Preferences and Context-sensitivity”. Invited chapter for a Festschrifft volume. Kluwer. 2006
18 C. Strapparava and A. Valitutti. “WordNet-Affect: An Affective Extension of WordNet”, In Proceedings of the 4th International Conference on Language Resources and Evaluation (LREC 2004), Lisbon, Portugal, 1083-1086. 2004
19 P. Rayson. “Matrix: A statistical method and software tool for linguistic analysis through corpus comparison”. Ph.D. thesis, Lancaster University. 2003
20 C. Fellbaum. “WordNet, an Electronic Lexical Database”. The MIT press. 1998
21 D. Sperber & D. Wilson. “Relevance: Communication and cognition (2nd ed.)”. Oxford, UK:Blackwell. 1995.
22 D. Wilson & D. Sperber. “Relevance Theory”. In G.Ward & L. Horn (Eds.), Handbook of Pragmatics (pp. 607–632). Oxford, UK: Blackwell. 2003.
23 M. Gillies, I.B. Crabtree and D. Ballin. “Individuality and Contextual Variation of Character Behaviour for Interactive Narrative”. In Proceedings of the AISB Workshop on Narrative AI and Games. 2006
24 J. Carletta. “Assessing Agreement on Classification Tasks: The Kappa statistic.”Computational Linguistics, 22 (2), pp.249-254. 1996
25 L. Zhang, M. Gillies, K. Dhaliwal, A. Gower, D. Robertson & B. Crabtree. “E-drama:Facilitating Online Role-play using an AI Actor and Emotionally Expressive Characters”.International Journal of Artificial Intelligence in Education. Vol 19(1), pp.5-38. 2009
26 J.M. Lopez, R. Gil, R., Garcia, I. Cearreta and N. Garay. “Towards an Ontology for Describing Emotions”. In WSKS '08 Proceedings of the 1st world summit on The Knowledge Society:Emerging Technologies and Information Systems for the Knowledge Society. 2008.
Dr. Li Zhang
Teesside University - United Kingdom