Talking Heads & Dialog Systems




User preferences can drive facial expressions: evaluating an embodied conversational agent in a recommender dialogue system
[PDF] from hw.ac.ukME Foster... - User Modeling and User-Adapted Interaction, 2010 - Springer
... All of the experiments described here take place in the context of the COMIC multi- modal dialogue
system ("COnversational Multimodal Interaction ... tablet display or with a mouse; the output combines
synthesised speech, non-verbal behaviour of a talking head, deictic gestures ... 
Related articles - All 6 versions - Import into BibTeX


Quality of talking heads in different interaction and media contexts
B Weiss, C Kühnel, I Wechsung, S Fagel... - Speech Communication, 2010 - Elsevier
... The participants first received a short introduction and were asked four questions concerning
their experience with talking heads and spoken dialogue systems in general. The body of
experiment E1 was divided into two parts, one per-sentence part and one per-set part. ... 
Cited by 3 - Related articles - All 5 versions - Import into BibTeX


On the development of a talking head system based on the use of PDE-based parametic surfaces
M Athanasopoulos, H Ugail... - ... on computational science ..., 2011 - Springer
... Real-time dialog systems can include personality, emotions and interactive dialog in a
human-computer or computer-computer situation. ... with the use of chatterbots where actions such
as personality, emotions and respond can be integrated within the talking head system [2 ... 
Related articles - All 3 versions - Import into BibTeX


Multi-modal dialogue system with sign language capabilities
M Hrúz, P Campr, Z Krnoul, M Železný... - The proceedings of the ..., 2011 - dl.acm.org
... the concatenation that puts together trajectories of hands with the articulatory trajectories
generated by the talking head system and provides the control over a signed utterance. Reader
can find more details in [2]. 4. CONCLUSION We have presented a dialogue system with SL ... 
Related articles - Import into BibTeX


Realistic facial expression synthesis for an image-based talking head
K Liu... - Multimedia and Expo (ICME), 2011 IEEE ..., 2011 - ieeexplore.ieee.org
... information services and video games has been the focus of the computer graphics community
in recent years [1]. These applications will use facial animation techniques combined with dialog
systems extensively in the future [2]. The current image-based talking heads [2] [3 ... 
Cited by 1 - Related articles - Import into BibTeX


Quality of Experiencing Multi-Modal Interaction
B Weiss, S Möller, I Wechsung... - Spoken Dialogue Systems ..., 2011 - Springer
... Other factors have also an significant impact on over- all quality of talking heads: Ie overall system
quality, how entertaining the embodiment is due to non ... The last scenario presented here are
multi-modal dialog systems which can be controlled by different input modalities. ... 
Related articles - Import into BibTeX


Animated Faces for Robotic Heads: Gaze and Beyond
S Al Moubayed, J Beskow, J Edlund... - Analysis of Verbal and ..., 2011 - Springer
... give access to. Keywords: Facial Animation, Talking Heads, Shader Lamps, Robotic
Heads, Gaze, Mona Lisa Effect, Avatar, Dialogue System, Situated In- teraction,
3D Projection, Gaze Perception. 1 Introduction During the ... 
Import into BibTeX


Head X: Customizable Audiovisual Synthesis for a Multi-purpose Virtual Head
M Luerssen, T Lewis... - AI 2010: Advances in Artificial ..., 2011 - Springer
... 436-447. Springer, Berlin (2004) 7. Massaro, DW: From multisensory integration to
talking heads and language learn- ing. In: Calvert, G., Spence, C., Stein, BE (eds.)
Advances in Natural, Multimodal Dialogue Systems, pp. 153-176. ... 
Related articles - Import into BibTeX


Situated reference in a hybrid human-robot interaction system
[PDF] from ed.ac.ukM Giuliani, ME Foster, A Isard, C Matheson... - Proceedings of the 6th ..., 2010 - dl.acm.org
... human-robot dialogue system which supports multimodal human-robot collaboration on a joint
construction task. The robot (Figure 1) has a pair of manipulator arms with grippers, mounted
in a position to resemble human arms, and an animatronic talking head (van Breemen ... 
Cited by 2 - Related articles - All 9 versions - Import into BibTeX


Face-to-face interaction and the KTH Cooking Show
J Beskow, J Edlund, B Granström... - ... of Multimodal Interfaces ..., 2010 - Springer
... The talking head developed at KTH is based on text-to-speech synthesis. ... Facial gestures can
also be used as conversational gestures to signal such things as positive or negative feedback,
control of the dialogue flow, and the internal state of a dialogue system (for a summary ... 
Cited by 3 - Related articles - All 2 versions - Import into BibTeX


Emotion representation, analysis and synthesis in continuous space: A survey
[PDF] from ic.ac.ukH Gunes, B Schuller, M Pantic... - Automatic Face & ..., 2011 - ieeexplore.ieee.org
... The difference between a Spoken Dialogue System and an ECA lies in the latter 'having an identity and a persona' [99]. ... both quantised and continuous) representation and prediction of emo- tions,
ranging from human-computer (eg, Sensitive Talking Heads [107], Sensitive ... 
Cited by 5 - Related articles - All 4 versions - Import into BibTeX


Visual prosody of newsreaders: Effects of information structure, emotional content and intended audience on facial expressions
M Swerts... - Journal of Phonetics, 2010 - Elsevier
... the effect of specific variations in the face on observers are tested through controlled manipulations
of synthetic talking heads ( [5] , [19] , [25 ... and pets (Burnham, Kitamura, & Vollmer-Conna, 2002)
or in interactions with a poorly performing spoken dialogue system ( [Hirschberg et ... 
Cited by 4 - Related articles - Import into BibTeX


Gaze, conversational agents and face-to-face communication
[PDF] from archives-ouvertes.frG Bailly, S Raidt... - Speech Communication, 2010 - Elsevier
... If the use of a virtual talking head instead of a humanoid robot limits physical actions, it extends
the domain of interaction to the virtual world. ... The ECA is embodied as a virtual talking head
obtained by cloning one target human speaker named HL in the following. ... 
Cited by 13 - Related articles - All 7 versions - Import into BibTeX


Embodied Conversational Characters: Representation Formats for Multimodal Communicative Behaviours
B Krenn, C Pelachaud, H Pirker... - Emotion-Oriented Systems, 2011 - Springer
... The embodiment of ECAs ranges from talking heads to full-bodied 2D and 3D characters. ... VHML
(Beard and Reid, 2002)2 is an example for this type of languages. It has been designed for
creating interactive multimodal applications with talking heads or full-bodied ECAs. ... 
Related articles - All 2 versions - Import into BibTeX


Czech senior COMPANION: wizard of Oz data collection and expressive speech corpus recording and annotation
[PDF] from zcu.czM Gruber, M Legát, P Ircing, J Romportl... - ... . Challenges for Computer ..., 2011 - Springer
... No dialogue system can be designed without prior knowledge about the specifics of the
conversations that such system is going to deal with ... Only the speech produced by a computer
was genuinely generated using a TTS system coupled with 3D avatar ("talking head") [4], which ... 
Related articles - All 5 versions - Import into BibTeX


[PDF] Motivating Teenagers' Physical Activity through Mobile Games
[PDF] from ucsc.eduS Kurniawan, M Walker... - 2010 - users.soe.ucsc.edu
... Test Screen b) Game List (Lateral navigation) c) Pop up message prior to playing game d) Logging
Screen e) Talking head view (e) ... UCSC, she was a professor at the University of Sheffield, UK
She has extensive research experience in dialogue analysis and dialogue systems. ... 
Related articles - View as HTML - Import into BibTeX


[PDF] JAMES: Joint Action for Multimodal Embodied Social Systems
[PDF] from ed.ac.ukR Petrick - 2011 - homepages.inf.ed.ac.uk
... Social Skills Executor Output Planner Talking-Head Controller Motion Planner Learned Policies
Robot Simulator ... Adapt techniques recently applied to spoken dialogue systems. • Social robotics
and embodiment (fortiss GmbH, Germany) - Robot simulation framework. ... 
Related articles - View as HTML - Import into BibTeX


Audio-Visual Isolated Words Recognition for Voice Dialogue System
J Chaloupka - Analysis of Verbal and Nonverbal Communication and ..., 2011 - Springer
... We have developed several multimodal voice dialog systems in our lab where audio-visual speech
synthesis (talking head) is included [1]. We would like to add a subsystem for audio- visual
automatic speech recognition (AV ASR) to our multimodal voice dialogue system; we ... 
Import into BibTeX


Video-realistic image-based eye animation via statistically driven state machines
[PDF] from uni-hannover.deA Weissenfeld, K Liu... - The Visual Computer, 2010 - Springer
... a camera and microphone. This setup is most sim- ilar with respect to possible
applications of talking-heads, eg, in a dialog system. The conversational settings
are the same as in the first experiment. The eye tracker processes ... 
Cited by 3 - Related articles - All 11 versions - Import into BibTeX


Audiovisual interface for Czech spoken dialogue system
[PDF] from zcu.czP Ircing, J Romportl... - Signal Processing (ICSP), ..., 2010 - ieeexplore.ieee.org
... by an embodied representation of a virtual dialogue partner ("talking head", "avatar"). Our paper
describes an application that encompasses all the modalities described above and serves as
an interface between the user and the central modules of the dialogue system (such as ... 
Related articles - All 3 versions - Import into BibTeX


Non-verbal communication strategies to improve robustness in dialogue systems: a comparative study
D Pardo, BL Mencia, ÁH Trapote... - Journal on Multimodal ..., 2010 - Springer
... in dialogue systems: a comparative study ... Keywords Embodied conversational agents ·
Non-verbal communication · Robustness · Comparative evaluation · Spoken dialogue
system · Voice authentication · Speaker verification · Gesture design ... 
Cited by 1 - Related articles - All 2 versions - Import into BibTeX


A multimodal approach of generating 3D human-like talking agent
M Yang, J Tao, K Mu, Y Li... - Journal on Multimodal User Interfaces, 2011 - Springer
... Text-driven face animation is often applied to an automatic and intelligent dialogue
system, in which the speech is usually rendered by a Text-to-Speech (TTS) system. ...
Natural head motion is an indispensable part of talking head. ... 
Import into BibTeX


Talking avatar for web-based interfaces
[PDF] from it.ptJ Nunes, L Sá... - ... -International Conference on ..., 2011 - ieeexplore.ieee.org
... Keywords: talking heads; speech animation;model adjustment; ... Graph. and App., 2003,
pp. 66-75 [3] J. Neto, R. Cassaca, M. Viveiros, M. Mourão, "Design of a multimodal input
interface for a dialogue system", in Proc. Int. Conf. Process. ... 
Related articles - All 2 versions - Import into BibTeX


[PDF] Evolution of attention mechanisms for early visual processing
[PDF] from tum.deT Müller... - Society of Photo-Optical Instrumentation Engineers ( ..., 2011 - in.tum.de
... The human-robot dialog system being built as part of the project3, 4 is designed as a platform
to integrate the projects empirical findings on cognition and dialog with ... The robot (Figure 1)
consists of a pair of mechanical arms with grippers and an animatronic talking head. ... 
Related articles - View as HTML - All 7 versions - Import into BibTeX


Interacting with embodied conversational agents
E André... - Speech technology, 2010 - Springer
... In contrast, most research prototypes of embodied conversational char- acters are instances of
complex multimodal dialogue systems, though the focus is usually on the generation of
synchronized multimodal expression. ... "August" [5], a talking head able to give information ... 
Cited by 10 - Related articles - All 2 versions - Import into BibTeX


Animating a Chinese interactive virtual character
K Mu, J Tao... - Machine Learning for Signal ..., 2011 - ieeexplore.ieee.org
... Since the facial expression is weakened in virtual agent compared to the talking head, the Chinese
phoneme-viseme pairs[17] can be simplified for lip movements (shown in Table ... All of the actions
are designed for each sentence in the dialog system used in the Control Module. ... 
Related articles - Import into BibTeX


The IMIX Demonstrator: An Information Search Assistant for the Medical Domain
[PDF] from beck-shop.deD Hofs, B Schooten... - Interactive Multi-modal Question- ..., 2011 - Springer
... Enabling the user to give feedback on their information need is one of the purposes of the dialogue system. ... The right corner shows RUTH, the talking head. The buttons allow the user to select the input modality, speech or text, and to signal the start of a new dialogue. ... 
Cited by 1 - Related articles - All 3 versions - Import into BibTeX


Hierarchical dialogue system for guide robot in shopping mall environments
M Prischepa... - Text, Speech and Dialogue, 2011 - Springer
... The template-based models for key phrases were prepared in each sub-dialogue for promotion,
inquiry, and guide modes of the mobile robot. Keywords: Spoken dialogue system, dialogue
management, multimodal inter- faces, talking head, speaker localization. 1 Introduction ... 
Related articles - All 3 versions - Import into BibTeX


MANA for the Ageing
[PDF] from aclweb.orgDMW Powers, MH Luerssen, TW Lewis... - ... Dialogue Systems, 2010 - dl.acm.org
Proceedings of the 2010 Workshop on Companionable Dialogue Systems, ACL 2010, pages
7-12, Uppsala, Sweden, 15 July 2010 ... We present a family of Embodied Conversa- tional Agents
(ECAs) using Talking Head technology, along with a program of associ- ated research ... 
Cited by 1 - Related articles - All 8 versions - Import into BibTeX


[PDF] Planning for natural language: instruction giving, robot dialogue, and social interaction
[PDF] from ed.ac.ukR Petrick - 2011 - homepages.inf.ed.ac.uk
... Dialogue systems are computer systems designed to carry out natural language conversations
with human users. A central component of most dialogue systems is the dialogue manager
which is responsible for making appropriate conversational moves. ... 
Related articles - View as HTML - Import into BibTeX


Computers in the Human Interaction Loop
[PDF] from gmu.eduA Waibel, R Stiefelhagen, R Carlson... - Handbook of Ambient ..., 2010 - Springer
... talking head makes it possible to deliver voice messages more quietly without decrease in
intelligibility from the perspective of the addressee of a mes- sage, resulting in less noise pollution
for non-addressees [80, 90]. 2.7 Interaction Designing spoken dialog systems in ... 
Cited by 14 - Related articles - All 19 versions - Import into BibTeX


Audiovisual Tools for Phonetic and Articulatory Visualization in Computer-Aided Pronunciation Training
[PDF] from cuhk.edu.hkB Kröger, P Birkholz, R Hoffmann... - Development of Multimodal ..., 2010 - Springer
... 172-175 (2003) [33] Massaro, DW: The psychology and technology of talking heads:
Applications in lan- guage learning. In: van Kuppevelt, JCJ, Dybkjær, L., Bernsen, NO (eds.)
Advances in Natural Multimodal Dialogue Systems, vol. 30, pp. 183-214. ... 
Related articles - All 8 versions - Import into BibTeX


Eyebrow raises in dialogue and their relation to discourse structure, utterance function and pitch accents in English
ML Flecha-García - Speech Communication, 2010 - Elsevier
... Using a synthetic audiovisual continuum with five levels, from ideal statement to ideal question,
in a computer-animated talking head, they found that both eyebrow raising and head tilting could
be used, together with auditory cues, to distinguish echoic questions from statements ... 
Cited by 3 - Related articles - All 4 versions - Import into BibTeX


Facial Expression Synthesis Based on Emotion Dimensions for Affective Talking Avatar
S Zhang, Z Wu, HM Meng... - Modeling Machine Emotions for ..., 2010 - Springer
Page 1. T. Nishida et al. (Eds.): Modeling Machine Emotions for Realizing Intelligence, SIST 1,
pp. 109-132. springerlink.com (c) Springer-Verlag Berlin Heidelberg 2010 Chapter 6 Facial
Expression Synthesis Based on Emotion Dimensions for Affective Talking Avatar ... 
Related articles - All 2 versions - Import into BibTeX


A Robot in the Kitchen
[PDF] from aclweb.orgP Wallis - ... 2010 workshop on companionable dialogue systems, 2010 - dl.acm.org
Page 1. Proceedings of the 2010 Workshop on Companionable Dialogue Systems, ACL
2010, pages 25-30, Uppsala, Sweden, 15 July 2010. ... The Nabaztag is a com- mercially
produced talking head from Violet in the Figure 1: Making an omelette. ... 
Cited by 4 - Related articles - All 10 versions - Import into BibTeX


[PDF] Conversation in Context: what should a robot companion say
[PDF] from project-sera.euP Wallis, V Maier, S Creer... - Proceedings of EMCSR, 2010 - project-sera.eu
... The Nabaztag is a commer- cially produced talking head from Violet in the style of kismet, the
iCat, or indeed Foust's talking skull. ... [Skantze, 2007] Skantze, Gabriel. 2007. Error handling in
spoken dialogue systems - managing un- certainty, grounding and miscommunication. ... 
Cited by 3 - Related articles - View as HTML - Import into BibTeX


The NOMCO multimodal Nordic resource-goals and characteristics
[PDF] from hb.seP Paggio, J Allwood, E Ahlsén... - 2010 - bada.hb.se
... Several studies have been done on the use of gestures in human-machine interaction. Some
suggest that users like gestural feedback by a talking head (Edlund and Nordstrand, 2002). ...
Turn-taking gestures and hour-glasses in a multi-modal dialogue system. ... 
Cited by 5 - Related articles - All 4 versions - Import into BibTeX


Multimodal human-robot interaction
VY Budkov, MV Prischepa... - ... and Control Systems ..., 2010 - ieeexplore.ieee.org
... In the standby mode, the talking head watching to coming people. ... It should be noted that the
interaction model should correspond to such conditions as: (1) information content - the information
should be valid, (2) naturalness - a dialogue system with the user should occur in a ... 
Related articles - Import into BibTeX


Intelligent assistance for conversational storytelling using story patterns
[PDF] from mit.eduPY Chi... - Proceedings of the 15th international conference ..., 2011 - dl.acm.org
Page 1. Intelligent Assistance for Conversational Storytelling Using Story Patterns Pei-Yu
(Peggy) Chi MIT Media Lab 20 Ames St. Cambridge, MA, USA peggychi@media.mit.edu Henry
Lieberman MIT Media Lab & MIT Mind-Machine Project 20 Ames St. ... 
Cited by 1 - Related articles - All 5 versions - Import into BibTeX


Challenges in Speech Synthesis
D Suendermann, H Höge... - Speech Technology, 2010 - Springer
... This kind of prophetic device was reputed to be able to answer any question [11]. In this spirit,
it can be regarded to have been the very first dialog system including components of speech
recognition, understanding, generation, and, last but not least, synthesis. ... Talking head. ... 
Cited by 1 - Related articles - All 2 versions - Import into BibTeX


Dialog model development of a mobile information and reference robot
V Budkov, M Prishchepa... - Pattern Recognition and Image ..., 2011 - Springer
... and moving object tracking and human face, and audio-visual synthesis of Rus sian speech
as a "virtual talking head." The integration of ... Dialog system development is a complex task, and
in dialogue framework development, first of all, expert knowledge of the object domain is ... 
Related articles - All 6 versions - Import into BibTeX


Evaluating Supportive and Instructive Robot Roles in Human-Robot Interaction
M Giuliani... - Social Robotics, 2011 - Springer
... a pair of manipulator arms with grippers, mounted in position to resemble human arms, and an
animatronic talking head [10] capable ... function, we employed a procedure similar to that used
in the PARADISE evaluation framework (PAradigm for DIalogue System Evaluation) [11 ... 
Import into BibTeX


Co-articulation generation using maximum direction change and apparent motion for Chinese visual speech synthesis
CH Wu, CH Lee... - Computer Symposium (ICS), ..., 2010 - ieeexplore.ieee.org
... 1980s [1]. Owing to the rising popularity of facial animation technology, agent systems, health
care systems and dialog systems [2-4 ... audio and video data synchronously, and train the
relationships between them to prevent mismatches when producing talking head animation [8 ... 
Related articles - All 3 versions - Import into BibTeX


[PDF] Predicting Speaker Changes and Listener Responses With And Without Eye-contact
[PDF] from kth.seD Neiberg... - 2011 - speech.kth.se
... Adding the appropriate turn-taking cues to a talking head has been found to elicit turn- taking
[4]. To mimic human speaker shifts, a dialog system should be able to reproduce the response
times between speaker shifts seen in human-human interaction. ... 
Related articles - All 2 versions - Import into BibTeX


An open source integrated framework for rapid prototyping of multimodal affective applications in digital entertainment
D Arnone, A Rossi... - Journal on Multimodal User Interfaces, 2010 - Springer
... frameworks like SmartKom [7], Embassi [8, 9], Galaxy C. [10], JASPIS [11] are mainly focused
on the development of Dialog Systems that implement ... concept, to build a multimodal application
upon it, has been released as an early demo and is called "Talking Head Scenario" [37 ... 
Related articles - All 2 versions - Import into BibTeX


Piavca: a framework for heterogeneous interactions with virtual characters
M Gillies, X Pan, M Slater - Virtual Reality, 2010 - Springer
... Bui TD, Heylen D, Nijholt A (2004) Combination of facial movements on a 3D talking head. ...
Proceedings of computer animation and simulation '99 Cassell J, Stone M (1999) Living hand
to mouth: psychological theories about speech and gesture in interactive dialogue systems. ... 
Related articles - All 9 versions - Import into BibTeX


A realistic, virtual head for human-computer interaction
S Marcos, J Gómez-García-Bermejo... - Interacting with Computers, 2010 - Elsevier
... The use of animated talking heads that are able to interact with humans in a natural way using
speech, gesture and facial expression, is one way of making use of the inherent human ability
to decode information from speech, facial displays, gestures and gaze. ... 
Related articles - All 3 versions - Import into BibTeX


Does it really matter whether students' contributions are spoken versus typed in an intelligent tutoring system with natural language?
SK D'Mello, N Dowell... - Journal of Experimental ..., 2011 - psycnet.apa.org
... information in the same modality. The ITS we tested (AutoTutor, which will be described
later) has a talking head with facial expressions, diagrams on the subject matter, and
three windows with text information. The visual channel is ... 
Cited by 1 - Related articles - All 4 versions - Import into BibTeX


How Our Personality Shapes Our Interactions with Virtual Characters-Implications for Research and Development
A von der Pütten, N Krämer... - Intelligent Virtual Agents, 2010 - Springer
... assumption to be correct. In later studies researchers began to transfer these studies
to virtual characters (talking heads, ECAs, avatars) and broadly confirmed this
hypothesis [16-24, see 25 for an overview]. Thus, it can generally ... 
Related articles - All 3 versions - Import into BibTeX


Listening-test-based annotation of communicative functions for expressive speech synthesis
[PDF] from zcu.czM Gruber... - Text, Speech and Dialogue, 2011 - Springer
... conversations, an extensive audiovisual database containing natural dialogues between seniors
and a computer (applying 3D avatar - "talking head" [3] with a ... The synthesizer is planned to be
used in a limited domain dialogue system, which is going to serve elderly people to ... 
Cited by 1 - Related articles - All 8 versions - Import into BibTeX


[PDF] Automatic Fingersign to Speech Translator
[PDF] from boun.edu.trP Campr, E Dikici, M Hruz... - Proc. 6-th Summer ..., 2010 - busim.ee.boun.edu.tr
... Then the relevant signs have to be concatenated to continuous utterance. The
non-manual components should be partially supplemented by a talking head system
that is able to articulate the utterance or express the face gestures. ... 
Cited by 2 - Related articles - View as HTML - Import into BibTeX


[HTML] Interaction and Service Design Research Group (IxS)
[HTML] from liu.seS Holmlid - 2010 - ida.liu.se
... interaction. Singing Heads. Design and programming of a music instrument based
on speech synthesis and talking heads. ... Background knowledge: Music, programming,
human-computer interaction. A Dialogue System Comes Out. It ... 
Cached - All 3 versions - Import into BibTeX


Interaction with the System
NO Bernsen... - Multimodal Usability, 2010 - Springer
... WOZ is frequently used in spoken dialogue system development but has a far larger potential
and has, in fact, been used to simulate many ... Converting wiz- ard speech to animated talking head
audiovisual speech output can also be done today but requires dedicated software. ... 
Related articles - Import into BibTeX


On Speech and Gestures Synchrony
A Esposito... - ... of Verbal and Nonverbal Communication and ..., 2011 - Springer
... been mainly devoted to model and synchronize speech production and facial movements for
implementing more natural "talking heads" or "talking ... of this gestural information would bring
to the implementation of more natural and user-friendly interactive dialog systems and may ... 
Import into BibTeX


Trends, Challenges and Opportunities in Spoken Dialogue Research
M McTear - Spoken Dialogue Systems Technology and Design, 2011 - Springer
... Following this some chal- lenges are identified, in particular, the issues faced by individual
researchers and those in small groups who wish to build viable end-to-end dialogue systems
and the difficulties that are often encountered by academic researchers when research. ... 
Related articles - Import into BibTeX


WebWOZ: a wizard of oz prototyping framework
[PDF] from tcd.ieS Schlögl, G Doherty, N Karamanis... - Proceedings of the 2nd ..., 2010 - dl.acm.org
... [22] used it to test their multi-modal ac- cess to a mediadata base and [13] as an analysis
instrument for their spoken dialogue system. ... They integrate var- ious LTCs like ASR, TTS and
for instance Talking Heads, under some kind of Rapid Application Development frame- work. ... 
Cited by 2 - Related articles - All 7 versions - Import into BibTeX


Cross-cultural investigation of prosody in verbal feedback in interactional rapport
[PDF] from washington.eduGA Levow, S Duncan... - Eleventh Annual Conference of ..., 2010 - isca-speech.org
... Each was fitted with a close-talking, head-mounted microphone, recording each speaker on a
single channel. ... ucsb.edu/faculty/chafe/pearfilm.htm [12] B. Pellom, W. Ward, J. Hansen, K. Hacioglu,
J. Zhang, X. Yu, and S. Pradhan, "University of Colorado dialog systems for travel ... 
Cited by 1 - Related articles - All 3 versions - Import into BibTeX


Bridging the gap between social animal and unsocial machine: A survey of social signal processing
[PDF] from gla.ac.ukA Vinciarelli, M Pantic, D Heylen... - Affective Computing ..., 2011 - ieeexplore.ieee.org
Page 1. IEEE TRANSACTIONS ON AFFECTIVE COMPUTING 1 Bridging the Gap
Between Social Animal and Unsocial Machine: A Survey of Social Signal Processing
Alessandro Vinciarelli, Maja Pantic, Dirk Heylen, Catherine ... 
Cited by 2 - Related articles - All 5 versions - Import into BibTeX


Affective dialogue management using factored pomdps
[PDF] from stanford.eduT Bui, J Zwiers, M Poel... - Interactive Collaborative Information ..., 2010 - Springer
... a multimodal dialogue system where the user's affective state might be recognized from speech,
facial expression, physiological sensors, or combined mul- timodal input channels. The system
expresses emotions through multimodal output channels such as a talking head or a ... 
Cited by 1 - Related articles - All 11 versions - Import into BibTeX


Multimodal aspects of positive and negative responses in Polish task-oriented dialogues
[PDF] from amu.edu.plZ Malisz... - Speech Prosody 2010-Fifth International ..., 2010 - isca-speech.org
... feedback are concerned, in an experiment conducted by [7], subjects' sensitivity to feedback cues,
as expressed by a talking head, was measured. ... The appropriate and precise identification of
response functions is crucial for the efficiency of dialogue systems both on the level of ... 
Related articles - All 6 versions - Import into BibTeX


Spoken Language Dialogue Models
K Jokinen - Speech Technology, 2010 - Springer
... For instance, at NTT Basic Research Laboratories, the WIT toolkit was developed for real-time
dialogue responding, and demonstrated the talking head, Noddy, which gave feed- back to the
speaker by nodding on ... The research projects also initiated dialogue system evaluation. ... 
Related articles - All 2 versions - Import into BibTeX


Empathic Touch by Relational Agents
[PDF] from neu.eduTW Bickmore, R Fernando, L Ring... - ... , IEEE Transactions on, 2010 - ieeexplore.ieee.org
... etc.) by the patient and able to use these same communicative signals in conjunction with a
speech-based dialogue system for comforting ... To enhance the feeling of connectedness, we
subsequently introduced a mannequin to visually connect the glove to the talking head (Fig. ... 
Cited by 3 - Related articles - All 8 versions - Import into BibTeX


Corrected Human Vision System and the McGurk Effect
[PDF] from cvut.czL Kunc... - HCI International 2011-Posters' Extended Abstracts, 2011 - Springer
... Spoken dialog systems provide new interaction modalities for user. ... Seeing virtual faces further
humanizes computer user interfaces and makes them more acceptable for a common user [2].
For example talking heads provide means for additional nonverbal communication. ... 
Related articles - All 2 versions - Import into BibTeX


[PDF] Head Movement Correlates to Focus Assignment in Swedish
[PDF] from diva-portal.orgS Sangari - 2011 - liu.diva-portal.org
... Talking heads are also used in dialogue systems. Cassel (2000a) shows how important
it is that the movements of computer- animated talking heads are based on a deep
understanding of the interaction between people. Because ... 
Related articles - View as HTML - All 4 versions - Import into BibTeX


Multimodal information processing for affective computing
J Tao - Speech Technology, 2010 - Springer
... and the recognition of emotional states, gestures, speech and facial expressions, in anticipation
of the implementation of intelligent avatars and interactive dialogue systems that could ...
Audio-visual unit selection for the synthesis of photo-realistic talking-heads. In: IEEE Int. Conf. ... 
Cited by 1 - Related articles - All 2 versions - Import into BibTeX


[PDF] Enhancement of Conversational Agents by Means of Multimodal Interaction
[PDF] from ugr.esR López-Cózar, Z Callejas, G Espejo... - Conversational Agents and ..., 2011 - ugr.es
... Many multimodal agents adopt a graphical human-like appearance in order to provide a more
natural and friendly interaction to the user. De- pending on the portion of body shown on screen,
they are usually called Talking Heads or Embodied Conversational Agents (ECAs). ... 
View as HTML - All 5 versions - Import into BibTeX


Multimodal HCI Output: Facial Motion, Gestures and Synthesised Speech Synchronisation
IS Pandžic - 2010 - books.google.com
... phonological representation with its accents marked. Lundeberg et al. in [42]
developed a talking head with the pur- pose of acting as an interactive agent in a
dialogue system. To add Page 285. 270 PART| III Multimodal Human ... 
Related articles - All 8 versions - Import into BibTeX


Assessment and Evaluation of Speech-Based Interactive Systems: From Manual Annotation to Automatic Usability Evaluation
S Möller - Speech Technology, 2010 - Springer
... Assessment methods have been pointed out for the standard components of most dialog systems,
including speech recognition, natural language understanding, dia ... for the distribution of output
to different modalities, as well as for the display of information (eg, a talking head). ... 
Cited by 2 - Related articles - All 2 versions - Import into BibTeX


Approaches to Verbal Persuasion in Intelligent User Interfaces
M Guerini, O Stock, M Zancanaro... - Emotion-Oriented ..., 2011 - Springer
... on. For instance, a talking head may express the mood of the message origina-
tor, a music theme may emphasize a given emotional aspect, or simply, a relevant
image can be combined with the produced text. Multimodality ... 
Related articles - Import into BibTeX


Real-time speech-driven lip synchronization
K Mu, J Tao, M Yang - ... Communication Symposium (IUCS), ..., 2010 - ieeexplore.ieee.org
... system: text and audio, ie, text and speech- driven face animation [3]. Text-driven face animation
is often applied to an automatic and intelligent dialogue system, in which ... MOS OF LIP
SYNCHRONIZATION RENDERED IN A 3-D TALKING HEAD Acoustic audio type Sentence No ... 
Import into BibTeX


Design and evaluation of a Serious Game for immersive cultural training
[PDF] from tuwien.ac.atJ Froschauer, I Seidel, M Ga¨rtner... - Virtual Systems and ..., 2010 - ieeexplore.ieee.org
... We integrated a dialogue system into the game that lets the player interactively choose what
to say and which answers to give. Fig. 1 shows a dialogue with a NPC. ... In Tactical Iraqi it is depicted
as a talking head that evaluates the learner's pronunciation and syntax [22]. ... 
Cited by 2 - Related articles - All 4 versions - Import into BibTeX


Toward Spoken Human-Computer Tutorial Dialogues
[PDF] from google.comSK D'Mello, A Graesser... - Human-Computer Interaction, 2010 - Taylor & Francis
... The students in the ITS we tested (AutoTutor, which is described later) has a talking head with
facial expressions, diagrams on the subject ... It is conceivable that ASR errors are less problematic
in spoken dialogue systems if the content of the user's utterance (response) can be ... 
Cited by 6 - Related articles - All 5 versions - Import into BibTeX


Fundamentals of agent perception and attention modelling
[PDF] from coventry.ac.ukC Peters, G Castellano, M Rehm, E André... - Emotion-Oriented ..., 2011 - Springer
... movements to point towards objects of interest). Their experiments on the interaction
between a realistic talking head and a user during a virtual card game study the growth
of user's interest. Most of the previous approaches process ... 
Cited by 1 - Related articles - All 9 versions - Import into BibTeX


Automatic fingersign-to-speech translation system
M Hrúz, P Campr, E Dikici, AA Kindiroglu... - Journal on Multimodal ..., 2011 - Springer
Page 1. J Multimodal User Interfaces DOI 10.1007/s12193-011-0059-3 ORIGINAL
PAPER Automatic fingersign-to-speech translation system Marek Hrúz · Pavel Campr ·
Erinç Dikici · Ahmet Alp Kindiro?glu · Zdenek Kr noul · Alexander ... 
Related articles - All 2 versions - Import into BibTeX


Silent speech interfaces
[PDF] from cnrs.frB Denby, T Schultz, K Honda, T Hueber... - Speech ..., 2010 - Elsevier
Cited by 31 - Related articles - Library Search - All 14 versions - Import into BibTeX


tHe role of Politeness
WL Johnson... - Human-Computer Etiquette, 2010 - books.google.com
... In Proceedings of AAAI Fall Symposium on Health Dialog Systems. 64-70. ... ori. org/ipip/ Graesser,
AC, Moreno, K., Marineau, J., Adcock, A., olney, A., and person, n.(2003). AutoTutor improves
deep learning of computer literacy: is it the dialog or the talking head? ... 
Related articles - Import into BibTeX


Multimodal fusion for multimedia analysis: a survey
[PDF] from nus.edu.sgPK Atrey, MA Hossain, A El Saddik... - Multimedia Systems, 2010 - Springer
... However, in general, these rules are domain specific and defining the rules requires proper
knowledge of the domain. This fusion method is widely used in the domain of multimodal dialog
systems and sports video analysis. 3.2 Classification-based fusion methods ... 
Cited by 18 - Related articles - All 6 versions - Import into BibTeX


My science tutor: A conversational multimedia virtual tutor for elementary school science
[PDF] from bltek.comW Ward, R Cole, D Bolaños... - ACM Transactions on ..., 2011 - dl.acm.org
... While spoken dialogue systems have been developed for science tutoring for university-level
students, and for children for reading and lan- guage assessment, we have no ... In comparisons
of programs with and without talking heads or human voices, children learned more and ... 
Cited by 4 - Related articles - All 3 versions - Import into BibTeX


Face Synthesis
[PDF] from hmc.eduY Wang, Z Liu... - Handbook of Face Recognition, 2011 - Springer
... Many human-machine dialog systems use realistic-looking human faces as visual representation
of the computer agent that interacts with the human user. Face synthesis techniques have also
been used for talking head compression in the video conferencing scenario. ... 
Related articles - All 2 versions - Import into BibTeX


State-of-the-art of Virtual Reality technologies for children on the autism spectrum
S Parsons... - European Journal of Special Needs ..., 2011 - Taylor & Francis
... [CrossRef], [PubMed], [Web of Science (r)] View all references) developed a three-dimensional
computer-animated talking head (called 'Baldi ... workshop on language-enabled educational
technology and development and evaluation of robust spoken dialogue systems at the 17th ... 
Cited by 6 - Related articles - All 3 versions - Import into BibTeX


Companions, Virtual Butlers, Assistive Robots: Empirical and Theoretical Insights for Building Long-Term Social Relationships.
[PDF] from cogprints.orgD Heylen, B Krenn... - 2010 - cogprints.org
Page 1. Österreichisches Forschungsinstitut für / Austrian Research Institute for / Artificial
Intelligence TR-2010-05 Dirk Heylen, Brigitte Krenn, Sabine Payr Companions, Virtual
Butlers, Assistive Robots: Empirical and Theoretical Insights ... 
All 2 versions - Import into BibTeX


Synthesizing mood-affected signed messages: modifications to the parametric synthesis
F López-Colino... - International Journal of Human-Computer ..., 2011 - Elsevier
... Most extended embodied agents are displayed as talking heads (Beskow, 2004);
their basic implementation is focused only on visual speech synthesis by means of
lip movements. However, the studies performed by Brave et al. ... 
Import into BibTeX


Two acts of social intelligence: the effects of mimicry and social praise on the evaluation of an artificial agent
M Kaptein, P Markopoulos, B de Ruyter... - AI & Society, 2010 - Springer
Page 1. ORIGINAL ARTICLE Two acts of social intelligence: the effects of mimicry
and social praise on the evaluation of an artificial agent Maurits Kaptein • Panos
Markopoulos • Boris de Ruyter • Emile Aarts Received: 26 February ... 
Related articles - All 4 versions - Import into BibTeX


Raconteur: intelligent assistance for conversational storytelling with media libraries
[PDF] from mit.eduH Lieberman, PY Chi - 2010 - dspace.mit.edu
Page 1. Raconteur: Intelligent Assistance for Conversational Storytelling with Media
Libraries BY PEI-YU (PEGGY) CHI MASTER OF SCIENCE IN COMPUTER SCIENCE
NATIONAL TAIWAN UNIVERSITY, 2008 BACHELOR ... 
Related articles - All 2 versions - Import into BibTeX


Facial animation retargeting and control based on a human appearance space
N Stoiber, R Seguier... - Computer Animation and ..., 2010 - Wiley Online Library
Page 1. Facial animation retargeting and control based on a human appearance space By
Nicolas Stoiber*, Renaud Seguier and Gaspard Breton ••••• Expressive ... 
Cited by 4 - Related articles - All 4 versions - Import into BibTeX


[BOOK] Lost in Transit: The Strange Story of the Philip K. Dick Android
DF Dufty - 2011 - books.google.com
... It's the Talking Heads album, Little Creatures. ... Graesser was considered one of the world's leading
experts in computer programs that could hold conversations, or 'dialogue systems', as they're
known, and had written seminal papers on a specific form of dialogue systems ... 
Library Search - Import into BibTeX


Conversational interfaces for task-oriented spoken dialogues: design aspects influencing interaction quality
[PDF] from utwente.nlAI Niculescu - 2011 - doc.utwente.nl
... Thus, conversational interfaces is a global term which can refer to an interactive voice user
interface, a spoken dialogue system, a multimodal question ... The an- swers consisting of text and
images were displayed on the screen and spoken by an anthropomorphic talking head. ... 
Import into BibTeX


Modalities and Devices
NO Bernsen... - Multimodal Usability, 2010 - Springer
... An over-the-phone spoken dialogue system is unimodal: we speak to it, it talks back and that's
it! ... However, explicit structures are also useful in other modalities, such as when we use a beep
to mark when the user can speak in a non-barge-in spoken dialogue system. ... 
Related articles - Import into BibTeX


Emotion recognition in text for 3-D facial expression rendering
RA Calix, SA Mallepudi, B Chen... - ... , IEEE Transactions on, 2010 - ieeexplore.ieee.org
... ECA). This field focuses specifically on multimodal interfaces rep- resented by
3-D talking heads. These interfaces can serve as dialogue systems which use speech
and facial expressions to communicate with users [35]-[38]. ... 
Cited by 4 - Related articles - All 4 versions - Import into BibTeX


Usability Data Analysis and Evaluation
NO Bernsen... - Multimodal Usability, 2010 - Springer
... Let's assume that we have done a first lab test of the spoken dialogue system described in Section
3.4.2. Based on usability requirements applied during data analysis, we find that several require-
ments are not satisfied to the extent planned at this development stage. ... 
Related articles - Import into BibTeX


[PDF] SPRING: Speech and PRonunciation ImprovemeNt through Games, for Hispanic children
[PDF] from berkeley.eduA Tewari, N Goyal, MK Chan, T Yau, J Canny... - 2010 - ocf.berkeley.edu
... were targeted at very young children. Massaro in 2003 [5] described Baldy, a virtual
talking head on a screen with focus on helping users learn how to pronounce the
phonemes properly as a virtual teacher. This is by far the ... 
Related articles - View as HTML - All 6 versions - Import into BibTeX


[PDF] Modelling solution step discussions in tutorial dialogue
[PDF] from uni-saarland.deM Buckley - 2010 - coli.uni-saarland.de
... 19 2.2.2 Belief and knowledge states in tutorial dialogue . . . . . 20 2.3 Tutorial
dialogue systems . . . . . ... 96 6 Predicting the tutor's task-level grounding actions 99
6.1 Machine learning and dialogue systems research . . . . . 100 ... 
View as HTML - Import into BibTeX


[PDF] Innovative User Interfaces in the Industrial Domain
[PDF] from mdh.seJ Jutterström - 2010 - idt.mdh.se
... Page 14. 14 Auditory interfaces are also being applied for multimodal spoken dialogue systems
(MSDS). MSDS is a speech-command system which combines an auditory interface with a graphic
avatar, commonly a talking head, which imitates a face-to-face communication. ... 
Related articles - View as HTML - Import into BibTeX


[PDF] In search of the conversational homunculus
[PDF] from diva-portal.orgJ EDLUND - 2011 - kth.diva-portal.org
... [Wallers et al., 2006] BOOK CHAPTER Jonas Beskow, Jens Edlund & Magnus Nordstrand (2005):
A model for multi-modal dialogue system output applied to an animated talking head. This paper
describes a formalism for describing multimodal dialogue system output. ... 
Related articles - View as HTML - All 2 versions - Import into BibTeX


A Study of Accomodation of Prosodic and Temporal Features in Spoken Dialogues in View of Speech Technology Applications
[PDF] from dit.ieS Kousidis - 2010 - arrow.dit.ie
... the (verbal and non-verbal) behaviour of each to that of the other(s). Implementation of this
behavior in spoken dialogue systems is desirable as an improvement on the naturalness of human- ...
meaningful for implementation in spoken dialogue system (SDS) environments. ... 
Related articles - Import into BibTeX


[PDF] The Virtual Language Teacher
[PDF] from diva-portal.orgP WIK - 2011 - diva-portal.org
... A different type of feedback, similarity measures, is investigated, and two different ways to interact
with the VLT with- in the Simicry paradigm are explored. Chapter 9 opens with an introduction
to spoken dialogue systems and how they may be utilized for CALL purposes. ... 
Related articles - View as HTML - All 3 versions - Import into BibTeX


[BOOK] Handbook of natural language processing and machine translation: DARPA global autonomous language exploitation
J Olive - 2011 - books.google.com
... was aimed. For dictation, WER above 10 percent is not acceptable, but for a dialogue
system, a much higher rate can be tolerated as long as the system can enable a
user to complete a specific task successfully. Initial studies ... 
Cited by 2 - Related articles - Library Search - All 4 versions - Import into BibTeX


Impact of different speech interfaces of personal devices on users' perception
[PDF] from researchgateway.ac.nzM Wadea - 2011 - aut.researchgateway.ac.nz
Page 1. IMPACT OF DIFFERENT SPEECH INTERFACES OF PERSONAL DEVICES ON
USERS' PERCEPTION Mazen Wadea A thesis submitted to Auckland University of
Technology in partial fulfilment of the requirements for the degree of ... 
Import into BibTeX


MENON: automating a Socratic teaching model for mathematical proofs
[PDF] from uni-saarland.deD Tsovaltzi - 2010 - scidok.sulb.uni-saarland.de
... 34 1.2.6 Theoretical Work on Designing Feedback Strategies . . . 35 1.2.7 Dialogue Systems:
Discourse vs. Task Planning . . . . . ... Page 22. xxii CONTENTS Page 23. xxiii List of Figures 1.1
The architecture of the prototype NL tutorial dialogue system of the Dialog project . . . . . ... 
Related articles - Library Search - All 4 versions - Import into BibTeX


A Computational Model of Unsupervised Speech Segmentation for Correspondence Learning
D Duran, H Schütze, B Möbius... - Research on Language & ..., 2010 - Springer
Page 1. Res on Lang and Comput DOI 10.1007/s11168-011-9075-4 A Computational Model
of Unsupervised Speech Segmentation for Correspondence Learning Daniel Duran · Hinrich
Schütze * Bernd Möbius * Michael Walsh (c) Springer Science+Business Media BV 2011 ... 
Related articles - All 4 versions - Import into BibTeX