[go: up one dir, main page]

Cassell, 1999 - Google Patents

Embodied conversation: integrating face and gesture into automatic spoken dialogue systems

Cassell, 1999

View PDF
Document ID
14011682084682594488
Author
Cassell J
Publication year

External Links

Snippet

In this chapter I'm going to discuss the issues that arise when we design automatic spoken dialogue systems that can use not only voice, but also facial and head movements and hand gestures to communicate with humans. For the most part I will concentrate on the generation …
Continue reading at www.media.mit.edu (PDF) (other versions)

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/08—Speech classification or search
    • G10L15/18—Speech classification or search using natural language modelling
    • G10L15/1822—Parsing for meaning understanding
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00—Electrically-operated educational appliances
    • G09B5/06—Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
    • G09B5/065—Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B19/00—Teaching not covered by other main groups of this subclass
    • G09B19/06—Foreign languages
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06F—ELECTRICAL DIGITAL DATA PROCESSING
    • G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/20—Handling natural language data
    • G06F17/28—Processing or translating of natural language
    • G06F17/2872—Rule based translation
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00—Electrically-operated educational appliances
    • G09B5/02—Electrically-operated educational appliances with visual presentation of the material to be studied, e.g. using film strip
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B21/00—Teaching, or communicating with, the blind, deaf or mute
    • G09B21/001—Teaching or communicating with blind persons
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B21/00—Teaching, or communicating with, the blind, deaf or mute
    • G09B21/009—Teaching or communicating with deaf persons

Similar Documents

Publication Publication Date Title
Cassell Nudge nudge wink wink: Elements of face-to-face conversation for embodied conversational agents
Cassell A framework for gesture generation and interpretation
Cassell Embodied conversation: integrating face and gesture into automatic spoken dialogue systems
Cassell et al. Embodiment in conversational interfaces: Rea
Cole et al. The challenge of spoken language systems: Research directions for the nineties
Kipp Gesture generation by imitation: From human behavior to computer character animation
Takeuchi et al. Communicative facial displays as a new conversational modality
Poggi et al. Performative facial expressions in animated faces
Cassell et al. More than just a pretty face: affordances of embodiment
Cole et al. New tools for interactive speech and language training: Using animated conversational agents in the classrooms of profoundly deaf children
Mittelberg Metaphor and metonymy in language and gesture: Discourse evidence for multimodal models of grammar
Beskow et al. OLGA-a dialogue system with an animated talking agent.
Woo et al. IAVA: Interactive and Adaptive Virtual Agent
Martin et al. Levels of Representation in the Annotation of Emotion for the Specification of Expressivity in ECAs
Pelachaud et al. Multimodal embodied agents
Yan Paired speech and gesture generation in embodied conversational agents
Pelachaud Some considerations about embodied agents
Murgiano et al. Language is less arbitrary than one thinks: iconicity and indexicality in real-world language learning and processing
Bevacqua Computational model of listener behavior for embodied conversational agents
Theune et al. Generating embodied information presentations
Mancini Multimodal distinctive behavior for expressive embodied conversational agents
Luperfoy Embodied Conversation: Integrating Face and Gesture into Automatic Spoken Dialogue Systems Justine Cassell MIT Media Laboratory
Pelachaud et al. Multimodal communication between synthetic agents
Granström et al. Speech and gestures for talking faces in conversational dialogue systems
Thies et al. First the hand, then the word: On gestural displacement in non-native English speech