基本説明
This is a selection of papers of the second “Venaco Workshop”, sponsored by the NATO Research Study Group RSG-10 on Automatic Speech Processing, and by the European Speech Communication Association (ESCA).
Full Description
Most dialogues are multimodal. When people talk, they use not only their voices, but also facial expressions and other gestures, and perhaps even touch. When computers communicate with people, they use pictures and perhaps sounds, together with textual language, and when people communicate with computers, they are likely to use mouse "gestures" almost as much as words. How are such multimodal dialogues constructed? This is the main question addressed in this selection of papers of the second "Venaco Workshop", sponsored by the NATO Research Study Group RSG-10 on Automatic Speech Processing, and by the European Speech Communication Association (ESCA).
Contents
1. Foreword; 2. Prologue; 3. 1. The Structure of Dialogue (by Allwood, Jens); 4. 2. Give us the tools: a personal view of multimodal computer-human dialogue (by Hill, David); 5. 3. Integrating Multimodal Information: Evidence for Cognitive Integrality (by Selcon, S.J.); 6. Part I: Models and Strategies; 7. 4. Toward Multimodal Support of Interpreted Telephone Dialogues (by Oviatt, Sharon L.); 8. 5. Human Factors and Error-Handling in Speech Interfaces (by Murray, A.C.); 9. 6. Cross-linked modalities make speech drift in rapid dialogue: Global multimedia dialogue, language shifts, and emotion (by Candelaria de Ram, S.); 10. 7. Dynamic Interpretation and Dialogue Theory (by Bunt, Harry); 11. 8. Dialgoue Acts are Rational Plans (by Sadek, M.D.); 12. 9. An approach to oral dialogue modelling (by Bilange, E.); 13. 10. A Dynamic Dialogue Model for Human-Machine Communication (by Luzzati, D.); 14. 11. Standia: a pragmatically driven man-machine system (by Vilnat, Anne); 15. 12. Moves in Dialogue (by Beun, Robbert-Jan); 16. 13. Designing Intelligence: A Case of Explicit Models and Layered Protocols (by Edwards, Jack L.); 17. 14. SPRUCE: Speech Synthesis (by Tatham, Marcel A.A.); 18. Part 2: Architectures and Experiences; 19. 15. Multimedia & Multimodal Interaction Structure (by Maybury, Mark T.); 20. 16. Robustness and cooperative multimodal humanmachine communication applications (by Junqua, Jean-Claude); 21. 17. Iconicity of Sign Languages (by Cuxac, Christian); 22. 18. A Taxonomy for Users' Behaviour in Human Computer Interaction (by Edmondson, Willis J.); 23. 19. Multimodal Interaction Interface using Voice and Gesture (by Teil, Daniel); 24. 20. Implementing an Oral and Geographic Multimodal Application: The Georal Project (by Gavignet, F.); 25. 21. Communicative Acts for Multimedia and Multimodal Dialogue (by Maybury, Mark T.); 26. 22. Graphical Modes of Human Multimodal Dialogue (by Boudreau, Ginette); 27. 23. Graphics and Natural Language in Multi-Modal Dialogues (by Lee, James); 28. 24. Referring in a Multimodal Environment: from NL to designation (by Gaiffe, Bertrand); 29. 25. Multiplexing, Diviplexing, and the Control of Multimodal Dialogue (by Taylor, M. Martin); 30. 26. Multimodal Approach to Concept Formation: and Example in Speech and Sketch Mode (by Datta, A.K.); 31. 27. Processing Facial Images to Enhance Speech Communication (by Brooke, N. Michael); 32. 28. The Intrinsic Bimodality of Speech Communication and the Synthesis of Talking Faces (by Benoit, C.); 33. Index
