Prototyping novel collaborative multimodal systems: simulation, data collection and analysis tools for the next decade

Alexander M. Arthur; Rebecca Lunsford; Matt Wesson; Sharon Oviatt

doi:10.1145/1180995.1181039

Prototyping novel collaborative multimodal systems: simulation, data collection and analysis tools for the next decade

Alexander M. Arthur, Rebecca Lunsford, Matt Wesson, Sharon Oviatt

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Research › peer-review

18 Citations (Scopus)

Abstract

To support research and development of next-generation multimodal interfaces for complex collaborative tasks, a comprehensive new infrastructure has been created for collecting and analyzing time-synchronized audio, video, and pen-based data during multi-party meetings. This infrastructure needs to be unobtrusive and to collect rich data involving multiple information sources of high temporal fidelity to allow the collection and annotation of simulation-driven studies of natural human-human-computer interactions. Furthermore, it must be flexibly extensible to facilitate exploratory research. This paper describes both the infrastructure put in place to record, encode, playback and annotate the meeting-related media data, and also the simulation environment used to prototype novel system concepts.

Original language	English
Title of host publication	ICMI '06 - Proceedings of the 8th international conference on Multimodal interfaces
Place of Publication	New York NY USA
Publisher	Association for Computing Machinery (ACM)
Pages	209-216
Number of pages	8
ISBN (Print)	159593541X, 9781595935410
DOIs	https://doi.org/10.1145/1180995.1181039
Publication status	Published - 2006
Externally published	Yes
Event	International Conference on Multimodal Interfaces 2006 - Banff, Canada Duration: 2 Nov 2006 → 4 Nov 2006 Conference number: 8th https://dl.acm.org/doi/proceedings/10.1145/1180995 (Proceedings)

Conference

Conference	International Conference on Multimodal Interfaces 2006
Abbreviated title	ICMI 2006
Country/Territory	Canada
City	Banff
Period	2/11/06 → 4/11/06
Internet address	https://dl.acm.org/doi/proceedings/10.1145/1180995 (Proceedings)

Keywords

Annotation tools
Data collection infrastructure
Meeting
Multi-party
Multimodal interfaces
Simulation studies
Synchronized media

Access to Document

10.1145/1180995.1181039

Cite this

@inproceedings{d79c9c001c734f6a826816cd4831ca3e,

title = "Prototyping novel collaborative multimodal systems: simulation, data collection and analysis tools for the next decade",

abstract = "To support research and development of next-generation multimodal interfaces for complex collaborative tasks, a comprehensive new infrastructure has been created for collecting and analyzing time-synchronized audio, video, and pen-based data during multi-party meetings. This infrastructure needs to be unobtrusive and to collect rich data involving multiple information sources of high temporal fidelity to allow the collection and annotation of simulation-driven studies of natural human-human-computer interactions. Furthermore, it must be flexibly extensible to facilitate exploratory research. This paper describes both the infrastructure put in place to record, encode, playback and annotate the meeting-related media data, and also the simulation environment used to prototype novel system concepts.",

keywords = "Annotation tools, Data collection infrastructure, Meeting, Multi-party, Multimodal interfaces, Simulation studies, Synchronized media",

author = "Arthur, {Alexander M.} and Rebecca Lunsford and Matt Wesson and Sharon Oviatt",

year = "2006",

doi = "10.1145/1180995.1181039",

language = "English",

isbn = "159593541X",

pages = "209--216",

booktitle = "ICMI '06 - Proceedings of the 8th international conference on Multimodal interfaces",

publisher = "Association for Computing Machinery (ACM)",

address = "United States of America",

note = "International Conference on Multimodal Interfaces 2006, ICMI 2006 ; Conference date: 02-11-2006 Through 04-11-2006",

url = "https://dl.acm.org/doi/proceedings/10.1145/1180995",

}

Arthur, AM, Lunsford, R, Wesson, M & Oviatt, S 2006, Prototyping novel collaborative multimodal systems: simulation, data collection and analysis tools for the next decade. in ICMI '06 - Proceedings of the 8th international conference on Multimodal interfaces. Association for Computing Machinery (ACM), New York NY USA, pp. 209-216, International Conference on Multimodal Interfaces 2006, Banff, Alberta, Canada, 2/11/06. https://doi.org/10.1145/1180995.1181039

Prototyping novel collaborative multimodal systems: simulation, data collection and analysis tools for the next decade. / Arthur, Alexander M.; Lunsford, Rebecca; Wesson, Matt et al.
ICMI '06 - Proceedings of the 8th international conference on Multimodal interfaces. New York NY USA: Association for Computing Machinery (ACM), 2006. p. 209-216.

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Research › peer-review

TY - GEN

T1 - Prototyping novel collaborative multimodal systems

T2 - International Conference on Multimodal Interfaces 2006

AU - Arthur, Alexander M.

AU - Lunsford, Rebecca

AU - Wesson, Matt

AU - Oviatt, Sharon

N1 - Conference code: 8th

PY - 2006

Y1 - 2006

N2 - To support research and development of next-generation multimodal interfaces for complex collaborative tasks, a comprehensive new infrastructure has been created for collecting and analyzing time-synchronized audio, video, and pen-based data during multi-party meetings. This infrastructure needs to be unobtrusive and to collect rich data involving multiple information sources of high temporal fidelity to allow the collection and annotation of simulation-driven studies of natural human-human-computer interactions. Furthermore, it must be flexibly extensible to facilitate exploratory research. This paper describes both the infrastructure put in place to record, encode, playback and annotate the meeting-related media data, and also the simulation environment used to prototype novel system concepts.

AB - To support research and development of next-generation multimodal interfaces for complex collaborative tasks, a comprehensive new infrastructure has been created for collecting and analyzing time-synchronized audio, video, and pen-based data during multi-party meetings. This infrastructure needs to be unobtrusive and to collect rich data involving multiple information sources of high temporal fidelity to allow the collection and annotation of simulation-driven studies of natural human-human-computer interactions. Furthermore, it must be flexibly extensible to facilitate exploratory research. This paper describes both the infrastructure put in place to record, encode, playback and annotate the meeting-related media data, and also the simulation environment used to prototype novel system concepts.

KW - Annotation tools

KW - Data collection infrastructure

KW - Meeting

KW - Multi-party

KW - Multimodal interfaces

KW - Simulation studies

KW - Synchronized media

UR - http://www.scopus.com/inward/record.url?scp=34547155503&partnerID=8YFLogxK

U2 - 10.1145/1180995.1181039

DO - 10.1145/1180995.1181039

M3 - Conference Paper

AN - SCOPUS:34547155503

SN - 159593541X

SN - 9781595935410

SP - 209

EP - 216

BT - ICMI '06 - Proceedings of the 8th international conference on Multimodal interfaces

PB - Association for Computing Machinery (ACM)

CY - New York NY USA

Y2 - 2 November 2006 through 4 November 2006

ER -

Prototyping novel collaborative multimodal systems: simulation, data collection and analysis tools for the next decade

Abstract

Conference

Keywords

Access to Document

Other files and links

Cite this