Synergistic use of direct manipulation and natural language

Philip R. Cohen; Mary Dalrymple; Douglas B. Moran; Fernando C N Pereira; Joseph W. Sullivan; Robert A. Gargan; Jon L. Schlossberg; Sherman W. Tyler

doi:10.1145/67449.67494

Synergistic use of direct manipulation and natural language

Philip R. Cohen, Mary Dalrymple, Douglas B. Moran, Fernando C N Pereira, Joseph W. Sullivan, Robert A. Gargan, Jon L. Schlossberg, Sherman W. Tyler

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Research › peer-review

61 Citations (Scopus)

Abstract

This paper shows how the integration of natural language with direct manipulation produces a multimodal interface that overcomes limitations of these techniques when used separately. Natural language helps direct manipulation in being able to specify objects and actions by description, while direct manipulation enables users to learn which objects and actions are available in the system. Furthermore, graphical rendering and manipulation of context provides a partial solution to difficult problems of natural language anaphora.

Original language	English
Title of host publication	Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 1989
Publisher	Association for Computing Machinery (ACM)
Pages	227-233
Number of pages	7
ISBN (Print)	0897913019, 9780897913010
DOIs	https://doi.org/10.1145/67449.67494
Publication status	Published - 1 Jan 1989
Externally published	Yes
Event	International Conference on Human Factors in Computing Systems 1989 - Austin, United States of America Duration: 30 Apr 1989 → 4 Jun 1989 Conference number: 7th

Publication series

Name	Conference on Human Factors in Computing Systems - Proceedings

Conference

Conference	International Conference on Human Factors in Computing Systems 1989
Abbreviated title	CHI 1989
Country	United States of America
City	Austin
Period	30/04/89 → 4/06/89

Keywords

Direct manipulation
Natural language
User interfaces

Access to Document

10.1145/67449.67494

Link to publication in Scopus

Cite this

Cohen, P. R., Dalrymple, M., Moran, D. B., Pereira, F. C. N., Sullivan, J. W., Gargan, R. A., Schlossberg, J. L., & Tyler, S. W. (1989). Synergistic use of direct manipulation and natural language. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 1989 (pp. 227-233). (Conference on Human Factors in Computing Systems - Proceedings). Association for Computing Machinery (ACM). https://doi.org/10.1145/67449.67494

Cohen, Philip R. ; Dalrymple, Mary ; Moran, Douglas B. ; Pereira, Fernando C N ; Sullivan, Joseph W. ; Gargan, Robert A. ; Schlossberg, Jon L. ; Tyler, Sherman W. / Synergistic use of direct manipulation and natural language. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 1989. Association for Computing Machinery (ACM), 1989. pp. 227-233 (Conference on Human Factors in Computing Systems - Proceedings).

@inproceedings{f6d13723f2ef4033b109b4a210ce3880,

title = "Synergistic use of direct manipulation and natural language",

abstract = "This paper shows how the integration of natural language with direct manipulation produces a multimodal interface that overcomes limitations of these techniques when used separately. Natural language helps direct manipulation in being able to specify objects and actions by description, while direct manipulation enables users to learn which objects and actions are available in the system. Furthermore, graphical rendering and manipulation of context provides a partial solution to difficult problems of natural language anaphora.",

keywords = "Direct manipulation, Natural language, User interfaces",

author = "Cohen, {Philip R.} and Mary Dalrymple and Moran, {Douglas B.} and Pereira, {Fernando C N} and Sullivan, {Joseph W.} and Gargan, {Robert A.} and Schlossberg, {Jon L.} and Tyler, {Sherman W.}",

year = "1989",

month = jan,

day = "1",

doi = "10.1145/67449.67494",

language = "English",

isbn = "0897913019",

series = "Conference on Human Factors in Computing Systems - Proceedings",

publisher = "Association for Computing Machinery (ACM)",

pages = "227--233",

booktitle = "Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 1989",

address = "United States of America",

note = "International Conference on Human Factors in Computing Systems 1989, CHI 1989 ; Conference date: 30-04-1989 Through 04-06-1989",

}

Cohen, PR, Dalrymple, M, Moran, DB, Pereira, FCN, Sullivan, JW, Gargan, RA, Schlossberg, JL & Tyler, SW 1989, Synergistic use of direct manipulation and natural language. in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 1989. Conference on Human Factors in Computing Systems - Proceedings, Association for Computing Machinery (ACM), pp. 227-233, International Conference on Human Factors in Computing Systems 1989, Austin, United States of America, 30/04/89. https://doi.org/10.1145/67449.67494

Synergistic use of direct manipulation and natural language. / Cohen, Philip R.; Dalrymple, Mary; Moran, Douglas B.; Pereira, Fernando C N; Sullivan, Joseph W.; Gargan, Robert A.; Schlossberg, Jon L.; Tyler, Sherman W.

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 1989. Association for Computing Machinery (ACM), 1989. p. 227-233 (Conference on Human Factors in Computing Systems - Proceedings).

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Research › peer-review

TY - GEN

T1 - Synergistic use of direct manipulation and natural language

AU - Cohen, Philip R.

AU - Dalrymple, Mary

AU - Moran, Douglas B.

AU - Pereira, Fernando C N

AU - Sullivan, Joseph W.

AU - Gargan, Robert A.

AU - Schlossberg, Jon L.

AU - Tyler, Sherman W.

N1 - Conference code: 7th

PY - 1989/1/1

Y1 - 1989/1/1

N2 - This paper shows how the integration of natural language with direct manipulation produces a multimodal interface that overcomes limitations of these techniques when used separately. Natural language helps direct manipulation in being able to specify objects and actions by description, while direct manipulation enables users to learn which objects and actions are available in the system. Furthermore, graphical rendering and manipulation of context provides a partial solution to difficult problems of natural language anaphora.

AB - This paper shows how the integration of natural language with direct manipulation produces a multimodal interface that overcomes limitations of these techniques when used separately. Natural language helps direct manipulation in being able to specify objects and actions by description, while direct manipulation enables users to learn which objects and actions are available in the system. Furthermore, graphical rendering and manipulation of context provides a partial solution to difficult problems of natural language anaphora.

KW - Direct manipulation

KW - Natural language

KW - User interfaces

UR - http://www.scopus.com/inward/record.url?scp=84884491122&partnerID=8YFLogxK

U2 - 10.1145/67449.67494

DO - 10.1145/67449.67494

M3 - Conference Paper

AN - SCOPUS:84884491122

SN - 0897913019

SN - 9780897913010

T3 - Conference on Human Factors in Computing Systems - Proceedings

SP - 227

EP - 233

BT - Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 1989

PB - Association for Computing Machinery (ACM)

T2 - International Conference on Human Factors in Computing Systems 1989

Y2 - 30 April 1989 through 4 June 1989

ER -

Cohen PR, Dalrymple M, Moran DB, Pereira FCN, Sullivan JW, Gargan RA et al. Synergistic use of direct manipulation and natural language. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 1989. Association for Computing Machinery (ACM). 1989. p. 227-233. (Conference on Human Factors in Computing Systems - Proceedings). https://doi.org/10.1145/67449.67494