Visual focus of attention recognition in the ambient kitchen

Ligeng Dong; Huijun Di; Linmi Tao; Guangyou Xu; Patrick Oliver

doi:10.1007/978-3-642-12297-2_53

Visual focus of attention recognition in the ambient kitchen

Ligeng Dong
, Huijun Di
, Linmi Tao
, Guangyou Xu
, Patrick Oliver

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Research › peer-review

8 Citations (Scopus)

Abstract

This paper presents a model for visual focus of attention recognition in the Ambient Kitchen, a pervasive computing prototyping environment. The kitchen is equipped with several blended displays on one wall and users may use information presented on these displays from multiple locations. Our goal is to recognize which display the user is looking at so that the environment can adjust the display content accordingly. We propose a dynamic Bayesian network model to infer the focus of attention, which models the relation between multiple foci of attention, multiple user locations and faces captured by the multiple cameras in the environment. Head pose is not explicitly computed but measured by a similarity vector which represents the likelihoods of multiple face clusters. Video data are collected in the Ambient Kitchen environment and experimental results demonstrate the effectiveness of our model.

Original language	English
Title of host publication	Computer Vision, ACCV 2009 - 9th Asian Conference on Computer Vision, Revised Selected Papers
Pages	548-559
Number of pages	12
Edition	PART 3
DOIs	https://doi.org/10.1007/978-3-642-12297-2_53
Publication status	Published - 2010
Externally published	Yes
Event	Asian Conference on Computer Vision 2009 - Xi'an, China Duration: 23 Sept 2009 → 27 Sept 2009 Conference number: 9th https://link.springer.com/book/10.1007/978-3-642-12307-8 (Proceedings)

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Number	PART 3
Volume	5996 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	Asian Conference on Computer Vision 2009
Abbreviated title	ACCV 2009
Country/Territory	China
City	Xi'an
Period	23/09/09 → 27/09/09
Internet address	https://link.springer.com/book/10.1007/978-3-642-12307-8 (Proceedings)

Access to Document

10.1007/978-3-642-12297-2_53

Cite this

Dong, L., Di, H., Tao, L., Xu, G., & Oliver, P. (2010). Visual focus of attention recognition in the ambient kitchen. In Computer Vision, ACCV 2009 - 9th Asian Conference on Computer Vision, Revised Selected Papers (PART 3 ed., pp. 548-559). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 5996 LNCS, No. PART 3). https://doi.org/10.1007/978-3-642-12297-2_53

Dong, Ligeng ; Di, Huijun ; Tao, Linmi et al. / Visual focus of attention recognition in the ambient kitchen. Computer Vision, ACCV 2009 - 9th Asian Conference on Computer Vision, Revised Selected Papers. PART 3. ed. 2010. pp. 548-559 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 3).

@inproceedings{d3e8cae5fce746fdbb02f85c5f4c5de9,

title = "Visual focus of attention recognition in the ambient kitchen",

abstract = "This paper presents a model for visual focus of attention recognition in the Ambient Kitchen, a pervasive computing prototyping environment. The kitchen is equipped with several blended displays on one wall and users may use information presented on these displays from multiple locations. Our goal is to recognize which display the user is looking at so that the environment can adjust the display content accordingly. We propose a dynamic Bayesian network model to infer the focus of attention, which models the relation between multiple foci of attention, multiple user locations and faces captured by the multiple cameras in the environment. Head pose is not explicitly computed but measured by a similarity vector which represents the likelihoods of multiple face clusters. Video data are collected in the Ambient Kitchen environment and experimental results demonstrate the effectiveness of our model.",

author = "Ligeng Dong and Huijun Di and Linmi Tao and Guangyou Xu and Patrick Oliver",

year = "2010",

doi = "10.1007/978-3-642-12297-2\_53",

language = "English",

isbn = "3642122965",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

number = "PART 3",

pages = "548--559",

booktitle = "Computer Vision, ACCV 2009 - 9th Asian Conference on Computer Vision, Revised Selected Papers",

edition = "PART 3",

note = "Asian Conference on Computer Vision 2009, ACCV 2009 ; Conference date: 23-09-2009 Through 27-09-2009",

url = "https://link.springer.com/book/10.1007/978-3-642-12307-8",

}

Dong, L, Di, H, Tao, L, Xu, G & Oliver, P 2010, Visual focus of attention recognition in the ambient kitchen. in Computer Vision, ACCV 2009 - 9th Asian Conference on Computer Vision, Revised Selected Papers. PART 3 edn, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), no. PART 3, vol. 5996 LNCS, pp. 548-559, Asian Conference on Computer Vision 2009, Xi'an, China, 23/09/09. https://doi.org/10.1007/978-3-642-12297-2_53

Visual focus of attention recognition in the ambient kitchen. / Dong, Ligeng; Di, Huijun; Tao, Linmi et al.
Computer Vision, ACCV 2009 - 9th Asian Conference on Computer Vision, Revised Selected Papers. PART 3. ed. 2010. p. 548-559 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 5996 LNCS, No. PART 3).

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Research › peer-review

TY - GEN

T1 - Visual focus of attention recognition in the ambient kitchen

AU - Dong, Ligeng

AU - Di, Huijun

AU - Tao, Linmi

AU - Xu, Guangyou

AU - Oliver, Patrick

N1 - Conference code: 9th

PY - 2010

Y1 - 2010

N2 - This paper presents a model for visual focus of attention recognition in the Ambient Kitchen, a pervasive computing prototyping environment. The kitchen is equipped with several blended displays on one wall and users may use information presented on these displays from multiple locations. Our goal is to recognize which display the user is looking at so that the environment can adjust the display content accordingly. We propose a dynamic Bayesian network model to infer the focus of attention, which models the relation between multiple foci of attention, multiple user locations and faces captured by the multiple cameras in the environment. Head pose is not explicitly computed but measured by a similarity vector which represents the likelihoods of multiple face clusters. Video data are collected in the Ambient Kitchen environment and experimental results demonstrate the effectiveness of our model.

AB - This paper presents a model for visual focus of attention recognition in the Ambient Kitchen, a pervasive computing prototyping environment. The kitchen is equipped with several blended displays on one wall and users may use information presented on these displays from multiple locations. Our goal is to recognize which display the user is looking at so that the environment can adjust the display content accordingly. We propose a dynamic Bayesian network model to infer the focus of attention, which models the relation between multiple foci of attention, multiple user locations and faces captured by the multiple cameras in the environment. Head pose is not explicitly computed but measured by a similarity vector which represents the likelihoods of multiple face clusters. Video data are collected in the Ambient Kitchen environment and experimental results demonstrate the effectiveness of our model.

UR - https://www.scopus.com/pages/publications/78650469747

U2 - 10.1007/978-3-642-12297-2_53

DO - 10.1007/978-3-642-12297-2_53

M3 - Conference Paper

AN - SCOPUS:78650469747

SN - 3642122965

SN - 9783642122965

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 548

EP - 559

BT - Computer Vision, ACCV 2009 - 9th Asian Conference on Computer Vision, Revised Selected Papers

T2 - Asian Conference on Computer Vision 2009

Y2 - 23 September 2009 through 27 September 2009

ER -

Dong L, Di H, Tao L, Xu G, Oliver P. Visual focus of attention recognition in the ambient kitchen. In Computer Vision, ACCV 2009 - 9th Asian Conference on Computer Vision, Revised Selected Papers. PART 3 ed. 2010. p. 548-559. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 3). doi: 10.1007/978-3-642-12297-2_53

Visual focus of attention recognition in the ambient kitchen

Abstract

Publication series

Conference

Access to Document

Other files and links

Cite this