From noise to meaning: how visual information makes sense

Research output: Other contributionOther

Abstract

Over our lifetimes, we get to see a varied collection of images that reflect the huge diversity of things around us. In reality, we are only likely to experience a very small subset of possible images. The things we end up seeing are not only constrained, but constrained in very predictable ways. Objects tend to have continuous edges and surfaces, and are constructed in ways consistent with the laws of the physical world. We also tend to see fewer, larger objects close to us, rather than the many smaller objects that are further away. These constraints produce regularity that brain can take advantage of to improve how it processes visual information.

Visual information comes in two forms: energy, and spatial structure. The ‘energy’ is the combination of frequencies and proportions present in the image, analogous to the combination of notes played simultaneously by an orchestra, or the palette of colours available to a painter. Spatial structure refers to how that energy is distributed across the space of an image: it is the melody the orchestra plays, or the scene the painter creates.

In this exhibit, I illustrate some of the regularities in which our brains specialise. The video begins with static-like noise: there is no structure. Gradually, the noise begins to look cloudy as the palette of energies is made more consistent with what we see in the natural world. The noise thins until the image becomes sparse and individual patterns emerge. The patterns then arrange themselves into elongated contours, which snap into focus as the energy across different spatial scales aligns at one point in space. Notice how the viewing experience becomes more comfortable as the visual information is arranged in increasingly natural ways and becomes more consistent with what the brain anticipates.

The regularities presented here have shaped the nature of our visual brains on both evolutionary and developmental timescales, and can provide an important lever towards understanding the inner working of neural networks.
Original languageEnglish
TypeVideo display
Media of outputVideo
PublisherMonash University Library
DOIs
Publication statusPublished - Mar 2018

Cite this

@misc{7efa98432cdf4934a53bf8a93a857294,
title = "From noise to meaning: how visual information makes sense",
abstract = "Over our lifetimes, we get to see a varied collection of images that reflect the huge diversity of things around us. In reality, we are only likely to experience a very small subset of possible images. The things we end up seeing are not only constrained, but constrained in very predictable ways. Objects tend to have continuous edges and surfaces, and are constructed in ways consistent with the laws of the physical world. We also tend to see fewer, larger objects close to us, rather than the many smaller objects that are further away. These constraints produce regularity that brain can take advantage of to improve how it processes visual information.Visual information comes in two forms: energy, and spatial structure. The ‘energy’ is the combination of frequencies and proportions present in the image, analogous to the combination of notes played simultaneously by an orchestra, or the palette of colours available to a painter. Spatial structure refers to how that energy is distributed across the space of an image: it is the melody the orchestra plays, or the scene the painter creates.In this exhibit, I illustrate some of the regularities in which our brains specialise. The video begins with static-like noise: there is no structure. Gradually, the noise begins to look cloudy as the palette of energies is made more consistent with what we see in the natural world. The noise thins until the image becomes sparse and individual patterns emerge. The patterns then arrange themselves into elongated contours, which snap into focus as the energy across different spatial scales aligns at one point in space. Notice how the viewing experience becomes more comfortable as the visual information is arranged in increasingly natural ways and becomes more consistent with what the brain anticipates.The regularities presented here have shaped the nature of our visual brains on both evolutionary and developmental timescales, and can provide an important lever towards understanding the inner working of neural networks.",
author = "Elizabeth Zavitz",
year = "2018",
month = "3",
doi = "10.4225/03/5abb12b79c499",
language = "English",
publisher = "Monash University Library",
type = "Other",

}

From noise to meaning : how visual information makes sense. / Zavitz, Elizabeth.

Monash University Library. 2018, Video display.

Research output: Other contributionOther

TY - GEN

T1 - From noise to meaning

T2 - how visual information makes sense

AU - Zavitz, Elizabeth

PY - 2018/3

Y1 - 2018/3

N2 - Over our lifetimes, we get to see a varied collection of images that reflect the huge diversity of things around us. In reality, we are only likely to experience a very small subset of possible images. The things we end up seeing are not only constrained, but constrained in very predictable ways. Objects tend to have continuous edges and surfaces, and are constructed in ways consistent with the laws of the physical world. We also tend to see fewer, larger objects close to us, rather than the many smaller objects that are further away. These constraints produce regularity that brain can take advantage of to improve how it processes visual information.Visual information comes in two forms: energy, and spatial structure. The ‘energy’ is the combination of frequencies and proportions present in the image, analogous to the combination of notes played simultaneously by an orchestra, or the palette of colours available to a painter. Spatial structure refers to how that energy is distributed across the space of an image: it is the melody the orchestra plays, or the scene the painter creates.In this exhibit, I illustrate some of the regularities in which our brains specialise. The video begins with static-like noise: there is no structure. Gradually, the noise begins to look cloudy as the palette of energies is made more consistent with what we see in the natural world. The noise thins until the image becomes sparse and individual patterns emerge. The patterns then arrange themselves into elongated contours, which snap into focus as the energy across different spatial scales aligns at one point in space. Notice how the viewing experience becomes more comfortable as the visual information is arranged in increasingly natural ways and becomes more consistent with what the brain anticipates.The regularities presented here have shaped the nature of our visual brains on both evolutionary and developmental timescales, and can provide an important lever towards understanding the inner working of neural networks.

AB - Over our lifetimes, we get to see a varied collection of images that reflect the huge diversity of things around us. In reality, we are only likely to experience a very small subset of possible images. The things we end up seeing are not only constrained, but constrained in very predictable ways. Objects tend to have continuous edges and surfaces, and are constructed in ways consistent with the laws of the physical world. We also tend to see fewer, larger objects close to us, rather than the many smaller objects that are further away. These constraints produce regularity that brain can take advantage of to improve how it processes visual information.Visual information comes in two forms: energy, and spatial structure. The ‘energy’ is the combination of frequencies and proportions present in the image, analogous to the combination of notes played simultaneously by an orchestra, or the palette of colours available to a painter. Spatial structure refers to how that energy is distributed across the space of an image: it is the melody the orchestra plays, or the scene the painter creates.In this exhibit, I illustrate some of the regularities in which our brains specialise. The video begins with static-like noise: there is no structure. Gradually, the noise begins to look cloudy as the palette of energies is made more consistent with what we see in the natural world. The noise thins until the image becomes sparse and individual patterns emerge. The patterns then arrange themselves into elongated contours, which snap into focus as the energy across different spatial scales aligns at one point in space. Notice how the viewing experience becomes more comfortable as the visual information is arranged in increasingly natural ways and becomes more consistent with what the brain anticipates.The regularities presented here have shaped the nature of our visual brains on both evolutionary and developmental timescales, and can provide an important lever towards understanding the inner working of neural networks.

U2 - 10.4225/03/5abb12b79c499

DO - 10.4225/03/5abb12b79c499

M3 - Other contribution

PB - Monash University Library

ER -