Skip to the replay
A Rough Idea Instrumented People, Places and Things Iota open house, 2012

Instrumented People, Places and Things: the Iota open house, 24 October 2012

Start here

Sensing behaviour in a space. In 2012 the Iota team at SapientNitro, in Chicago, explored how a space could sense the people in it: many inexpensive sensors spread through a room, each picking up a different trace of activity, such as where people stand, where it is warm and how loud it is. Combined in software, those traces could become a model of how a space is used, and give the people who design spaces richer context than a floor plan or a survey.

On 24 October 2012 the team opened its lab to visitors. Four Kinect depth cameras tracked people as skeletons, three Grid-EYE thermal arrays looked down at the floor, and four of Iota's own spider sensors listened. This replays one hour, about 16:00 to 17:00, as the team's 2013 viewer drew it.

Moments

How to read what you see
Skeletons
People a Kinect tracked. The newest frame is red; the last 10 seconds fade out behind it. Someone two Kinects saw at once is drawn twice, so the count is per Kinect.
Squares of colour
A Grid-EYE's 8 × 8 heat, on the floor where it looked: green is that sensor's coolest reading of the hour, red its warmest. Warmth that never moves may be equipment; TJ remembers heat-generating equipment in their views.
Rings
A spider's sound in seven bands, one ring each; wider and warmer is louder. A pulsing cube means no reading.
Cones
Each sensor's field of view; Fields of view, above the sensor list, hides them.
The tables
Two tables side by side, where TJ remembers them, there all hour; the 2013 model had three, where people stood, and the 2013 viewer skipped drawing them.
Data panel
A sensor's measures over the hour, computed as the 2013 viewer did. A Kinect's movement is how far its people's tracked joints moved since their last frame, all summed and scaled to that Kinect's busiest 1%; click movement to split it into arms and legs. A Grid-EYE's hot spot is how far its warmest pixel rises above its recent average, as a person beneath it does; click it for the average, lowest and highest readings, in the floor's colours. A spider's sound shows its seven bands in one row, band 1 at the top; click it to see each at full height. Tick Graph beside a sensor below.

One of the studies in Instrumented People, Places and Things.

Three corrections to 2013

The 2013 viewer played the recording as stored. This replay makes three corrections, each measured from the data.

Clocks. Each computer stamped its sensors' readings by its own clock, and the clocks disagreed: Kinect 804's ran 3 minutes fast. Every Kinect and Grid-EYE is replayed on Kinect 803's clock; the spiders keep their own, as nothing in the data ties them to the others.

Placement. Kinect heights and tilts are fitted so that feet stand on the floor. Grid-EYEs 907 and 909 are turned 180° and moved about 3 ft, to where their warmth follows the people the Kinects track; 905, which no Kinect sees, gets the same turn and their average move.

Colour. The Grid-EYEs differed in level and sensitivity (909 reads about 9 °C low), so each is drawn from its own coolest reading to its warmest.

What it can and cannot tell

Kinects lose people behind others and sometimes see one person twice; Kinects 801 and 804 place some people they both see about 3 ft apart, and the data does not say which is right. Grid-EYE heat is relative to each sensor, not a temperature. In this hour the spiders recorded only sound, and spider 906 nothing. It is one hour of one event, and nothing here identifies anyone.

The sensing, the sensors and the open house were the Iota team's, at SapientNitro. Instrumented Homes Explorable ↗, a sister site on Iota's kitchen study.

Sensors

GraphSensorReads
16:27:46

Data panel