Sensor-based Distributed Tangible User Interface

Patent metadata

Field	Value
Publication number	US-2016112279-A1
Application number	US-201414519050-A
Country	US
Kind code	A1
Filing date	Oct 20, 2014
Priority date	Oct 20, 2014
Publication date	Apr 21, 2016
Grant date	—

Abstract

A distributed tangible user interface comprises compact, self-powered, tangible user interface manipulative devices having sensing, display, and wireless communication capabilities, along with one or more associated digital content or other interactive software management applications. The manipulative devices display visual representations of digital content or program controls and can be physically manipulated as a group by a user for interaction with the digital information or software application. A controller on each manipulative device receives and processes data from a movement sensor, initiating behavior on the manipulative and/or forwarding the results to a management application that uses the information to manage the digital content, software application, and/or the manipulative devices. The manipulative devices may also detect the proximity and identity of other manipulative devices, responding to and/or forwarding that information to the management application, and may have feedback devices for presenting responsive information to the user.

First claim

What is claimed is:

1 . A sensor network user interface, comprising:
a sensor-based distributed tangible user interface, comprising:
a set of special-purpose tangible user interface manipulative devices, wherein:
the set of manipulative devices form and are members of the distributed user interface,
each manipulative device has no significant functionality independent of membership in the distributed user interface, being useable only as part of the set of manipulative devices under the control of the sensor network user interface,
each manipulative device is configured to directly detect the presence and location of the other manipulative devices in the set solely by being placed proximate to any of the other manipulative devices in the set,
each manipulative device is independently physically manipulable relative to the other manipulative devices in the set, and
each manipulative device comprises:
at least one wireless communications device;
a visual display for digital content;
a power source;
at least one movement sensor;
at least one neighborhood wireless communications device for detecting the presence of nearby manipulative devices; and
at least one manipulative device controller adapted for:
 receiving data from the movement sensor;
 processing the received data to derive movement parameters;
 at least one of forwarding the derived movement parameters or initiating behavior of the manipulative device in response to the derived movement parameters;
 sensing, using the neighborhood wireless communication device, the position of at least one nearby manipulative device;
 processing the position of, and any communication received from, the sensed nearby manipulative device in order to derive neighborhood information; and
 at least one of forwarding the derived neighborhood information or initiating behavior of the manipulative device in response to the derived neighborhood information; and

at least one user interface controller, the user interface controller being adapted for controlling the behavior of the sensor-based distributed tangible user interface by coordinating and controlling the behavior of the set of manipulative devices as a group by:
sending digital content or behavior instructions to individual manipulative devices;
receiving at least one of derived neighborhood information or derived movement parameters from at least one of the manipulative devices;
processing any received derived neighborhood information and derived movement parameters to derive instructions about management of the digital content or program behavior for the set of manipulative devices; and
changing program behavior or managing the digital content for the set of manipulative devices according to the derived instructions.

2 . The sensor network user interface of claim 1 , the user interface controller being further adapted for sending at least one of revised digital content or behavior instructions to individual manipulative devices according to the derived instructions.

3 . The sensor network user interface of claim 1 , each manipulative device further comprising at least one feedback device for presenting responsive information to a user.

4 . The sensor network user interface of claim 1 , wherein the user interface controller resides on one of the manipulative devices.

5 . The sensor network user interface of claim 1 , wherein the movement sensor is an accelerometer.

6 . The sensor network user interface of claim 1 , each manipulative device further comprising memory for storing at least one of digital content or program instructions.

7 . A tangible user interface manipulative device, comprising:
a special-purpose manipulative device specifically adapted to form and be a member of a sensor-based distributed tangible user interface comprising a defined set of special-purpose manipulative devices that are controlled as a group by a central controller adapted to control the distributed tangible user interface by controlling the set of manipulative devices as a group, wherein:
the manipulative device has no significant functionality independent of membership in the distributed tangible user interface, being useable only as part of the set of manipulative devices under control of the central controller,
the manipulative device is configured to directly detect the presence and location of other manipulative devices in the set when placed proximate to those other manipulative devices,
the manipulative device is independently physically manipulable relative to the other manipulative devices in the set, and
the manipulative device comprises:
a visual display;
a power source;
at least one wireless communications device, the wireless communications device being adapted for receiving behavior commands or digital content for display on the visual display from the central controller;
at least one movement sensor;
at least one neighborhood wireless communications device for detecting the presence of nearby manipulative devices; and
at least one manipulative device controller adapted for:
sensing, using the neighborhood wireless communication device, the position of any nearby manipulative device;
at least one of:
 processing the sensed position of, and any communication received from, the sensed nearby manipulative device in order to derive neighborhood information;
 initiating behavior as a result of the sensed position or derived neighborhood information; and
 forwarding the sensed position or derived neighborhood information to the central controller using the wireless communications device;
 receiving data from the movement sensor; and
 at least one of:
 processing the received data to derive movement parameters;
 initiating behavior as a result of the data or movement parameters; and
 forwarding the derived movement parameters or the received data to the central controller using the wireless communications device.

8 . The tangible user interface manipulative device of claim 7 , wherein at least one of the derived movement parameters and derived neighborhood information are forwarded to a computing device.

9 . The tangible user interface manipulative device of claim 7 , further comprising at least one feedback device for presenting responsive information to a user.

10 . The tangible user interface manipulative device of claim 7 , wherein the movement sensor is an accelerometer.

11 . The tangible user interface manipulative device of claim 7 , further comprising memory for storing at least one of digital content or program instructions.

12 . A method for facilitating user interaction with digital content or application programs, comprising the steps of:
displaying a visual representation of at least one of digital content or program control elements on a sensor-based distributed tangible user interface, the distributed user interface comprising a set of special-purpose manipulative devices that are controlled as a group by a computing device adapted for controlling the distributed user interface, wherein:
only a subset of the digital content or program control elements is displayed on any individual manipulative device,
the set of manipulative devices form and are members of the distributed user interface,
each manipulative device has no significant functionality independent of membership in the distributed user interface, being useable only as part of the set of manipulative devices under the control of the sensor network user interface,
each manipulative device is configured to directly detect the presence and location of the other manipulative devices in the set solely by being placed proximate to any

Assignees

• Kalanithi Jeevan James
• Merrill David Jeffrey
• Maes Patricia Emilia
• Massachusetts Inst Technology

Inventors

• Kalanithi Jeevan James
• Merrill David Jeffrey
• Maes Patricia Emilia

Classifications

• H04B7/24 Primary

  for communication between two or more posts (wireless communication networks H04W) · CPC title

• G06F3/04847

  Interaction techniques to control parameter settings, e.g. interaction with sliders or dials · CPC title

• G06F3/04842

  Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) · CPC title

• H04L67/10

  in which an application is distributed across nodes in the network (software deployment G06F8/60; multiprogramming arrangements G06F9/46) · CPC title

• H04L41/22 Primary

  comprising specially adapted graphical user interfaces [GUI] · CPC title