Apparatus and methods for tangible collaborative learning

Patent metadata

Field	Value
Publication number	US-10163369-B2
Application number	US-201514734938-A
Country	US
Kind code	B2
Filing date	Jun 9, 2015
Priority date	Jun 9, 2014
Publication date	Dec 25, 2018
Grant date	Dec 25, 2018

Abstract

The present invention relates generally to a system and method that bring together the advantages of computer games and the physical world to increase engagement, collaboration and learning. The system and method can be used with a myriad of physical setups and can be used for many different content areas in education. In one embodiment, a mixed reality interaction is facilitated with an EarthShake™ game presented on a display. The game is synchronized with a tangible interface comprising a physical object and a sensor capable of detecting a change in the condition of the physical object. The system and method help kids discover scientific and other learning principles while experimenting with real objects in a physical environment supported with audio and visual feedback. Students interactively make predictions, see results, grapple with disconfirming evidence and formulate explanations in forms of general principles.

First claim

What is claimed is:

1. A method of teaching using mixed reality, comprising:
presenting an experimental set-up in a physical space,
wherein the experimental set-up comprises a movable table in communication with a controller connected to a computer and an object associated with the movable table,
wherein the object comprises a plurality of towers of blocks that can exist in a plurality of physical configurations in the physical world through physical manipulation by a user, and
wherein movement of the movable table is designed to collapse at least one of the plurality of towers of blocks;

instructing the user to position the object in a first physical configuration by providing a prompt on a display screen connected to the computer;
obtaining data about the object from a sensor connected to the computer,
wherein the sensor is not connected to the object,
wherein the sensor comprises an imaging device;

identifying the first physical configuration of the object using a sensing algorithm,
wherein the sensing algorithm processes the data from the sensor to identify the object and to determine a condition or property of the physical object;

displaying a virtual representation of the object in the first physical configuration on the display screen;
entering a prediction from a user about whether the first physical configuration of the object will change in response to an event;
initiating the event through the movable table,
wherein the movable table is adapted to cause the object to experience the event, thereby causing a change in the condition of at least one of the plurality of towers of blocks
wherein a controller connected to the computer operates the movable table;

identifying a response of the object to the event using the sensing algorithm to process data provided by the sensor obtained after the event to detect a change in the condition or property of the physical object,
wherein identifying comprises:
retrieving data from the imaging device,
finding and merging blobs in the image data to separate each tower of the plurality of towers of blocks,
calculating an inertia of each tower by using a mathematical formula based on a distance of each pixel in the image data from an x and a y axis of a bounding box, and
determining if the tower is upright or collapsed by using a height of the bounding box;

interpreting the response of the object to the event with consideration of the prediction to determine an outcome;
displaying a virtual representation of the object after the event on the display screen; and
providing interactive feedback to the user based on the outcome.

2. The method of claim 1 , wherein the plurality of physical configurations are not pre-defined.

3. The method of claim 1 , wherein interpreting the response of the object to the event in consideration of the prediction to determine an outcome comprises:
comparing the virtual representation of the first physical configuration with the virtual representation of the post-event physical configuration of the object to determine if the object changed physical configurations to assign an event result, wherein the virtual representation is derived by the sensing algorithm;
comparing the prediction with the event result; and
determining whether the prediction was correct or incorrect.

4. The method of claim 1 , wherein the response of the object to the event comprises:
a change from the first physical configuration to another physical configuration.

5. The method of claim 1 , further comprising:
prompting the user to provide a self-explanation after seeing the outcome.

6. The method of claim 1 , further comprising:
providing a second object, wherein the second object can exist in a plurality of physical configurations through physical manipulation by the user;
positioning the object in a second physical configuration; and
comparing the response of the first object to the event to the response of the second object to the event.

7. The method of claim 1 , further comprising:
assessing a trait of the object using the sensing algorithm, wherein the trait is based at least in part on the configuration of the object.

8. The method of claim 7 , wherein the trait is selected from the group consisting of:
height, center of gravity, base width, and symmetry.

9. The method of claim 1 , further comprising:
administering a test to the user prior to the event and collecting first results;
administering the test to the user subsequent to collecting the first results and collecting second results; and
comparing the first results to the second results to determine a progression of the user.

10. The method of claim 1 , wherein the experimental setup comprises an experimental contrast having a plurality of differing objects.

11. The method of claim 1 , further comprising:
providing interactive visualizations on the display to provide an explanation of principles relating to the outcome.

Assignees

• Carnegie Mellon Univ A Pennsylvania Non Profit Corporation
• Univ Carnegie Mellon

Inventors

• Yannier Nesra
• Koedinger Kenneth R
• Hudson Scott E

Classifications

• G09B23/10 Primary

  of solid bodies · CPC title

• G09B7/02

  of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student · CPC title

• G09B7/06

  of the multiple-choice answer-type, i.e. where a given question is provided with a series of answers and a choice has to be made from the answers · CPC title