Portable computing device for learning mathematical concepts

Patent metadata

Field	Value
Publication number	US-11610502-B2
Application number	US-201816202291-A
Country	US
Kind code	B2
Filing date	Nov 28, 2018
Priority date	Nov 28, 2018
Publication date	Mar 21, 2023
Grant date	Mar 21, 2023

Abstract

A system and method for assisted-learning with a portable computing device that includes requesting that a user complete a mathematical challenge by arranging real-world objects in an environment to form an arrangement according to the mathematical challenge, optionally receiving an input from the user that the arrangement is complete, activating a camera of a portable computing device located in the environment with the user to capture an image of the arrangement, wherein the image is received from the portable computing device over a network, evaluating the arrangement using a visual recognition engine to determine whether the arrangement successfully completes the mathematical challenge, and providing at least one of a visual feedback and an audible feedback to the user.

First claim

What is claimed is:

1. A method for assisted-learning with a robot including a head portion and a body portion, the ethod comprising:
requesting, by a processor of a computing system, that a user complete a mathematical challenge by locating a group of real-world objects of a specific type and a specific shape from an environment containing a plurality of real-world objects of multiple different types and shapes, and arranging the group of real-world objects to form an arrangement according to the mathematical challenge;
receiving, by the processor, an input from the user that the arrangement is complete;
activating, by the processor, a camera included in the head portion of the robot and located in the environment with the user to capture an image of the arrangement, wherein the processor receives the image of the arrangement from the robot over a network;
evaluating, by the processor, the arrangement using a visual recognition engine to determine whether the group of the real-world objects is a correct type and a correct shape of real-world object, and ii) the arrangement of the group of real-world objects successfully completes the mathematical challenge; and
providing, by the processor, at least one of a visual feedback on a display included in the head portion of the robot and an audible feedback to the user,
wherein the robot supports a plurality of modes of operation, including a math mode with the mathematical challenge, a spatial recognition mode presenting the mathematical challenge, a training mode, and a game mode such that the user selects a mode from the plurality of modes of operation by interacting with the display included in the head portion of the robot.

2. The method of claim I, wherein the training mode trains the robot to scan and identify a group of objects arranged by the user.

3. The method of claim 1 , further comprising:
detecting, by the processor, that the arrangement is not successfully captured by the camera of the robot;
providing, by the processor, feedback to the user to reposition the robot to improve image capturing of the arrangement; and
activating, by the processor, the camera to capture digital data representing the arrangement.

4. The method of claim 1 , wherein providing visual feedback comprises: displaying, by the processor, a congratulatory message on the display included in the head portion of the robot, and initiating, by the processor, a musical sequence.

5. The method of claim 1 , further comprising: increasing, by the processor, a score of the user in the game mode, in response to determining that the user successfully completed the mathematical challenge.

6. The method of claim 5 , further comprising: decreasing, by the processor, the score of the user in the game mode, in response to determining that the user did not successfully complete the mathematical challenge.

7. The method of claim 1 , wherein the visual recognition engine counts a number of real-world objects in the image to be compared with a number of real-world objects required in the mathematical challenge.

8. The method of claim 1 , wherein the mathematical challenge requires the user to sort a predetermined number of real-world objects according to a size of each of the real-world objects.

9. A computing system, comprising:
a processor;
a memory device coupled to the processor; and
a computer readable storage device coupled to the processor, wherein the storage device contains program code executable by the processor via the memory device to implement a method for assisted-learning with a robot including a head portion and a body portion, the method comprising:
requesting, by a processor of a computing system, that a user complete a mathematical challenge by locating a group of real-world objects of a specific type and a specific shape from an environment containing a plurality of real-world objects of multiple different types and shapes, and arranging the group of real-world objects to form an arrangement according to the mathematical challenge;
receiving, by the processor, an input from the user that the arrangement is complete;
activating, by the processor, a camera included in the head portion of the robot and located in the environment with the user to capture an image of the arrangement, wherein the processor receives the image of the arrangement from the robot over a network;
evaluating, by the processor, the arrangement using a visual recognition engine to determine whether i) the group of the real-world objects is a correct type and a correct shape of real-world object, and ii) the arrangement of the group of real-world objects successfully completes the mathematical challenge and
providing, by the processor, at least one of a visual feedback on a display included in the head portion of the robot and an audible feedback to the user,
wherein the robot supports a plurality of modes of operation, including a math mode with the mathematical challenge. a spatial recognition mode presenting the mathematical challenge, a training mode, and a game mode such that the user selects a mode from the plurality of modes of operation by interacting with the display included in the head portion of the robot.

10. The computing system of claim 9 , wherein the training mode trains the robot to scan and identify a group of objects arranged by the user.

11. The computing system of claim 9 , wherein providing visual feedback comprises: displaying, by the processor, a congratulatory message on the display included in the head portion of the robot, and initiating, by the processor, a musical sequence.

12. The computing system of claim 9 , further comprising:
increasing, by the processor, a score of the user in the game mode, in response to determining that the user successfully completed the athematical chiller.

13. The computing system of claim 12 , further comprising:
decreasing, by the processor, the score of the user in the game mode, in response to determining that the user did not successfully complete the mathematical challenge.

14. The computing system of claim 9 , wherein the visual recognition engine counts a number of real-world objects in the image to be compared with a. number of real-world objects required in the mathematical challenge.

15. The computing system of claim 9 , wherein the mathematical challenge requires the user to sort a predetermined number of real-world objects according to a sizeof each of the real-world objects.

16. A computer program product, comprising a computer readable hardware storage device storing a computer readable program code, the computer readable program code comprising an algorithm that when executed by a computer processor of a computing system implements a method for assisted-learning with a robot including a head portion and a body portion, the method comprising:
requesting, by a processor of a computing system, that a user complete a mathematical challenge by locating a group of real-world objects of a specific type and a specific shape from an environment containing a plurality of real-world objects of multiple different types and shapes, and arranging the group of real-world objects to form an arrangement according to the mathematical challenge;
receiving, by the processor, an input from the user that the arrangement is complete;
activating, by the processor, a camera included in the head portion of the robot and located in the environment with the user to capture an image of the arrangement, wherein the processor receives the image of the arrangement from the robot over a network;
evaluating, by the processor, the arrangeme

Assignees

• Kyndryl Inc

Inventors

• Rodriguez Bravo Cesar Augusto

Classifications

• G09B7/02 Primary

  of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student · CPC title

• G09B23/02

  for mathematics (for statics or dynamics G09B23/08) · CPC title

• G06N5/02

  Knowledge representation; Symbolic representation · CPC title

• G06N5/022

  Knowledge engineering; Knowledge acquisition · CPC title

• G06N3/008

  based on physical entities controlled by simulated intelligence so as to replicate intelligent life forms, e.g. based on robots replicating pets or humans in their appearance or behaviour · CPC title