Methods and systems for providing a tutorial for graphic manipulation of objects including real-time scanning in an augmented reality

Patent metadata

Field	Value
Publication number	US-2022414997-A1
Application number	US-202217899481-A
Country	US
Kind code	A1
Filing date	Aug 30, 2022
Priority date	Jun 28, 2019
Publication date	Dec 29, 2022
Grant date	—

Abstract

A device including a storage medium storing instructions, and at least one processor configured to execute the stored instructions to perform operations is provided. The operations include displaying on a display screen an interactive scene containing an augmented reality element, receiving input to change display of the interactive scene, and receiving a request to simulate the capturing of image data representing the interactive scene. The operations further include determining a position of the augmented reality element relative to a region defined on the display screen, simulating the capturing of the image data representing the interactive scene, and providing, based on the determined position, an indication of whether the simulation has succeeded.

First claim

1 .- 20 . (canceled)

21 . A device, comprising:
a storage medium storing instructions; and at least one processor configured to execute the stored instructions to perform operations comprising:
displaying, on a display screen, an interactive scene containing an augmented reality element;
detecting a position of the augmented reality element relative to the interactive scene;
displaying, on the display screen, an indication to a user to move the display screen to position the augmented reality element within the interactive scene;
receiving a command from the user to simulate capturing the augmented reality element;
calculating a recognition probability based on the position of the augmented reality element relative to the interactive scene; and
providing a response to the user via the display screen indicating that the augmented reality element has been simulate-captured or indicating a device manipulation to improve the calculated recognition probability, based on the calculated recognition probability.

21 . The device of claim 21 , wherein the recognition probability is further based on an orientation of the augmented reality element relative to a viewpoint of the interactive scene.

22 . The device of claim 21 , wherein the device manipulation comprises a movement of a viewpoint towards the augmented reality element, a movement of a viewpoint away from the augmented reality element, or a movement of a viewpoint laterally relative to the augmented reality element.

23 . The device of claim 21 , wherein the operations further comprise providing the recognition probability to the user.

24 . The device of claim 21 , wherein the response to the user indicating that the augmented reality element has been simulate-captured comprises audio data or image data presented to the user.

25 . The device of claim 21 , wherein the response to the user indicating that the augmented reality element has been simulate-captured is presented to the user prior to the simulate-capturing of the augmented reality element.

26 . The device of claim 21 , wherein the indication to the user to move the display screen comprises a message presented on the display screen, an arrow, or an audio cue.

27 . The device of claim 21 , wherein the operations further comprise recording one or more parameters of an environment of the user.

28 . The device of claim 27 , wherein the operations further comprise setting one or more default optimal parameters for the device based on the recorded parameters.

29 . The device of claim 21 , wherein the operations further comprise recording one or more steps taken by the user to simulate-capture the augmented reality element.

30 . A method comprising:
displaying, on a display screen, an interactive scene containing an augmented reality element; detecting a position of the augmented reality element relative to the interactive scene; displaying, on the display screen, an indication to a user to move the display screen to position the augmented reality element within the interactive scene; receiving a command from the user to simulate capturing the augmented reality element; calculating a recognition probability based on the position of the augmented reality element relative to the interactive scene; and providing a response to the user via the display screen indicating that the augmented reality element has been simulate-captured or indicating a device manipulation to improve the calculated recognition probability, based on the calculated recognition probability.

31 . The method of claim 30 , wherein the recognition probability is further based on a perceived distance to the augmented reality element in the interactive scene.

32 . The method of claim 30 , further comprising receiving a command from the user to alter an orientation and a position of the augmented reality element within the interactive scene to correspond to a real-world environment.

33 . The method of claim 30 , further comprising adjusting, based on input from the user, one or more parameters of the device, wherein the parameters of the device comprise a focal length of the device, an aperture size, a shutter speed, or a light sensitivity.

34 . The method of claim 30 , further comprising receiving a command from the user to save image data of the interactive scene.

35 . The method of claim 30 , wherein the indication to the user to move the display screen comprises a message presented on the display screen, an arrow, or an audio cue.

36 . The method of claim 35 , wherein a size of the arrow displayed on the display screen indicates an amount of motion needed to adjust the position of the augmented reality element in the interactive scene.

37 . The method of claim 30 , further comprising storing information related to user preferences in a user profile.

38 . The method of claim 30 , wherein the interactive scene comprises a view of an environment of the user.

39 . The method of claim 30 , wherein the recognition probability is further based on an orientation of the augmented reality element relative to a viewpoint of the interactive scene.

40 . The method of claim 30 , wherein the device manipulation comprises a movement of a viewpoint towards the augmented reality element, a movement of a viewpoint away from the augmented reality element, or a movement of a viewpoint laterally relative to the augmented reality element.

Assignees

• Capital One Services Llc

Inventors

• Duckworth Staevan
• Martinez Daniel
• Hardin William
• Blacksher Victoria
• Castaneda Jonathan
• Youngblood Stewart

Classifications

• G06V10/235

  based on user input or interaction · CPC title

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06V20/20 Primary

  in augmented reality scenes · CPC title

• G06F30/20

  Design optimisation, verification or simulation (optimisation, verification or simulation of circuit designs G06F30/30) · CPC title

• G06T2207/20081

  Training; Learning · CPC title