Manipulation of virtual object position within a plane of an extended reality environment

Patent metadata

Field	Value
Publication number	US-11544911-B1
Application number	US-202117175353-A
Country	US
Kind code	B1
Filing date	Feb 12, 2021
Priority date	Apr 30, 2019
Publication date	Jan 3, 2023
Grant date	Jan 3, 2023

Abstract

A mobile device is fitted with a camera and an extended reality (XR) software application program executing on a processor within an XR system. Via the XR software application program, techniques are performed for manipulating virtual objects in an XR environment. In one technique, the XR software application program facilitates the movement of a virtual object from a first location to a second location, within a plane parallel to a touchscreen of a mobile device, responsive to a displacement determined based on user input detected via the touchscreen.

First claim

What is claimed is:

1. A computer-implemented method, comprising:
receiving, via a client device, an interaction with a virtual object located at a first location within a plane in an extended reality (XR) environment, wherein the plane is parallel to a display screen of the client device; and
moving the virtual object, within the plane parallel to the display screen of the client device, from the first location within the plane to a second location within the plane based on the interaction.

2. The computer-implemented method of claim 1 , wherein:
receiving the interaction with the virtual object comprises receiving a touch-and-hold gesture; and
the virtual object is attached to a camera view of the XR environment displayed by the display screen while the touch-and-hold gesture is being performed.

3. The computer-implemented method of claim 1 , wherein the moving of the virtual object is further based on a distance from the client device to the virtual object in the XR environment and a camera view of the XR environment displayed by the display screen.

4. The computer-implemented method of claim 1 , further comprising:
determining a field of view associated with a camera view of the XR environment displayed by the display screen based on a projection from a camera frame to the camera view,
wherein the moving of the virtual object is further based on the field of view and a distance from a camera of the client device to the virtual object in the XR environment.

5. The computer-implemented method of claim 1 , wherein the moving of the virtual object comprises, for each of x- and y-components:
determining a displacement based on user input detected via an input device of the client device;
determining a respective adjustment factor based on an associated x- or y-component of a field of view associated with a camera view of the XR environment displayed by the display screen and a distance from a camera of the client device to the virtual object in the XR environment;
determining a respective approximated chord length based on an associated x- or y-component of the displacement, the respective adjustment factor, and a respective maximum displacement; and
moving the virtual object within the plane parallel to the display screen based on the respective approximated chord length.

6. The computer-implemented method of claim 1 , further comprising determining a displacement based on user input detected via an input device of the client device, wherein the displacement is a vector.

7. The computer-implemented method of claim 1 , further comprising detaching the virtual object from an anchor point located within the XR environment.

8. The computer-implemented method of claim 1 , wherein moving the virtual object to the second location comprises:
responsive to determining that a user input detected via the client device has ended, detaching the virtual object from a camera view at the second location within the XR environment, and
attaching the virtual object to an anchor point at the second location.

9. The computer-implemented method of claim 1 , wherein the virtual object is an extended reality overlay of a real-world object.

10. The computer-implemented method of claim 1 , wherein the virtual object is an extended reality overlay of a real-world object that includes a data representation of real-time data or near-real-time data.

11. The computer-implemented method of claim 1 , wherein the virtual object is an extended reality overlay of a real-world object that is a data representation of real-time data or near-real-time data from a data intake and query system, wherein the real-time or near-real-time data is generated by executing a query of machine data, at least part of which is related to the real-world object.

12. A non-transitory computer-readable storage medium including instructions that, when executed by a processor, cause the processor to perform the steps of:
receiving, via a client device, an interaction with a virtual object located at a first location within a plane in an extended reality (XR) environment, wherein the plane is parallel to a display screen of the client device; and
moving the virtual object, within the plane parallel to the display screen of the client device, from the first location within the plane to a second location within the plane based on the interaction.

13. The non-transitory computer-readable storage medium of claim 12 , further comprising, prior to moving the virtual object, attaching the virtual object to a camera view of the XR environment displayed by the display screen.

14. The non-transitory computer-readable storage medium of claim 13 , wherein:
receiving the interaction with the virtual object comprises receiving a touch-and-hold gesture; and
the virtual object is attached to a camera view of the XR environment displayed by the display screen while the touch-and-hold gesture is being performed.

15. The non-transitory computer-readable storage medium of claim 13 , wherein the moving of the virtual object is further based on a distance to the virtual object in the XR environment and a camera view of the XR environment displayed by the display screen.

16. The non-transitory computer-readable storage medium of claim 13 , further comprising:
determining a field of view associated with a camera view of the XR environment displayed by the display screen based on a projection from a camera frame to the camera view,
wherein the moving of the virtual object is further based on the field of view and a distance to the virtual object in the XR environment.

17. The non-transitory computer-readable storage medium of claim 13 , wherein the moving of the virtual object comprises, for each of x- and y-components:
determining a displacement based on user input detected via an input device of the client device;
determining a respective adjustment factor based on an associated x- or y-component of a field of view associated with a camera view of the XR environment displayed by the display screen and a distance from a camera of the client device to the virtual object in the XR environment;
determining a respective approximated chord length based on an associated x- or y-component of the displacement, the respective adjustment factor, and a respective maximum displacement; and
moving the virtual object within the plane parallel to the display screen based on the respective approximated chord length.

18. The non-transitory computer-readable storage medium of claim 13 , further comprising detaching the virtual object from an anchor point located within the XR environment.

19. A computing device, comprising:
a memory that includes an extended reality application program; and
a processor that is coupled to the memory and, when executing the extended reality application program, is configured to:
receive, via a client device, an interaction with a virtual object located at a first location within a plane in an extended reality (XR) environment, wherein the plane is parallel to a display screen of the client device; and
move the virtual object, within the plane parallel to the display screen of the client device, from the first location within the plane to a second location within the plane based on the interaction.

Assignees

• Splunk Inc

Inventors

• Bhushan Devin
• Chor Jesse
• Wong Glen
• Zhu Jim Jiaming

Classifications

• G06F3/0482

  Interaction with lists of selectable items, e.g. menus · CPC title

• G06F3/04883

  for inputting data by handwriting, e.g. gesture or text · CPC title

• G06F3/0486

  Drag-and-drop · CPC title

• G06T19/20 Primary

  Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts · CPC title

• G06F3/04845

  for image manipulation, e.g. dragging, rotation, expansion or change of colour · CPC title