Display control device, display control method, program, and display system

Patent metadata

Field	Value
Publication number	US-2020126464-A1
Application number	US-201816605269-A
Country	US
Kind code	A1
Filing date	Jun 27, 2018
Priority date	Jul 14, 2017
Publication date	Apr 23, 2020
Grant date	—

Abstract

A position/pose acquisition unit acquires a position and a pose of a viewpoint in a real space. A site data disposition unit disposes site data which is three-dimensional data representing a shape of a construction site in a virtual space on the basis of the position and the pose of the viewpoint. A machine data disposition unit disposes machine data which is three-dimensional data representing a shape of a work machine at a position corresponding to the site data in the virtual space. A rendering unit renders the disposed machine data.

First claim

1 . A display control device comprising:
a position/pose acquisition unit that acquires a position and a pose of a viewpoint in a real space; a site data disposition unit that disposes site data which is three-dimensional data representing a shape of a construction site in a virtual space on the basis of the position and the pose of the viewpoint; a machine data disposition unit that disposes machine data which is three-dimensional data representing a shape of a work machine at a position corresponding to the site data in the virtual space; and a rendering unit that renders the disposed machine data.

2 . The display control device according to claim 1 ,
wherein the rendering unit renders the disposed machine data by changing a position or a pose of the machine data with time.

3 . The display control device according to claim 2 , further comprising:
a dynamic state setting unit that sets a dynamic state of the machine data, wherein the rendering unit renders the disposed machine data by changing the position or the pose of the machine data with time according to the dynamic state set by the dynamic state setting unit.

4 . The display control device according to claim 1 ,
wherein the rendering unit renders one of a plurality of positions or a plurality of poses of the disposed machine data.

5 . The display control device according to claim 1 ,
wherein the machine data has a movable portion, and wherein the rendering unit renders the machine data by changing a pose of the movable portion of the disposed machine data.

6 . The display control device according to claim 1 , further comprising:
an image acquisition unit that acquires an image captured by an imaging device, wherein the position/pose acquisition unit acquires a position and a pose of a viewpoint of the imaging device.

7 . The display control device according to claim 6 ,
wherein the rendering unit combines the rendered machine data with the image.

8 . The display control device according to claim 6 , further comprising:
a site data acquisition unit that acquires the site data on the basis of the image.

9 . The display control device according to claim 1 ,
wherein the position/pose acquisition unit acquires a position and a pose of the display control device.

10 . The display control device according to claim 1 ,
wherein the position/pose acquisition unit acquires a position and a pose of an HMD which displays the rendered machine data.

11 . A display control method comprising the steps of:
acquiring a position and a pose of a viewpoint in a real space; disposing site data which is three-dimensional data representing a shape of a construction site in a virtual space on the basis of the position and the pose of the viewpoint; disposing machine data which is three-dimensional data representing a shape of a work machine at a position corresponding to the site data in the virtual space; and rendering the disposed machine data.

12 . A program causing a computer to execute the steps of:
acquiring a position and a pose of a viewpoint in a real space; disposing site data which is three-dimensional data representing a shape of a construction site in a virtual space on the basis of the position and the pose of the viewpoint; disposing machine data which is three-dimensional data representing a shape of a work machine at a position corresponding to the site data in the virtual space; and rendering the disposed machine data.

13 . A display system comprising:
a position/pose measurement unit that measures a position and a pose of a viewpoint in a real space; a site data disposition unit that disposes site data which is three-dimensional data representing a shape of a construction site in a virtual space on the basis of the position and the pose of the viewpoint; a machine data disposition unit that disposes machine data which is three-dimensional data representing a shape of a work machine at a position corresponding to the site data in the virtual space; a rendering unit that renders the disposed machine data; and a display unit that displays the rendered machine data.

14 . The display control device according to claim 2 ,
wherein the machine data has a movable portion, and wherein the rendering unit renders the machine data by changing a pose of the movable portion of the disposed machine data.

15 . The display control device according to claim 3 ,
wherein the machine data has a movable portion, and wherein the rendering unit renders the machine data by changing a pose of the movable portion of the disposed machine data.

16 . The display control device according to claim 2 , further comprising:
an image acquisition unit that acquires an image captured by an imaging device, wherein the position/pose acquisition unit acquires a position and a pose of a viewpoint of the imaging device.

17 . The display control device according to claim 16 ,
wherein the rendering unit combines the rendered machine data with the image.

18 . The display control device according to claim 7 , further comprising:
a site data acquisition unit that acquires the site data on the basis of the image.

19 . The display control device according to claim 2 ,
wherein the position/pose acquisition unit acquires a position and a pose of the display control device.

20 . The display control device according to claim 2 ,
wherein the position/pose acquisition unit acquires a position and a pose of an HMD which displays the rendered machine data.

Assignees

• Komatsu Mfg Co Ltd

Inventors

• Onishi Yoshiyuki
• Kurihara Masahiro

Classifications

• G09G3/20 Primary

  for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix {no fixed position being assigned to or needed to be assigned to the individual characters or partial characters} · CPC title

• G06T19/00 Primary

  Manipulating three-dimensional [3D] models or images for computer graphics · CPC title

• G09G5/377

  for mixing or overlaying two or more graphic patterns (G09G5/02, G09G5/397 take precedence) · CPC title

• G09G5/38

  with means for controlling the display position · CPC title

• H04N7/18

  Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast · CPC title