Method and video communication device for transmitting video to a remote user

Patent metadata

Field	Value
Publication number	US-9628772-B2
Application number	US-201314895121-A
Country	US
Kind code	B2
Filing date	Jun 27, 2013
Priority date	Jun 27, 2013
Publication date	Apr 18, 2017
Grant date	Apr 18, 2017

Abstract

A method, computer program product and video communication device are provided for transmitting video to a remote user. The video communication device includes a communication interface for providing a communication session with a device of the remote user, a camera capturing images, and a control unit configured to obtain a three-dimensional model of the location, control the camera to capture video images of the location, determine a current orientation of the video communication device, and transfer the three-dimensional model and orientation to the device of the remote user together with a video stream from the camera comprising the captured video images.

First claim

The invention claimed is:

1. A method of transmitting video to a remote user from an industrial site where a process control system is operated, the method being performed by a video communication device being placed at a location of the industrial site and performed in relation to a communication session carried out between the video communication device and a device of the remote user, the method comprising:
obtaining a three-dimensional model of the location and the various objects at the location;
obtaining the position of the video communication device at the location;
capturing video images of the location using a camera of the video communication device;
determining a current orientation of the camera;
adding a representation of the video communication device to the three-dimensional model of the location so that the video communication device is shown in the model; and
transferring, in the communication session from the video communication device to the device of the remote user, the three-dimensional model and the orientation of the camera and the position of the video communication device together with a video stream comprising the captured video images.

2. The method according to claim 1 , further comprising investigating if there is a pre-existing three-dimensional model of the location, fetching and using the pre-existing model if there is one and otherwise creating the three-dimensional model based on scanning the location.

3. The method according to claim 1 , wherein the orientation of the camera is provided as a solid angle related to the position of the video communication device and a reference angle.

4. The method according to claim 2 , if there is a pre-existing three-dimensional model, further comprising obtaining previous positions of the video communication device, possibly together with previous orientations of the camera and video recordings made at these previous positions.

5. The method according to claim 1 , wherein the orientation of the camera is provided as a part of the three-dimensional model that is continuously transferred to the device of the remote user.

6. The method according to claim 1 , wherein the orientation of the camera is transferred as updates of the three-dimensional model during the transfer of video images from the video communication device to the device of the remote user.

7. A video communication device for transmitting video to a remote user from an industrial site where a process control system is operated, the video communication device being placed at a location of the industrial site and comprising:
a communication interface for providing a communication session between the video communication device and a device of the remote user;
a camera capturing images; and
a control unit configured to:
obtain a three-dimensional model of the location and the various objects at the location;
obtain the position of the video communication device at the location;
control the camera to capture video images of the location;
determine a current orientation of the camera;
add a representation of the video communication device to the three-dimensional model of the location so that the video communication device is shown in the model; and
transfer, in the communication session from the video communication device to the device of the remote user, the three-dimensional model and the orientation of the camera and the position of the video communication device together with a video stream from the camera comprising the captured video images.

8. The video communication device according to claim 7 , the control unit being further configured to investigate if there is a pre-existing three-dimensional model of the location, fetch and use the pre-existing model if there is one and otherwise create the three-dimensional model based on scanning the location using the camera.

9. The video communication device according to claim 7 , wherein the orientation of the camera is provided as a solid angle related to the position of the video communication device and a reference angle.

10. The video communication device according to claim 8 , wherein if there is a pre-existing three-dimensional model, the control unit is further configured to obtain previous positions of the video communication device, possibly together with previous orientations of the camera and video recordings made at these previous positions.

11. The video communication device according to claim 7 , wherein the orientation of the camera is provided as a part of the three-dimensional model that is continuously transferred to the device of the remote user.

12. The video communication device according to claim 7 , wherein the orientation of the camera is transferred as updates of the three-dimensional model during the transfer of video images from the video communication device to the device of the remote user.

13. A computer program product for transmitting video to a remote user from an industrial site where a process control system is operated, said computer program product being provided on a non-transitory data carrier comprising computer program code configured to cause a video communication device comprising a camera to, when said computer program code is loaded into the video communication device and the video communication device is placed at a location of the industrial site and there is a communication session between the video communication device and a device of the remote user,
obtain a three-dimensional model of the location and the various objects at the location;
obtain the position of the video communication device at the location;
capture video images of the location using the camera;
determine a current orientation of the camera;
add a representation of the video communication device to the three-dimensional model of the location so that the video communication device is shown in the model; and
transfer, in the communication session from the video communication device to the device of the remote user, the three-dimensional model and the orientation of the camera and the position of the video communication device together with a video stream comprising the captured video images.

14. The method according to claim 2 , wherein the orientation of the camera is provided as a solid angle related to the position of the video communication device and a reference angle.

15. The method according to claim 2 , wherein the orientation of the camera is provided as a part of the three-dimensional model that is continuously transferred to the device of the remote user.

16. The method according to claim 3 , wherein the orientation of the camera is provided as a part of the three-dimensional model that is continuously transferred to the device of the remote user.

17. The method according to claim 4 wherein the orientation of the camera is provided as a part of the three-dimensional model that is continuously transferred to the device of the remote user.

18. The method according to claim 2 , wherein the orientation of the camera is transferred as updates of the three-dimensional model during the transfer of video images from the video communication device to the device of the remote user.

19. The method according to claim 3 , wherein the orientation of the camera is transferred as updates of the three-dimensional model during the transfer of video images from the video communication device to the device of the remote user.

20. The method according to claim 4 , wherein the orientation of the camera is transferred

Assignees

• Abb Schweiz Ag

Inventors

• Alfredsson Fredrik
• Vartiainen Elina
• Brönmark Jonas
• Tsai Tony
• Billinghurst Mark
• Tait Matthew

Classifications

• H04N21/422

  Input-only peripherals {, i.e. input devices connected to specially adapted client devices}, e.g. global positioning system [GPS] {(input devices also receiving signals from specially adapted client devices H04N21/4104)} · CPC title

• H04N21/42202

  environmental sensors, e.g. for detecting temperature, luminosity, pressure, earthquakes · CPC title

• H04N21/8126

  involving additional data, e.g. news, sports, stocks, weather forecasts · CPC title

• H04N13/0059 Primary

  Electricity · mapped topic

• H04N21/816

  involving special video data, e.g 3D video · CPC title