Method and apparatus for operating control system, storage medium, and electronic apparatus

Patent metadata

Field	Value
Publication number	US-11275239-B2
Application number	US-201916594565-A
Country	US
Kind code	B2
Filing date	Oct 7, 2019
Priority date	Nov 3, 2017
Publication date	Mar 15, 2022
Grant date	Mar 15, 2022

Abstract

Embodiments of the present disclosure disclose a method and an apparatus for operating a control system, a storage medium, and an electronic apparatus. The method includes: obtaining, by using a target recording device in a control system, first image information of a target object moving in a real scene; obtaining a first distance corresponding to the first image information, the first distance being a distance between the target recording device and the target object; and adjusting a target parameter of the control system according to the first distance, the target parameter being used for outputting media information to a virtual reality (VR) device, the VR device being connected to the control system, the media information being corresponding to movement information of the target object moving in the real scene, and the movement information comprising the first distance.

First claim

What is claimed is:

1. A method for operating a control system, comprising:
obtaining, by using a target recording device in a control system, first image information of a target object moving in a real scene;
obtaining a first distance corresponding to the first image information, the first distance being a distance between the target recording device and the target object; and
adjusting a target parameter of the control system according to the first distance, the target parameter being used for outputting media information to a virtual reality (VR) device, the VR device being connected to the control system, the media information being corresponding to movement information of the target object moving in the real scene, and the movement information comprising the first distance,
wherein the media information comprises light information, the target parameter comprises a light parameter used to control the light information being sent to the VR device, and adjusting the target parameter of the control system according to the first distance comprises:
adjusting the light parameter to a first value if a status change of the first distance indicates that the first distance is reduced, light of the control system being focused within a target region of the target recording device; and
adjusting the light parameter to a second value if the status change of the first distance indicates that the first distance is increased, the light of the control system being focused beyond the target region of the target recording device.

2. The method according to claim 1 , the obtaining a first distance corresponding to the first image information comprising:
obtaining a first image parallax between first sub-image information and second sub-image information in the first image information, wherein the first sub-image information is obtained by recording the target object by a first video camera, the second sub-image information is obtained by recording the target object by a second video camera, the first video camera and the second video camera are in the target recording device, and the first image parallax representing a difference between a first image of the target object indicated by the first sub-image information and a second image of the target object indicated by the second sub-image information; and
obtaining the first distance corresponding to the first image parallax in a target correspondence table.

3. The method according to claim 2 , the obtaining a first image parallax between first sub-image information and second sub-image information in the first image information comprising:
obtaining a first midpoint horizontal coordinate in the first sub-image information, the first midpoint horizontal coordinate being a horizontal coordinate of a central point of the first image in a target coordinate system;
obtaining a second midpoint horizontal coordinate in the second sub-image information, the second midpoint horizontal coordinate being a horizontal coordinate of a central point of the second image in the target coordinate system; and
determining a difference between the first midpoint horizontal coordinate and the second midpoint horizontal coordinate as the first image parallax.

4. The method according to claim 2 , the obtaining the first distance corresponding to the first image parallax in a target correspondence table comprising:
looking up the target correspondence table for a target image parallax with a minimum difference from the first image parallax; and
determining a distance corresponding to the target image parallax in the target correspondence table as the first distance.

5. The method according to claim 2 , wherein before the obtaining the first distance corresponding to the first image parallax in a target correspondence table, the method further comprises:
obtaining second image information of the target object by using the target recording device, the distance between the target object and the target recording device being a first target distance;
obtaining a second image parallax between third sub-image information and fourth sub-image information in the second image information, the third sub-image information being obtained by recording the target object by the first video camera, the fourth sub-image information being obtained by recording the target object by the second video camera, and the second image parallax representing a difference between a third image of the target object indicated by the third sub-image information and a fourth image of the target object indicated by the fourth sub-image information;
establishing a correspondence between the first target distance and the second image parallax in the target correspondence table;
obtaining third image information of the target object by using the target recording device, the distance between the target object and the target recording device being a second target distance, and the second target distance being different from the first target distance;
obtaining a third image parallax between fifth sub-image information and sixth sub-image information in the third image information, wherein the fifth sub-image information is obtained by recording the target object by the first video camera, the sixth sub-image information is obtained by recording the target object by the second video camera, and the third image parallax representing a difference between a fifth image of the target object indicated by the fifth sub-image information and a sixth image of the target object indicated by the sixth sub-image information; and
establishing a correspondence between the second target distance and the third image parallax in the target correspondence table.

6. The method according to claim 5 , the obtaining the second image parallax between the third sub-image information and the fourth sub-image information further comprising:
obtaining a third midpoint horizontal coordinate in the third sub-image information, wherein the third midpoint horizontal coordinate is a horizontal coordinate of a central point of the third image in a target coordinate system;
obtaining a fourth midpoint horizontal coordinate in the fourth sub-image information, wherein the fourth midpoint horizontal coordinate is a horizontal coordinate of a central point of the fourth image in the target coordinate system; and determining a difference between the third midpoint horizontal coordinate and the fourth midpoint horizontal coordinate as the second image parallax; and
the obtaining the third image parallax between the fifth sub-image information and the sixth sub-image information comprising:
obtaining a fifth midpoint horizontal coordinate in the fifth sub-image information, wherein the fifth midpoint horizontal coordinate is a horizontal coordinate of a central point of the fifth image in the target coordinate system;
obtaining a sixth midpoint horizontal coordinate in the sixth sub-image information, wherein the sixth midpoint horizontal coordinate is a horizontal coordinate of a central point of the sixth image in the target coordinate system; and
determining a difference between the fifth midpoint horizontal coordinate and the sixth midpoint horizontal coordinate as the third image parallax.

7. The method according to claim 3 , the obtaining a first midpoint horizontal coordinate in the first sub-image information comprising one of the following:
determining an average value between a horizontal coordinate of a central point of a left-eye image in the target coordinate system and a horizontal coordinate of a central point of a right-eye image in the target coordinate system as the first midpoint horizontal coordinate if the first image information is image information of a face;
determining a horizontal coordinate o

Assignees

• Tencent Tech Shenzhen Co Ltd

Inventors

• Zhou Yang
• Wang Jingui

Classifications

• G02B2027/0129

  comprising devices for correcting parallax · CPC title

• H04N13/239 Primary

  using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance (H04N13/243 takes precedence) · CPC title

• H04N2013/0081

  Depth or disparity estimation from stereoscopic image signals · CPC title

• G05B13/04

  involving the use of models or simulators · CPC title

• H04N13/254

  in combination with electromagnetic radiation sources for illuminating objects · CPC title