Picture Projection Methods and Systems

Patent metadata

Field	Value
Publication number	US-2026004509-A1
Application number	US-202519318571-A
Country	US
Kind code	A1
Filing date	Sep 4, 2025
Priority date	Aug 11, 2023
Publication date	Jan 1, 2026
Grant date	—

Abstract

Aspects described herein disclose picture projection techniques in virtual environments. The techniques may be performed by a vehicle simulator, the vehicle simulator may include an image generator and a projection device. The techniques may include performing scene rendering using the image generator based on scene data, to obtain a first scene picture, the scene data indicating a scene falling within a field of view when a first virtual scene is observed from a first virtual viewpoint, and the first scene picture being located in an image space; mapping the first scene picture to a to-be-projected picture using the image generator based on a first mapping relationship between the first virtual viewpoint and the image space, the to-be-projected picture being located in the image space; and performing projection display using the projection device based on a pixel value corresponding to each coordinate point in the to-be-projected picture, to obtain a projection picture. Picture projection accuracy is improved using the described techniques.

First claim

What is claimed is:

1 . A computer-implemented method, comprising:
performing, by a vehicle-simulator comprising an image generator and a projection device, scene rendering by the image generator based on scene data, to obtain a first scene picture, the scene data indicating a scene within a field of view when a first virtual scene is observed from a first virtual viewpoint; mapping the first scene picture to a to-be-projected picture by the image generator according to a first mapping relationship between the first virtual viewpoint and an image space, the to-be-projected picture being located in the image space; and performing projection display by the projection device based on a pixel value corresponding to each coordinate point in the to-be-projected picture, to obtain a projection picture.

2 . The method according to claim 1 , wherein the performing scene rendering comprises:
determining three-dimensional space coordinate points within a line-of-sight range in the first virtual scene along a line-of-sight range of the first virtual viewpoint by the image generator, the scene data comprising sub-data corresponding to the three-dimensional space coordinate points; performing the scene rendering by the image generator based on the sub-data of the three-dimensional space coordinate points, to obtain the first scene picture; and the mapping comprises: obtaining a pixel value corresponding to each pixel in the first scene picture; and updating the pixel value corresponding to each pixel in the first scene picture according to the first mapping relationship between the first virtual viewpoint and the image space, to obtain the to-be-projected picture.

3 . The method of claim 1 , wherein the vehicle simulator further comprises a computer device, and the method further comprises:
obtaining a second mapping relationship between the image space and a screen space by the computer device, the projection picture being located in the screen space; obtaining a third mapping relationship between the first virtual viewpoint and the screen space by the computer device; and obtaining the first mapping relationship between the first virtual viewpoint and the image space by the computer device through inverse mapping calculation based on the second mapping relationship and the third mapping relationship.

4 . The method according to claim 3 , wherein the obtaining the second mapping relationship comprises:
performing projection display on at least three first mark points to enable the at least three first mark points to be in a one-to-one mapping with at least three second mark points set on a projection screen, wherein the at least three second mark points are non-collinear points; obtaining a first coordinate set of the at least three first mark points in the image space after the at least three first mark points are in the one-to-one mapping with the at least three second mark points; obtaining a second coordinate set of the at least three second mark points in the screen space; and determining the second mapping relationship between the image space and the screen space based on the first coordinate set, the second coordinate set, a shape of the projection screen, and a projection matrix corresponding to the projection device.

5 . The method according to claim 4 , wherein the performing projection display on at least three first mark points comprises:
performing projection display on the at least three first mark points, to obtain a mark projection picture; shooting the mark projection picture by using a camera, to obtain a shot picture, the shot picture comprising the at least three first mark points and the at least three second mark points; and aligning the at least three first mark points with the at least three second mark points based on the shot picture.

6 . The method of claim 3 , wherein the obtaining the third mapping relationship comprises:
determining a line-of-sight set from the first virtual viewpoint to the second coordinate set based on the second coordinate set of the at least three second mark points in the screen space; and determining the third mapping relationship between the first virtual viewpoint and the screen space based on the first virtual viewpoint, the line-of-sight set, the second coordinate set, and the shape of the projection screen.

7 . The method of claim 3 , wherein the obtaining the first mapping relationship comprises:
determining two mapping relationship expressions corresponding to the second coordinate set based on the second mapping relationship and the third mapping relationship; and determining the first mapping relationship between the first virtual viewpoint and the image space in an inverse mapping calculation manner based on the two mapping relationship expressions.

8 . The method of claim 1 , wherein the vehicle simulator further comprises a computer device, and when at least two projection devices and at least two image generators are present, the at least two projection devices and the at least two image generators are in a one-to-one mapping, and the method further comprises:
determining a first mapping relationship between the first virtual viewpoint and an image space corresponding to each image generator by the computer device; mapping each first scene picture to a to-be-projected picture in each image space based on the first mapping relationship between the first virtual viewpoint and each image space by the at least two image generators; performing projection display by each projection device based on pixel values corresponding to coordinate points of the to-be-projected picture in each image space, to obtain a plurality of projection pictures; and determining a picture overlapping area by the computer device based on an overlapping situation of the plurality of projection pictures and a shape of a projection screen corresponding to each projection device.

9 . The method according to claim 8 , further comprising:
determining an overlapping coordinate point corresponding to each projection device in a respective to-be-projected picture by the computer device based on a second mapping relationship between a screen space and an image space of each projection device, the overlapping coordinate point being a coordinate point that is overlapped after being mapped to the screen space; and adjusting a brightness value of the overlapping coordinate point by the computer device based on screen projection brightness, causing the projection brightness corresponding to the overlapping coordinate point to be the same as the projection brightness corresponding to other non-overlapping coordinate points.

10 . The method according to claim 1 , wherein the vehicle simulator further comprises a computer device, and the method further comprises:
displaying a viewpoint selection control on the computer device before picture projection; and determining that the first virtual viewpoint is selected from the first virtual viewpoint and a second virtual viewpoint by using the computer device in response to a trigger operation on the viewpoint selection control.

11 . A vehicle simulator system, comprising:
a processor; an image generator; a projection device; and memory storing computer readable instructions which, when executed by the processor, configure the vehicle simulator system to perform:
rendering a scene by the image generator based on scene data, to obtain a first scene picture, the scene data indicating a scene within a field of view when a first virtual scene is observed from a first virtual viewpoint;
mapping the first scene picture to a to-be-projected picture by the image generator according to a

Assignees

• Tencent Tech Shenzhen Co Ltd

Inventors

• Wu Yu
• Zhu Sikan

Classifications

• H04N9/3147

  Multi-projection systems (video walls G06F3/1446) · CPC title

• G06T2200/24

  involving graphical user interfaces [GUIs] · CPC title

• G06T15/20 Primary

  Perspective computation · CPC title

• H04N13/363

  using image projection screens (volumetric display H04N13/388) · CPC title

• H04N9/3194

  including sensor feedback · CPC title