Systems and methods for image display

Patent metadata

Field	Value
Publication number	US-11967038-B2
Application number	US-202117304745-A
Country	US
Kind code	B2
Filing date	Jun 25, 2021
Priority date	Dec 28, 2018
Publication date	Apr 23, 2024
Grant date	Apr 23, 2024

Abstract

A system and method for jointly displaying an image and a map is disclosed. The method may including obtaining an image captured by a camera. The image may include a target in a surrounding environment of the camera. The method may further include obtaining a map of the surrounding environment. The map may at least include a location corresponding to the target and a location corresponding to the camera. The method may jointly display the image and the map, wherein a representation of the image is aligned with the location corresponding to the target and the location corresponding to the camera in the map.

First claim

We claim:

1. A system implemented on an image processing device, the image processing device comprising:
an obtaining module, a map processing module, an image processing module, a displaying module, and a storage module, wherein the storage module is configured to store data, instructions, or any other information related to image display, and the image processing device is directed to cause the system to:
obtain an image captured by a camera by the obtaining module, the image including a target in a surrounding environment of the camera;
obtain a map of the surrounding environment by the obtaining module, the map at least including a location corresponding to the target and a location corresponding to the camera; and
jointly display the image and the map by the displaying module, wherein a representation of the image is aligned with the location corresponding to the target and the location corresponding to the camera in the map, and to jointly display the image and the map, the image processing device is directed to:
project a content of the map onto a first imaging surface by the map processing module, to form a representation of the map, the map being transmitted to the map processing module by the obtaining module;
project a content of the image onto a second imaging surface by the image processing module, to form the representation of the image, the image being transmitted to the image processing module by the obtaining module; and
display the representation of the map and the representation of the image by the displaying module.

2. The system of claim 1 , wherein the image captured by the camera is a panorama.

3. The system of claim 1 , wherein the second imaging surface includes a cylindrical surface.

4. The system of claim 1 , wherein the representation of the map is formed according to a first projection relationship associated with the map, and the representation of the image is formed according to a second projection relationship associated with the image.

5. The system of claim 4 , wherein the first projection relationship includes a first rotation angle associated with an orientation of the map.

6. The system of claim 5 , wherein the second projection relationship includes a second rotation angle associated with the representation of the image on the second imaging surface.

7. The system of claim 6 , wherein the image processing device is further directed to cause the system to:
receive an instruction to adjust an orientation of the joint display of the image and the map;
adjust the first rotation angle associated with the orientation of the map and the second rotation angle associated with the representation of the image on the second imaging surface; and
update the joint display of the image and the map according to the adjusted first rotation angle and the adjusted second rotation angle.

8. The system of claim 4 , wherein the first projection relationship includes a first scale associated with a zooming effect of the map.

9. The system of claim 8 , wherein the second projection relationship includes a second scale associated with a zooming effect of the image.

10. The system of claim 9 , wherein the image processing device is further directed to cause the system to:
receive an instruction to adjust a field of view in the joint display of the image and the map;
adjust the first scale associated with the zooming effect of the map and the second scale associated with the zooming effect of the image; and
update the joint display of the image and the map according to the adjusted first scale and the adjusted second scale.

11. A method implemented on a device having at least one storage medium including a set of instructions and at least one processor in communication with the at least one storage medium, the method comprising:
obtaining an image captured by a camera, the image including a target in a surrounding environment of the camera;
obtaining a map of the surrounding environment, the map at least including a location corresponding to the target and a location corresponding to the camera; and
jointly displaying the image and the map, wherein a representation of the image is aligned with the location corresponding to the target and the location corresponding to the camera in the map, wherein jointly displaying the image and the map includes:
projecting a content of the map onto a first imaging surface to form a representation of the map;
projecting a content of the image onto a second imaging surface to form the representation of the image; and
jointly displaying the representation of the map and the representation of the image.

12. The method of claim 11 , wherein the representation of the map is formed according to a first projection relationship associated with the map, and the representation of the image is formed according to a second projection relationship associated with the image.

13. The method of claim 12 , wherein the first projection relationship includes a first rotation angle associated with an orientation of the map.

14. The method of claim 13 , wherein the second projection relationship includes a second rotation angle associated with the representation of the image on the second imaging surface.

15. The method of claim 14 , wherein the method further includes:
receiving an instruction to adjust an orientation of the joint display of the image and the map;
adjusting the first rotation angle associated with the orientation of the map and the second rotation angle associated with the representation of the image on the second imaging surface; and
updating the joint display of the image and the map according to the adjusted first rotation angle and the adjusted second rotation angle.

16. The method of claim 12 , wherein the first projection relationship includes a first scale associated with a zooming effect of the map.

17. The method of claim 16 , wherein the second projection relationship includes a second scale associated with a zooming effect of the image.

18. The method of claim 17 , wherein the method further includes:
receiving an instruction to adjust a field of view in the joint display of the image and the map;
adjusting the first scale associated with the zooming effect of the map and the second scale associated with the zooming effect of the image; and
updating the joint display of the image and the map according to the adjusted first scale and the adjusted second scale.

Assignees

• Zhejiang Dahua Technology Co

Inventors

• Li Qiankun
• Lu Wei
• Yin Jun
• Zhang Xingming

Classifications

• G06T3/005 Primary

  Physics · mapped topic

• G06T3/40

  Scaling of whole images or parts thereof, e.g. expanding or contracting · CPC title

• G06T3/60

  Rotation of whole images or parts thereof · CPC title

• G06T11/60

  Creating or editing images; Combining images with text · CPC title

• H04N23/53

  of electronic viewfinders, e.g. rotatable or detachable · CPC title