Method and system for generating at least one image of a real environment

Patent metadata

Field	Value
Publication number	US-2024106971-A1
Application number	US-202318525058-A
Country	US
Kind code	A1
Filing date	Nov 30, 2023
Priority date	Dec 29, 2014
Publication date	Mar 28, 2024
Grant date	—

Abstract

A method of generating at least one image of a real environment comprises providing at least one environment property related to at least part of the real environment, providing at least one virtual object property related to a virtual object, determining at least one imaging parameter according to the at least one provided virtual object property and the at least one provided environment property, and generating at least one image of the real environment representing information about light leaving the real environment according to the determined at least one imaging parameter, wherein the light leaving the real environment is measured by at least one camera.

First claim

1 . A method for generating an image of an environment, comprising:
determining one or more properties of a virtual object to be presented in a view of a physical environment; selecting one or more adjusted camera parameters based on one or more properties of the physical environment and the one or more properties of the virtual object; and causing the image capture device to capture an image of the physical environment using the one or more adjusted camera parameters to account for the virtual object to be presented in the view of the physical environment.

2 . The method of claim 1 , further comprising, in response to the image capture device capturing the image of the physical environment:
generating a composite image comprising the virtual object and the image of the environment, wherein the composite image comprises the virtual object in the view of the physical environment.

3 . The method of claim 1 , wherein the one or more properties of the virtual object comprises an illumination characteristic of the virtual object, and the one or more adjusted camera parameters are further selected in accordance with a predicted lighting effect of the virtual object on the environment.

4 . The method of claim 3 , wherein the one or more properties of the virtual object comprises a brightness characteristic of the virtual object, and wherein the one or more adjust camera parameters are associated with at least one selected from group consisting of an aperture setting and an exposure time.

5 . The method of claim 1 , wherein the one or more properties of the virtual object comprise at least part of a pose of the virtual object relative to the image capture device.

6 . The method of claim 5 , wherein the one or more adjust camera parameters are associated with a viewing direction.

7 . The method of claim 1 , wherein the one or more properties of then virtual object comprise a geometrical property of the virtual object.

8 . The method of claim 7 , wherein the one or more adjust camera parameters are associated with a focal length.

9 . The method of claim 1 , wherein the one or more properties of the physical environment comprise at least one or more of: a pose of the image capture device within the physical environment, a visual property of the real environment, and a geometric property of the real environment.

10 . A non-transitory computer readable medium comprising computer readable code executable by one or more processors to:
determine one or more properties of a virtual object to be presented in a view of a physical environment; select one or more adjusted camera parameters based on one or more properties of the physical environment and the one or more properties of the virtual object; and cause the image capture device to capture an image of the physical environment using the one or more adjusted camera parameters to account for the virtual object to be presented in the view of the physical environment.

11 . The non-transitory computer readable medium of claim 10 , further comprising computer readable code to, in response to the image capture device capturing the image of the physical environment:
generate a composite image comprising the virtual object and the image of the environment, wherein the composite image comprises the virtual object in the view of the physical environment.

12 . The non-transitory computer readable medium of claim 10 , wherein the one or more properties of the virtual object comprises an illumination characteristic of the virtual object, and the one or more adjusted camera parameters are further selected in accordance with a predicted lighting effect of the virtual object on the environment.

13 . The non-transitory computer readable medium of claim 12 , wherein the one or more properties of the virtual object comprises a brightness characteristic of the virtual object, and wherein the one or more adjust camera parameters are associated with at least one selected from group consisting of an aperture setting and an exposure time.

14 . The non-transitory computer readable medium of claim 10 , wherein the one or more properties of the virtual object comprise at least part of a pose of the virtual object relative to the image capture device.

15 . The non-transitory computer readable medium of claim 14 , wherein the one or more adjust camera parameters are associated with a viewing direction.

16 . The non-transitory computer readable medium of claim 10 , wherein the one or more properties of then virtual object comprise a geometrical property of the virtual object.

17 . The non-transitory computer readable medium of claim 16 , wherein the one or more adjust camera parameters are associated with a focal length.

18 . The non-transitory computer readable medium of claim 10 , wherein the one or more properties of the physical environment comprise at least one or more of: a pose of the image capture device within the physical environment, a visual property of the real environment, and a geometric property of the real environment.

19 . A system comprising:
one or more processors; and one or more computer readable media comprising computer readable code executable by the one or more processors to:
determine one or more properties of a virtual object to be presented in a view of a physical environment;
select one or more adjusted camera parameters based on one or more properties of the physical environment and the one or more properties of the virtual object; and
cause the image capture device to capture an image of the physical environment using the one or more adjusted camera parameters to account for the virtual object to be presented in the view of the physical environment.

20 . The system of claim 19 , wherein the one or more adjusted camera parameters comprise at least one selected from a group consisting of: a focus, exposure time, flash setting, torch setting, ISO, dynamic range, lens position, Device's Configuration, (Color) Formats, Focus Settings, Exposure Settings, Zoom Settings, Flash Settings, Torch Settings, Low Light Settings, Frame Rate Settings, Subject Area, Device Characteristics, Lens Position, Image Exposure, White Balance, ISO, High Dynamic Range Video, resolution, framerate, shutter mode, bit depth, gamma correction, black level adjustment, noise reduction, edge enhancement, contrast enhancement, false chroma suppression, chroma subsampling, chroma resampling, color transformation, image compression, and rolling shutter.

Assignees

• Apple Inc

Inventors

• Knorr Sebastian
• Kurz Daniel

Classifications

• H04N23/951

  by using two or more images to influence resolution, frame rate or aspect ratio · CPC title

• H04N23/957

  Light-field or plenoptic cameras or camera modules · CPC title

• H04N23/80

  Camera processing pipelines; Components thereof · CPC title

• H04N5/272 Primary

  Means for inserting a foreground image in a background image, i.e. inlay, outlay · CPC title

• G06T7/70

  Determining position or orientation of objects or cameras (camera calibration G06T7/80) · CPC title