Method and appartus for selectively integrating sensory content

Patent metadata

Field	Value
Publication number	US-2016125656-A1
Application number	US-201514929322-A
Country	US
Kind code	A1
Filing date	Oct 31, 2015
Priority date	Nov 4, 2014
Publication date	May 5, 2016
Grant date	—

Abstract

To integrate a sensory property such as occlusion, shadowing, reflection, etc. among physical and notional (e.g. virtual/augment) visual or other sensory content, providing an appearance of similar occlusion, shadowing, etc. in both models. A reference position, a physical data model representing physical entities, and a notional data model are created or accessed. A first sensory property from either data model is selected. A second sensory property is determined corresponding with the first sensory property, and notional sensory content is generated from the notional data model with the second sensory property applied thereto. The notional sensory content is outputted to the reference position with a see-through display. Consequently, notional entities may appear occluded by physical entities, physical entities may appear to cast shadows from notional light sources, etc.

First claim

We claim:

1 . A machine-implemented method, comprising in a processor:
establishing a reference position; establishing a physical data model at least substantially representing at least one physical entity, said physical data model being spatially dynamic in time; establishing a notional data model at least substantially representing at least one notional entity, said notional data model being dynamic in time and non-exclusive of spatial coincidence with said physical data model; determining an occlusion of said notional data model by said physical data model relative to said reference position, wherein a first distance along a first direction from said reference position to said physical data model is less than a second distance along a second direction from said reference position to said notional data model, said second direction being at least substantially similar to said first direction; generating notional visual content representing at least a portion of said notional data model with at least a portion of said occlusion applied thereto; outputting to said reference position with a see-through display said notional visual content, at least substantially registered with said physical data model.

2 . The method of claim 1 , wherein:
further determining said occlusion wherein said first distance along said second direction from said reference position to said physical data model is substantially equal to said second distance along said second direction from said reference position to said notional data model.

3 . The method of claim 1 , wherein:
said at least one physical entity comprises at least a portion of a viewer.

4 . The method of claim 1 , wherein:
said at least one notional entity comprises at least one of a virtual reality entity and an augmented reality entity.

5 . The method of claim 1 , wherein:
said reference point substantially corresponds with an eye of a viewer.

6 . The method of claim 1 , wherein:
said see-through display is a head mounted display.

7 . The method of claim 1 , wherein:
said see-through display is at least one of an optical see-through display such that optical physical content at least substantially passes therethrough and a virtual see-through display adapted to output at least a portion of said physical data model therefrom.

8 . A machine-implemented method, comprising in a processor:
establishing a reference position; establishing a physical data model at least substantially representing at least one physical entity, said physical data model being spatially dynamic in time; establishing a notional data model at least substantially representing at least one notional entity, said notional data model being dynamic in time and non-exclusive of spatial coincidence with said physical data model; establishing a first sensory property from one of said physical and notional data models; determining a second sensory property, said second sensory property at least substantially corresponding with said first sensory property for another of said physical and notional data models; generating notional sensory content representing at least a portion of said notional data model with at least a portion of said second sensory property applied thereto; outputting to said reference position with a perceive-through display said notional sensory content, at least substantially registered with said physical data model.

9 . The method of claim 8 , wherein:
said first sensory property comprises at least one of a visual property and an auditory property.

10 . The method of claim 8 , wherein:
said second sensory property comprises at least one of a visual property and an auditory property.

11 . The method of claim 8 , wherein:
said at least one physical entity comprises at least a portion of a viewer.

12 . The method of claim 8 , wherein:
said at least one notional entity comprises at least one of a virtual reality entity and an augmented reality entity.

13 . The method of claim 8 , wherein:
said reference point substantially corresponds with an eye of a viewer.

14 . The method of claim 8 , wherein:
said perceive-through display is a head mounted display.

15 . The method of claim 8 , wherein:
said perceive-through display is at least one of an optical see-through display such that optical physical content at least substantially passes therethrough and a virtual see-through display adapted to output at least a portion of said physical data model therefrom.

16 . The method of claim 8 , comprising:
establishing said first sensory property from said physical data model; said second sensory property at least substantially corresponding with said first sensory property for said notional data model.

17 . The method of claim 16 , wherein:
said first sensory property at least substantially represents a physical environmental phenomenon.

18 . The method of claim 17 , wherein:
said physical environmental phenomenon comprises at least one of physical illumination, physical shadowing, a physical volumetric effect, and an optical phenomenon.

19 . The method of claim 17 , wherein:
said physical volumetric effect comprises at least one of a group consisting of at least one falling element, at least one flying element, and at least one suspended element.

20 . The method of claim 17 , wherein:
said physical volumetric effect comprises at least one of a group consisting of ash, debris, dust, fog, gas, hail, heat distortion, insects, leaves, mist, rain, sleet, smoke, snow, spray, and steam.

21 . The method of claim 17 , wherein:
said optical phenomenon comprises at least one of a group consisting of diffraction, diffusion, focus, glory, haloing, lens flare, and reflection.

22 . The method of claim 17 , wherein:
said second sensory property effect at least substantially represents a physical environmental phenomenon.

23 . The method of claim 22 , wherein:
said physical environmental phenomenon comprises at least one of physical illumination, physical shadowing, a physical volumetric effect, and an optical phenomenon.

24 . The method of claim 23 , wherein:
said physical volumetric effect comprises at least one of a group consisting of at least one falling element, at least one flying element, and at least one suspended element.

25 . The method of claim 23 , wherein:
said physical volumetric effect comprises at least one of a group consisting of ash, debris, dust, fog, gas, hail, heat distortion, insects, leaves, mist, rain, sleet, smoke, snow, spray, and steam.

26 . The method of claim 23 , wherein:
said physical environmental phenomenon comprises at least one of a group consisting of diffraction, diffusion, glory, haloing, lens flare, and reflection.

27 . The method of claim 8 , comprising:
establishing said first sensory property from said notional data model; said second sensory property at least substantially corresponding with said first sensory property for said physical data model.

28 . The method of claim 27 , wherein:
said first sensory phenomenon at least substantially represents a physical environmental phenomenon.

29 . The method of claim 28 , wherein:
said physical environmental phenomenon comprises at least one of physical illumination, physical shadowing, a physical volumetric effect, an

Assignees

• Atheer Inc

Inventors

• James Greg
• Yang Allen Yang
• Itani Sleiman

Classifications

• H04N23/00

  Cameras or camera modules comprising electronic image sensors; Control thereof · CPC title

• G02B27/0101

  characterised by optical features (G02B27/0172 takes precedence) · CPC title

• G02B27/0172

  characterised by optical features · CPC title

• G06T7/20

  Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) · CPC title

• G06T7/60

  Analysis of geometric attributes · CPC title