Gaze enhanced natural motion blur

Patent metadata

Field	Value
Publication number	US-2020394766-A1
Application number	US-202016833790-A
Country	US
Kind code	A1
Filing date	Mar 30, 2020
Priority date	Mar 29, 2019
Publication date	Dec 17, 2020
Grant date	—

Abstract

There is provided systems, methods and computer program products for generating motion blur on image frames, comprising: obtaining gaze data related to an eye movement between consecutive images, determining movement of at least one object in relation to said gaze data by calculating the difference in position of said at least one object and said gaze data between the image frames, forming a motion blur vector and applying a motion blur on an image frame based on said motion blur vector.

First claim

1 . A method for generating motion blur, said method comprises the steps of:
obtaining gaze data related to an eye movement between a first image and a consecutive image, determining a relative movement of at least one object in relation to said gaze data during a sequence of image frames, comprising at least two images, by calculating the difference in position of said at least one object and said gaze data between said first image frame and said consecutive image frame, forming a motion blur vector based on the relative movement of said at least one object in relation to said gaze data, and applying a motion blur on a second image frame based on said motion blur vector.

2 . The method according to claim 1 , wherein the step of forming a motion blur vector comprises determining a movement resultant vector between said relative movement of said at least one object and a movement vector of said gaze data.

3 . The method according to claim 1 , wherein the step of forming a motion blur vector is further based on a motion scene camera movement provided by a motion scene camera used for capture said sequence of image frames.

4 . The method according to claim 1 wherein there is a time delay between said consecutive image frame and said second image frame.

5 . The method according to claim 1 , wherein said second image frame and said consecutive image frame are the same frame.

6 . The method according to claim 1 , wherein said gaze data comprises measurements of an eye orientation.

7 . A system for generating motion blur for a sequence of image frames comprising:
a scene renderer configured to:
obtain gaze data related to an eye movement between a first image and a consecutive image;
determine a relative movement of at least one object in relation to said gaze data during a sequence of image frames, comprising at least two images by calculating the difference in position of said at least one object and said gaze data between said first image frame and said consecutive image frame;
form a motion blur vector based on the relative movement of said at least one object in relation to said gaze data; and
apply a motion blur on a second image frame based on said motion blur vector.

8 . The system according to claim 7 , wherein the system further comprises a scene camera configured to capture a sequence of image frames, each having at least one object.

9 . The system according to claim 7 , wherein the system further comprises an eye tracker configured to determine said gaze data related to an eye movement and send said gaze data to the scene renderer.

10 . A head-mounted display, said head-mounted display comprising:
a frame adapted to be worn by a user; a display; and a scene renderer configured to:
obtain gaze data related to an eye movement between a first image and a consecutive image;
determine a relative movement of at least one object in relation to said gaze data during a sequence of image frames, comprising at least two images by calculating the difference in position of said at least one object and said gaze data between said first image frame and said consecutive image frame;
form a motion blur vector based on the relative movement of said at least one object in relation to said gaze data; and
apply a motion blur on a second image frame based on said motion blur vector;
wherein the display is configured to render said applied motion blur on the second image frame.

11 . The head-mounted display according to claim 10 , wherein the head-mounted display further comprises an eye tracker configured to determine said gaze data related to an eye movement and send said gaze data to the scene renderer.

12 . The head-mounted display according to claim 10 , wherein the head-mounted display is adapted for virtual reality, augmented reality, mixed reality or other extended reality experiences.

13 . (canceled)

14 . (canceled)

Assignees

• Tobii Ab

Inventors

• Rönngren Denny

Classifications

• G06V40/19

  Sensors therefor · CPC title

• G06V40/193

  Preprocessing; Feature extraction · CPC title

• G06T2207/20201

  Motion blur correction · CPC title

• G06T7/254

  involving subtraction of images · CPC title

• G06T7/20

  Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) · CPC title