Method and control system for three-dimensional video playback using visual fatigue estimation

Patent metadata

Field	Value
Publication number	US-9300942-B2
Application number	US-201313939188-A
Country	US
Kind code	B2
Filing date	Jul 11, 2013
Priority date	Oct 18, 2012
Publication date	Mar 29, 2016
Grant date	Mar 29, 2016

Abstract

A method for playing a three-dimensional video is provided, which includes the following steps. A disparity velocity or a disparity acceleration for at least one continuous video in the three-dimensional video is calculated. A visual fatigue estimating value of a viewer is calculated according to the disparity velocity or the disparity acceleration. A subsequent playback of the three-dimensional video is controlled according to the visual fatigue estimating value.

First claim

What is claimed is:

1. A method for playing a three-dimensional video, comprising:
calculating a disparity velocity or a disparity acceleration for at least one continuous video in the three-dimensional video;
calculating a visual fatigue estimating value of a viewer according to the disparity velocity or the disparity acceleration, wherein the step of calculating the visual fatigue estimating value comprises:
calculating a visual fatigue estimating value (fa) according to Formula (3), wherein Formula (3) is fa=f(DA), where fa is a visual fatigue estimating value of the viewer after watching at each of time units in the at least one continuous video, and DA is a disparity acceleration for each of the time units in the at least one continuous video; and
calculating an overall visual fatigue estimating value (Fa) according to Formula (4), wherein Formula (4) is Fa=f(fa, T), where T is a playback time for the at least one continuous video, wherein the overall visual fatigue estimating value is calculated according to Formula (6.8), where Formula (6.8) is Fa=Σ T 1 T 2 fa=Σ T 1 T 2 DS Tdi R T W d V i , DS Tdi is the disparity velocity, W d is a disparity range weight, R T is a temporal weight, V i is a disparity velocity weight, T 1 is a start time for the at least one continuous video, and T 2 is an end time for the at least one continuous video; and

controlling a subsequent playback of the three-dimensional video according to the visual fatigue estimating value.

2. The method for playing the three-dimensional video according to claim 1 , wherein the disparity velocity comprises a mean disparity velocity, a maximum disparity velocity and/or a minimum disparity velocity.

3. The method for playing the three-dimensional video according to claim 1 , wherein the disparity acceleration comprises a mean disparity acceleration, a maximum disparity acceleration and/or a minimum disparity acceleration.

4. The method for playing the three-dimensional video according to claim 1 , wherein the overall visual fatigue estimating value is calculated according to Formula (6.1), where Formula (6.1) is Fa=Σ T 1 T 2 fa=Σ T 1 T 2 DS T , DS T is the disparity velocity, T 1 is a start time for the at least one continuous video, and T 2 is an end time for the at least one continuous video.

5. The method for playing the three-dimensional video according to claim 1 , wherein the overall visual fatigue estimating value is calculated according to Formula (6.2), where Formula (6.2) is Fa=Σ T 1 T 2 fa=Σ T 1 T 2 DS T R T , DS T is the disparity velocity, R T is a temporal weight, T 1 is a start time for the at least one continuous video, and T 2 is an end time for the at least one continuous video.

6. The method for playing the three-dimensional video according to claim 1 , wherein the overall visual fatigue estimating value is calculated according to Formula (6.3), where Formula (6.3) is Fa=Σ T 1 T 2 fa=Σ T 1 T 2 DS i V i , DS i is the disparity velocity, V i is a disparity velocity weight, T 1 is a start time for the at least one continuous video, and T 2 is an end time for the at least one continuous video.

7. The method for playing the three-dimensional video according to claim 1 , wherein the overall visual fatigue estimating value is calculated according to Formula (6.4), where Formula (6.4) is Fa=Σ T 1 T 2 fa=Σ T 1 T 2 DS Ti R T V i , DS T is the disparity velocity, R T is a temporal weight, V i is a disparity velocity weight, T 1 is a start time for the at least one continuous video, and T 2 is an end time for the at least one continuous video.

8. The method for playing the three-dimensional video according to claim 1 , wherein the overall visual fatigue estimating value is calculated according to Formula (6.5), where Formula (6.5) is Fa=Σ T 1 T 2 fa=Σ T 1 T 2 DS di W d V i , DS di is the disparity velocity, W d is a disparity range weight, V i is a disparity velocity weight, T 1 is a start time for the at least one continuous video, and T 2 is an end time for the at least one continuous video.

9. The method for playing the three-dimensional video according to claim 1 , wherein the step of calculating the overall visual fatigue estimating value comprises:
when a disparity range is greater than a predetermined value, the overall visual fatigue estimating value is calculated according to Formula (6.6), where Formula (6.6) is Fa=Σ T 1 T 2 fa=Σ T 1 T 2 DS di W d V i , DS di is the disparity velocity, W d is a disparity range weight, V i is a disparity velocity weight, T 1 is a start time for the at least one continuous video, and T 2 is an end time for the at least one continuous video; and
when the disparity range is less than the predetermined value, the overall visual fatigue estimating value is calculated according to Formula (6.7), where Formula (6.7) is Fa=Σ T 1 T 2 fa=Σ T 1 T 2 DS di .

10. The method for playing the three-dimensional video according to claim 1 , wherein the disparity velocity or the disparity acceleration for the at least one continuous video is obtained by calculating all of regions in the at least one continuous video.

11. The method for playing the three-dimensional video according to claim 1 , wherein the disparity velocity or the disparity acceleration for the at least one continuous video is obtained by calculating a part of regions in the at least one continuous video.

12. A control system adapted to control a playback of a three-dimensional video, the control system comprising:
a three-dimensional video stream input unit;
a disparity estimation unit, coupled to the three-dimensional video stream input unit, wherein the disparity estimation unit calculates a disparity velocity or a disparity acceleration for at least one continuous video in the three-dimensional video;
a visual fatigue estimation unit, coupled to the disparity estimation unit, wherein the visual fatigue estimation unit calculates a visual fatigue estimating value (fa) according to Formula (3) and an overall visual fatigue estimating value (Fa) according to Formula (4),
wherein Formula (3) is fa=f(DA), where fa is a visual fatigue estimating value of the viewer after watching at each of time units in the at least one continuous video, and DA is a disparity acceleration for each of the time units in the at least one continuous video, and
wherein Formula (4) is Fa=f(fa, T), where T is a playback time for the at least one continuous video, wherein the overall visual fatigue estimating value is calculated according to Formula (6.8), where Formula (6.8) is Fa=Σ T 1 T 2 fa=Σ T 1 T 2 DS Tdi R T W d V i , DS Tdi is the disparity velocity, W d is a disparity range weight, R T is a temporal weight, V i is a disparity velocity weight, T 1 is a start time for the at least one continuous video, and T 2 is an end time for the at least one continuous video;

a fatigue recovery control unit, coupled to the three-dimensional video stream input unit and the visual fatigue estimation unit, wherein the fatigue recovery control unit controls a subsequent playback of the three-dimensional video according to the visual fatigue estimating value; and
a three-dimensional video stream display unit, coupled to the fatigue recovery control unit.

13. A control system adapted to control a playback of a three-dimensional video, the control system comprising:
a three-dimensional video stream input unit;
a disparity estimation unit, couple

Assignees

• Ind Tech Res Inst

Inventors

• Zeng Wen-Jun
• Lin Ming-Hui
• Lin Yu-Ting

Classifications

• H04N13/128

  Adjusting depth or disparity · CPC title

• H04N13/144 Primary

  for flicker reduction · CPC title

• H04N13/0022

  Electricity · mapped topic

• H04N13/0033 Primary

  Electricity · mapped topic