Method for reproducing an item of audiovisual content having haptic actuator control parameters and device implementing the method

Patent metadata

Field	Value
Publication number	US-10536682-B2
Application number	US-201414770814-A
Country	US
Kind code	B2
Filing date	Feb 24, 2014
Priority date	Feb 27, 2013
Publication date	Jan 14, 2020
Grant date	Jan 14, 2020

Abstract

The present disclosure relates to a method for reproducing an item of video content filmed using a camera. An item of video content composed of sequences is developed and enhanced by commands applied to the camera at the time of filming. With a view to reproduction, the video content is divided into sequences. The commands applied to the camera are extracted for each sequence and make it possible to calculate at least one haptic actuator control parameter associated with this sequence. At the time of the reproduction of a sequence of the video content, at least one control parameter thus calculated controls at least one haptic actuator. In this way, the spectator perceives stimuli making it possible to enhance his perception of the video document during the reproduction. Advantageously, the player able to reproduce the enhanced content determines a cinematographic effect for a set of sequences from commands applied to the camera. Then the haptic metaphor associated with this effect is applied to this set of sequences.

First claim

The invention claimed is:

1. A method of reproducing at least one sequence of a video content filmed using a camera, the video content being a first part of an enhanced content, the method comprising
retrieving a cinematographic effect from a predetermined set of cinematographic effects analyzing commands applied to the camera when filming the at least one sequence; said at least one data being a second part of the enhanced content and comprising at least zoom commands for said camera; a cinematographic effect of said predetermined set being associated with a sequence of camera commands to retrieve when analyzing; and
controlling, during the reproduction of the at least one sequence, at least one haptic actuator using at least one control parameter associated with said cinematographic effect in said predetermined set.

2. The method according to claim 1 , wherein said at least one command applied to the camera is measured using at least one movement sensor associated with said camera.

3. The method according to claim 1 , wherein said at least one command belongs to a group of commands comprising:
command for displacement along at least one axis of a coordinate system associated with a scene filmed by said camera;
command for rotation about at least one axis of a coordinate system associated with a scene filmed by said camera;
in addition to zoom command for said camera.

4. The method according to claim 1 , wherein numerical values of the at least one command applied to the camera produce numerical values controlling the at least one haptic actuator.

5. The method according to claim 1 , further comprising transmitting the video content and the at least one command applied to the camera during said at least one sequence to a device for reproducing video content and controlling the at least one haptic actuator, the obtaining of the at least one control parameter for the at least one haptic actuator being executed by said device.

6. The method according to claim 1 , further comprising transmitting the video content and the at least one control parameter for the at least one haptic actuator to a device for reproducing video content and controlling the at least one haptic actuator.

7. The method according to claim 6 , wherein a plurality of groups of control parameters for the at least one haptic actuator are associated with said at least one sequence, each group of parameters being associated with a device for reproducing video content and controlling particular haptic actuators.

8. The method according to claim 1 , wherein the actuators are three in number, two actuators intended to be gripped, one in each hand, by a spectator, and one actuator intended to support the head of said spectator.

9. The method according to claim 1 , wherein if no cinematographic effect is detected during a sequence, then the at least one control parameter for the at least one haptic actuator associated with said at least one sequence is obtained from the control values applied to the camera during filming of said at least one sequence.

10. The method according to claim 1 wherein the determined cinematographic effect belongs to a group of cinematographic effects comprising: arc shot, crane shot, Dutch angle, travelling shot, tilt shot, vertigo shot and zoom.

11. A device configured for reproducing at least one sequence of a video content filmed using a camera, the video content being a first part of an enhanced content, wherein said device comprises at least one processor configured to:
retrieve a cinematographic effect from a predetermined set of cinematographic effects by analyzing commands applied to the camera when filming the at least one sequence; said at least one data being a second part of the enhanced content and comprising at least zoom commands for said camera; a cinematographic effect of said predetermined set being associated with a sequence of camera commands to retrieve when analyzing; and
control, during the reproduction of the at least one sequence, at least one haptic actuator using at least one control parameter associated with said cinematographic effect in said predetermined set.

12. The device according to claim 11 , wherein the at least one processor is configured to control three haptic actuators, two actuators being intended to be gripped, one in each hand, by a spectator, and one actuator being intended to support the head of said spectator.

13. The device according to claim 11 , wherein said at least one command applied to the camera is measured using at least one movement sensor associated with said camera.

14. The device according to claim 11 , wherein said at least one command belongs to a group of commands comprising:
command for displacement along at least one axis of a coordinate system associated with a scene filmed by said camera;
command for rotation about at least one axis of a coordinate system associated with a scene filmed by said camera;
in addition to zoom command for said camera.

15. The device according to claim 11 , wherein numerical values of the at least one command applied to the camera produce numerical values controlling the at least one haptic actuator.

16. The device according to claim 11 , wherein the at least one processor is further configured to transmit the video content and the at least one command applied to the camera during said at least one sequence to a device for reproducing video content and controlling the at least one haptic actuator.

17. The device according to claim 11 , wherein the at least one processor is further configured to transmit the video content and the at least one control parameter for the at least one haptic actuator to a device for reproducing video content and controlling the at least one haptic actuator.

18. The device according to claim 17 , wherein a plurality of groups of control parameters for the at least one haptic actuator are associated with said at least one sequence, each group of parameters being associated with a device for reproducing video content and controlling particular haptic actuators.

19. The device according to claim 11 , wherein when no cinematographic effect is detected during a sequence, then the at least one control parameter for the at least one haptic actuator associated with said at least one sequence is obtained from control values applied to the camera during filming of said at least one sequence.

20. The device according to claim 11 wherein the determined cinematographic effect belongs to a group of cinematographic effects comprising: arc shot, crane shot, Dutch angle, travelling shot, tilt shot, vertigo shot and zoom.

21. A non-transitory computer-readable storage medium storing a computer program product comprising instructions for implementing the method according to claim 1 , when the program is executed by a processor.

Assignees

• Thomson Licensing
• Interdigital Ce Patent Holdings

Inventors

• Danieau Fabien
• Fleureau Julien
• Guillotel Philippe
• Mollet Nicolas
• Lecuyer Antole
• Christie Marc

Classifications

• H04N23/69

  Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming · CPC title

• A63G31/16

  creating illusions of travel · CPC title

• H04N9/8205 Primary

  involving the multiplexing of an additional signal and the colour video signal · CPC title

• H04N5/262

  Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects {; Cameras specially adapted for the electronic generation of special effects} · CPC title

• H04N5/2621

  Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability · CPC title