Automatic adjustment of video orientation

Patent metadata

Field	Value
Publication number	US-9762848-B2
Application number	US-201313838686-A
Country	US
Kind code	B2
Filing date	Mar 15, 2013
Priority date	Mar 15, 2013
Publication date	Sep 12, 2017
Grant date	Sep 12, 2017

Abstract

Methods, systems and computer program products for automatic adjustment of video orientation are provided. A computer-implemented method may include receiving a video comprising a plurality of image frames, detecting an orientation change in the video, determining a standard orientation for the video, and adjusting the video to the standard orientation by resizing one or more of the image frames and by rotating one or more of the image frames to the standard orientation. The adjusted video in the standard orientation then may be provided to a user.

First claim

What is claimed is:

1. A computer-implemented method comprising:
receiving, by a video sharing service, a video recorded by a video recording device of a mobile device of a user, the video comprising a plurality of image frames;
determining, by a processor of the video sharing service, that an orientation change and shaking of the mobile device have occurred during recording of the video, wherein the orientation change and shaking are determined for the video based on data stored by the video recording device in each of the plurality of image frames of the video, the data comprising orientation information of a corresponding image frame of the video and position information of the corresponding image frame of the video, the position information being indicative of shaking;
notifying, by the processor, the user of the orientation change and shaking of the mobile device during the recording of the video;
determining, by the processor, a standard orientation and a baseline alignment for the video, the standard orientation being determined based on a most common orientation detected throughout the video, and one or more parameters of a video player to present the video;
adjusting, by the processor, the video to the standard orientation and the baseline alignment, wherein the adjusting comprises:
automatically resizing one or more of the plurality of image frames in the video based on the standard orientation;
automatically rotating one or more of the plurality of image frames in the video to the standard orientation; and
automatically adjusting one or more of the plurality of image frames in the video to the baseline alignment to correct shaking; and

providing, by the processor, a user interface comprising the video player to present a preview of the adjusted video in the standard orientation and baseline alignment to the user on the mobile device.

2. The computer-implemented method of claim 1 , wherein determining that the orientation change and shaking of the mobile device have occurred during recording of the video comprises:
comparing, by the processor, a video recording device position associated with a first image frame in the video to a second video recording device position associated with a second image frame in the video.

3. The computer-implemented method of claim 1 , wherein adjusting the video to the standard orientation further comprises:
determining a degree of rotation required to adjust the image frame to the standard orientation.

4. The computer-implemented method of claim 1 , wherein automatically resizing comprises cropping one or more of the image frames.

5. The computer-implemented method of claim 1 , wherein automatically resizing comprises extending display resolution of one or more of the image frames.

6. The computer-implemented method of claim 5 , wherein extending display resolution of one or more of the image frames comprises:
defining a square of longest sides of the video based on a landscape orientation of the video and a portrait orientation of the video; and
extending resolution of image frames to the square of the longest sides of the video.

7. The computer-implemented method of claim 5 , wherein the resizing comprises:
calculating a standard display size for the video using shortest sides of the video; and
cropping portions of the one or more of the plurality of image frames that extend beyond the calculated display size.

8. The computer-implemented method of claim 1 , further comprising:
providing an interface to allow the user to adjust the video to the standard orientation.

9. The computer-implemented method of claim 1 , wherein the standard orientation is further determined based on an original orientation of the video.

10. The computer-implemented method of claim 1 , wherein the standard orientation is further determined based on a stored user preference.

11. The computer-implemented method of claim 1 , wherein the standard orientation is further determined based on a user selection.

12. The computer-implemented method of 1 , wherein the one or more parameters of the video player comprises at least one of an orientation of the video player, a size of the video player, an orientation of a display device providing the video player, or a size of the display device.

13. A non-transitory computer readable medium having instructions stored thereon, that when executed by a processor, cause the processor to perform operations comprising:
receiving, by a video sharing service, a video recorded by a video recording device of a mobile device of a user, the video comprising a plurality of image frames;
determining, by the processor of the video sharing service, that an orientation change and shaking of the mobile device have occurred during recording of the video, wherein the orientation change and shaking are determined for the video based on data stored by the video recording device in each of the plurality of image frames of the video, the data comprising orientation information of a corresponding image frame of the video and position information of the corresponding image frame of the video, the position information being indicative of shaking;
notifying, by the processor, the user of the orientation change and shaking of the mobile device during the recording of the video;
determining, by the processor, a standard orientation and a baseline alignment for the video, the standard orientation being determined based on a most common orientation detected throughout the video, and one or more parameters of a video player to present the video;
adjusting, by the processor, the video to the standard orientation and the baseline alignment, wherein the adjusting comprises:
automatically resizing one or more of the plurality of image frames in the video based on the standard orientation;
automatically rotating one or more of the plurality of image frames in the video to the standard orientation; and
automatically adjusting one or more of the plurality of image frames in the video to the baseline alignment to correct shaking; and

providing, by the processor, a user interface comprising the video player to present a preview of the adjusted video in the standard orientation and baseline alignment to the user on the mobile device.

14. The computer readable medium of claim 13 , wherein determining that the orientation change and shaking of the mobile device have occurred during recording of the video comprises:
comparing, by the processor, a video recording device position associated with a first image frame in the video to a second video recording device position associated with a second image frame in the video.

15. The computer readable medium of claim 13 , wherein adjusting the video to the standard orientation comprises:
determining a degree of rotation required to adjust the image frame to the standard orientation.

16. A system, comprising:
a memory; and
a processor coupled to the memory to:
receive a video recorded by a video recording device of a mobile device of a user, the video comprising a plurality of image frames;
determine that an orientation change and shaking of the mobile device have occurred during recording of the video, wherein the orientation change and shaking are determined for the video based on data stored by the video recording device in each of the plurality of image frames of the video, the data comprising orientation information of a corresponding image frame of the video and position information of the corresponding image frame of the video, the position information being indicative of shaking;
notify the user of

Assignees

• Nowakowski Maciek S
• Szabo Balazs
• Google Inc

Inventors

• Nowakowski Maciek S
• Szabo Balazs

Classifications

• H04N23/6811

  based on the image signal · CPC title

• H04N23/681

  Motion detection · CPC title

• H04N5/2628

  Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation · CPC title

• H04N7/0117 Primary

  involving conversion of the spatial resolution of the incoming video signal (for graphics images G09G2340/0407) · CPC title

• H04N5/23254

  Electricity · mapped topic