Method, apparatus and computer program product to represent motion in composite images

Patent metadata

Field	Value
Publication number	US-2016125633-A1
Application number	US-201314890015-A
Country	US
Kind code	A1
Filing date	May 13, 2013
Priority date	May 13, 2013
Publication date	May 5, 2016
Grant date	—

Abstract

In an example embodiment a method, apparatus and computer program product are provided. The method includes facilitating access of a plurality of images associated with a scene comprising at least one moving object, and segmenting the plurality of images into foreground regions and background regions based on changes in corresponding image regions between the images. The foreground regions comprise the at least one moving object. The method includes determining at least one object parameter associated with the at least one moving object in the foreground regions and generating a background image based on the background regions, and modifying at least one of the foreground regions and the background image to represent a motion of the at least one moving object based on the at least one object parameter. The method includes generating a composite image based on the modified at least one of the foreground regions and the background image.

First claim

1 - 66 . (canceled)

67 . A method comprising:
facilitating access of a plurality of images associated with a scene, the scene comprising at least one moving object; segmenting the plurality of images into foreground regions and background regions based on a change in corresponding image regions between the plurality of images, wherein the foreground regions comprise the at least one moving object; determining at least one object parameter associated with the at least one moving object in the foreground regions; generating a background image based on the background regions; modifying at least one of the foreground regions and the background image to represent a motion of the at least one moving object based on the at least one object parameter; and generating a composite image based on the at least one modified foreground regions and the background image.

68 . The method as claimed in claim 67 , further comprising aligning the plurality of images.

69 . The method as claimed in claim 67 , wherein the segmenting the plurality of images comprises segmenting an image of the plurality of images, and wherein the segmenting the image of the plurality of images comprises:
determining at least one image region in the image comprising a change with respect to a corresponding image region in at least one other image of the plurality of images; classifying the at least one image region of the image as the foreground region of the image if there a change in the at least one image region; and classifying remaining image regions of the image as the background region of the image.

70 . The method as claimed in claim 67 , wherein the at least one object parameter associated with the at least one moving object comprises one or more of a location of the at least one moving object and a shape of the at least one moving object.

71 . The method as claimed in claim 67 , wherein the modifying comprises blurring at most n−1 foreground regions, if there are n foreground regions associated with the plurality of images, where n is a natural number.

72 . The method as claimed in claim 67 , wherein the modifying the at least one of the foreground regions comprises performing an extreme motion blur emulation on at most n−1 foreground regions, if the foreground regions comprises n foreground regions, where n is a natural number.

73 . The method as claimed in claim 67 , wherein the modifying the background image comprises performing a blur operation on the background image.

74 . The method as claimed in claim 67 , wherein the modifying the background image comprises performing a selective blur of the background image to create a path associated with the moving object.

75 . The method as claimed in claim 74 , wherein the path of the at least one moving object is determined based on the object parameters of the plurality of images.

76 . The method as claimed in claim 67 , wherein the modifying the at least one of the foreground regions comprises replacing at most n−1 foreground regions by a sample image, if the foreground regions comprises n foreground regions, where n is a natural number.

77 . An apparatus comprising:
at least one processor; and at least one memory comprising computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to at least perform:
facilitate access of a plurality of images associated with a scene, the scene comprising at least one moving object;
segment the plurality of images into foreground regions and background regions based on a change in corresponding image regions between the plurality of images, wherein foreground regions comprise the at least one moving object;
determine at least one object parameter associated with the at least one moving object in the foreground regions;
generate a background image based on the background regions;
modify at least one of the foreground regions and the background image to represent a motion of the at least one moving object based on the at least one object parameter; and
generate a composite image based on the modified at least one of the foreground regions and the background image.

78 . The apparatus as claimed in claim 77 , wherein the apparatus is further caused, at least in part, to align the plurality of images.

79 . The apparatus as claimed in claim 77 , wherein the segmenting the plurality of images comprises segmenting an image of the plurality of images, and wherein the apparatus is further caused, at least in part to:
determine at least one image region in the image comprising a change with respect to a corresponding image region in at least one other image of the plurality of images; classify the at least one image region of the image as the foreground region of the image if there is a change in the at least one image region; and classify remaining image regions of the image as the background region of the image.

80 . The apparatus as claimed in claim 77 , wherein the at least one object parameter associated with the at least one moving object comprises one or more of a location of the at least one moving object and a shape of the at least one moving object.

81 . The apparatus as claimed in claim 77 , wherein to modify the at least one of the foreground regions, the apparatus is further caused, at least in part to blur at most n−1 foreground regions, if foreground regions comprises n foreground regions, where n is a natural number.

82 . The apparatus as claimed in claim 77 , wherein to modify the at least one of the foreground regions, the apparatus is further caused, at least in part to perform extreme motion blur emulation of at most n−1 foreground regions, if the foreground regions comprises n foreground regions, where n is a natural number.

83 . The apparatus as claimed in claim 77 , wherein to modify the background image, the apparatus is further caused, at least in part to perform a blur operation on the background image.

84 . The apparatus as claimed in claim 77 , wherein to modify the background image, the apparatus is further caused, at least in part to perform a selective blur of the background image to create a path associated with the moving object.

85 . The apparatus as claimed in claim 84 , wherein the apparatus is further caused, at least in part to determine the path of the at least one moving object based on the object parameters of the plurality of images.

86 . The apparatus as claimed in claim 77 , wherein to modify the at least one of the foreground regions, the apparatus is further caused, at least in part to replace at most n−1 foreground regions by a sample image, if the foreground regions comprises n foreground regions, where n is a natural number.

87 . A computer program product comprising at least one computer-readable storage medium, the computer-readable storage medium comprising a set of instructions, which, when executed by one or more processors, cause an apparatus to at least perform:
facilitate access of a plurality of images associated with a scene, the scene comprising at least one moving object; segment the plurality of images into foreground regions and background regions based on changes in corresponding image regions between the plurality of images, wherein foreground regions at least comprise the at least one moving object; determine at least one object parameter associated with the at least one moving object in the foreground regions; generate a background ima

Assignees

• Nokia Technologies Oy

Inventors

• Windmark Johan
• Lindskog Alexander
• Karlsson Tobias

Classifications

• G06T3/4038 Primary

  Image mosaicing, e.g. composing plane images from plane sub-images · CPC title

• G06T11/60 Primary

  Creating or editing images; Combining images with text · CPC title

• G06F18/24

  Classification techniques · CPC title

• G06T7/2033

  Physics · mapped topic

• G06T2207/20144

  Physics · mapped topic