Image processing device, image processing method, and non-transitory storage medium

Patent metadata

Field	Value
Publication number	US-12506970-B2
Application number	US-202418788316-A
Country	US
Kind code	B2
Filing date	Jul 30, 2024
Priority date	Jun 13, 2019
Publication date	Dec 23, 2025
Grant date	Dec 23, 2025

Abstract

The present invention provides an image processing apparatus ( 10 ) including a detection unit ( 12 ) that detects a plurality of predetermined points of a body of each of a plurality of persons from an image in an image circle of a fisheye image, a gravity direction determination unit ( 13 ) that determines a gravity direction in a position of each of the plurality of persons from the plurality of predetermined points, a reference point decision unit ( 14 ) that decides a reference point, based on the gravity direction in the position of each of the plurality of persons, a complementary circular image generation unit ( 16 ) that generates a complementary circular image that is a circular image acquired by adding a complementary image to the image in the image circle of the fisheye image, and that has, as a center, the reference point different from a center of the image in the image circle, and an expansion unit ( 17 ) that panoramically expands the complementary circular image, based on the reference point, and generates a panoramic image.

First claim

The invention claimed is:

1 . An image processing apparatus comprising;
at least one memory storing instructions and at least one processor configured to execute the instructions to:
receive a fisheye image;
determine a reference point regarding the fisheye image based on information related to a person shown in the fisheye image; and
generate a panoramic image based on the reference point regarding the fisheye image.

2 . The image processing apparatus according to claim 1 , wherein the information related to a person shown in the fisheye image includes a gravity direction in a position of the person.

3 . The image processing apparatus according to claim 1 , wherein the at least one processor further configured to execute the instructions to generate a complementary circular image,0 wherein the instruction to generate the panoramic image uses the complementary circular image for generating the panoramic image.

4 . The image processing apparatus according to claim 3 , wherein the complementary circular image is used in a case where the reference point dose not coincide with a center of an image regarding the fisheye image.

5 . An image processing method executed by a computer, the method comprising;
receiving a fisheye image; determining a reference point regarding the fisheye image based on information related to a person shown in the fisheye image; and generating a panoramic image based on the reference point regarding the fisheye image.

6 . The image processing method according to claim 5 , wherein the information related to a person shown in the fisheye image includes a gravity direction in a position of the person.

7 . The image processing method according to claim 5 , wherein the computer generates a complementary circular image, wherein the computer uses the complementary circular image for generating the panoramic image.

8 . The image processing method according to claim 7 , wherein the complementary circular image is used in a case where the reference point dose not coincide with a center of an image regarding the fisheye image.

Assignees

• Nec Corp

Inventors

• Liu Jianquan
• Li Junnan

Classifications

• H04N23/611 Primary

  where the recognised objects include parts of the human body · CPC title

• H04N23/698 Primary

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• H04N1/387

  Composing, repositioning or otherwise {geometrically} modifying originals · CPC title

• G06T3/00

  Geometric image transformations in the plane of the image · CPC title