Method of Pose Change Notification and Related Interactive Image Processing System

Patent metadata

Field	Value
Publication number	US-2020342610-A1
Application number	US-201916392650-A
Country	US
Kind code	A1
Filing date	Apr 24, 2019
Priority date	Apr 24, 2019
Publication date	Oct 29, 2020
Grant date	—

Abstract

A method of pose change notification for an interactive image processing system performing a space scanning process includes receiving a current image and a previous image from a camera of the interactive image processing system; calculating a pose change of the camera of the interactive image processing system according to the current image and the previous image; and generating a notification to a user of the interactive image processing system when the pose change of the camera has met at least one threshold.

First claim

What is claimed is:

1 . A method of pose change notification for an interactive image processing system performing a space scanning process, comprising:
receiving a current image and a previous image from a camera of the interactive image processing system; calculating a pose change of the camera of the interactive image processing system according to the current image and the previous image; and generating a notification to a user of the interactive image processing system when the pose change of the camera of the interactive image processing system has met at least one threshold.

2 . The method of pose change notification of claim 1 , wherein the at least one threshold comprises a first threshold associated with a rotation of the pose change, a second threshold associated with a translation of the pose change, and a third threshold associated with an elapsed time of the pose change.

3 . The method of pose change notification of claim 2 , wherein the notification is generated: when the rotation of the pose change meets the first threshold indicating a predetermined degrees, when the translation of the pose change meets the second threshold causing a content of the previous image and a content of the current image to change by one-third of a same scene, and when the elapsed time of the pose change meets the third threshold indicating a predetermined time.

4 . The method of pose change notification of claim 1 , wherein calculating the pose change of the camera of the interactive image processing system according to the current image and the previous image comprises:
calculating a previous pose corresponding to the previous image; calculating a current pose corresponding to the current image; and subtracting the previous pose from the current pose to calculate the pose change.

5 . The method of pose change notification of claim 1 , wherein calculating the previous pose corresponding to the previous image or calculating the current pose corresponding to the current image comprises:
extracting features of the previous image or the current image; finding correspondences from the features of the previous image or the current image; and estimating the previous pose corresponding to the previous image or the current pose corresponding to the current image based on the correspondences of the previous image or the current image.

6 . The method of pose change notification of claim 5 , wherein calculating the previous pose corresponding to the previous image or calculating the current pose corresponding to the current image further comprises:
storing coordinates of the features of the previous image or the current image; and refining the previous pose corresponding to the previous image or the current pose corresponding to the current image based on the coordinates of the features of the previous image or the current image.

7 . An interactive image processing system performing a space scanning process, comprising:
a camera configured to generate a current image and a previous image; a processing device coupled to the camera, and configured to generate a control signal according to the current image and the previous image; a notification device coupled to the processing device, and configured to generate a notification to a user according to the control signal; and a memory device coupled to the processing device, and configured to store a program code, wherein the program code instructs the processing device to perform following steps in the space scanning process:
receiving the current image and the previous image from the camera;
calculating a pose change of the camera according to the current image and the previous image;
comparing the pose change of the camera with at least one threshold; and
generating the control signal to the notification device when the pose change of the camera has met the at least one threshold.

8 . The interactive image processing system of claim 7 , wherein the at least one threshold comprises a first threshold associated with a rotation of the pose change, a second threshold associated with a translation of the pose change, and a third threshold associated with an elapsed time of the pose change.

9 . The interactive image processing system of claim 8 , wherein the notification is generated: when the rotation of the pose change meets the first threshold indicating a predetermined degrees, when the translation of the pose change meets the second threshold causing a content of the previous image and a content of the current image to change by one-third of a same scene, and when the elapsed time of the pose change meets the third threshold indicating a predetermined time.

10 . The interactive image processing system of claim 7 , wherein calculating a pose change of the camera according to the current image and the previous image comprises:
calculating a previous pose corresponding to the previous image; calculating a current pose corresponding to the current image; and subtracting the previous pose from the current pose to calculate the pose change.

11 . The interactive image processing system of claim 7 , wherein calculating the previous pose corresponding to the previous image or calculating the current pose corresponding to the current image comprises:
extracting features of the previous image or the current image; finding correspondences from the features of the previous image or the current image; and estimating the previous pose corresponding to the previous image or the current pose corresponding to the current image based on the correspondences of the previous image or the current image.

12 . The interactive image processing system of claim 11 , wherein calculating the previous pose corresponding to the previous image or calculating the current pose corresponding to the current image further comprises:
storing coordinates of the features of the previous image or the current image; and refining the previous pose corresponding to the previous image or the current pose corresponding to the current image based on the coordinates of the features of the previous image or the current image.

Assignees

• Xrspace Co Ltd

Inventors

• Wu Meng-Hau
• Tsai Chung-Chih
• Su Shang-Chin

Classifications

• G06T7/73 Primary

  using feature-based methods · CPC title

• H04N23/64

  Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image · CPC title

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title