Portable information device having real-time display with relevant information

Patent metadata

Field	Value
Publication number	US-12316950-B2
Application number	US-202418623454-A
Country	US
Kind code	B2
Filing date	Apr 1, 2024
Priority date	Aug 8, 2008
Publication date	May 27, 2025
Grant date	May 27, 2025

Abstract

A portable information device includes: an image sensor; a position information acquisition portion that outputs position information; an orientation sensor; and a display that displays an image of an object output from the image sensor and displays relevant information on the object, the relevant information on the object being obtained based on at least measurement data from the position information acquisition portion and the orientation sensor.

First claim

What is claimed is:

1. A portable information device configured to be in communication with an information search server via an information communication network, the portable information device comprising:
an image sensor configured to pick up an image of a subject;
a locator configured to acquire position information about an image pickup position of the image sensor;
an orientation sensor configured to acquire an orientation information corresponding to an imaging direction at the image pickup position;
a display configured to display the image of the subject; and
a controller configured to transmit an image information on the subject, the position information and the orientation information to the information search server via the information communication network, wherein
the information search server (a) specifies the subject in the image, based on the image information, the position information and the orientation information, in reference to a database in the information search server, the database storing relevant information on a plurality of objects and position information on the objects, the relevant information being associated, in the database, with at least the position information, the information search server specifying the subject in the image by comparing a characteristic amount from image recognition of the subject in the image with a characteristic amount from image recognition of an image of a selected object of the plurality of objects in the database that is selected based on the position information and the orientation information, and (b) transmits the relevant information on the subject that has been specified to the portable information device via the information communication network, and
the controller controls the display to display the relevant information transmitted by the information search server.

2. The portable information device according to claim 1 , wherein
the controller controls the display to display the relevant information and the image of the subject substantially simultaneously.

3. The portable information device according to claim 2 , wherein
the controller controls the display to display the relevant information so that at least a part of the relevant information is overlapped on the image of the subject.

4. The portable information device according to claim 1 , wherein
the display includes a touch panel display.

5. The portable information device according to claim 1 , further comprising:
a memory configured to store the image information of the subject with identification information assigned thereto, wherein
the position information and the orientation information are stored in the memory in correspondence to the identification information.

6. The portable information device according to claim 1 , wherein
the subject is a building structure, and
the relevant information includes at least one of a name of the building structure, a peripheral image of the building structure and an inside image of the building structure.

7. The portable information device according to claim 6 , wherein
the building structure is a store and the relevant information includes commercial information of the store, and
the commercial information includes at least one of an inside image of the store and product information in the store.

8. The portable information device according to claim 7 , wherein
the relevant information includes at least one of post information on the store and coupon information.

9. The portable information device according to claim 1 , wherein
the information search server specifies the subject in the image when a similarity value obtained by the comparing of the characteristic amount of the subject in the image with the characteristic amount of the image of the selected object is equal or higher than a set value.

Assignees

• Nikon Corp

Inventors

• Inoue Hideya
• Iwaoka Toru
• Noborisaka Michiko
• Hatori Masayuki
• Hamada Tomohide

Classifications

• H04N23/633

  for displaying additional information relating to control or operation of the camera · CPC title

• H04N23/64

  Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image · CPC title

• H04N23/63

  by using electronic viewfinders · CPC title

• H04N2201/3276

  of a customised additional information profile, e.g. a profile specific to a user ID · CPC title

• H04N2201/3273

  Display · CPC title