Determining floor name based on audio and/or visual samples

Patent metadata

Field	Value
Publication number	US-12473174-B2
Application number	US-202017076289-A
Country	US
Kind code	B2
Filing date	Oct 21, 2020
Priority date	Oct 21, 2020
Publication date	Nov 18, 2025
Grant date	Nov 18, 2025

Abstract

A processor obtains an audio sample captured by an audio sensor associated with a device and/or image data captured by an image sensor associated with the device. The image data comprises a representation of one or more elevator buttons. The processor analyzes the audio sample to identify a floor name indicator in the audio sample and/or the image data to identify an activated elevator button from among the one or more elevator buttons represented by the image data; and determines a floor name based on the floor name indicator identified in the analyzed audio sample and/or a floor name indicator associated with the identified activated elevator button in accordance with the analyzed image data. The processor causes the determined floor name to be stored and/or provided for positioning purposes.

First claim

That which is claimed:

1 . A method comprising:
obtaining, by one or more processors, one or more of (i) an audio sample captured by an audio sensor associated with a device or (ii) image data captured by an image sensor associated with the device, the image data comprising a representation of one or more elevator buttons; analyzing, by the one or more processors, one or more of (i) the audio sample to identify a floor name indicator in the audio sample or (ii) the image data to identify an activated elevator button from among the one or more elevator buttons represented by the image data; determining, by the one or more processors, a floor name based on one or more of the following: (i) the floor name indicator identified in the analyzed audio sample or (ii) a floor name indicator associated with the identified activated elevator button in accordance with the analyzed image data; and storing or providing, by the one or more processors, the determined floor name for positioning purposes.

2 . The method of claim 1 , further comprising associating the determined floor name with a horizontal reference position associated with a horizontal plane component of a location of the device when the one or more of (i) the audio sample or (ii) the image data was captured.

3 . The method of claim 2 , further comprising providing the determined floor name in association with the horizontal reference position such that a network device receives the floor name in association with the horizontal reference position.

4 . The method of claim 1 , wherein the analyzing is performed using a machine learning trained floor name identification model.

5 . The method of claim 1 , further comprising:
obtaining a sensor fingerprint captured using a sensor associated with the device at a location where the one or more of (i) the audio sample or (ii) the image data was captured; and associating the sensor fingerprint or a result of analyzing the sensor fingerprint with the determined floor name.

6 . The method of claim 1 , further comprising:
receiving an altitude of the device at a location where the one or more of (i) the audio sample or (ii) the image data was captured; and associating the altitude with the determined floor name.

7 . The method of claim 1 , wherein the audio sample comprises audio of an automated elevator voice.

8 . An apparatus comprising at least one processor and at least one memory storing computer program code, the at least one memory and the computer program code are configured to, with the processor, cause the apparatus to at least:
obtain one or more of (i) an audio sample captured by an audio sensor associated with a device or (ii) image data captured by an image sensor associated with the device, the image data comprising a representation of one or more elevator buttons; analyze one or more of (i) the audio sample to identify a floor name indicator in the audio sample or (ii) the image data to identify an activated elevator button from among the one or more elevator buttons represented by the image data; determine a floor name based on one or more of the following: (i) the floor name indicator identified in the analyzed audio sample or (ii) a floor name indicator associated with the identified activated elevator button in accordance with the analyzed image data; and store or provide the determined floor name for positioning purposes.

9 . The apparatus of claim 8 , wherein the at least one memory and the computer program code are further configured to, with the processor, cause the apparatus to associate the determined floor name with a horizontal reference position associated with a horizontal plane component of a location of the device when the one or more of (i) the audio sample or (ii) the image data was captured.

10 . The apparatus of claim 9 , wherein the at least one memory and the computer program code are further configured to, with the processor, cause the apparatus to provide the determined floor name in association with the horizontal reference position such that a network device receives the floor name in association with the horizontal reference position.

11 . The apparatus of claim 8 , wherein the analyzing is performed using a machine learning trained floor name identification model.

12 . The apparatus of claim 8 , wherein the at least one memory and the computer program code are further configured to, with the processor, cause the apparatus to:
obtain a sensor fingerprint captured using a sensor associated with the device at a location where the one or more of (i) the audio sample or (ii) the image data was captured; and associate the sensor fingerprint or a result of analyzing the sensor fingerprint with the determined floor name.

13 . The apparatus of claim 8 , wherein the at least one memory and the computer program code are further configured to, with the processor, cause the apparatus to:
receive an altitude of the device at a location where the one or more of (i) the audio sample or (ii) the image data was captured; and associate the altitude with the determined floor name.

14 . The apparatus of claim 8 , wherein the audio sample comprises audio of an automated elevator voice.

15 . A computer program product comprising at least one non-transitory computer-readable storage medium having computer-readable program code portions stored therein, the computer-readable program code portions comprise executable portions configured, when executed by a processor of an apparatus, to cause the apparatus to:
obtain one or more of (i) an audio sample captured by an audio sensor associated with a device or (ii) image data captured by an image sensor associated with the device, the image data comprising a representation of one or more elevator buttons; analyze one or more of (i) the audio sample to identify a floor name indicator in the audio sample or (ii) the image data to identify an activated elevator button from among the one or more elevator buttons represented by the image data; determine a floor name based on one or more of the following: (i) the floor name indicator identified in the analyzed audio sample or (ii) a floor name indicator associated with the identified activated elevator button in accordance with the analyzed image data; and store or provide the determined floor name for positioning purposes.

16 . The computer program product of claim 15 , wherein the computer-readable program code portions comprise executable portions configured, when executed by the processor of the apparatus, to cause the apparatus to associate the determined floor name with a horizontal reference position associated with a horizontal plane component of a location of the device when the one or more of (i) the audio sample or (ii) the image data was captured.

17 . The computer program product of claim 16 , wherein the computer-readable program code portions comprise executable portions configured, when executed by the processor of the apparatus, to cause the apparatus to provide the determined floor name in association with the horizontal reference position such that a network device receives the floor name in association with the horizontal reference position.

18 . The computer program product of claim 15 , wherein the analyzing is performed using a machine learning trained floor name identification model.

19 . The computer program product of claim 15 , wherein the computer-readable program code portions comprise executable portions configured, when executed by the processor of the appar

Assignees

• Here Global Bv

Inventors

• Nurminen Henri Jaakko Julius
• Ivanov Pavel
• Wirola Lauri Aarne Johannes

Classifications

• G06N20/00

  Machine learning · CPC title

• B66B2201/4646

  using voice recognition · CPC title

• B66B2201/4615

  Wherein the destination is registered before boarding · CPC title

• B66B2201/103

  Destination call input before entering the elevator car · CPC title

• B66B2201/4653

  wherein the call is registered using portable devices · CPC title