Augmented reality car operating panel

Patent metadata

Field	Value
Publication number	US-11420846-B2
Application number	US-201916352187-A
Country	US
Kind code	B2
Filing date	Mar 13, 2019
Priority date	Mar 13, 2018
Publication date	Aug 23, 2022
Grant date	Aug 23, 2022

Abstract

An elevator system is provided. Aspects includes an elevator car, a sensor, and a projector affixed to the elevator car, wherein the projector is operated by a controller and the controller is configured to receive an indication of a presence of a passenger in the elevator car. A car operating panel is projected, by a projector, in the elevator car, wherein the car operating panel comprises a virtual element. An activation of the virtual element from the passenger is sensed by a sensor and an action is initiated based at least in part on sensing the activation of the virtual element.

First claim

What is claimed is:

1. An elevator system comprising:
an elevator car, a sensor, and a projector affixed to the elevator car, wherein the projector is operated by a controller; and
wherein the controller is configured to:
receive an indication of a presence of a passenger in the elevator car;
project, by the projector, a car operating panel in the elevator car, wherein the car operating panel comprises a virtual element;
sense, by the sensor, an indication of a selection of the virtual element by the passenger;
determine a confidence level for the indication, wherein based on the confidence level being below a confidence threshold alerting the passenger to adjust the selection; and
initiate an action based at least in part on sensing the activation of the virtual element.

2. The elevator system of claim 1 , the action comprises: initiating an elevator command for the elevator car.

3. The elevator system of claim 1 , the action comprises:
adding, by the controller, a second virtual element to the car operating panel; and
projecting, by the projector, the second virtual element in the car operating panel.

4. The elevator system of claim 1 , wherein the activation of the virtual element from the passenger comprises:
engaging, by the passenger, a region in the virtual element for a duration of time.

5. The elevator system of claim 1 , wherein the activation of the virtual element from the passenger comprises:
engaging, by the passenger, a region in the virtual element utilizing a movement pattern.

6. The elevator system of claim 1 , wherein the virtual element comprises a first color; and
responsive to sensing the activation of the virtual element from the passenger, the virtual element changes to a second color.

7. The elevator system of claim 1 , wherein the controller is further configured to:
periodically detect, by the sensor, the presence of the passenger; and
responsive to the passenger exiting the elevator car, initiating a power savings mode for the car operating panel.

8. The elevator system of claim 1 , wherein the car operating panel is projected on to a surface of the elevator car.

9. The elevator system of claim 1 , wherein the car operating panel comprises a first mode and a second mode;
wherein the first mode comprises a minimal display of the virtual element; and
wherein the second mode comprises a descriptive display of the virtual element.

10. The elevator system of claim 9 , wherein the initiating the action comprises projecting, by the projector, the second mode for the car operating panel.

11. The elevator system of claim 1 , wherein the controller is further operable to:
determine a location of the passenger in the elevator car; and
wherein the car operating panel is projected to a second location proximate to the location of the passenger.

12. The elevator system of claim 1 , wherein the car operating panel further comprises a news feed.

13. The elevator system of claim 1 further comprising a microphone, wherein the microphone is operated by the controller; and
wherein the controller is further configured to:
receive an audio command from the user; and
responsive to the audio command from the user, initiate a second action for the elevator car.

14. A computer-implemented method for operating an elevator system comprising:
receiving an indication of a presence of a passenger in an elevator car;
projecting, by the projector, a car operating panel in the elevator car, wherein the car operating panel comprises a virtual element;
sensing, by a sensor, an indication of a selection of the virtual element by the passenger;
determining a confidence level for the indication, wherein based on the confidence level being below a confidence threshold alerting the passenger to adjust the selection; and
initiating an action based at least in part on sensing the activation of the virtual element.

15. The method of claim 14 , wherein initiating the action comprises initiating an elevator command for the elevator car.

16. The method of claim 14 , wherein initiating the action comprises:
adding a second virtual element to the car operating panel; and
projecting, by the projector, the second virtual element in the car operating panel.

17. The method of claim 14 , wherein the activation of the virtual element from the passenger comprises:
engaging, by the passenger, a region in the virtual element for a duration of time.

18. The method of claim 14 , wherein the activation of the virtual element from the passenger comprises:
engaging, by the passenger, a region in the virtual element utilizing a movement pattern.

19. The method of claim 14 , wherein the virtual element comprises a first color; and
responsive to sensing the activation of the virtual element from the passenger, the virtual element changes to a second color.

20. The method of claim 14 further comprising:
periodically detecting, by the sensor, the presence of the passenger; and
responsive to the passenger exiting the elevator car, initiating a power savings mode for the car operating panel.

Assignees

• Otis Elevator Co

Inventors

• Gireddy Jayapal Reddy

Classifications

• B66B2201/4646

  using voice recognition · CPC title

• B66B1/467

  characterised by their mounting position · CPC title

• B66B1/46 Primary

  Adaptations of switches or switchgear (switches or switchgear in general, applications of switches or switchgear for floor-levelling purpose H01H; panels for boards or switching arrangements H02B1/015) · CPC title

• B66B2201/4638

  Wherein the call is registered without making physical contact with the elevator system · CPC title

• B66B1/461

  characterised by their shape or profile · CPC title