Remote play using a local projector

Patent metadata

Field	Value
Publication number	US-11745098-B2
Application number	US-202117552066-A
Country	US
Kind code	B2
Filing date	Dec 15, 2021
Priority date	Dec 15, 2021
Publication date	Sep 5, 2023
Grant date	Sep 5, 2023

Abstract

A controller device for interactive gameplay of a video game is provided, including: the controller device being configured to be handheld by a user; at least one motion sensor, said motion sensor generating motion data in response to movement of the controller device when handheld by the user during the interactive gameplay of the video game; a wireless communications device that receives gameplay video over a network from a remotely executing session of the video game; a projector, said projector being integrated with the controller device, said projector configured to project the gameplay video onto a projection surface in a local environment, wherein the projection of the gameplay video is stabilized based on the motion data.

First claim

What is claimed is:

1. A controller device for interactive gameplay of a video game, comprising:
the controller device being configured to be handheld by a user;
at least one motion sensor, said motion sensor generating motion data in response to movement of the controller device when handheld by the user during the interactive gameplay of the video game;
a wireless communications device that receives gameplay video over a network from a remotely executing session of the video game;
a projector, said projector being integrated with the controller device, said projector configured to project the gameplay video onto a projection surface in a local environment, wherein the projection of the gameplay video is stabilized based on the motion data, wherein the stabilization of the gameplay video includes adjusting a zoom of the projector in response to movements of the controller towards or away from the projection surface.

2. The controller device of claim 1 , wherein the movement of the controller device is generated from interactive gameplay of the video game, said motion data being provided as input to the remotely executing session of the video game.

3. The controller device of claim 1 , wherein the remotely executing session is executed by a cloud gaming service.

4. The controller device of claim 1 , wherein the remotely executing session is executed by a remotely located game console.

5. The controller device of claim 1 , wherein the gameplay video depicts a view of a virtual environment of the video game.

6. The controller device of claim 1 , wherein the stabilization of the gameplay video includes adjusting a direction of the projector towards a location on the projection surface.

7. The controller device of claim 1 , wherein the stabilization of the gameplay video includes adjusting a keystone of the projector in response to lateral movements of the controller relative to the projection surface.

8. The controller device of claim 1 , wherein said at least one motion sensor includes one or more of an accelerometer, a gyroscope, or a magnetometer.

9. The controller device of claim 1 , further comprising:
at least one input device selected from a button, trigger, joystick, or touchpad.

10. A system for interactive gameplay of a video game, comprising:
a controller device, said controller device being configured to be handheld by a user, said controller device having at least one motion sensor, said motion sensor generating motion data in response to movement of the controller device when handheld by the user during the interactive gameplay of the video game;
a projector, said projector configured to be detachably connected to the controller device, said projector having a wireless communications device that receives gameplay video over a network from a remotely executing session of the video game, said projector configured to project the gameplay video onto a projection surface in a local environment, wherein the projection of the gameplay video is stabilized based on the motion data, wherein the stabilization of the gameplay video includes adjusting a zoom of the projector in response to movements of the controller towards or away from the projection surface.

11. The system of claim 10 , wherein the movement of the controller device is generated from interactive gameplay of the video game, said motion data being provided as input to the remotely executing session of the video game.

12. The system of claim 10 , wherein the remotely executing session is executed by a cloud gaming service.

13. The system of claim 10 , wherein the remotely executing session is executed by a remotely located game console.

14. The system of claim 10 , wherein the gameplay video depicts a view of a virtual environment of the video game.

15. The system of claim 10 , wherein the stabilization of the gameplay video includes adjusting a direction of the projector towards a location on the projection surface.

16. The system of claim 10 , wherein the stabilization of the gameplay video includes adjusting a keystone of the projector in response to lateral movements of the controller relative to the projection surface.

17. The system of claim 10 , wherein said at least one motion sensor includes one or more of an accelerometer, a gyroscope, or a magnetometer.

18. The system of claim 10 , wherein the controller device further includes at least one input device selected from a button, trigger, joystick, or touchpad.

Assignees

• Sony Interactive Entertainment LLC

Inventors

• Santangelo Josh
• Rottler Ben
• Benedetto Warren
• Webb Jon

Classifications

• A63F13/27 Primary

  characterised by a large display in a public venue, e.g. in a movie theatre, stadium or game arena · CPC title

• A63F13/327

  using wireless networks, e.g. Wi-Fi® or piconet · CPC title

• A63F13/211 Primary

  using inertial sensors, e.g. accelerometers or gyroscopes · CPC title

• A63F13/26

  having at least one additional display device, e.g. on the game controller or outside a game booth · CPC title

• A63F13/355

  Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client · CPC title