Multiplayer somatosensory system, method, and apparatus combining virtual and reality, and medium

Patent metadata

Field	Value
Publication number	US-12285680-B2
Application number	US-202217747680-A
Country	US
Kind code	B2
Filing date	May 18, 2022
Priority date	Apr 16, 2021
Publication date	Apr 29, 2025
Grant date	Apr 29, 2025

Abstract

This disclosure discloses a multiplayer somatosensory system, method, and apparatus combining virtual and reality, and a medium, which belongs to the field of human-computer interaction. The system includes: a computer device, and a simulation carrier, n simulation firearms and a display apparatus; where the simulation carrier includes a driver's seat and n passenger seats; the display apparatus is configured to display a virtual environment picture and n aiming points provided by the computer device; and the computer device is configured to control a virtual carrier to change a driving direction in the virtual environment; control the virtual carrier to change a driving speed in the virtual environment; and shoot a virtual object aimed at an i th aiming point in the virtual environment in response to a shooting operation on an i th simulation firearm in the n simulation firearms.

First claim

What is claimed is:

1. A multiplayer somatosensory system, comprising:
a simulation carrier, comprising:
a driver's seat;
n passenger seats, disposed adjacent to the driver's seat;
a first controller, disposed adjacent to the driver's seat and configured to control a driving direction; and
a second controller, disposed adjacent to the driver's seat and configured to control a driving speed;

n simulation firearms, n being a positive integer;
a display apparatus configured to display a virtual environment picture and n aiming points, the virtual environment picture being a picture of a virtual environment in which a virtual carrier corresponding to the simulation carrier is located; and
a computer, coupled to the simulation carrier, the n simulation firearms, and the display apparatus, and configured to:
provide the n aiming points;
control, in response to a first driving operation on the first controller, the virtual carrier to change the driving direction in the virtual environment;
control, in response to a second driving operation on the second controller, the virtual carrier to change the driving speed in the virtual environment;
shoot a virtual object aimed at an i th aiming point in the virtual environment in the n aiming points in response to a shooting operation on an i th simulation firearm in the n simulation firearms, i being a positive integer not greater than n;
transmit room information of the virtual environment, an entry graphic code of the driver's seat, and entry graphic codes of the n passenger seats to an administrator terminal;
receive a first join request triggered by a first terminal scanning the entry graphic code of the driver's seat; and
add, in response to the first join request, a virtual character corresponding to a first account logged in by the first terminal to the driver's seat of the virtual carrier in the virtual environment.

2. The system according to claim 1 , wherein:
the simulation carrier comprises a simulation vehicle, the first controller comprises a steering wheel, and the second controller comprises an accelerator and a brake;
or,
the simulation carrier comprises a simulation aircraft, the first controller comprises at least one of a flight stick or a rudder, and the second controller comprises a throttle stick.

3. The system according to claim 1 , wherein
at least one seat of the driver's seat or the n passenger seats comprises a vibration feedback component.

4. The system according to claim 1 , wherein
at least one of the n simulation firearms establishes a wireless communication connection with the computer;
and/or,
at least one of the n simulation firearms establishes a wired communication connection with the computer.

5. The system according to claim 1 , wherein
the display apparatus comprises a virtual reality headset; or
the display apparatus comprises n+1 virtual reality (VR) headsets; or
the display apparatus comprises a display screen; or
the display apparatus comprises a semi-surround screen disposed in front of the simulation carrier or a surround screen disposed on a peripheral side of the simulation carrier; or
the display apparatus comprises a projector.

6. The system according to claim 5 , wherein the display apparatus comprises the semi-surround screen disposed in front of the simulation carrier,
a width of the semi-surround screen being not less than a width of the simulation carrier, and a height of the semi-surround screen being not less than a height of the simulation carrier.

7. A multiplayer somatosensory method, comprising:
displaying a virtual environment picture and n aiming points by using a display apparatus, the virtual environment picture being a picture of a virtual environment in which a virtual carrier corresponding to a simulation carrier is located;
controlling, in response to a first driving operation on a first controller, the virtual carrier to change a driving direction in the virtual environment;
controlling, in response to a second driving operation on a second controller, the virtual carrier to change a driving speed in the virtual environment;
shooting a virtual object aimed at an i th aiming point in the virtual environment in n aiming points in response to a shooting operation on an i th simulation firearm in n simulation firearms;
transmitting room information of the virtual environment, an entry graphic code of a driver's seat, and entry graphic codes of n passenger seats to an administrator terminal;
receiving a first join request triggered by a first terminal scanning the entry graphic code of the driver's seat; and
adding, in response to the first join request, a virtual character corresponding to a first account logged in by the first terminal to the driver's seat of the virtual carrier in the virtual environment.

8. The method according to claim 7 , wherein the simulation carrier comprises a simulation vehicle; and
controlling, in response to the first driving operation on the first controller, the virtual carrier to change the driving direction in the virtual environment comprises:
controlling, in response to the first driving operation on a steering wheel of the simulation vehicle, a virtual vehicle to change the driving direction in the virtual environment.

9. The method according to claim 7 , wherein the simulation carrier comprises a simulation aircraft; and
controlling, in response to the first driving operation on the first controller, the virtual carrier to change the driving direction in the virtual environment comprises:
controlling, in response to the first driving operation on a flight stick and/or a rudder of the simulation aircraft, a virtual aircraft to change the driving direction in the virtual environment.

10. The method according to claim 7 , wherein the simulation carrier comprises a simulation vehicle; and
controlling, in response to the second driving operation on the second controller, the virtual carrier to change the driving speed in the virtual environment comprises:
controlling, in response to the second driving operation on an accelerator and/or a brake of the simulation vehicle, a virtual vehicle to change the driving speed in the virtual environment.

11. The method according to claim 7 , wherein the simulation carrier comprises a simulation aircraft; and
controlling, in response to the second driving operation on the second controller, the virtual carrier to change the driving speed in the virtual environment comprises:
controlling, in response to the second driving operation on a throttle stick of the simulation aircraft, a virtual aircraft to change the driving speed in the virtual environment.

12. The method according to claim 7 , wherein the display apparatus comprises n+1 VR headsets; and
displaying the virtual environment picture and the n aiming points by using the display apparatus comprises:
displaying the virtual environment picture and the i th aiming point in the n aiming points by using an (i+1) th VR headset in the n+1 VR headsets.

13. The method according to claim 7 , wherein the display apparatus comprises a surround screen or a projector; and
displaying the virtual environment picture and the n aiming points by using the display apparatus comprises:
displaying the virtual environment picture and the n aiming points by using the surround screen or the projector, the n aiming points having different icon styles, the icon styles comprising at least one of shape, color, transparency, or number.

14. The method according to claim 7 , further comprising:
receiving a second join request triggered by that a second terminal

Assignees

• Tencent Tech Shenzhen Co Ltd

Inventors

• Wang Gaolei
• Zhu Yingyan
• Xiao Hui
• Liu Xin
• Wang Jin
• Luo Li
• Lin Yu

Classifications

• A63F13/803 Primary

  Driving vehicles or craft, e.g. cars, airplanes, ships, robots or tanks · CPC title

• A63F13/837 Primary

  Shooting of targets · CPC title

• A63F2300/8082

  Virtual reality · CPC title

• A63F13/57

  Simulating properties, behaviour or motion of objects in the game world, e.g. computing tyre load in a car race game (A63F13/56 takes precedence) · CPC title

• G02B27/017

  Head mounted · CPC title