Picture update method and apparatus, computer device, and storage medium

Patent metadata

Field	Value
Publication number	US-12440751-B2
Application number	US-202217732386-A
Country	US
Kind code	B2
Filing date	Apr 28, 2022
Priority date	Jul 27, 2020
Publication date	Oct 14, 2025
Grant date	Oct 14, 2025

Abstract

This application relates to a picture update method and apparatus, a computer device, and a storage medium. The method includes: receiving sensor data sent by a terminal, the sensor data being collected by a physical sensor of the terminal; writing the sensor data into a virtual sensor, the virtual sensor corresponding to a structure of the physical sensor and is configured to support a sensor service associated with the physical sensor; reading the sensor data in the virtual sensor, updating a multimedia picture based on the sensor data, and generating corresponding updated multimedia data; and returning the updated multimedia data to the terminal, so that the terminal displays the corresponding updated multimedia picture based on the updated multimedia data.

First claim

What is claimed is:

1. A picture update method performed by a server, wherein the server receives a panoramic picture from a terminal and determines a multimedia picture in the panoramic picture based on a currently displayed picture on the terminal, the method comprising:
receiving, at the server, sensor data sent by the terminal, the sensor data being collected by a physical sensor of the terminal;
writing, by the server, the sensor data into a virtual sensor at the server, the virtual sensor corresponding to a structure of the physical sensor and having a memory shared with the physical sensor, and the virtual sensor is configured to store the sensor data in the shared memory using a sensor interface to support a sensor service associated with the physical sensor;
determining a first viewing angle corresponding to the currently displayed picture on the terminal;
determining a second viewing angle based on the sensor data stored in the shared memory;
determining a picture that matches the second viewing angle in the panoramic picture;
generating multimedia viewing angle update data based on the first viewing angle and the second viewing angle; and
returning the multimedia viewing angle update data to the terminal, wherein the terminal is configured to update, based on the multimedia viewing angle update data, the currently displayed picture corresponding to the first viewing angle to the picture corresponding to the second viewing angle.

2. The method according to claim 1 , wherein the method further comprises:
prior to receiving sensor data sent by the terminal:
receiving, at the server, an application startup instruction sent by the terminal, wherein the application startup instruction includes a terminal identifier and an application identifier of an application triggered at the terminal; and
obtaining, based on the application startup instruction, a target container corresponding to the application identifier from an idle container pool, starting up the target container, and correlating the target container with the terminal identifier.

3. The method according to claim 2 , wherein the sensor data carries the terminal identifier, and receiving the sensor data sent by the terminal comprises:
receiving, using an application proxy at the server, the sensor data sent by the terminal, and inputting the sensor data into the target container based on the terminal identifier, the target container containing an application corresponding to the application identifier, a sensor service module, the virtual sensor, and an application backend, and the sensor service module being configured to provide the sensor service associated with the physical sensor;
the application backend is configured to receive the sensor data input by the application proxy, and write the sensor data into the virtual sensor;
the application is configured to invoke the sensor service module to read the sensor data in the virtual sensor, update the multimedia picture based on the sensor data, and transmit the updated multimedia picture to the application backend; and
the application backend is further configured to generate the corresponding updated multimedia data based on the updated multimedia picture, and transmit the updated multimedia data to the terminal through the application proxy.

4. The method according to claim 1 , wherein the virtual sensor comprises a virtual sensor abstraction layer and a shared memory, the virtual sensor abstraction layer is configured to provide a virtual sensor list and a sensor interface, and the shared memory is configured to generate a virtual sensor device.

5. The method according to claim 4 , wherein the method further comprises:
prior to receiving sensor data sent by the terminal:
receiving a virtual sensor control instruction sent by the terminal, wherein the virtual sensor control instruction includes a sensor type identifier;
updating, based on the virtual sensor control instruction, switch status of a target virtual sensor device corresponding to the sensor type identifier through the virtual sensor abstraction layer, so as to obtain current switch status of the target virtual sensor device; and
generating a physical sensor control instruction based on the current switch status of the target virtual sensor device, and returning the physical sensor control instruction to the terminal, so that the terminal synchronizes the switch status for a target physical sensor corresponding to the target virtual sensor device based on the current switch status.

6. The method according to claim 5 , wherein the method further comprises:
after receiving the virtual sensor control instruction sent by the terminal:
invoking a sensor creation function in the virtual sensor abstraction layer through the sensor service based on the virtual sensor control instruction; and
generating the sensor interface and the shared memory based on the sensor creation function.

7. The method according to claim 5 , wherein updating, based on the virtual sensor control instruction, switch status of a target virtual sensor device corresponding to the sensor type identifier through the virtual sensor abstraction layer, so as to obtain current switch status of the target virtual sensor device, comprises:
invoking, when the virtual sensor list comprises the sensor type identifier, the sensor interface through the sensor service to update the switch status of the target virtual sensor device, so as to obtain current switch status of the target virtual sensor device; and
writing the current switch status of the target virtual sensor device into a current switch status statistics list in the shared memory, the current switch status statistics list comprising the current switch status of a plurality of virtual sensor devices.

8. The method according to claim 7 , wherein generating a physical sensor control instruction based on the current switch status of the target virtual sensor device, and returning the physical sensor control instruction to the terminal, so that the terminal synchronizes the switch status for a target physical sensor corresponding to the target virtual sensor device based on the current switch status, comprise:
reading the current switch status statistics list in the shared memory, and generating a corresponding physical sensor control instruction, wherein the physical sensor control instruction includes the current switch status statistics list; and
returning the physical sensor control instruction to the terminal, so that the terminal obtains a historical switch status statistics list based on the physical sensor control instruction, and updates the switch status of the corresponding target physical sensor based on a difference between the historical switch status statistics list and the current switch status statistics list.

9. The method according to claim 4 , wherein writing the sensor data into a virtual sensor comprises:
writing the sensor data into a tail of a queue in the shared memory, and updating a tail identifier associated with the tail of the queue; and
reading the sensor data in the virtual sensor comprises:
reading the sensor data at a head of the queue, and updating a head identifier associated with the head of the queue.

10. The method according to claim 9 , wherein reading the sensor data in the virtual sensor, updating a multimedia picture based on the sensor data, and generating corresponding updated multimedia data, comprise:
obtaining a preset rollback threshold when a number of items of the sensor data written into the virtual sensor is greater than a preset write threshold;
updating the head identifier based on the preset rollback threshold to obtain a target head identif

Assignees

• Tencent Tech Shenzhen Co Ltd

Inventors

• Wu Jiaping

Classifications

• A63F2300/105

  using inertial sensors, e.g. accelerometers, gyroscopes · CPC title

• G06F9/45558

  Hypervisor-specific management and integration aspects · CPC title

• G06F2009/45562

  Creating, deleting, cloning virtual machine instances · CPC title

• G05B2219/37537

  Virtual sensor · CPC title

• A63F2300/1043

  being characterized by constructional details · CPC title