Remote screen control device, remote screen control method, and recording medium

Patent metadata

Field	Value
Publication number	US-9269281-B2
Application number	US-201213618660-A
Country	US
Kind code	B2
Filing date	Sep 14, 2012
Priority date	Nov 30, 2011
Publication date	Feb 23, 2016
Grant date	Feb 23, 2016

Abstract

A server apparatus renders a process result of software on an image memory that stores a display image to be displayed on a client terminal, detects an update area in which an update occurs between frames of an image. The server apparatus selectively switches and performs a first generation process and a second generation process according to the number of detected update areas. The first generation process is a process that generates a color map for each update area based on colors used in the update area. The second generation process is a process that generates a color map commonly used between the update areas based on colors used in images of the update areas. The server apparatus reduces the number of colors in an update area using the generated color map and transmits a compressed image of the update area to the client terminal.

First claim

What is claimed is:

1. A remote screen control device comprising:
a memory; and
a processor coupled to the memory, wherein the processor executes a process comprising:
rendering a process result of software on an image memory that stores a display image to be displayed on a terminal apparatus connected via a network;
detecting an update area in which an update occurs between frames of the display image;
selecting either of a first generation process that generates a color map for each update area based on colors used in an image of the update area, and a second generation process that generates a color map commonly used between the update areas based on colors used in the entire display image or an image of an area that includes all of update areas, according to a number of the detected update areas;
performing the first generation process or the second generation process, selected at the selecting;
reducing a number of colors in the update areas using the color map generated by performing the first generation process or the second generation process; and
first transmitting a compressed image of update area to the terminal apparatus, wherein

the selecting includes selecting the first generation process when the number of the detected update areas is less than a threshold value, and selecting the second generation process when the number of the detected update areas is greater than or equal to the threshold value.

2. The remote screen control device according to claim 1 , wherein the processor executes the process further comprising:
identifying a high-frequency changing area in which a frequency of update between frames of the display image is higher than or equal to a predetermined frequency;
setting an image of a high-frequency changing area identified from the display image into a moving image mode; and
second transmitting an image of a high-frequency changing area, which is set into the moving image mode, to the terminal apparatus, wherein
the selecting further includes selecting, when the moving image mode set is finished, a third generation process that generates an overwrite color map that overwrites an image transmitted to the terminal apparatus during the moving image mode set, based on colors used in the display image,
the performing includes performing the third generation process when the third generation process is selected,
the reducing includes reducing the number of colors in part or all of the display image using the generated overwrite color map, and
the first transmitting includes transmitting part or all of the display image compressed by the reducing to the terminal apparatus.

3. The remote screen control device according to claim 1 , wherein
the selecting further includes selecting the second generation process when the number of colors included in the display image rendered on the image memory is less than or equal to a predetermined number of colors.

4. A remote screen control method comprising:
rendering, using a processor, a process result of software on an image memory that stores a display image to be displayed on a terminal apparatus connected via a network;
detecting, using the processor, an update area in which an update occurs between frames of the display image;
selecting, using the processor, either of a first generation process that generates a color map for each update area based on colors used in an image of the update area, and a second generation process that generates a color map commonly used between the update areas based on colors used in the entire display image or an image of an area that includes all of update areas, according to a number of the detected update areas;
performing the first generation process or the second generation process, selected at the selecting;
reducing, using the processor, a number of colors in the update areas using the color map generated by performing the first generation process or the second generation process; and
transmitting, using the processor, a compressed image of update area to the terminal apparatus, wherein
the selecting includes selecting the first generation process when the number of the detected update areas is less than a threshold value, and selecting the second generation process when the number of the detected update areas is greater than or equal to the threshold value.

5. A non-transitory computer readable recoding medium having stored therein a program that causes a computer to execute a remote screen control process comprising:
rendering a process result of software on an image memory that stores a display image to be displayed on a terminal apparatus connected via a network;
detecting an update area in which an update occurs between frames of the display image;
selecting either of a first generation process that generates a color map for each update area based on colors used in an image of the update area, and a second generation process that generates a color map commonly used between the update areas based on colors used in the entire display image or an image of an area that includes all of update areas, according to a number of the detected update areas;
performing the first generation process or the second generation process, selected at the selecting;
reducing a number of colors in the update areas using the color map generated by performing the first generation process or the second generation process; and
transmitting a compressed image of update area to the terminal apparatus, wherein
the selecting includes selecting the first generation process when the number of the detected update areas is less than a threshold value, and selecting the second generation process when the number of the detected update areas is greater than or equal to the threshold value.

Assignees

• Matsui Kazuki
• Horio Kenichi
• Miyamoto Ryo
• Imai Tomoharu
• Fujitsu Ltd

Inventors

• Matsui Kazuki
• Horio Kenichi
• Miyamoto Ryo
• Imai Tomoharu

Classifications

• G09G2340/06

  Colour space transformation · CPC title

• G06F3/1462

  with means for detecting differences between the image stored in the host and the images displayed on the remote displays · CPC title

• G09G2340/02

  Handling of images in compressed format, e.g. JPEG, MPEG · CPC title

• G09G2360/122

  Tiling · CPC title

• G09G2370/022

  Centralised management of display operation, e.g. in a server instead of locally · CPC title