Multimodal data visualization using bandwidth profiles and optional environmental compensation

Patent metadata

Field	Value
Publication number	US-11087502-B2
Application number	US-201816176680-A
Country	US
Kind code	B2
Filing date	Oct 31, 2018
Priority date	Oct 31, 2018
Publication date	Aug 10, 2021
Grant date	Aug 10, 2021

Abstract

A computer-implemented method includes receiving a base visualization having first data in a first set of channels, where each channel in the first set of channels is associated with a respective range in the base visualization. It is detected that the respective ranges of the first set of channels fall outside a perceptual bandwidth of a first user. The base visualization is automatically transformed to a second visualization, based on the perceptual bandwidth of the first user. The second visualization includes second data in a second set of channels, where each channel in the second set of channels is associated with a respective range in the second visualization. The respective ranges of the second set of channels fall within the perceptual bandwidth of the first user.

First claim

What is claimed is:

1. A computer-implemented method comprising:
receiving a base visualization comprising first data in a first set of channels, wherein each channel in the first set of channels is associated with a respective range in the base visualization;
detecting that the respective ranges of the first set of channels fall outside a perceptual bandwidth of a first user, the perceptual bandwidth of the first user previously determined based at least in part on a result of a bandwidth test implemented by a calibration engine to measure a range of perception of the first user with respect to a plurality of senses including measuring a plurality of aspects of at least one of the plurality of senses based at least in part on input from the first user; and
automatically transforming the base visualization to a second visualization, based on the perceptual bandwidth of the first user, wherein the second visualization comprises second data in a second set of channels, wherein each channel in the second set of channels is associated with a respective range in the second visualization,
the respective ranges of the second set of channels falling within the perceptual bandwidth of the first user.

2. The computer-implemented method of claim 1 , further comprising receiving iterative feedback from the first user and from a second user to further transform the second visualization into a new visualization, wherein the base visualization fits into the perceptual bandwidth of the second user.

3. The computer-implemented method of claim 1 , further comprising:
detecting an environmental factor; and
adjusting the perceptual bandwidth of the first user based on the environmental factor.

4. The computer-implemented method of claim 1 , further comprising:
detecting a bandwidth of an output device; and
adjusting the perceptual bandwidth of the first user based on the bandwidth of the output device.

5. The computer-implemented method of claim 1 , wherein the automatically transforming the base visualization to the second visualization comprises porting an input stream, comprising a first channel of the base visualization, to an output stream of the second visualization, wherein the output stream comprises a second channel distinct from the input stream.

6. The computer-implemented method of claim 5 , wherein the porting the input stream to the output stream comprises compressing the first channel of the base visualization to fit within an available bandwidth of the second channel in the perceptual bandwidth of the first user.

7. The computer-implemented method of claim 5 , wherein the porting the input stream to the output stream comprises splitting the first channel across a respective available bandwidth in the second channel and a respective available bandwidth in a third channel of the perceptual bandwidth of the first user.

8. A system comprising:
a memory having computer-readable instructions; and
one or more processors for executing the computer-readable instructions, the computer-readable instructions comprising:
receiving a base visualization comprising first data in a first set of channels, wherein each channel in the first set of channels is associated with a respective range in the base visualization;
detecting that the respective ranges of the first set of channels fall outside a perceptual bandwidth of a first user, the perceptual bandwidth of the first user previously determined based at least in part on a result of a bandwidth test implemented by a calibration engine to measure a range of perception of the first user with respect to a plurality of senses including measuring a plurality of aspects of at least one of the plurality of senses based at least in part on input from the first user; and
automatically transforming the base visualization to a second visualization, based on the perceptual bandwidth of the first user, wherein the second visualization comprises second data in a second set of channels, wherein each channel in the second set of channels is associated with a respective range in the second visualization,
the respective ranges of the second set of channels falling within the perceptual bandwidth of the first user.

9. The system of claim 8 , the computer-readable instructions further comprising receiving iterative feedback from the first user and from a second user to further transform the second visualization into a new visualization, wherein the base visualization fits into the perceptual bandwidth of the second user.

10. The system of claim 8 , the computer-readable instructions further comprising:
detecting an environmental factor; and
adjusting the perceptual bandwidth of the first user based on the environmental factor.

11. The system of claim 8 , the computer-readable instructions further comprising:
detecting a bandwidth of an output device; and
adjusting the perceptual bandwidth of the first user based on the bandwidth of the output device.

12. The system of claim 8 , wherein the automatically transforming the base visualization to the second visualization comprises porting an input stream, comprising a first channel of the base visualization, to an output stream of the second visualization, wherein the output stream comprises a second channel distinct from the input stream.

13. The system of claim 12 , wherein the porting the input stream to the output stream comprises compressing the first channel of the base visualization to fit within an available bandwidth of the second channel in the perceptual bandwidth of the first user.

14. The system of claim 12 , wherein the porting the input stream to the output stream comprises splitting the first channel across a respective available bandwidth in the second channel and a respective available bandwidth in a third channel of the perceptual bandwidth of the first user.

15. A computer-program product for generating a visualization for a user, the computer-program product comprising a computer-readable storage device having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to perform a method comprising:
receiving a base visualization comprising first data in a first set of channels, wherein each channel in the first set of channels is associated with a respective range in the base visualization;
detecting that the respective ranges of the first set of channels fall outside a perceptual bandwidth of a first user, the perceptual bandwidth of the first user previously determined based at least in part on a result of a bandwidth test implemented by a calibration engine to measure a range of perception of the first user with respect to a plurality of senses including measuring a plurality of aspects of at least one of the plurality of senses based at least in part on input from the first user; and
automatically transforming the base visualization to a second visualization, based on the perceptual bandwidth of the first user, wherein the second visualization comprises second data in a second set of channels, wherein each channel in the second set of channels is associated with a respective range in the second visualization,
the respective ranges of the second set of channels falling within the perceptual bandwidth of the first user.

16. The computer-program product of claim 15 , the method performed by the processor further comprising receiving iterative feedback from the first user and from a second user to further transform the second visualization into a new visualization, wherein the base visualization fits into the perceptual bandwidth of the second

Assignees

• IBM

Inventors

• Fry Jonathan
• Nwobodo Victoria A
• U Kam Hou
• Lapointe Michael

Classifications

• G06T11/10 Primary

  Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) · CPC title

• G06T11/26 Primary

  Drawing of charts or graphs · CPC title

• G06F3/04842

  Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) · CPC title

• G06T11/20

  Drawing from basic elements · CPC title

• G06T2200/24

  involving graphical user interfaces [GUIs] · CPC title