Translation to braille

Patent metadata

Field	Value
Publication number	US-10943116-B2
Application number	US-201916283036-A
Country	US
Kind code	B2
Filing date	Feb 22, 2019
Priority date	Feb 22, 2019
Publication date	Mar 9, 2021
Grant date	Mar 9, 2021

Abstract

A structured description is generated for a digital image of a scene. The structured description may include a first feature and a second feature of the scene. The structured description may also include a first detail of the first feature and a second detail of the second feature. A portable braille sequence printer may generate braille text of the first and second features using the structured description. The portable braille sequence printer may further generate additional braille text regarding the first detail in response to a prompt from the user regarding the first feature.

First claim

What is claimed is:

1. A system comprising:
a processor; and
a memory in communication with the processor, the memory containing program instructions that, when executed by the processor, are configured to cause the processor to execute a method, the method comprising:
receiving a digital image of a scene;
generating a structured description of the scene utilizing image recognition techniques on the digital image, wherein the structured description includes:
a natural language phrase that describes the scene using at least a first feature and a second feature of the scene such that the first feature is a first pointer and the second feature is a second pointer within the natural language phrase;
a first detail of the first feature stored in a natural language format and embedded in the structured description via the first pointer; and
a second detail of the second feature stored in a natural language format and embedded in the structured description via the second pointer; and

transmitting the structured description to a portable braille sequence printer such that the transmission of the structured description enables the portable braille sequence printer to generate braille text of the natural language phrase and subsequently generate additional braille text regarding the first detail.

2. The system of claim 1 , the memory comprising additional program instructions that, when executed by the processor, are configured to cause the processor to execute the method which further comprises:
receiving an instantiating prompt to create the structured description of the scene; and
transmitting, in response to the instantiating prompt, a signal configured to cause a camera to create the digital image.

3. The system of claim 1 , the memory comprising additional program instructions that, when executed by the processor, are configured to cause the processor to execute the method which further comprises:
receiving, from a user, a prompt regarding a third detail of the first feature; and
generating an updated structured description of the scene utilizing image recognition techniques on the digital image, wherein the updated structured description includes the third detail of the first feature.

4. The system of claim 1 , the memory comprising additional program instructions that, when executed by the processor, are configured to cause the processor to execute the method which further comprises:
receiving, from a user, a prompt regarding a third detail of the first feature;
determining, utilizing image recognition techniques, that the digital image includes less than a threshold amount of information regarding the third detail;
transmitting, in response to determining that the digital image includes less than the threshold amount of information, a signal configured to cause a camera to create an additional digital image of the scene; and
generating an updated structured description of the scene utilizing image recognition techniques on the additional digital image, wherein the updated structured description includes the third detail of the first feature.

5. The system of claim 1 , the memory comprising additional program instructions that, when executed by the processor, are configured to cause the processor to execute the method which further comprise:
receiving, from a user, a prompt regarding a third feature of the scene; and
generating an updated structured description of the scene utilizing image recognition techniques on the digital image, wherein the updated structured description includes the third feature and a third detail about the third feature.

6. The system of claim 1 , further comprising the portable braille sequence printer that is configured to generate braille text of the first and second features using the structured description and subsequently generate additional braille text regarding the first detail in response to a prompt from a user regarding the first feature.

7. The system of claim 6 , further comprising a camera that is configured to create the digital image of the scene in response to an instantiating prompt from the user to create the structured description of the scene.

8. The system of claim 7 , wherein both the portable braille sequence printer and the camera are wearable.

9. A computer program product, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a computer to cause the computer to:
receive a digital image of a scene;
generate a structured description of the scene utilizing image recognition techniques on the digital image, wherein the structured description includes:
a natural language phrase that describes the scene using at least a first feature and a second feature of the scene such that the first feature is a first pointer and the second feature is a second pointer within the natural language phrase;
a first detail of the first feature stored in a natural language format and embedded in the structured description via the first pointer; and
a second detail of the second feature stored in a natural language format and embedded in the structured description via the second pointer; and

transmit the structured description to a portable braille sequence printer such that the transmission of the structured description enables the portable braille sequence printer to generate braille text of the natural language phrase and subsequently generate additional braille text regarding the first detail.

10. The computer program product of claim 9 , wherein the computer program product comprises additional program instructions that, when executed by the computer, cause the computer to:
receive, from a user, a first prompt regarding the first feature;
cause the portable braille sequence printer to generate additional braille text regarding the first detail;
receive, from the user, a second prompt regarding an additional detail of the first feature;
generate an updated structured description of the scene utilizing image recognition techniques on the digital image, wherein the updated structured description includes the additional detail of the first feature; and
transmit the updated structured description to the portable braille sequence printer.

11. The computer program product of claim 9 , wherein the structured description includes an overview of the scene that is a natural language sentence that includes both the first and the second feature, wherein the portable braille sequence printer generating the braille text of the first and second features includes the portable braille sequence printer generating the overview.

12. The computer program product of claim 9 , the computer readable storage medium having further program instructions embodied therewith that, when executed by the computer, cause the computer to:
receive, from a user, a first prompt regarding the first feature;
cause the portable braille sequence printer to generate additional braille text regarding the first detail;
receive, from the user, a second prompt regarding an additional detail of the first feature;
determine, utilizing image recognition techniques, that the digital image includes less than a threshold amount of information regarding the additional detail;
gather, in response to determining that the digital image includes less than the threshold amount of information, the additional detail from a data repository;
generate an updated structured description of the scene utilizing image recognition techniques on the additional digital image, wherein the updated structured description includes the additional detail of the first feature;

Assignees

• IBM

Inventors

• Beller Charles E
• Pervin Shaila
• Trim Craig M

Classifications

• G06V20/10 Primary

  Terrestrial scenes (scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59) · CPC title

• G06F3/0304

  Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042) · CPC title

• G06F3/016

  Input arrangements with force or tactile feedback as computer generated output to the user · CPC title

• G06F3/014

  Hand-worn input/output arrangements, e.g. data gloves · CPC title

• G06F3/002

  Specific input/output arrangements not covered by G06F3/01 - G06F3/16 (other optical apparatus G02B27/00) · CPC title