Triggering actions in response to optically or acoustically capturing keywords from a rendered document

Patent metadata

Field	Value
Publication number	US-2017192960-A1
Application number	US-201715462309-A
Country	US
Kind code	A1
Filing date	Mar 17, 2017
Priority date	Apr 1, 2004
Publication date	Jul 6, 2017
Grant date	—

Abstract

A system for processing text captured from rendered documents is described. The system receives a sequence of one or more words optically or acoustically captured from a rendered document by a user. The system identifies among words of the sequence a word with which an action has been associated. The system then performs the associated action with respect to the user.

First claim

1 - 20 . (canceled)

21 . A computer-implemented method comprising:
receiving, from a mobile computing device that includes a capture device and is associated with an output device, a sequence of symbols optically captured from a rendered document by the capture device; determining, by one or more processors, that the sequence of symbols includes a predetermined keyword or keyphrase; selecting, by one or more processors, a content item that has been associated with the predetermined keyword or keyphrase; and transmitting, to the mobile computing device, the selected content item that has been associated with the predetermined keyword or keyphrase, for presentation by the output device associated with the mobile computing device.

22 . The computer-implemented method of claim 21 , wherein the content item includes one or more of text, graphics, or audio.

23 . The computer-implemented method of claim 21 , wherein the content item is an electronic document.

24 . The computer-implemented method of claim 21 , wherein the content item is a link to a webpage.

25 . The computer-implemented method of claim 21 , wherein the output device includes one or more of a visual display or an audio speaker.

26 . The computer-implemented method of claim 21 , wherein the output device is a printer.

27 . The computer-implemented method of claim 21 , further comprising receiving, from the mobile computing device, an email address of a user of the mobile computing device, wherein the content item is transmitted to the mobile computing device using the email address.

28 . The computer-implemented method of claim 21 , further comprising receiving, from the mobile computing device, location information that identifies a current location of the mobile computing device, wherein two or more content items have each been associated with the predetermined keyword or keyphrase, and selecting from the two or more content items is based at least in part on the location information.

29 . The computer-implemented method of claim 21 , further comprising determining time information corresponding to a time at which the sequence of symbols was optically captured from the rendered document by the capture device, wherein two or more content items have each been associated with the predetermined keyword or keyphrase, and selecting from the two or more content items is based at least in part on the time information.

30 . The computer-implemented method of claim 21 , further comprising identifying the rendered document from which the sequence of symbols was optically captured by the capture device, wherein two or more content items have each been associated with the predetermined keyword or keyphrase, and selecting from the two or more content items is based at least in part on the identified rendered document.

31 . A system, comprising:
one or more data processing apparatus; and one or more computer-readable storage devices including instructions executable by the data processing apparatus and upon such execution cause the data processing apparatus to perform operations comprising: receiving, from a mobile computing device that includes a capture device and is associated with an output device, a sequence of symbols optically captured from a rendered document by the capture device; determining, by one or more processors, that the sequence of symbols includes a predetermined keyword or keyphrase; selecting, by one or more processors, a content item that has been associated with the predetermined keyword or keyphrase; and transmitting, to the mobile computing device, the selected content item that has been associated with the predetermined keyword or keyphrase, for presentation by the output device associated with the mobile computing device.

32 . The system of claim 31 , the operations further comprising receiving, from the mobile computing device, an email address of a user of the mobile computing device, wherein the content item is transmitted to the mobile computing device using the email address.

33 . The system of claim 31 , the operations further comprising receiving, from the mobile computing device, location information that identifies a current location of the mobile computing device, wherein two or more content items have each been associated with the predetermined keyword or keyphrase, and selecting from the two or more content items is based at least in part on the location information.

34 . The system of claim 31 , the operations further comprising determining time information corresponding to a time at which the sequence of symbols was optically captured from the rendered document by the capture device, wherein two or more content items have each been associated with the predetermined keyword or keyphrase, and selecting from the two or more content items is based at least in part on the time information.

35 . The system of claim 31 , the operations further comprising identifying the rendered document from which the sequence of symbols was optically captured by the capture device, wherein two or more content items have each been associated with the predetermined keyword or keyphrase, and selecting from the two or more content items is based at least in part on the identified rendered document.

36 . A computer-readable storage device storing software including instructions executable by one or more computers which, upon such execution, cause the one or more computers to perform operations comprising:
receiving, from a mobile computing device that includes a capture device and is associated with an output device, a sequence of symbols optically captured from a rendered document by the capture device; determining, by one or more processors, that the sequence of symbols includes a predetermined keyword or keyphrase; selecting, by one or more processors, a content item that has been associated with the predetermined keyword or keyphrase; and transmitting, to the mobile computing device, the selected content item that has been associated with the predetermined keyword or keyphrase, for presentation by the output device associated with the mobile computing device.

37 . The computer-readable storage device of claim 36 , the operations further comprising receiving, from the mobile computing device, an email address of a user of the mobile computing device, wherein the content item is transmitted to the mobile computing device using the email address.

38 . The computer-readable storage device of claim 36 , the operations further comprising receiving, from the mobile computing device, location information that identifies a current location of the mobile computing device, wherein two or more content items have each been associated with the predetermined keyword or keyphrase, and selecting from the two or more content items is based at least in part on the location information.

39 . The computer-readable storage device of claim 36 , the operations further comprising determining time information corresponding to a time at which the sequence of symbols was optically captured from the rendered document by the capture device, wherein two or more content items have each been associated with the predetermined keyword or keyphrase, and selecting from the two or more content items is based at least in part on the time information.

40 . The computer-readable storage device of claim 36 , the operations further comprising identifying the rendered document from which the sequence of symbols was optically captured by the capture d

Assignees

• Google Inc

Inventors

• King Martin T
• Grover Dale L
• Kushler Clifford A
• Stafford-Fraser James Q

Classifications

• G06V30/412 Primary

  Layout analysis of documents structured with printed lines or input boxes, e.g. business forms or tables · CPC title

• G06F40/30

  Semantic analysis · CPC title

• G06F16/44

  Browsing; Visualisation therefor · CPC title

• G06F16/435

  Filtering based on additional data, e.g. user or group profiles · CPC title

• G06F16/41

  Indexing; Data structures therefor; Storage structures · CPC title