Displaying a representation of a user touch input detected by an external device

Patent metadata

Field	Value
Publication number	US-11579721-B2
Application number	US-202017000853-A
Country	US
Kind code	B2
Filing date	Aug 24, 2020
Priority date	Sep 2, 2014
Publication date	Feb 14, 2023
Grant date	Feb 14, 2023

Abstract

A device includes a touch-sensitive display, one or more processors, and memory storing one or more programs including instructions for receiving data from an external device representing user input received over a duration of time at the external device. The programs may include instructions for determining whether the electronic device is actively executing an application for playback. The programs may further include instructions for in accordance with a determination that the electronic device is not actively executing an application for playback: displaying an indication of the receiving of the data; and displaying an affordance, wherein the affordance when selected launches the application for playback and causes the electronic device to playback the received data according to the duration of time of the user input.

First claim

What is claimed is:

1. An electronic device, comprising:
a display;
a touch-sensitive surface;
one or more processors;
memory; and
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
receiving, from an external device, a communication with data, the data corresponding to a graphical representation of one or more user touch inputs detected by the external device as part of a communication application;
after receiving the communication, displaying, on the display, an indication of the communication received from the external device;
while displaying the indication of the communication received from the external device, detecting, on the touch-sensitive surface, a touch input at a location corresponding to the indication of the communication;
in response to receiving the touch input at the location corresponding to the indication of the communication, displaying, on the display, the graphical representation of the one or more user touch inputs detected by the external device, wherein the graphical representation of the one or more user touch inputs detected by the external device is displayed within a drawing area of a first user interface and wherein, while the graphical representation of the one or more user touch inputs detected by the external device is displayed within the drawing area of the first user interface, the electronic device is not configured to receive touch inputs within the drawing area of the first user interface;
determining that the graphical representation has been displayed for a threshold duration of time;
in response to determining that the graphical representation has been displayed for the threshold duration of time, fading out display of the graphical representation in an order that the one or more user touch inputs were detected by the external device, wherein subsequent to fading out display of the graphical representation, the electronic device is configured to receive touch inputs within the drawing area of the first user interface;
subsequent to fading out display of the graphical representation within the drawing area of the first user interface, while maintaining display of the drawing area of the first user interface, detecting one or more touch inputs at one or more positions on the display that correspond to the drawing area of the first user interface; and
subsequent to detecting the one or more touch inputs, transmitting, to the external device, a second communication with data corresponding to the one or more touch inputs.

2. The electronic device of claim 1 ,
wherein the one or more user touch inputs detected by the external device comprise a first stroke,
wherein the first stroke has characteristic kinematics, and
wherein receiving the communication with data comprises receiving data indicating the characteristic kinematics of the first stroke.

3. The electronic device of claim 2 , wherein displaying, on the display, the graphical representation of the one or more user touch inputs detected by the external device comprises displaying, on the display, a graphical representation of the first stroke according to the characteristic kinematics of the first stroke.

4. The electronic device of claim 2 ,
wherein the one or more user touch inputs detected by the external device further comprise a second stroke occurring after the first stroke,
wherein the second stroke has characteristic kinematics,
wherein the first and second stroke are separated by an intervening amount of time, and
wherein receiving the communication with data comprises receiving data indicating the intervening amount of time and the characteristic kinematics of the second stroke.

5. The electronic device of claim 4 , wherein displaying, on the display, the graphical representation of the one or more user touch inputs detected by the external device comprises displaying, on the display, a graphical representation of the one or more user touch inputs detected by the external device according to the characteristic kinematics of the first stroke, the characteristic kinematics of the second stroke, and the intervening amount of time.

6. The electronic device of claim 5 , wherein displaying, on the display, the graphical representation of the one or more user touch inputs detected by the external device comprises displaying a graphical representation of the first stroke, followed by a pause of the intervening amount of time, and then displaying a graphical representation of the second stroke.

7. The electronic device of claim 1 ,
wherein the one or more user touch inputs detected by the external device has a beginning and an end,
wherein the graphical representation of the one or more user touch inputs detected by the external device comprises a beginning corresponding to the beginning of the one or more user touch inputs and an end corresponding to the end of the one or more user touch inputs, and
wherein fading out display of the graphical representation comprises fading out the beginning of the graphical representation before fading out the end of the graphical representation.

8. A method comprising:
at an electronic device with a display and a touch-sensitive surface and configured to communicate with an external device:
receiving, from the external device, a communication with data, the data corresponding to a graphical representation of one or more user touch inputs detected by the external device as part of a communication application;
after receiving the communication, displaying, on the display, an indication of the communication received from the external device;
while displaying the indication of the communication received from the external device, detecting, on the touch-sensitive surface, a touch input at a location corresponding to the indication of the communication;
in response to receiving the touch input at the location corresponding to the indication of the communication, displaying, on the display, the graphical representation of the one or more user touch inputs detected by the external device, wherein the graphical representation of the one or more user touch inputs detected by the external device is displayed within a drawing area of a first user interface and wherein, while the graphical representation of the one or more user touch inputs detected by the external device is displayed within the drawing area of the first user interface, the electronic device is not configured to receive touch inputs within the drawing area of the first user interface;
determining that the graphical representation has been displayed for a threshold duration of time;
in response to determining that the graphical representation has been displayed for the threshold duration of time, fading out display of the graphical representation in an order that the one or more user touch inputs were detected by the external device, wherein subsequent to fading out display of the graphical representation, the electronic device is configured to receive touch inputs within the drawing area of the first user interface;
subsequent to fading out display of the graphical representation within the drawing area of the first user interface, while maintaining display of the drawing area of the first user interface, detecting one or more touch inputs at one or more positions on the display that correspond to the drawing area of the first user interface; and
subsequent to detecting the one or more touch inputs, transmitting, to the external device, a second communication with data corresponding to the one or more touch inputs.

9. The method of claim 8 ,
wherein the one or more user touch

Assignees

• Apple Inc

Inventors

• Anzures Freddy Allen
• Chaudhri Imran
• Dye Alan C
• Ive Jonathan P
• Kerr Duncan Robert
• King Nicholas V
• Lynch Kevin
• Novick Gregory
• Preston Daniel Trent
• Jenkins Monica
• Yang Lawrence Y

Classifications

• G06F3/04845

  for image manipulation, e.g. dragging, rotation, expansion or change of colour · CPC title

• H04L51/52

  for supporting social networking services · CPC title

• H04M1/72439

  for image or video messaging · CPC title

• G06F2203/04104

  Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger · CPC title

• G06F3/0416 Primary

  Control or interface arrangements specially adapted for digitisers · CPC title