Method and device for surfacing accumulated strain information

Patent metadata

Field	Value
Publication number	US-12367632-B2
Application number	US-202418631381-A
Country	US
Kind code	B2
Filing date	Apr 10, 2024
Priority date	May 23, 2022
Publication date	Jul 22, 2025
Grant date	Jul 22, 2025

Abstract

A method includes: presenting a posture summary interface including: a representation of the user, a visualization of a current accumulated strain value for the user, and a first affordance for initiating an animated posture summary associated with the accumulated strain value for the user over a respective time window; and in response to detecting a user input directed to the first affordance within the posture summary interface, presenting an animation of the representation of the user over the respective time window that corresponds to one or more instances in which head pose information changes associated with the user caused an increase or a decrease to the accumulated strain value greater than a significance threshold, wherein an appearance of the visualization of the current accumulated strain value for the user changes to represent the accumulated strain value for the user over the respective time window.

First claim

What is claimed is:

1. A method comprising:
at a computing system including non-transitory memory and one or more processors, wherein the computing system is communicatively coupled to a display device and one or more input devices via a communication interface:
determining a plurality of muscle strain values for a respective plurality of muscle regions based on head pose information of a user over a time window;
detecting, via the one or more input devices, a user input to display a muscle strain interface; and
in response to detecting the user input, displaying the muscle strain interface including:
a representation of the user including the plurality of muscle regions; and
a plurality of visualizations of the plurality of muscle strain values respectively displayed in association with the plurality of muscle regions.

2. The method of claim 1 , further comprising:
determining an accumulated muscle strain value based on the plurality of muscle strain values, wherein the muscle strain interface further includes a visualization of the accumulated muscle strain value.

3. The method of claim 2 , wherein the muscle strain interface further includes a graph of the accumulated muscle strain value over the time window.

4. The method of claim 1 , further comprising:
detecting, via the one or more input devices, a user input selecting a particular muscle region of the plurality of muscle regions; and
in response to detecting the user input selecting the particular muscle region, displaying a graph of a muscle strain value for the particular muscle region over the time window.

5. The method of claim 1 , wherein determining the plurality of muscle strain values includes determining displacement, velocity, or acceleration values for a head of the user.

6. The method of claim 1 , wherein a particular visualization of the plurality of visualizations for a particular muscle strain value of the plurality of muscle strain values has a color based on the particular muscle strain value.

7. The method of claim 1 , wherein a particular visualization of the plurality of visualizations for a particular muscle strain value of the plurality of muscle strain values has a size based on the particular muscle strain value.

8. The method of claim 1 , wherein the user input corresponds to one of a touch input directed to the display device, a voice input, a gaze input, or a hand/extremity tracking input.

9. The method of claim 1 , wherein the user input corresponds to a user input directed to an affordance.

10. A device comprising:
one or more processors;
a non-transitory memory;
an interface for communicating with a display device and one or more input devices; and
one or more programs stored in the non-transitory memory, which, when executed by the one or more processors, cause the device to:
determine a plurality of muscle strain values for a respective plurality of muscle regions based on head pose information of a user over a time window;
detect, via the one or more input devices, a user input to display a muscle strain interface; and
in response to detecting the user input, display the muscle strain interface including:
a representation of the user including the plurality of muscle regions; and
a plurality of visualizations of the plurality of muscle strain values respectively displayed in association with the plurality of muscle regions.

11. The device of claim 10 , wherein the one or more programs further cause the device to:
determine an accumulated muscle strain value based on the plurality of muscle strain values, wherein the muscle strain interface further includes a visualization of the accumulated muscle strain value.

12. The device of claim 11 , wherein the muscle strain interface further includes a graph of the accumulated muscle strain value over the time window.

13. The device of claim 10 , wherein the one or more programs further cause the device to:
detect, via the one or more input devices, a user input selecting a particular muscle region of the plurality of muscle regions; and
in response to detecting the user input selecting the particular muscle region, display a graph of a muscle strain value for the particular muscle region over the time window.

14. The device of claim 10 , wherein a particular visualization of the plurality of visualizations for a particular muscle strain value of the plurality of muscle strain values has a color based on the particular muscle strain value.

15. The device of claim 10 , wherein a particular visualization of the plurality of visualizations for a particular muscle strain value of the plurality of muscle strain values has a size based on the particular muscle strain value.

16. The device of claim 10 , wherein the user input corresponds to a user input directed to an affordance.

17. A non-transitory memory storing one or more programs, which, when executed by one or more processors of a device with an interface for communicating with a display device and one or more input devices, cause the device to:
determine a plurality of muscle strain values for a respective plurality of muscle regions based on head pose information of a user over a time window;
detect, via the one or more input devices, a user input to display a muscle strain interface; and
in response to detecting the user input, display the muscle strain interface including:
a representation of the user including the plurality of muscle regions; and
a plurality of visualizations of the plurality of muscle strain values respectively displayed in association with the plurality of muscle regions.

18. The non-transitory memory of claim 17 , wherein the one or more programs further cause the device to:
determine an accumulated muscle strain value based on the plurality of muscle strain values, wherein the muscle strain interface further includes a visualization of the accumulated muscle strain value.

19. The non-transitory memory of claim 18 , wherein the muscle strain interface further includes a graph of the accumulated muscle strain value over the time window.

20. The non-transitory memory of claim 17 , wherein the one or more programs further cause the device to:
detect, via the one or more input devices, a user input selecting a particular muscle region of the plurality of muscle regions; and
in response to detecting the user input selecting the particular muscle region, display a graph of a muscle strain value for the particular muscle region over the time window.

Assignees

• Apple Inc

Inventors

• Demers Matthew S
• Ullal Adeeti V
• Bruno Alexander G
• Trietsch Daniel M
• Negoita Ioana
• Dunne James J
• Salter Thomas G
• Moore Thomas J

Classifications

• G06T11/26 Primary

  Drawing of charts or graphs · CPC title

• G06F3/012

  Head tracking input arrangements · CPC title

• A61B5/744

  Displaying an avatar, e.g. an animated cartoon character · CPC title

• G06T2200/24

  involving graphical user interfaces [GUIs] · CPC title

• G06T13/80

  Two-dimensional [2D] animation, e.g. using sprites · CPC title