Classifying collision events using inertial and audio data

Patent metadata

Field	Value
Publication number	US-10272324-B2
Application number	US-201514998163-A
Country	US
Kind code	B2
Filing date	Dec 24, 2015
Priority date	Dec 24, 2015
Publication date	Apr 30, 2019
Grant date	Apr 30, 2019

Abstract

Systems, apparatuses and methods may obtain motion data, obtain audio data, and detect a collision between a handheld device and an object based on the motion data and the audio data. In one example, noise may be removed from the motion data and the audio data to obtain filtered collision data, wherein the object is classified based on the filtered collision data.

First claim

We claim:

1. A handheld device comprising:
an inertial sensor to generate one or more motion signals;
a microphone to generate one or more audio signals;
a wireless transceiver to transmit information regarding a collision between the handheld device and an object; and
logic, implemented at least partly in one or more of configurable logic or fixed-functionality logic hardware, to:
obtain motion data associated with the one or more motion signals,
obtain audio data associated with the one or more audio signals,
detect the collision between the handheld device and the object based on the motion data and the audio data, and
classify the object as one of a person or a second handheld device based on filtered collision data, wherein classification of the object includes operations to: distinguish between a first audible sound generation quality of a first strike event and a different second audible sound generation quality of a second strike event, wherein the first strike event is of the handheld device contacting the second handheld device and the second strike event is of the handheld device contacting the person, wherein the first strike event is to have the first audible sound generation quality based at least in part on a material of the second handheld device, and wherein the second strike event is to have the different second audible sound generation quality based at least in part on a material of the person.

2. The handheld device of claim 1 , wherein the logic is to:
remove noise from the motion data and the audio data to obtain the filtered collision data.

3. The handheld device of claim 2 , wherein the logic is to:
identify one or more features of the collision, wherein the one or more features are to include one or more of a maximum value, a minimum value, a baseline value, a linear acceleration integration, a Euler angle integration, an audio frequency spectrum or a post-collision vibration frequency spectrum, and
compare the one or more features to training data to classify the object.

4. The handheld device of claim 2 , wherein the logic is to trigger one or more of a competitive score update or an audiovisual effect based on whether the object is classified as the person or the second handheld device.

5. The handheld device of claim 1 , further including one or more buffers, wherein the logic is to:
detect an availability of one or more new data samples, and
retrieve the motion data and the audio data from the one or more buffers in response to the availability.

6. The handheld device of claim 1 , wherein the logic is to:
determine, based on the motion data, that a difference between a peak acceleration and an average acceleration has reached a first threshold, and
determine, based on the audio data, that a difference between a peak audio level and an average audio level has reached a second threshold.

7. The handheld device of claim 1 , further including a housing having a form of a sword, saber, foil, epee, or blade.

8. An apparatus comprising:
logic, implemented at least partly in one or more of configurable logic or fixed-functionality logic hardware, to:
obtain motion data,
obtain audio data,
detect a collision between a handheld device and an object based on the motion data and the audio data, and
classify the object based on filtered collision data, wherein the object to be classified is one of a person or a second handheld device, and wherein the classification of the object includes: distinguishing between a first audible sound generation quality of a first strike event and a different second audible sound generation quality of a second strike event, wherein the first strike event is of the handheld device contacting the second handheld device and the second strike event is of the handheld device contacting the person, wherein the first strike event is to have the first audible sound generation quality based at least in part on a material of the second handheld device, and wherein the second strike event is to have the different second audible sound generation quality based at least in part on a material of the person.

9. The apparatus of claim 8 , wherein the logic is to:
remove noise from the motion data and the audio data to obtain the filtered collision data.

10. The apparatus of claim 9 , wherein the logic is to:
identify one or more features of the collision, wherein the one or more features are to include one or more of a maximum value, a minimum value, a baseline value, a linear acceleration integration, a Euler angle integration, an audio frequency spectrum or a post-collision vibration frequency spectrum, and
compare the one or more features to training data to classify the object.

11. The apparatus of claim 9 , wherein the logic is to trigger one or more of a competitive score update or an audiovisual effect based on whether the object is classified as the person or the second handheld device.

12. The apparatus of claim 8 , wherein the logic is to: detect an availability of one or more new data samples, and retrieve the motion data and the audio data from one or more buffers in response to the availability.

13. The apparatus of claim 8 , wherein the logic is to:
determine, based on the motion data, that a difference between a peak acceleration and an average acceleration has reached a first threshold, and
determine, based on the audio data, that a difference between a peak audio level and an average audio level has reached a second threshold.

14. A method comprising:
obtaining motion data;
obtaining audio data;
detecting a collision between a handheld device and an object based on the motion data and the audio data, and
classifying the object based on filtered collision data, wherein the object to be classified is one of a person or a second handheld device, and wherein the classification of the object includes: distinguishing between a first audible sound generation quality of a first strike event and a different second audible sound generation quality of a second strike event, wherein the first strike event is of the handheld device contacting the second handheld device and the second strike event is of the handheld device contacting the person, wherein the first strike event has the first audible sound generation quality based at least in part on a material of the second handheld device, and wherein the second strike event has the different second audible sound generation quality based at least in part on a material of the person.

15. The method of claim 14 , further including:
removing noise from the motion data and the audio data to obtain the filtered collision data.

16. The method of claim 15 , wherein classifying the object includes: identifying one or more features of the collision, wherein the one or more features include one or more of a maximum value, a minimum value, a baseline value, a linear acceleration integration, a Euler angle integration, an audio frequency spectrum or a post-collision vibration frequency spectrum; and
comparing the one or more features to training data.

17. The method of claim 15 , wherein the method further includes triggering one or more of a competitive score update or an audiovisual effect based on whether the object is classified as the person or the second handheld device.

18. The method of claim 14 , wherein obtaining the motion data and the audio data includes:
detecting an availability of one or more new data samples; and
retrieving the motion data and the audio data from one or more buffers in response to the availability.

Assignees

• Holmes Steven T
• Wright Jason
• Intel Corp

Inventors

• Holmes Steven T
• Wright Jason

Classifications

• A63B2220/803

  Motion sensors · CPC title

• A63B2069/0008

  for batting · CPC title

• A63B71/0669

  Score-keepers or score display devices · CPC title

• A63B2220/44

  Angular acceleration · CPC title

• A63B69/02 Primary

  for fencing {, e.g. means for indicating hits} · CPC title