Providing MIDI controls within a virtual conferencing system

Patent metadata

Field	Value
Publication number	US-12457305-B2
Application number	US-202418678568-A
Country	US
Kind code	B2
Filing date	May 30, 2024
Priority date	Sep 30, 2021
Publication date	Oct 28, 2025
Grant date	Oct 28, 2025

Abstract

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for providing Musical Instrument Digital Interface (MIDI) controls within a virtual conferencing system. The program and method provide, in association with designing a room for virtual conferencing, an interface for updating a property of an element within a room based on a received MIDI message; receiving, based on the interface, an indication of user input specifying to update the property of the element when the received MIDI message includes a predefined value; providing a virtual conference between plural participants within the room, the room including the element; receiving a MIDI message that includes the predefined value; and updating, in response to receiving the MIDI message, the property of the element.

First claim

What is claimed is:

1. A method, comprising:
providing, in association with designing a room for virtual interaction, an interface for updating a property of an element within the room based on a received Musical Instrument Digital Interface (MIDI) message;
receiving, based on the interface, an indication of first user input specifying the element, the property of the element to be updated, and a MIDI note number selected from plural available MIDI note numbers;
providing for virtual interaction between plural participants within the room, the room including the element;
receiving a MIDI message that includes the MIDI note number; and
updating, in response to receiving the MIDI message, the property of the element.

2. The method of claim 1 , wherein the first user input further specifies that the MIDI message corresponds to a note-on message, and
wherein the MIDI message indicates the note-on message.

3. The method of claim 1 , wherein the first user input further specifies that the MIDI message corresponds to a note-off message, and
wherein the MIDI message indicates the note-off message.

4. The method of claim 1 , further comprising:
providing, in response to receiving the MIDI message, audio output of an instrumental note corresponding to the MIDI note number.

5. The method of claim 1 , wherein designing the room is associated with a design interface for designing rooms for a virtual environment, and
wherein the virtual interaction for the room is associated with a navigation interface for navigating between the rooms.

6. The method of claim 1 , further comprising:
storing, prior to providing the virtual interaction, the indication of user input in association with the element.

7. The method of claim 1 , further comprising:
providing, for each of the plural participants, display of a participant video element which corresponds to the participant and which includes a video feed for the participant,
wherein the element corresponds to at least one of the participant video elements.

8. A system comprising:
at least one processor; and
a memory storing instructions that, when executed by the at least one processor, configure the at least one processor to perform operations comprising:
providing, in association with designing a room for virtual interaction, an interface for updating a property of an element within the room based on a received Musical Instrument Digital Interface (MIDI) message;
receiving, based on the interface, an indication of first user input specifying the element, the property of the element to be updated, and a MIDI note number selected from plural available MIDI note numbers;
providing for virtual interaction between plural participants within the room, the room including the element;
receiving a MIDI message that includes the MIDI note number; and
updating, in response to receiving the MIDI message, the property of the element.

9. The system of claim 8 , wherein the first user input further specifies that the MIDI message corresponds to a note-on message, and
wherein the MIDI message indicates the note-on message.

10. The system of claim 8 , wherein the first user input further specifies that the MIDI message corresponds to a note-off message, and
wherein the MIDI message indicates the note-off message.

11. The system of claim 8 , the operations further comprising:
providing, in response to receiving the MIDI message, audio output of an instrumental note corresponding to the MIDI note number.

12. The system of claim 8 , wherein designing the room is associated with a design interface for designing rooms for a virtual environment, and
wherein the virtual interaction for the room is associated with a navigation interface for navigating between the rooms.

13. The system of claim 8 , the operations further comprising:
storing, prior to providing the virtual interaction, the indication of user input in association with the element.

14. The system of claim 8 , the operations further comprising:
providing, for each of the plural participants, display of a participant video element which corresponds to the participant and which includes a video feed for the participant,
wherein the element corresponds to at least one of the participant video elements.

15. A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to perform operations comprising:
providing, in association with designing a room for virtual interaction, an interface for updating a property of an element within the room based on a received Musical Instrument Digital Interface (MIDI) message;
receiving, based on the interface, an indication of first user input specifying the element, the property of the element to be updated, and a MIDI note number selected from plural available MIDI note numbers;
providing for virtual interaction between plural participants within the room, the room including the element;
receiving a MIDI message that includes the MIDI note number; and
updating, in response to receiving the MIDI message, the property of the element.

16. The non-transitory computer-readable storage medium of claim 15 , wherein the first user input further specifies that the MIDI message corresponds to a note-on message, and
wherein the MIDI message indicates the note-on message.

17. The non-transitory computer-readable storage medium of claim 15 , wherein the first user input further specifies that the MIDI message corresponds to a note-off message, and
wherein the MIDI message indicates the note-off message.

18. The non-transitory computer-readable storage medium of claim 15 , the operations further comprising:
providing, in response to receiving the MIDI message, audio output of an instrumental note corresponding to the MIDI note number.

Assignees

• Snap Inc

Inventors

• Lin Andrew Cheng-Min
• Lin Walton

Classifications

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06T2219/2012

  Colour editing, changing, or manipulating; Use of colour codes · CPC title

• G06T2219/024

  Multi-user, collaborative environment · CPC title

• G10H1/0066

  using a MIDI interface · CPC title

• G06T19/20

  Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts · CPC title