Computer-generated immersive and interactive displays based on transformed dimensional views

Patent metadata

Field	Value
Publication number	US-12436648-B2
Application number	US-202418740429-A
Country	US
Kind code	B2
Filing date	Jun 11, 2024
Priority date	Jun 12, 2023
Publication date	Oct 7, 2025
Grant date	Oct 7, 2025

Abstract

Systems and methods are described for generating an immersive experience for designing a physical space using multi-dimensional visualizations and sharing the design process in real-time. A system may system may identify a user and access a project associated with the user. The system may identify an input token placed on a touchscreen of an interaction device and a stored object associated with the input token. The system may access information about and a visual representation of the stored object. The system may generate, for display via the touchscreen, a two-dimensional view of the physical space and/or the information about the stored object. The system may generate a three-dimensional view of the physical space that includes the visual representation of the stored object. The system may transmit the three-dimensional view for display via one or more display devices that are independently housed from the interaction device.

First claim

What is claimed is:

1. A system comprising:
a processor programmed to:
identify a user and access a project associated with the user, the project comprising user-specified data for a physical space being designed by the user;
identify an input token placed on a touchscreen of an interaction device and a stored object associated with the input token;
access information about the stored object and a visual representation of the stored object;
generate, for display via the touchscreen, a two-dimensional view of the physical space and/or the information about the stored object;
generate, via a dimensional view transformer, a three-dimensional view of at least a portion of the physical space for the project, the three-dimensional view comprising the visual representation of the stored object;
transmit the three-dimensional view for display via one or more display devices, wherein the one or more display devices is independently housed from the interaction device and is larger than the touchscreen; and
transmit, via a user access point, for display to one or more authorized users in real-time as the project is being updated or for later download by the one or more authorized users, data relating to the project and/or the three-dimensional view.

2. The system of claim 1 , wherein the input token is an actuatable input token having a plurality of actuation states, each actuation state being associated with a corresponding system response or visual representation of the stored object.

3. The system of claim 2 , wherein the processor is further programmed to:
determine a first capacitance on the touchscreen that is imparted by the actuatable input token based on a first actuation state; and
generate a first visualization change in the three-dimensional view based on the first capacitance.

4. The system of claim 3 , wherein the processor is further programmed to:
determine a second capacitance on the touchscreen that is imparted by the actuatable input token based on a second actuation state;
generate a second visualization change in the three-dimensional view based on the second capacitance; and
change the three-dimensional view from the first visualization change to the second visualization change in response to the second capacitance.

5. The system of claim 2 , wherein the processor is further programmed to:
identify the actuatable input token and/or an actuation state based on a computer vision model trained on one or more images of the actuatable input token and/or the plurality of actuation states.

6. The system of claim 1 , wherein the input token comprises a Radio Frequency Identification (RFID) tag, and wherein the processor is programmed to identify the input token based on the RFID tag.

7. The system of claim 6 , wherein the input token is an actuatable input token having a plurality of actuation states and wherein a resonance of the RFID tag is varied based on an actuation state of the actuatable input token.

8. The system of claim 1 , wherein the processor is further programmed to;
identify a direction, size, or pattern of movement of the input token on the touchscreen of the interaction device; and
identify a system response or a visualization change to the stored object based on the identified direction, size, or pattern of movement.

9. The system of claim 1 , wherein to identify the user, the processor is programmed to: detect a user input token placed on the touchscreen.

10. A method, comprising:
identifying, by a processor, a user and accessing a project associated with the user, the project comprising user-specified data for a physical space being designed by the user;
identifying, by the processor, an input token placed on a touchscreen of an interaction device and a stored object associated with the input token;
identifying, by the processor, a direction, size, or pattern of movement of the input token on the touchscreen of the interaction device;
identifying, by the processor, a system response or a visualization change to the stored object based on the identified direction, size, or pattern of movement;
accessing, by the processor, information about the stored object and a visual representation of the stored object;
generating, by the processor, for display via the touchscreen, a two-dimensional view of the physical space and/or the information about the stored object;
generating, by the processor, via a dimensional view transformer, a three-dimensional view of at least a portion of the physical space for the project, the three-dimensional view comprising the visual representation of the stored object; and
transmitting, by the processor, the three-dimensional view for display via one or more display devices, wherein the one or more display devices is independently housed from the interaction device and is larger than the touchscreen.

11. The method of claim 10 , wherein the input token is an actuatable input token having a plurality of actuation states, each actuation state being associated with a corresponding system response or visual representation of the stored object.

12. The method of claim 11 , further comprising:
determining a first capacitance on the touchscreen that is imparted by the actuatable input token based on a first actuation state; and
generating a first visualization change in the three-dimensional view based on the first capacitance.

13. The method of claim 12 , further comprising:
determining a second capacitance on the touchscreen that is imparted by the actuatable input token based on a second actuation state;
generating a second visualization change in the three-dimensional view based on the second capacitance; and
changing the three-dimensional view from the first visualization change to the second visualization change in response to the second capacitance.

14. The method of claim 11 , further comprising:
identifying the actuatable input token and/or an actuation state based on a computer vision model trained on one or more images of the actuatable input token and/or the plurality of actuation states.

15. The method of claim 11 , wherein the input token comprises a Radio Frequency Identification (RFID) tag, the method further comprising:
identifying the input token based on the RFID tag.

16. The method of claim 15 , wherein the input token is an actuatable input token having a plurality of actuation states and wherein a resonance of the RFID tag is varied based on an actuation state of the actuatable input token.

17. The method of claim 10 , wherein the processor is further programmed to:
transmitting, via a user access point, for display to one or more authorized users in real-time as the project is being updated or for later download by the one or more authorized users, data relating to the project and/or the three-dimensional view.

18. A non-transitory computer readable medium storing instructions that, when executed by a processor, program the processor to:
detect a user input token placed on a touchscreen;
identify a user based on the user input token and access a project associated with the user, the project comprising user-specified data for a physical space being designed by the user;
identify an input token placed on the touchscreen of an interaction device and a stored object associated with the input token;
access information about the stored object and a visual representation of the stored object;
generate, for display via the touchscreen, a two-dimensional view of the physical space and/or the information about the stored object;
generate, via a dimen

Assignees

• Fellowes Inc

Inventors

• Fellowes John
• Holderness Todd
• Bruno Jami
• Matlin Tai Hoon K

Classifications

• G06K19/0723

  the record carrier comprising an arrangement for non-contact communication, e.g. wireless communication circuits on transponder cards, non-contact smart cards or RFIDs · CPC title

• G06F3/0488

  using a touch-screen or digitiser, e.g. input of commands through traced gestures · CPC title

• G06F30/13

  Architectural design, e.g. computer-aided architectural design [CAAD] related to design of buildings, bridges, landscapes, production plants or roads · CPC title

• G06F3/04845

  for image manipulation, e.g. dragging, rotation, expansion or change of colour · CPC title

• A63F13/2145

  the surface being also a display device, e.g. touch screens · CPC title