Interactive workspace integration system and method

Abstract

The invention discloses an interactive workspace integration system which is used for integrating a physical workspace and a virtual workspace. The system includes a plurality of electronic devices disposed within a physical workspace and controller devices interconnected to each other, each controller device configured to interact with a virtual workspace and control the electronic device. Each controller device includes: a programmable processor; a base platform having at least two multidirectional microphones; and a display panel. The display panel comprises a display screen used for displaying a user control interface and a status bar. Each controller device is configured to receive audio signals from other controller devices and to receive media signals from the electronic device; the controller is coupled to the electronic device and configured to generate a control signal based on the user input, the audio signal and / or the media signal to control the electronic device.

Description

[0001] Cross-references

[0002] This application claims the benefit of priority to U.S. Patent Application No. 18 / 149,738, filed January 4, 2023, the contents of which are incorporated herein by reference in their entirety. The full disclosure of any publications or patent documents referenced in this application is incorporated herein by reference. Technical Field

[0003] This disclosure discloses a device control system. Specifically, this disclosure relates to a programmable, interactive, remote control system for controlling various electronic devices in a group environment. Background Technology

[0004] Recent policy changes have transformed the way people work. With increasing acceptance and support for remote work, and the rapid development of computer systems and audiovisual technologies, people in different locations can connect in real time. Further technological advancements have led to interconnected systems, enabling multiple remote participants to simultaneously share documents, access the internet, and use assistive technologies in virtual collaborations. In contrast, the application of such technological capabilities in physical office environments is often limited or even absent.

[0005] While remote work systems offer numerous advantages, the value and demand for face-to-face collaboration are becoming increasingly prominent. In-person office environments typically provide richer social opportunities, stronger integration into corporate culture, more frequent informal learning and communication, networking opportunities, and convenient access to physical resources. Given the respective advantages of remote and in-person work models, hybrid work is gradually becoming the ideal choice. In modern workplaces, it is common for in-person meetings to include at least one remote participant. However, neither in-person nor hybrid work can match the level of technical collaboration, system integration, and ease of use offered by remote work systems.

[0006] Therefore, there is an urgent need for an interactive control automation system: a system that provides each group member in a physical environment with an interconnected, independent controller device, supporting both individual use and facilitating physical and virtual interaction among group members. Furthermore, this system not only enhances interaction between offline members but also supports the participation of remote members. Ideally, the controller devices are interconnected, enabling group members to share documents, access the internet, and collaborate using assistive technologies during meetings. In addition, each controller device can support members in expressing their opinions in real time, speaking or interacting in the physical environment, and operating one or more electronic devices within the meeting venue.

[0007] References or discussions of certain documents, actions, or arguments in this specification do not imply that such content or combinations thereof were publicly known, publicly available, common general knowledge, or constitute prior art under applicable law as of the priority date; nor do they indicate that they are necessarily related to the technical problem to be solved by this invention.

[0008] To facilitate understanding of the technical solutions of this invention, some prior art is illustrated in the specification, but this should not be construed as abandoning those technical solutions. The claims of this application may also cover one or more of the prior art described herein. Summary of the Invention

[0009] An exemplary embodiment of the present invention provides an interactive workspace integration system for integrating a physical workspace containing at least one electronic device with a virtual workspace.

[0010] In some embodiments, the system includes multiple controller devices located within a physical workspace, interconnected and each corresponding to a user. Each controller device is configured to interact with the virtual workspace and control the electronic devices.

[0011] In some embodiments, each controller device includes a programmable processor operatively connected to one or more memory devices and capable of interacting with a virtual workspace. The programmable processor may run a Linux operating system. In some embodiments, the processor further includes a video graphics engine with a high-definition streaming media decoder for receiving and decoding video files.

[0012] In some embodiments, each controller device includes a base platform and a display panel. The base platform extends horizontally from its leading edge to its trailing edge and includes at least two multi-directional microphones for capturing sound in the physical workspace and converting it into audio signals. The display panel extends generally orthogonally from the leading edge of the base platform and includes a display screen and a status bar, wherein the display screen is configured to display a user control interface and receive user input, and the status bar can be selectively illuminated in response to user input.

[0013] In some embodiments, each controller device is configured to receive audio signals from other controller devices and media signals from one or more electronic devices, and to generate control signals based on user input, audio signals, and / or media signals to control the electronic devices.

[0014] In some embodiments, each controller device includes an internal network server for displaying a configuration page on a display panel; it may also include an audio port on the base platform for connecting an audio output device configured to process audio signals to perform audio amplification and / or language translation.

[0015] In other embodiments, one controller device may be designated as the master device for controlling other controller devices. The master device can initiate voting requests to the other controller devices, which respond to the requests by generating votes and transmitting the results to the master device for tallying. The status bar of each controller device can be illuminated based on the voting results.

[0016] In some embodiments, each controller device includes at least one sensor for acquiring ambient information and transmitting it to a programmable processor. The user control interface may be configured to provide hand-raising functionality, voting functionality, hearing aid functionality, and / or language translation functionality.

[0017] In another exemplary embodiment of the invention, an integration method is provided for integrating a physical workspace containing at least one electronic device with a virtual workspace. The method includes: providing a physical workspace containing at least one electronic device to a plurality of users, and equipping each user with a controller device configured to control the electronic device and interact with the virtual workspace.

[0018] In some embodiments, the controller device includes a programmable processor operatively connected to one or more memory devices and interacting with a virtual workspace. The controller device also includes a base platform extending horizontally from a leading edge to a trailing edge and equipped with two or more multi-directional microphones for acquiring sound from the physical workspace and converting it into audio signals.

[0019] In some embodiments, each controller device further includes a display panel that extends generally orthogonally from the leading edge of the base platform. The display panel includes a display screen and a status bar, wherein the display screen is configured to display a user control interface and receive user input, and the status bar can be selectively illuminated in response to user input.

[0020] In some embodiments, the method includes: receiving user input, audio signals from other controller devices, and / or media signals from an electronic device at a controller device; generating a control signal based on the user input, audio signals, and / or media signals; and transmitting the control signal to the electronic device.

[0021] In some embodiments, receiving user input includes receiving touch input through a user control interface; it may also include acquiring sound input through a multi-directional microphone, and the sound input may be capable of noise cancellation and / or echo cancellation.

[0022] In other embodiments, receiving user input further includes receiving configuration information designating a controller device as a master device, the master device being configured to control other controller devices. In these and other embodiments, the method includes: the master device issuing a voting request to each controller device, each controller device responding to the request and generating a vote, and the master device receiving and tallying the voting results.

[0023] This invention addresses at least one deficiency in existing workspace solutions. It is also understood that this invention can be applied to various technical fields to address other problems and shortcomings. Therefore, the claims of this invention should not be limited to the specific problems or shortcomings described herein.

[0024] To achieve the above objectives, the present invention can be implemented as shown in the accompanying drawings. However, it should be noted that the drawings are for illustrative purposes only and are not intended to limit the scope of the invention. Various modifications and improvements to the present invention should be considered to fall within its protection scope. Attached Figure Description

[0025] Figure 1 A high-level block diagram of a computing system is shown, exemplarily illustrating a computing system in which the systems and methods of the present invention can be implemented;

[0026] Figure 2 A front perspective view of the controller device is shown;

[0027] Figure 3 A rear perspective view of the controller device is shown;

[0028] Figure 4A A front view of a controller device according to an embodiment of the present invention is shown;

[0029] Figure 4B A front view of the controller device according to another embodiment is shown;

[0030] Figure 5 A schematic front view of a representative physical workspace with a wall-mounted controller device is shown;

[0031] Figure 6 A schematic top view of a representative physical workspace of an interactive workspace integration system is shown.

[0032] Figure 7A A schematic top view shows the microphone pickup range of an interactive workspace integrated system in a single-user scenario;

[0033] Figure 7B A schematic top view of the microphone pickup range in the case of two users is shown;

[0034] Figure 7C A schematic top view of the microphone pickup range in the case of four users is shown;

[0035] Figure 8 This shows a front view of the wireless communication between the controller device and the mobile device;

[0036] Figure 9 The main view of the controller device, which includes a configurable user control interface, is shown.

[0037] Figure 10 The main view of the controller device that provides a hand-raising function in the user control interface is shown.

[0038] Figure 11 The main view of the controller device, which provides voting functionality through the user control interface, is shown.

[0039] Figure 12 A front perspective view of the controller device and audio output device is shown, in which the user control interface provides hearing aid functionality;

[0040] Figure 13A A schematic top view of a controller device embodying point-to-point communication is shown;

[0041] Figure 13B A schematic top view of a controller device embodying point-to-center communication is shown.

[0042] This disclosure will now be described more fully below with reference to the accompanying drawings, which illustrate various exemplary embodiments. However, this application may be embodied in many different forms and should not be construed as limited to the exemplary embodiments described herein. Rather, these exemplary embodiments are provided so that this application will be thorough and complete to those skilled in the art, and to give full consideration to the scope of this application. Detailed Implementation

[0043] As discussed in the background section, interconnected technology systems can facilitate virtual collaboration by supporting virtual meetings among multiple participants in different locations, while simultaneously enabling document sharing, internet access, and the use of assistive technologies. However, these advantages are often difficult to realize in a physical workspace environment. This invention proposes solutions to these and other related problems.

[0044] In this specification, the term "media signal" should be understood to include audio signals, video signals, or a combination of audio and video signals.

[0045] like Figure 1As shown, computing system 2 serves as an exemplary environment to demonstrate the systems and methods achievable by the present invention. Computing system 2 can be a mobile device, such as a smartphone or tablet; it can also be a desktop computer, workstation, or server, etc. It should be understood that computing system 2 is merely an example and not intended to be limiting. The systems and methods of this application are not limited to... Figure 1 The computing system shown can also be applied to other types of computing systems, or run in a distributed manner on multiple computing systems 2.

[0046] The computing system 2 includes at least one processor 4, and may also include multiple processors 4. The processor 4 is operatively connected to memories 6a, 6b, and 6c. The memories may include one or more non-volatile storage devices, such as a hard disk drive 6a, a solid-state drive 6a, a CD-ROM drive 6a, a DVD-ROM drive 6a, a magnetic tape drive 6a, etc.; they may also include non-volatile memory, such as read-only memory 6b (e.g., ROM, EPROM, EEPROM, and / or flash memory ROM), and volatile memory, such as random access memory 6c (RAM or running memory). Buses 7 (or multiple buses 7) are used to connect the processor 4, memories 6a, 6b, 6c, and other devices to enable the transfer of data and instructions between them.

[0047] To enable communication with external systems or devices, the computing system 2 may include one or more ports 8. Port 8 can be a wired port (e.g., USB port, serial port, FireWire port, SCSI port, parallel port, etc.) or a wireless port (e.g., Bluetooth port, IrDA port, etc.). Through port 8, the computing system 2 can communicate with one or more input devices 10 (e.g., keyboard, mouse, touchscreen, camera, microphone, scanner, storage device, etc.) and with one or more output devices 12 (e.g., display, monitor, speaker, printer, storage device, etc.). Furthermore, port 8 can also be used to establish connections with other computing systems 2.

[0048] In some embodiments, the computing system 2 further includes a wired or wireless network adapter 14 for connecting the computing system 2 to a network 16 (such as a local area network (LAN), wide area network (WAN), Wi-Fi, or the Internet). Through this network 16, the computing system 2 can connect to one or more servers 18, workstations, personal computers 20, mobile computing devices, or other devices. The network 16 can also be interconnected with another network via a router 22 or other devices. With the aid of the router 22, the computing system 2 can communicate with servers, workstations, personal computers, or other devices located on different networks.

[0049] like Figure 2 and Figure 3As shown, in some embodiments, the present invention provides an interactive workspace integration system for integrating one or more electronic devices in a physical workspace with a virtual workspace. The system may include multiple controller devices 34 arranged within the physical workspace, interconnected and capable of interacting with the virtual workspace. In some embodiments, the virtual workspace includes digital technologies supporting distributed remote work and collaboration, such as Zoom, Teams, or WebEx.

[0050] In some embodiments, each controller device 34 corresponds to only one user; in other embodiments, one controller device 34 may serve multiple users simultaneously. Figure 2 , 3 As shown in Figure 5, the physical workspace 28 may include one or more electronic devices 82, such as stereo speakers, cameras, computers, CD / DVD players, monitors or screens, lighting equipment, speakers, or other electronic devices. The controller device 34 may be configured to control one or more electronic devices 82 in the physical workspace 28.

[0051] In some embodiments, each controller device 34 includes a programmable processor 60 operatively connected to one or more memory devices. In some embodiments, the programmable processor 60 is capable of running a Linux operating system or other suitable operating systems and may be natively integrated within the controller device 34.

[0052] In other embodiments, the programmable processor 60 may also be located outside the controller device 34. For example, the programmable processor 60 may be a remote server 24 (such as a cloud server, mobile device, or other suitable remote computing device). Compared to the local controller device 34, the remote server 24 typically has greater processing power and resources, and is therefore capable of performing computationally intensive tasks such as video processing.

[0053] In some embodiments, the remote server 24 may include a video graphics engine and be equipped with a high-definition streaming media decoder for receiving and decoding video files. In this and other embodiments, the controller device 34 can maintain a connection with the remote server 24 via wired or wireless communication methods (such as Wi-Fi, cellular data, etc.). In some cases, the controller device 34 may also exchange data with the remote server 24 wirelessly via Wi-Fi, Near Field Communication (NFC), or Bluetooth. In other embodiments, the video graphics engine and / or high-definition streaming media decoder may also be directly integrated into the local programmable processor 60.

[0054] In another embodiment, the controller device 34 has a built-in network server 70, through which the user can configure the device. For example... Figure 2 and Figure 3 As shown, the controller device 34 includes a base platform 36 and a display panel 44. The base platform 36 can integrate a network server 70, which can display a configuration page on the display panel 44 to facilitate user settings. In addition, the display panel 44 also includes a user control interface 62, through which users can directly input information to complete the configuration of the controller device 34.

[0055] The base platform 36 is generally planar in structure, extending along the horizontal axis 42 from the leading edge 38 to the trailing edge 40. In some embodiments, the base platform 36 is provided with a network port 52 (such as an Ethernet port) for communicating with other devices in a shared network. It may also be equipped with various communication interfaces for connecting to remote devices (such as a remote server 24), such as a Wi-Fi port 72, a Bluetooth port 74, and / or an NFC port 76. In addition, the base platform 36 may also include a power supply 78 and its associated battery and power cord.

[0056] In some embodiments, the base platform 36 also integrates one or more multi-directional microphone arrays 54a-c. The microphones can take various forms, such as digital microphones, microphones with intelligent amplifiers (for sound enhancement), or microphones employing beamforming technology for directional sound transmission and reception. In some cases, microelectromechanical systems (MEMS) microphones may also be used.

[0057] like Figure 2 and Figure 3 As shown, the multi-directional microphone arrays 54a-c can be distributed on different surfaces of the base platform 36. For example, one approach is to integrate one or more microphones 54a at the leading edge 38, while microphones 54b and 54c are arranged at different locations on the trailing edge 40.

[0058] like Figure 12 As shown, in some embodiments, the base platform 36 may also be provided with an audio port 64 for connecting audio output devices 65 such as headphones, earphones, or speakers. These devices are capable of processing the received audio signals, such as amplifying, translating, or otherwise enhancing the audio.

[0059] In some embodiments, a stabilizing structure 66 may be provided on the bottom surface of the base platform 36 to improve the stability of the device on a smooth surface (such as a desktop or tabletop). The stabilizing structure may be made of rubber, felt, or other suitable materials as legs or panels, which may be fixedly mounted or integrally molded with the base platform 36. Generally, the stabilizing structure is typically manufactured directly as an integral part of the platform.

[0060] The display panel 44 tilts upwards from its leading edge 38, forming an acute angle with the base platform 36. This ensures that the front surface 46 of the display panel 44 faces the user, improving the viewing experience and facilitating interactive input. The base platform 36 and the display panel 44 can be connected via mechanical fasteners such as hinges, screws, and rivets, or they can be integrally molded. Both can be made from thermoplastic polymers such as acrylonitrile-butadiene-styrene (ABS), polyamide, polycarbonate, polyphenylene ether (PPE), or combinations thereof and similar materials.

[0061] In some embodiments, the controller device 34 can be designed to be compact for easy handheld use or placement in a small personal workspace. For example, the base platform 36 can be approximately square, with each side measuring about 4 inches, and the distance from the leading edge 38 to the trailing edge 40 also approximately 4 inches. Of course, it can also be other regular or irregular shapes and adjusted to different sizes as needed.

[0062] In some embodiments, the display panel 44 may be tilted from the leading edge 38 to the trailing edge 40 of the base platform 36 to form an acute angle, so that the front surface 46 is tilted upward toward the user for easy viewing and interaction. The display panel 44 may include a front surface 46, a rear surface 48, a top edge 50, and a status bar 56. Its shape and size are generally similar to those of the base platform 36, for example, a square with each side less than 4 inches, and the overall dimensions of the device in the length, width, and height directions do not exceed 4 inches. In other cases, the display panel 44 may also take any suitable shape and size. The thickness of the display panel 44 is generally less than or equal to the thickness of the base platform 36.

[0063] In some embodiments, the display panel 44 may include a display screen 61 for displaying a control interface 62 to a user. The display screen 61 may be a touch screen 63, which can not only display the interface but also receive touch input. It may be fixed or integrated with the display panel 44 by pressing, adhesive, or other means. The touch screen 63 may be resistive, capacitive, or may use LCD, OLED, holographic touch display, etc., and its shape may be square, rectangular, or other suitable.

[0064] In some embodiments, the status bar 56 is typically positioned on the front surface 46 of the display panel 44, but may also be integrated into the top edge 50 or the rear surface 48 depending on the design, allowing users to view it from different angles. In some designs, the status bar 56 appears simultaneously on the front surface and the top or rear surface, enabling simultaneous display on both the front and back sides. It can also be directly mounted on the base platform 36. The status bar 56 may consist of one or more LEDs (or other light sources) that illuminate continuously or intermittently in response to user input to indicate device status. For example, it may indicate whether the multi-directional microphones 54a-c are on, or flash in response to user actions, prompting for a speaking request, etc.

[0065] like Figure 5 As shown, in some embodiments, the controller device 34 may also integrate or connect to various sensors 57a, 57b for collecting environmental information, including proximity, illumination, motion, or position data. The programmable processor 60 processes this information to automatically execute relevant functions or adjust the settings of one or more electronic devices 82 in the physical workspace 28. For example, when the light sensors 57a, 57b detect insufficient ambient light, the processor can automatically turn on the lighting; simultaneously, the system can also present relevant data on the user interface 62 for the user to manually adjust device parameters.

[0066] Now for reference Figure 4A and 4B In some embodiments, the controller device 34 may include a display panel 44 having a display screen 61 (e.g., a touchscreen 63). The touchscreen 63 may include a size smaller than or equal to the front surface 46 of the display panel 44. In one embodiment, such as Figure 4A As shown, the front surface 46 of the touchscreen 63 and display panel 44 can be less than approximately 4 square inches. In another embodiment, as... Figure 4B As shown, the front surface 46 of the touchscreen 63 and display panel 44 can be measured diagonally 71 from one corner to the other, and is less than approximately 4 inches. In some cases, the touchscreen 63 may extend over a large portion of the front surface 46 of the display panel 44 to maximize the reuse of the available touchscreen 63. In these and other embodiments, the height 67 and / or width 69 of the touchscreen 63 may substantially match the height and / or width of the display panel 44.

[0067] In some embodiments, the height 67 and / or width 69 of the touchscreen 63 may be smaller than the overall height and / or width of the display panel 44, thereby reserving installation space for other components of the controller device 34. For example, the height 67 of the touchscreen 63 may be appropriately reduced to provide space for the status bar 56 and / or the multi-directional microphone 54. In some cases, components of the controller device 34 may also be mounted or integrated onto the leading edge 38 of the base platform 36. As shown, the display panel 44 may also be directly and integrally connected to the leading edge 38 of the base platform 36 for a seamless transition.

[0068] like Figure 5 As shown, in some embodiments, the interactive workspace integration system 30 may include one or more controller devices 34 equipped with wall mount brackets 58 or other fasteners for attachment to a wall 59 or other vertical surface. In some cases, the controller devices 34 may be directly mounted on the inner or outer wall of the physical workspace 28; in others, they may be attached to the wall of an adjacent space.

[0069] In some embodiments, the controller device 34 can also be used to display the usage status of the physical workspace 28. For example, such as Figure 2 As shown, controller device 34 may include user control interface 62, enabling authorized users to access the space, make reservations, or register for use. In some cases, controller device 34 may also display the seating distribution within the physical workspace 28.

[0070] In some embodiments, the wall-mounted controller device 34 also includes one or more multi-directional microphones 54 for receiving user voice commands or other audio input. Furthermore, these microphones can also support voice communication between users inside and outside the physical workspace 28.

[0071] In some embodiments, the status bar 56 illuminates when the multi-directional microphone 54 is activated. In other cases, the status bar 56 also illuminates when the physical workspace 28 is occupied. The status bar 56 can indicate different states using different colors: red indicates the space is occupied, yellow indicates the meeting is about to begin, and green indicates the space is available. In some cases, the status bar 56 will also flash to alert the user when the multi-directional microphone 54 is active.

[0072] In some embodiments, the wall-mounted controller device 34 also includes a backlight 80 for illuminating the device itself in low-light environments. Furthermore, the controller device 34 can also be used to control lights 82 or other electronic devices within the physical workspace 28.

[0073] like Figure 6 As shown, in some embodiments, the interactive workspace integration system 30 may include multiple controller devices 34a-e, each corresponding to a user 32a-e, with each controller device 34 controlled by a single user. In some cases, at least one controller device 34f can be operated simultaneously by multiple users (32f-h).

[0074] like Figure 2 and Figure 3 As shown, the multi-directional microphones 54a-c in one or more controller devices 34a-f can perform audio amplification, echo cancellation, or other enhancement processes to improve the received audio signal, thereby providing high-quality audio output for users 32a-h within the physical workspace 28 and for remote users in the virtual workspace. In some embodiments, one or more controller devices 34a-f can also be configured to transmit audio signals for local recording or remote video conferencing (such as Zoom, Teams, or WebEx).

[0075] In some embodiments, one of the controller devices 34a-f can be designated as the master device 35 for selectively controlling the other controller devices 34a-e. The master device 35 can send voting requests to each controller device 34a-f to collect votes from users 32a-h. Each controller device generates a vote upon receiving the request and sends the result back to the master device 35. The master device 35 can display and / or tally the votes. Figure 2 As shown, the status bar 56 of the controller devices 34a-f can also indicate the voting status by lighting up and changing colors.

[0076] For example, status bar 56 displays red light to indicate a negative vote, green light to indicate a positive vote, and yellow light to indicate no vote has been cast. Status bar 56 can also display any color or color combination according to user settings to convey the required information. Another way is to differentiate through different display modes: flashing indicates no vote, continuously lit indicates a positive vote, and off indicates a negative vote. In some designs, status bar 56 may also simply illuminate to indicate that a vote has been submitted to the main device 35, without revealing the vote content.

[0077] like Figures 7A-7C As shown, in some embodiments, the controller device 34 further includes a multi-directional microphone array 54, consisting of multiple multi-directional microphones 54a-c, for acquiring and transmitting directional sound within the physical workspace 28. In some embodiments, one or more microphones 54a-c in the array may be digital beamforming microphones with speakers. The controller device 34 may include a combination of software, hardware, and / or network protocols for converting the sound acquired by the microphone array 54 into high-fidelity digital audio signals and transmitting them over a network. In some embodiments, the microphone array 54 is capable of transmitting uncompressed multi-channel, low-latency digital audio over Ethernet using Layer 3 IP packets. In other embodiments, the microphone array 54 may also transmit compressed audio signals over a network.

[0078] like Figure 2 and Figure 3 As shown, in some embodiments, multi-directional microphones 54a-c are distributed around the periphery of the base platform 36 to optimize the localization and extraction of sound from multiple speakers. Specifically, in some embodiments, the first multi-directional microphone 54a is located at the leading edge 38 of the base platform 36, while the other two multi-directional microphones 54b and 54c are located at the trailing edge 40 of the base platform 36.

[0079] Figures 7A-7CVarious microphone pickup patterns involving an array of multi-directional microphones 54 disposed on a single controller device 34 are illustrated. As shown, the distribution of the multi-directional microphones 54 around the controller device 34 can optimize high-fidelity sound capture and transmission in fluid configurations where various users 32a-d are located at different distances from the controller device 34 and are arranged relative to each other in various arrangements.

[0080] like Figure 8 As shown, in some embodiments, the controller device 34 includes an internal network server 70 for displaying a configuration page 68 on the display panel 44. The configuration page 68 can be used to input login information (such as a name) and display it to other users, while also allowing users to select a color scheme or other display options. In some embodiments, the internal network server 70 can store the configuration page 68 locally and automatically display it on the display screen 61 upon power-on.

[0081] In some embodiments, the controller device 34 can communicate with the user mobile device 92 to receive configuration information. The configuration information may include authorization information, such as username, password, fingerprint, or photo recognition. The controller device 34 can connect to the user mobile device 92 via wireless communication protocols such as Wi-Fi, Near Field Communication (NFC), or Bluetooth. In some embodiments, both the user mobile device 92 and the controller device 34 are provided with NFC ports 94 and 76 to transmit configuration information and user input information via the NFC protocol.

[0082] like Figure 6 and Figure 9-12 As shown, in some embodiments, the display panel 44 includes a display screen 61 for presenting a user control interface 62. The user control interface 62 can receive various forms of user input, including touch input from the touchscreen 63, voice input from one or more multi-directional microphones 54, and / or input via an external input device connected to the controller device 34. In some embodiments, the user control interface 62 can display desired text and / or images and supports custom color schemes, font styles, and themes. In some embodiments, the user control interface 62 can display the user's name and / or their seating arrangement in the physical workspace 28. Furthermore, the user control interface 62 can also be configured to display or link to web pages, news feeds, social media, applications, and other information or media content.

[0083] like Figure 10 As shown, in some embodiments, the user control interface 62 may provide a "raise hand" function 73 to indicate that a user wishes to speak or requests the right to speak. This function can receive user input via a configurable button. In other embodiments, the user control interface 62 may also be overlaid on a virtual workspace, so that the button and the user image are displayed simultaneously.

[0084] like Figure 11 As shown, in some embodiments, the user control interface 62 may provide a voting function 102, enabling users to vote on questions asked verbally or from the main device 35 (e.g., Figure 6 The user control interface 62 allows users to vote on questions (as shown). This interface can be implemented via one or more buttons, which users can click to submit their vote. In other embodiments, the user control interface 62 provides a slider, allowing users to select positions within a continuous range to express their voting intentions. This disclosure also covers any interface form that enables users to express their voting intentions through selection or manipulation. Furthermore, in some embodiments, the status bar 56 can be illuminated after voting is completed to indicate that the vote has been submitted. Figure 12 As shown, in some embodiments, the user control interface 62 may provide hearing aid functions 104, such as sound amplification, noise cancellation, and / or echo cancellation. The interface may also allow the user to adjust the audio output volume. In some embodiments, the hearing aid function 104 may translate speech input into text and present it to the user via the display screen 61.

[0085] In some embodiments, each controller device 34 includes an audio port 64 disposed on the base platform 36 for connecting an audio output device 65. Hearing aid functionality 104 can be implemented via the audio port 64 and / or the audio output device 65. Figure 2 As shown, audio port 64 and / or audio output device 65 can also communicate with programmable processor 60 to support hearing aid function 104.

[0086] In other embodiments, the user control interface 62 may also provide language translation functionality, allowing the user to select multiple languages ​​via the touchscreen 63. The audio port 64 and / or audio output device 65 can process sounds from the surrounding environment and output them in the selected language. The audio port 64 and / or audio output device 65 may also communicate with the programmable processor 60 to enable sound translation and output.

[0087] like Figure 13A and 13B As shown, in some embodiments, the various controller devices 34a-c in the interactive workspace integration system 30 can be interconnected. For example... Figure 13A As shown, any one of the controller devices 34a-c can broadcast information to all other controller devices, or selectively transmit it to one or more specific controller devices. In some embodiments, information between the controller devices 34a-c can be transmitted and received via wired connections and / or wireless communication protocols.

[0088] like Figure 6As shown, in some embodiments, any one of the controller devices 34a-c can be designated as the master device 35 and configured to control the other controller devices. In other embodiments, a separate hub device 98 can be provided for transmitting and receiving information between the controller devices 34a-c and for selectively controlling them.

[0089] In some embodiments, the hub device 98 may be a server, a mobile device, or other local or remote device capable of communicating with each controller device 34a-c, and may be connected to each controller device via wired or wireless means. The hub device 98 may be configured to initiate voting requests to each controller device 34a-c, receive the voting results returned by them, and summarize and statistically analyze the results.

[0090] Various aspects of this invention can be implemented by systems, methods, or computer program products. Implementation can be entirely hardware-based, entirely software-based (e.g., firmware, resident software, microcode, etc.), or a combination of hardware and software. In this specification, all of the above implementations are collectively referred to as "circuit," "module," or "system." Furthermore, various aspects of this invention can also be embodied as computer program products stored on one or more computer-readable media and containing program code that can be read and executed by a computer.

[0091] Computer-readable media can take one or more forms or combinations thereof, and can be either computer-readable signal media or computer-readable storage media (including, but not limited to, non-transitory computer-readable storage media). The storage medium can be an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. Examples include, but are not limited to: electrical connections implemented by one or more wires, portable hard disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable and programmable read-only memory (such as EPROM or flash memory), optical fiber, portable optical disc read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any combination thereof. In the context of this document, "computer-readable storage medium" means any tangible medium capable of storing programs and being used by an instruction execution system, apparatus, or device.

[0092] Computer-readable signal media may include propagated data signals carrying computer-readable program code, such as baseband signals, or as part of a carrier wave. Such propagated signals typically include, but are not limited to, electromagnetic signals, optical signals, or any combination thereof. They differ from computer-readable storage media in that signal media are used to communicate with, propagate, or transmit programs with an instruction execution system, apparatus, or device.

[0093] Program code stored on a computer-readable medium may be transmitted by any means of transmission, including but not limited to wireless, line, fiber optic cable, radio frequency (RF), or any combination thereof.

[0094] The computer program code described in this invention can be written in one or more programming languages, such as object-oriented languages ​​(e.g., Java, JavaScript, Smalltalk, C++, etc.), procedural languages ​​(e.g., C or similar languages), and other languages ​​such as XML, XBRL, and HTML5. The program code can be executed entirely on the user's computer, partially on a local computer, partially on a remote computer, or entirely on a remote computer or server. In remote execution, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN), a wide area network (WAN), or the Internet.

[0095] Aspects of the invention are described below with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. Each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions / actions specified in the blocks of the following figures and / or block diagrams.

[0096] These computer program instructions may also be stored in a computer-readable medium that can instruct a computer, other programmable data processing apparatus or other apparatus to operate in a particular manner, such that the instructions stored in the computer-readable medium produce an article of art including instructions that implement the functions / actions specified in the flowcharts and / or block diagrams.

[0097] Computer program instructions may also be loaded onto a computer, other programmable data processing apparatus or other device to perform a series of operational steps on the computer, other programmable apparatus or other device, thereby producing a computer-implemented process, such that the instructions, which execute on the computer or other programmable device, provide a process for implementing the functions / actions specified in the flowchart and / or block diagram blocks.

[0098] The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code, comprising one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may appear in the order indicated in the figures. For example, depending on the functions involved, two blocks shown consecutively may actually be executed substantially simultaneously, or these blocks may sometimes be executed in reverse order. Each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented by a system based on dedicated hardware that performs the specified function or action, or by a combination of dedicated hardware and computer instructions.

[0099] The corresponding structures, materials, actions, and equivalents of all means or steps plus functional elements in the following claims are intended to include any structure, material, or action that performs a function in combination with other elements specifically claimed. The description of the invention is for illustrative and descriptive purposes only and is not intended to be exhaustive or limited to the inventive form described. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the invention. The embodiments were chosen and described in order to best explain the principles and practical application of the invention and to enable those skilled in the art to understand the inventive content of various embodiments with various modifications suitable for the intended particular use.

[0100] The flowchart described herein is merely an example. Many variations may be made to the diagram or the steps (or operations) described therein without departing from the spirit of the invention. For example, these steps may be performed in a different order and / or steps may be added, deleted, and / or modified. All such variations are considered part of the claimed invention.

[0101] In summary, this paper presents an interactive workspace integration system and method. The invention is illustrated by way of example in the accompanying drawings and throughout the written description. It should be understood that many variations are possible while adhering to the inventive concept. Such variations are considered part of the invention.

Claims

1. An interactive workspace integration system, characterized in that, The system includes a controller device for integrating a physical workspace containing at least one electronic device with a virtual workspace to form an interactive workspace, the controller device comprising: A programmable processor operatively connected to at least one memory device and interacting with a virtual workspace; the processor is configured to receive media signals from at least one electronic device and generate control signals based on the media signals and / or user input to control the electronic device; A base platform includes a front edge and a rear edge extending in a horizontal direction, the overall length of which is parallel to and in contact with the support surface; the base platform includes a first multi-directional beamforming microphone disposed at the front edge and a second multi-directional beamforming microphone disposed at the rear edge, the microphones being configured to collect sound in the physical workspace and convert it into audio signals; The first status bar, located at the front edge of the basic platform, is configured to provide information to the first user by being illuminated; A display panel is fixedly connected to the front edge of the base platform and extends upward from the front edge to the rear edge at a fixed acute angle; the display panel includes a front surface, a rear surface, and a display screen disposed on the front surface; the fixed acute angle tilts the display screen upward to optimize the viewing angle of the first user; the display screen is configured to display a user control interface and receive user input; A second status bar, located on the rear surface of the display panel, is configured to provide information to a second user by being illuminated, and the display screen is not visible to the second user.

2. The interactive workspace integration system according to claim 1, characterized in that, The second status bar is located near the top edge of the display panel to enhance visibility for the second user.

3. The interactive workspace integration system according to claim 1, characterized in that, The base platform has a network port at its rear edge, which is configured to enable the controller device to communicate with Ethernet.

4. The interactive workspace integration system according to claim 3, characterized in that, The audio signal includes an uncompressed multi-channel low-latency digital audio signal, and the first and second multi-directional beamforming microphones are configured to transmit the audio signal via the Ethernet.

5. The interactive workspace integration system according to claim 1, characterized in that, The basic platform is provided with an audio port, which is configured to connect to an audio output device, wherein the audio signal is transmitted to the audio output device via the audio port.

6. The interactive workspace integration system according to claim 1, characterized in that, The size range of the controller device is from 4 inches * 4 inches * 4 inches to 8 inches * 8 inches * 8 inches.

7. The interactive workspace integration system according to claim 1, characterized in that, Both the first status bar and the second status bar are configured to indicate the operating status of the first multi-directional beamforming microphone and / or the second multi-directional beamforming microphone.

8. The interactive workspace integration system according to claim 1, characterized in that, The length of the base platform is equal to the height of the display panel, and the second status bar is located on the side away from the base platform.

Images