Multi-mode interactive intelligent office lighting system

Abstract

The invention relates to a multi-mode interactive intelligent office lighting system, which provides a user-friendly and highly-automatic lighting control solution by combining voice and gesture recognition technologies. The system mainly comprises a lighting unit, a control unit, a voice recognition unit, a gesture recognition unit and a user preference recording unit. The control unit is designed to receive and process control signals from the speech recognition unit and the gesture recognition unit within a time window. According to the received control signal, the system can flexibly adjust the setting of the lighting unit so as to adapt to the specific requirements of the office environment. And if no control signal is received within the specified time, the system performs illumination adjustment according to settings stored in the user preference recording unit, so that the continuity and individuation of the illumination environment are ensured. The design of the intelligent lighting system considers the dynamism and diversity of the office environment, optimizes the lighting experience of the user through the intelligent technology, and improves the working efficiency and comfort.

Description

Technical Field

[0001] The present invention relates to the field of lighting technology, and in particular to a multi-modal interactive intelligent office lighting system. Background Art

[0002] In the existing technology, office lighting systems usually rely on traditional switch control or simple automation technology, such as motion sensors and timers. These systems may include basic dimming functions and limited automatic response capabilities. With the development of smart home and office automation technology, some systems have begun to integrate more advanced technologies, such as Wi-Fi connected control devices, allowing users to remotely control lighting through mobile applications. In addition, some systems have introduced basic voice control functions, which can achieve basic voice command response through compatibility with smart assistant devices.

[0003] Despite this, existing smart lighting systems often face operational complexity and insufficient responsiveness. For example, systems that rely solely on voice control may not accurately recognize commands in noisy office environments, while traditional sensor control systems lack personalized adjustment capabilities and cannot automatically optimize lighting settings based on user preferences and environmental conditions. In addition, existing systems often fail to provide an effective multimodal interaction method that integrates voice and gesture input to improve system usability and flexibility.

[0004] Therefore, it is urgent to develop a new type of multimodal interactive intelligent office lighting system. Summary of the invention

[0005] The present application provides a multi-modal interactive intelligent office lighting system to optimize the user's lighting experience.

[0006] The present application provides a multi-modal interactive intelligent office lighting system, comprising:

[0007] A lighting unit for providing office lighting;

[0008] a control unit, the control unit being configured to receive a first control signal provided by the speech recognition unit and a second control signal provided by the gesture recognition unit within a specified time window; if at least one of the first control signal and the second control signal is received within the specified time window, setting the lighting unit according to the received control signal; if neither the first control signal nor the second control signal is received within the specified time window, setting the lighting unit according to the user's preferred lighting setting recorded by the user preference recording unit;

[0009] A speech recognition unit, communicating with the control unit, is used to receive and analyze the user's speech command, convert the speech command into a corresponding first control signal, and send the first control signal to the control unit;

[0010] a gesture recognition unit, communicating with the control unit, configured to receive and analyze a user's gesture input, and convert the gesture input into a corresponding second control signal;

[0011] The user preference recording unit is configured to record the user's preferred lighting settings based on the user's operation history.

[0012] Furthermore, the first control signal and the second control signal include the following information:

[0013] Command types, including adjusting brightness, changing color temperature, and turning lighting on and off;

[0014] The parameter value corresponding to the command type;

[0015] Command priority;

[0016] Timestamp, which indicates when the command was issued.

[0017] Furthermore, the control unit is specifically used for:

[0018] When the first control signal and the second control signal have different command priorities, selecting the control signal with a higher priority among the control signals; and adjusting the lighting unit according to the control signal with a higher priority;

[0019] When the first control signal and the second control signal have the same command priority, the control unit is configured to average or merge the parameter values ​​in the first control signal and the second control signal according to a preset ratio to form a comprehensive control signal, and adjust the lighting unit according to the comprehensive control signal.

[0020] Furthermore, the control unit is specifically used for:

[0021] When the first control signal and the second control signal have the same command priority, the control unit is configured to average or fuse the parameter values ​​in the first control signal, the second control signal, and the user's preferred lighting settings recorded by the user preference recording unit in a preset ratio to form a comprehensive control signal, and adjust the lighting unit based on the comprehensive control signal.

[0022] Furthermore, the control unit is provided with a user configuration interface, allowing the user to set the command priority of the first control signal and the second control signal.

[0023] Furthermore, when the user sets the command priorities of the first control signal and the second control signal to be the same in the user configuration interface, the user configuration interface provides a dedicated configuration area to allow the user to select a fusion strategy; wherein the fusion strategy includes:

[0024] Averaging the parameter values ​​in the first control signal and the second control signal or fusing them according to a preset ratio;

[0025] The parameter values ​​in the first control signal and the second control signal and the user's preferred lighting settings recorded by the user preference recording unit are averaged or merged according to a preset ratio.

[0026] Furthermore, the gesture recognition unit includes:

[0027] Depth camera, used to capture the user's three-dimensional gesture information;

[0028] The gesture classification module is used to match the captured three-dimensional gesture information with the preset gesture library and identify the user's specific gesture instructions.

[0029] Furthermore, the multimodal interactive intelligent office lighting system also includes an emotion recognition unit for identifying the user's emotional state by analyzing the user's voice features and facial expressions; wherein the control unit is configured to adjust the color temperature and brightness of the lighting unit according to the user's emotional state identified by the emotion recognition unit to improve the user's mood and work efficiency.

[0030] Furthermore, the multimodal interactive intelligent office lighting system further includes a multi-user identification unit for identifying multiple users in the office space;

[0031] The control unit is configured to determine the final lighting setting by weighted averaging or voting mechanism based on the recognition result of the multi-user recognition unit and in combination with the preference settings of multiple users.

[0032] Furthermore, the control unit determines the final control signal using the following formula:

[0033]

[0034] Among them, V represents the parameter value of the final integrated control signal, which is used to adjust the settings of the lighting unit, including the brightness or color temperature of the lighting unit; P1 and P2 represent the parameter values ​​in the first control signal and the second control signal, respectively, and the parameter values ​​include the brightness or color temperature of the lighting unit; U represents the parameter value in the user's preferred lighting settings recorded by the user preference recording unit; E represents the light intensity data detected by the environmental sensor; a and b are the weights set by the user for the first control signal and the second control signal, respectively; c and d are the weights corresponding to user preferences and environmental data, respectively; k1, k2, k3, k4 are adjustment parameters; W1 and W2 are the total weights used to adjust the control signals and the influence of user / environmental factors.

[0035] This application has the following beneficial technical effects:

[0036] (1) By integrating voice and gesture recognition technologies, the system allows users to control office lighting in a more natural and intuitive way. This multimodal interaction not only improves the ease of use of the system, but also enables users to quickly and easily adjust lighting in a variety of scenarios, such as using voice commands when both hands are busy, or using gestures when silent operation is required.

[0037] (2) The user preference recording unit in the system can learn and adapt to the lighting preferences of each user, automatically adjusting the light brightness, color temperature and other settings to meet the specific needs of individual users. This personalized adjustment not only improves the comfort of the working environment, but also helps improve employee work efficiency and satisfaction.

[0038] (3) By processing input signals within a specified time window, the system can effectively synchronize multiple control signals and reduce the possibility of command conflicts and misoperation. This intelligent management method ensures that the lighting system responds promptly and accurately, thereby saving energy and reducing unnecessary lighting adjustments. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] Figure 1 It is a schematic diagram of a multimodal interactive intelligent office lighting system provided in the first embodiment of the present application. DETAILED DESCRIPTION

[0040] Many specific details are described in the following description to facilitate a full understanding of the present application. However, the present application can be implemented in many other ways than those described herein, and those skilled in the art can make similar generalizations without violating the connotation of the present application, so the present application is not limited by the specific implementation disclosed below.

[0041] The first embodiment of the present application provides a multi-modal interactive intelligent office lighting system. Figure 1 , which is a schematic diagram of the first embodiment of the present application. Figure 1A first embodiment of the present application provides a multi-modal interactive intelligent office lighting system for detailed description.

[0042] The intelligent office lighting system includes a lighting unit 101 , a control unit 102 , a speech recognition unit 103 , a gesture recognition unit 104 and a user preference recording unit 105 .

[0043] The lighting unit 101 is used to provide office lighting.

[0044] In this embodiment, the lighting unit 101 is a core component of the multimodal interactive intelligent office lighting system, and its main function is to provide lighting suitable for an office environment.

[0045] The lighting unit 101 is designed to include multiple LED bulbs or other types of lighting elements, such as fluorescent lamps or halogen lamps, to provide efficient and uniform lighting. These lighting elements are installed in adjustable lamps, allowing the user or system to adjust the direction and distribution of light according to specific needs. The lighting unit 101 is designed with energy efficiency in mind, using lighting technology that can provide high-quality light for a long time while consuming low electricity.

[0046] The circuit design for controlling the lighting unit 101 includes an interface with the control unit 102, which is capable of receiving instructions from the control unit based on the control signals received from the voice recognition unit 103 and the gesture recognition unit 104. To achieve this, the lighting unit 101 may include a necessary microprocessor and memory inside to receive and parse the control signals and execute the lighting adjustment instructions. The microprocessor is programmed to understand and respond to commands to adjust specific parameters such as brightness, color temperature, and lighting direction.

[0047] In addition, the lighting unit 101 is also equipped with sensors for detecting ambient light conditions and indoor activities to automatically adjust the lighting to adapt to environmental changes and user needs. The data from these sensors is transmitted to the control unit 102 in real time for data analysis and decision support.

[0048] To ensure that the lighting of the lighting unit 101 can be adjusted precisely according to the user's preferences, it also works closely with the user preference recording unit 105. The recording unit stores detailed information about each user's lighting preferences, including preferred brightness levels and color temperatures, as well as possible lighting modes (e.g., reading, computer work, or resting). These preferences are updated and optimized over time to provide a more personalized lighting environment.

[0049] The design and functional integration of the lighting unit 101 ensures its efficiency and flexibility in providing office lighting, making it a key component in this embodiment, supporting highly automated and personalized lighting management.

[0050] A control unit 102, wherein the control unit is configured to receive a first control signal provided by a speech recognition unit and a second control signal provided by a gesture recognition unit within a specified time window; if at least one of the first control signal and the second control signal is received within the specified time window, the lighting unit is set according to the received control signal; if neither the first control signal nor the second control signal is received within the specified time window, the lighting unit is set according to the user's preferred lighting settings recorded by the user preference recording unit.

[0051] The control unit 102 plays a core scheduling and control role in the multi-modal interactive intelligent office lighting system provided in this embodiment. The unit is responsible for integrating and processing signals from different input units and controlling the operation of the lighting unit 101 accordingly.

[0052] The control unit 102 is built on a high-performance microprocessor equipped with sufficient computing power to process input signals from the voice recognition unit 103 and the gesture recognition unit 104. The unit has an integrated memory module for temporarily storing operating data and user configuration settings, as well as running control algorithms. The microprocessor is capable of running advanced software programs that are written to parse and execute commands from different sources and adjust the state of the lighting unit 101, such as brightness, color temperature and direction, based on these commands.

[0053] The control unit 102 also has a built-in clock management function for defining and monitoring the specified time window. This time management function allows the system to prioritize the received control signals within the preset time window to solve the command conflict problem that may be caused by multiple signal inputs. The setting of the time window ensures the timely response of the system and the accuracy of control, while reducing the possibility of misoperation.

[0054] In order to achieve communication with other units, the control unit 102 is equipped with a variety of communication interfaces, including but not limited to wireless network interfaces, Bluetooth, and possible wired connection ports. These interfaces enable the control unit to receive signals from the voice recognition unit 103 and the gesture recognition unit 104, and exchange data with the user preference recording unit 105 as needed. In addition, these communication interfaces also allow the control unit 102 to receive remote commands and software updates, so that the system can be continuously optimized with technological advances.

[0055] The control unit 102 is also designed with a user interface, which may include a display screen and an input device, such as a keyboard or a touch screen, so that the user can directly change settings or view system status. The design of the user interface focuses on user friendliness and intuitive operation.

[0056] Through such implementation steps, the control unit 102 can not only effectively manage signals from multiple input sources, but also maintain high reliability and operational flexibility of the system to meet the complex requirements of the lighting system in a modern office environment.

[0057] Furthermore, the first control signal and the second control signal include the following information:

[0058] Command types, including adjusting brightness, changing color temperature, and turning lighting on and off;

[0059] The parameter value corresponding to the command type;

[0060] Command priority;

[0061] Timestamp, which indicates when the command was issued.

[0062] In the multimodal interactive smart office lighting system, the first control signal and the second control signal are core components that enable the system to respond to commands input by the user through different modes (such as voice or gesture). Both the first control signal and the second control signal contain several key elements that are essential for correctly understanding and executing user commands:

[0063] The command type defines the specific action to be performed, such as adjusting the brightness, changing the color temperature, or switching the lighting on and off. These command types enable the control unit to recognize the user's specific needs and take appropriate action.

[0064] The parameter value corresponding to each command type specifies the specific details of the operation. For example, if the command type is to adjust the brightness, the parameter value may be any value from 0% to 100%, indicating the desired brightness level. For color temperature adjustment, the parameter value may represent a specific value of color temperature, such as 2700K (warm light) to 6500K (cold light).

[0065] Command priority determines which commands should be processed first when multiple commands arrive at the same time. The priority setting allows the system to respond based on predetermined priority rules when receiving multiple conflicting instructions, ensuring that more critical operations are executed first.

[0066] Each control signal includes a timestamp that records the exact time the command was issued. Timestamps are critical to the order and timeliness of command processing, especially in dynamic environments, where they help the system track the timeliness of commands and ensure that operations are executed in the order in which they were issued.

[0067] Furthermore, the control unit is specifically used for:

[0068] When the first control signal and the second control signal have different command priorities, the control signal with a higher priority among the control signals is selected; and the lighting unit is adjusted according to the control signal with the higher priority.

[0069] When the first control signal and the second control signal received by the control unit have different priorities, the operation of the system is straightforward. The control unit checks the priority information contained in each signal. The priority is usually pre-set, determined by user configuration or system default settings, and may be based on the urgency of the usage scenario or user preference.

[0070] In this case, the control unit will automatically select the control signal with a higher priority to execute. For example, if the control signal from the voice recognition unit has a higher priority than the signal from the gesture recognition unit, the system will adjust the lighting unit according to the parameters in the voice control signal (such as brightness adjustment, color temperature change, or on / off command). This ensures that in conflicting instructions, more important or more urgent operations can be executed first.

[0071] When the first control signal and the second control signal have the same command priority, the control unit takes a more complex approach. In this case, the control unit does not just select one signal and ignore the other, but combines the parameter values ​​in the two signals by averaging or fusing them according to a preset ratio.

[0072] The specific fusion method can be based on a variety of factors, including but not limited to the user's historical preference settings, current environmental conditions, or the system's preset response strategy. For example, if two signals both indicate adjusting the brightness but the specific values ​​are different, the control unit may calculate the average of the two values ​​or adjust the brightness according to a set ratio to form a comprehensive control signal.

[0073] After creating the composite control signal, the control unit will adjust the lighting units according to this signal. This approach allows the system to respond more flexibly and delicately to the actual needs of the user when faced with multiple inputs of the same priority.

[0074] Furthermore, the control unit is specifically used for:

[0075] When the first control signal and the second control signal have different command priorities, selecting the control signal with a higher priority among the control signals; and adjusting the lighting unit according to the control signal with a higher priority;

[0076] When the first control signal and the second control signal have the same command priority, the control unit is configured to average or merge the parameter values ​​in the first control signal and the second control signal according to a preset ratio to form a comprehensive control signal, and adjust the lighting unit according to the comprehensive control signal.

[0077] When the first control signal and the second control signal received by the control unit have different priorities, the operation of the system is straightforward. The control unit checks the priority information contained in each signal. The priority is usually pre-set, determined by user configuration or system default settings, and may be based on the urgency of the usage scenario or user preference.

[0078] In this case, the control unit will automatically select the control signal with a higher priority to execute. For example, if the control signal from the voice recognition unit has a higher priority than the signal from the gesture recognition unit, the system will adjust the lighting unit according to the parameters in the voice control signal (such as brightness adjustment, color temperature change, or on / off command). This ensures that in conflicting instructions, more important or more urgent operations can be executed first.

[0079] When the first control signal and the second control signal have the same command priority, the control unit takes a more complex approach. In this case, the control unit does not just select one signal and ignore the other, but combines the parameter values ​​in the two signals by averaging or fusing them according to a preset ratio.

[0080] The specific fusion method can be based on a variety of factors, including but not limited to the user's historical preference settings, current environmental conditions, or the system's preset response strategy. For example, if two signals both indicate adjusting the brightness but the specific values ​​are different, the control unit may calculate the average of the two values ​​or adjust the brightness according to a set ratio to form a comprehensive control signal.

[0081] After creating the composite control signal, the control unit will adjust the lighting units according to this signal. This approach allows the system to respond more flexibly and delicately to the actual needs of the user when faced with multiple inputs of the same priority.

[0082] Furthermore, the control unit is specifically used for:

[0083] When the first control signal and the second control signal have the same command priority, the control unit is configured to average or fuse the parameter values ​​in the first control signal, the second control signal, and the user's preferred lighting settings recorded by the user preference recording unit in a preset ratio to form a comprehensive control signal, and adjust the lighting unit based on the comprehensive control signal.

[0084] The control unit receives signals from different input sources, including voice and gesture control units. Each control signal contains specific command type, parameter value and priority information. When the first control signal and the second control signal have the same priority, the control unit needs to process these signals in a specific way to ensure that the lighting system response is consistent and optimized.

[0085] To process signals with the same priority, the control unit adopts a fusion strategy which includes the following steps:

[0086] Collection of signal parameters: The control unit first extracts command parameter values ​​from the first and second control signals. These parameters may involve the brightness, color temperature, etc. of the lighting.

[0087] Integration of user preferences: At the same time, the control unit also extracts relevant preference settings from the user preference recording unit, which are based on the user's previous operation history and selection records.

[0088] Fusion of parameter values: The control unit fuses these collected parameter values ​​(from control signals and user preferences) in a predetermined ratio. This can be done by simple averaging or more complex weighted averaging, where the weight distribution can be determined based on the system configuration or user-set preferences.

[0089] Generate a comprehensive control signal: The fused parameter values ​​form a comprehensive control signal, which will be used to actually adjust the lighting unit. This step ensures that when commands from different input sources have the same priority, the system can reasonably balance the various needs and provide a unified response.

[0090] Furthermore, the control unit is provided with a user configuration interface, allowing the user to set the command priority of the first control signal and the second control signal.

[0091] In the multimodal interactive intelligent office lighting system, the control unit has a key function, which is to provide a user configuration interface. This interface enables users to customize the command priority of the first control signal and the second control signal, thereby achieving personalized lighting control. This configuration capability is one of the core features of the system, ensuring that users can optimize the lighting environment according to their specific needs and preferences.

[0092] The user configuration interface is designed to be intuitive and easy to use, allowing users to set and adjust the priority of control signals through simple interactions. The interface can be accessed from a variety of devices, including computers, tablets or smartphones, ensuring that users can configure the system at any time.

[0093] On the interface, the user will see two partitions, each representing the settings of a control signal. For each control signal, the user can select a priority through a sliding bar or a drop-down menu. Priorities can range from low to high and are usually marked with numbers or represented by descriptive labels such as "low", "medium", and "high".

[0094] Furthermore, when the user sets the command priorities of the first control signal and the second control signal to be the same in the user configuration interface, the user configuration interface provides a dedicated configuration area to allow the user to select a fusion strategy; wherein the fusion strategy includes:

[0095] Averaging the parameter values ​​in the first control signal and the second control signal or fusing them according to a preset ratio;

[0096] The parameter values ​​in the first control signal and the second control signal and the user's preferred lighting settings recorded by the user preference recording unit are averaged or merged according to a preset ratio.

[0097] In a multimodal interactive intelligent office lighting system, the design of the user configuration interface is crucial, especially when users need to process multiple control signals of the same priority. To ensure that users can flexibly control the lighting system and adjust the lighting according to specific needs, the system provides a dedicated configuration area for selecting the fusion strategy.

[0098] When the command priorities of the first control signal (e.g., the signal from the voice recognition unit) and the second control signal (e.g., the signal from the gesture recognition unit) are set to be the same by the user, the user configuration interface of the control unit will enable a specific configuration area. This area is specifically used to allow the user to define how to handle the conflict between the two signals.

[0099] The user can choose from several fusion strategies to determine how to combine the two signals:

[0100] Averaging: The user can choose to perform a simple mathematical average of the parameter values ​​in the first and second control signals. This means that if one signal suggests adjusting the brightness to 70% and the other to 30%, the system will set the brightness to 50%.

[0101] Preset Ratio Fusion: This option allows the user to set a ratio to determine the weight of each signal in the final decision. For example, the user can decide that the first control signal has 70% weight and the second control signal has 30% weight. This method provides greater flexibility, allowing users to adjust the influence of the signal according to various situations.

[0102] Fusion of user preferences: In addition to the above two signals, this strategy also includes data from the user preference record unit. This strategy is particularly suitable for users who want to combine historical preferences with real-time input. For example, if the user generally prefers lower brightness, the system can take this preference into account, even if the two control signals suggest a higher brightness.

[0103] Furthermore, the control unit determines the final control signal using the following formula:

[0104]

[0105] Wherein, V represents the parameter value of the final integrated control signal, which is used to adjust the settings of the lighting unit, including the brightness and color temperature of the lighting unit; P1 and P2 represent the parameter values ​​in the first control signal and the second control signal, respectively, and the parameter values ​​include the brightness and color temperature of the lighting unit; U represents the parameter value in the user's preferred lighting settings recorded by the user preference recording unit; E represents the light intensity data detected by the environmental sensor; a and b are the weights set by the user for the first control signal and the second control signal, respectively; c and d are the weights corresponding to user preferences and environmental data respectively; k1, k2, k3, k4 are adjustment parameters; W1 and W2 are the total weights used to adjust the control signal and the influence of user / environmental factors.

[0106] This formula is used to determine the final lighting settings based on input from different sources to adjust parameters such as brightness and color temperature of the lighting units.

[0107]

[0108] 1. Parameter value of V comprehensive control signal:

[0109] V represents the value of the resulting control signal, which determines the brightness or color temperature of the lighting unit. This parameter is calculated by combining data and weights from different sources to adjust the lighting unit to reflect user needs and environmental conditions.

[0110] 2. Parameter values ​​of the first and second control signals P1 and P2:

[0111] These parameter values ​​include the brightness or color temperature of the lighting unit. P1 and P2 are data obtained from control inputs such as the voice recognition unit and the gesture recognition unit.

[0112] 3. Parameter values ​​in U user preferences:

[0113] U represents data obtained from the user preference recording unit, reflecting the preferred brightness or color temperature set by the user.

[0114] 4.E Ambient light intensity data:

[0115] E is the data measured by the environmental sensor, indicating the light intensity in the current environment, which may affect the adjustment requirements of the lighting unit.

[0116] 5. a and b, c and d, weights of control signals and environment / user preferences:

[0117] a and b are weights that can be set by the user, which determine the influence of the first and second control signals on the final output.

[0118] c and d are also weights, which are used to weight the importance of user preferences and environmental data in the formula respectively. They can be obtained through experimental data or set directly based on expert knowledge.

[0119] 6.k1, k2, k3, k4 adjustment parameters:

[0120] These parameters are used to adjust the influence of each control signal and parameter value in the preference setting. This allows the system to flexibly respond to different situations and increase or decrease the influence of specific inputs. They can be obtained through experimental data or set directly based on expert knowledge.

[0121] 7.W1 and W2 total weight adjustment factor:

[0122] W1 and W2 are the total weights that adjust the influence of each part of the whole formula. These weights further adjust the influence through logarithmic and exponential functions, strengthening or weakening the role of specific terms. They can be obtained through experimental data or set directly based on expert knowledge.

[0123] This calculation method ensures that the lighting system can integrate various information to adapt to changing environments and user needs, while also providing sufficient flexibility to adapt to the needs of specific scenarios.

[0124] The voice recognition unit 103 communicates with the control unit, and is used to receive and analyze the user's voice instructions, convert the voice instructions into corresponding first control signals; and send the first control signal to the control unit.

[0125] The voice recognition unit 103 plays a vital role in the multimodal interactive intelligent office lighting system provided in this embodiment. It is responsible for receiving and parsing operation instructions issued by the user through voice, and converting these instructions into control signals that can be understood and executed by the control unit 102.

[0126] The speech recognition unit 103 consists of a sophisticated microphone array, a signal processing module, and an advanced speech processing software. The microphone array is responsible for capturing the user's voice commands, and the microphones are designed to effectively isolate and recognize the speaker's voice in a noisy office environment. The design and placement of the microphones take into account the need to receive sound from multiple directions, ensuring that the system can work effectively throughout the entire office space.

[0127] The collected voice data is sent to the signal processing module, which first pre-processes the voice signal, including noise suppression, echo cancellation, and sound enhancement. This step is necessary to ensure that the accuracy of voice recognition is not reduced by background noise or other distractions in the office.

[0128] The pre-processed speech signal is then fed into the speech processing software, which runs on the central processing unit (CPU) of the speech recognition unit. This software uses advanced speech recognition algorithms, such as deep learning models, to understand and interpret voice commands in multiple languages ​​and accents. The software is designed to continuously optimize and expand its vocabulary and grammar parsing capabilities through remote updates to adapt to changes in user needs and new operating commands.

[0129] Once the voice command is accurately recognized and parsed, the voice processing software converts it into a digital control signal, i.e., a first control signal, which is then sent to the control unit 102. In order to ensure the reliability and security of signal transmission, the communication between the voice recognition unit 103 and the control unit 102 may be completed through an encrypted wireless or wired connection.

[0130] The design of the entire voice recognition unit 103 focuses on ease of use and efficiency, ensuring that users can quickly control office lighting through simple voice commands without physical contact or complicated operations, greatly improving the convenience and modernity of the office environment.

[0131] The first control signal is generated by the voice recognition unit 103 and is used to control the settings of the lighting unit 101. Specifically, this signal is a response to a user's voice command, such as adjusting the brightness, color temperature, switch status, etc. of the lighting. The purpose of this signal is to convert the user's voice command into a specific lighting control command that can be executed by the control unit 102.

[0132] The first control signal is usually in digital format, encoded as data packets that can be directly interpreted and processed by the control unit 102. These data packets contain all necessary parameter information to instruct the control unit how to adjust the operation of the lighting unit 101. For example, the signal may include the following information:

[0133] Command type: such as adjusting brightness, changing color temperature, turning lighting on and off, etc.

[0134] Parameter value: a specific value or state, such as adjusting the brightness to 70%, the color temperature to 5000K, or turning the lighting on or off.

[0135] Command priority: Information about which commands should be processed first when multiple commands arrive at the same time, which helps the system resolve command conflicts.

[0136] Timestamp: Indicates the specific time when a command was issued to help the control unit manage and synchronize instruction execution.

[0137] The gesture recognition unit 104 communicates with the control unit, and is used to receive and analyze the user's gesture input, and convert the gesture input into a corresponding second control signal.

[0138] The gesture recognition unit 104 plays a key role in the multimodal interactive intelligent office lighting system provided in this embodiment, and is mainly responsible for receiving and parsing user gesture inputs, and then converting these inputs into instructions for controlling the lighting unit 101.

[0139] Gesture control is more complex than voice recognition in application because gestures are more diverse and have greater individual differences. In order to accurately understand the user's true intention, the gesture recognition module in the smart office lighting system usually adopts the following strategies:

[0140] Standardized gesture library: The system first defines a set of standard gestures, each corresponding to a specific control command. These gestures are clearly stated in the user manual or guided by the user through the tutorial during the initial setup. This method relies on the user to learn and use these preset gestures.

[0141] Deep learning model: The system has built-in deep learning models that can recognize and analyze gestures. These models are usually trained with a large amount of gesture data and can process multiple factors including hand shape, gesture speed, motion trajectory, etc. The data set for model training may contain gesture samples from various cultural and customary backgrounds to increase the system's generalization ability.

[0142] The gesture recognition unit 104 consists of high-resolution cameras or infrared sensors installed at strategic locations in the office to capture the user's gestures in all directions. These sensors are carefully selected and configured to ensure accurate gesture recognition even in environments with low light or complex backgrounds. The camera is connected to high-performance image processing hardware, which is responsible for processing the input video data in real time.

[0143] Running inside the processing hardware is advanced image recognition software that uses deep learning algorithms to recognize and interpret a variety of gestures. These algorithms are trained based on a large amount of gesture data and are able to recognize a range of complex gestures including waving, tapping, sliding, etc. The software is designed to allow it to learn new gesture patterns and continuously optimize recognition accuracy as it is used. The image recognition software can also generate specific control signals based on standard gestures pre-defined in a standardized gesture library.

[0144] Once the gesture is recognized, the gesture recognition unit 104 converts the gesture into digital signals, namely second control signals, which are encoded to indicate specific lighting adjustment commands, such as adjusting brightness, changing color temperature, or turning lights on and off. These control signals are then sent to the control unit 102 via a secure communication link. The communication protocol and link may include a wired connection such as Ethernet or a wireless connection such as Wi-Fi to ensure the stability and security of data transmission.

[0145] In order to enhance the user-friendliness and interactivity of the system, the gesture recognition unit 104 is also equipped with a feedback mechanism. When a user gesture is recognized, it can immediately respond to the user operation through visual or sound feedback, such as displaying a confirmation message on a small display screen or emitting a sound signal.

[0146] In order to enhance the user-friendliness and interactivity of the system, the gesture recognition unit (usually marked as 104) is designed in the intelligent office lighting system to not only recognize the user's gesture commands, but also respond to the user's operation through an immediate feedback mechanism. This feedback mechanism mainly includes visual feedback and sound feedback, and the specific implementation method is as follows:

[0147] 1. Visual feedback:

[0148] The gesture recognition unit may be equipped with a small display that can show confirmation information or status indication when the user performs the gesture. For example, when the user makes a "dim the lights" gesture, the display can show "dimming lights" or an icon indicating that the light brightness is decreasing.

[0149] The system can also provide feedback using LED indicators. These LEDs can change color or flash patterns depending on the action to indicate system status or confirm a command. For example, flashing green might mean a command was successfully received, while flashing red might indicate an error or unrecognized gesture.

[0150] 2. Sound feedback:

[0151] The gesture recognition unit can send out sound signals through the built-in speaker or connected audio system to confirm the user's operation. This sound feedback can be a simple change in pitch or specific voice feedback, such as "brightness adjusted" or "command unknown, please try again."

[0152] To better suit different office environments and user preferences, audio feedback may be customizable. Users can choose different prompt tones or choose to turn off audio feedback in certain situations to avoid distractions.

[0153] Through these feedback mechanisms, the system not only allows users to confirm that their gestures have been correctly recognized and executed, but also provides guidance and error prompts during the operation, greatly improving the user's operating experience and the practicality of the system. In addition, instant feedback also helps new users learn and adapt to the operation of the system, accelerating the user's mastery of gesture control functions. This interactivity and feedback mechanism is an important user interface design consideration in modern intelligent systems, aiming to make technology more user-friendly and easy to use.

[0154] The second control signal is generated by the gesture recognition unit 104 and is used to control the settings of the lighting unit 101. Specifically, this signal is a response to a user's voice command, such as adjusting the brightness, color temperature, switch status, etc. of the lighting. The purpose of this signal is to convert the user's voice command into a specific lighting control command that can be executed by the control unit 102.

[0155] The second control signal is usually in digital format, encoded as data packets that can be directly interpreted and processed by the control unit 102. These data packets contain all necessary parameter information to instruct the control unit how to adjust the operation of the lighting unit 101. For example, the signal may include the following information:

[0156] Command type: such as adjusting brightness, changing color temperature, turning lighting on and off, etc.

[0157] Parameter value: a specific value or state, such as adjusting the brightness to 70%, the color temperature to 5000K, or turning the lighting on or off.

[0158] Command priority: Information about which commands should be processed first when multiple commands arrive at the same time, which helps the system resolve command conflicts.

[0159] Timestamp: Indicates the specific time when a command was issued to help the control unit manage and synchronize instruction execution.

[0160] With such a configuration, the gesture recognition unit 104 not only provides an intuitive and contactless operation mode, but also greatly enhances the flexibility and adaptability of the office lighting system, allowing users to interact with their work environment more naturally.

[0161] Furthermore, the gesture recognition unit includes:

[0162] Depth camera, used to capture the user's three-dimensional gesture information;

[0163] The gesture classification module is used to match the captured three-dimensional gesture information with the preset gesture library and identify the user's specific gesture instructions.

[0164] In the multimodal interactive smart office lighting system, the gesture recognition unit is a key component that allows users to control the lighting environment through gestures. This unit consists of two main parts: a depth camera and a gesture classification module.

[0165] The function of the depth camera is to capture the user's three-dimensional gesture information. This camera is different from a conventional two-dimensional camera. It can measure the distance between the object and the camera by emitting and receiving infrared light, thereby obtaining the three-dimensional coordinates of the object. In this system, the depth camera is installed in a strategic location (such as the center of the office or above the user's workstation) to ensure that the user's gestures can be clearly captured.

[0166] The selection and setting of depth cameras need to take into account their field of view, resolution, and adaptability to different lighting conditions. To ensure effective operation in various lighting environments, the camera should have high dynamic range and low-light performance. In addition, the camera system should include appropriate image processing hardware or software to process and analyze the captured image data in real time.

[0167] The gesture classification module is another core part of the system. Its task is to match the 3D gesture information captured by the depth camera with the preset gesture library. This module is usually implemented by software, including machine vision and image processing algorithms, and can recognize and analyze various complex gestures.

[0168] The gesture library is predefined and contains a series of standard gestures and their corresponding commands, such as waving up and down to adjust brightness, waving left and right to switch color temperature, etc. The classification module uses algorithms (such as pattern recognition, neural networks or decision trees, etc.) to analyze the input 3D image data, identify the gestures, and convert the recognition results into specific control signals to send to the control unit.

[0169] The user preference recording unit 105 is configured to record the user's preferred lighting settings according to the user's operation history.

[0170] The user preference recording unit 105 is a key component designed to enhance the personalization and self-adaptation capabilities of the multimodal interactive intelligent office lighting system provided in this embodiment. The main function of this unit is to collect, store and analyze the user's lighting preferences, and automatically adjust the lighting settings to suit the user's needs when appropriate.

[0171] The user preference recording unit 105 includes a database and related data processing software, which runs on one or more microprocessors. The database is used to store various data about the user's lighting preferences, including but not limited to parameters such as the brightness, color temperature, turn-on frequency and duration of the lighting. These data are collected by analyzing the user interaction data received from the control unit 102 (such as commands issued by the voice recognition unit 103 and the gesture recognition unit 104).

[0172] The data processing software contains algorithms that can learn and infer the preferences of users from their historical actions. The software design includes machine learning functions, which can continuously improve the accuracy of predicting user preferences over time and with the accumulation of data. This learning process allows the lighting system to gradually adapt to the user's personalized needs, thereby providing a more comfortable and efficient lighting environment.

[0173] In addition, the user preference recording unit 105 is also configured with a communication interface with the control unit 102, which allows the preference data and any updated preset preference settings to be transmitted to the control unit in real time to adjust the operation of the lighting unit 101. The communication interface can be wired or wireless, ensuring flexibility and reliability of data transmission.

[0174] The user preference recording unit 105 also has a user interface, allowing the user to directly view and manually modify the stored preference settings. This interface can be a dedicated application or a web page interface, providing a user-friendly graphical interface, allowing the user to easily view and modify the preference settings.

[0175] The user interface of the user preference recording unit 105 is to provide a direct and convenient way for users to interact, view and adjust their lighting preference settings. This interface is designed to be highly user-friendly, aiming to reduce operational complexity and increase the intuitiveness of interaction. The specific implementation can be achieved by:

[0176] First, the user interface can be designed as a dedicated mobile application that is compatible with multiple operating systems such as iOS and Android to ensure wide accessibility. This application can be connected to the user preference recording unit 105 through a secure login process, where user authentication can use a username and password, or more advanced biometrics such as fingerprint or facial recognition to enhance security.

[0177] The main interface of the application will intuitively display the various parameters of the current lighting settings, such as brightness, color temperature and lighting mode. Users can adjust these parameters through simple sliders or preset buttons. After each adjustment, the system automatically updates the user's preference record in the database. In addition, the interface can provide a "learning mode" switch. After the user activates it, the system will more actively learn the user's operating habits and automatically apply the learning results to daily lighting settings.

[0178] Secondly, the interface can also be designed as a responsive web interface, allowing users to operate not only on mobile phones or tablets, but also on any computer with an Internet connection. This web interface should be designed to be easy to navigate, with a clear menu structure and intuitive control elements such as drop-down menus and buttons. The web interface can be developed using modern web technologies such as HTML5, CSS3 and JavaScript to ensure its cross-browser compatibility and high responsiveness.

[0179] In the design of the user interface, a help and support section can also be included to provide answers to frequently asked questions and operation guides. This can help users better understand how to use the interface to adjust the lighting settings and how to use the various functions provided by the system to create a working environment that suits their personal needs.

[0180] Finally, to enhance the user experience, the interface can also provide real-time feedback. For example, when the user adjusts the lighting settings, the interface can instantly display a preview of the adjustment effect, or when the system automatically adjusts the lighting according to the user's preferences, the interface can display a notification message to inform the user which settings have been applied.

[0181] Through these specific implementations, the user interface of the user preference recording unit 105 not only enables users to easily manage and customize their lighting preferences, but also greatly enhances the interactivity and personalization level of the entire lighting system.

[0182] By integrating these functions, the user preference recording unit 105 not only enhances the intelligence of the lighting system and the user experience, but also supports a wider range of data analysis and service personalization capabilities, making the smart office lighting system more in line with the high requirements for comfort and flexibility in modern office environments.

[0183] Furthermore, the multimodal interactive intelligent office lighting system also includes an emotion recognition unit for identifying the user's emotional state by analyzing the user's voice features and facial expressions; wherein the control unit is configured to adjust the color temperature and brightness of the lighting unit according to the user's emotional state recognized by the emotion recognition unit to improve the user's mood and work efficiency.

[0184] In the multimodal interactive smart office lighting system, the introduction of emotion recognition units is an innovation, which enables the lighting system to not only respond to physical inputs (such as gestures or voice), but also sense and respond to the user's emotional state.

[0185] The emotion recognition unit has the ability to analyze the user's voice features and facial expressions to identify the user's emotional state. This unit usually includes the following components:

[0186] 1. Voice analysis system: This system uses a microphone to collect user voice data and analyzes voice characteristics such as pitch, intensity, speed and rhythm through an acoustic model. These characteristics can reveal the user's emotional state. For example, the pitch and speed of the voice may indicate the user's tension or relaxation.

[0187] 2. Facial expression analysis system: Use one or more cameras to capture the user's facial image. Image processing algorithms analyze changes in facial muscles, such as the raising of eyebrows, the degree of eye opening, and the movement of the corners of the mouth, which are key indicators of emotional expression. By identifying these changes in expression, the system can infer the user's emotional state, such as happiness, sadness, anger, etc.

[0188] The emotional state information recognized by the emotion recognition unit is transmitted to the control unit. The control unit adjusts the lighting settings based on this information, mainly adjusting the color temperature and brightness. The specific adjustment methods include:

[0189] Color temperature adjustment: Scientific studies have shown that different color temperatures can affect people's emotions and biorhythms. For example, warmer color temperatures (such as yellow light) generally make people feel relaxed and comfortable, while cooler color temperatures (such as blue light) help improve concentration and efficiency. The system automatically adjusts the color temperature according to the user's emotional needs, such as lowering the color temperature to provide a soothing environment when the user feels stressed or nervous.

[0190] Brightness adjustment: Brightness also affects mood and work efficiency. When the system detects that the user is depressed or tired, it can increase the brightness to motivate the spirit and improve concentration.

[0191] Furthermore, the multimodal interactive intelligent office lighting system further includes a multi-user identification unit for identifying multiple users in the office space;

[0192] The control unit is configured to determine the final lighting setting by weighted averaging or voting mechanism based on the recognition result of the multi-user recognition unit and in combination with the preference settings of multiple users.

[0193] In the multimodal interactive intelligent office lighting system, a multi-user identification unit is introduced, which enables the system to identify and distinguish multiple users within the office space. The key to the implementation of this function is to be able to adjust the lighting settings to meet the needs of all users, which is achieved by combining the preferences of individual users and using a specific decision-making mechanism.

[0194] The main function of the multi-user identification unit is to accurately identify and distinguish different users within the office space. This can be achieved through a series of sensors, such as cameras, infrared sensors, or microwave sensors, which can detect and track the position and movement of the human body. More advanced implementations may include facial recognition technology or other biometric methods to enhance the accuracy and reliability of identification.

[0195] Once the Multi-User Identification Unit has determined the presence and location of each user within the space, the Control Unit needs to adjust the lighting based on this information and the user preferences stored in the system. The Control Unit will perform the following steps:

[0196] 1. Collecting preferences: The system pre-stores each user’s lighting preferences, which may include settings for parameters such as brightness and color temperature. When a user is identified, their preferences are extracted as input for decision making.

[0197] 2. Application decision-making mechanism:

[0198] Weighted average: This method takes into account the preferences of each user and factors such as their relative location in the space or frequency of activity. For example, if a user spends more time working in a specific area, the user's preferences will have a greater impact on the lighting settings in that area.

[0199] Voting mechanism: In some settings, each user can "vote" on lighting preferences, and the system will use the majority choice to set the lighting. This mechanism is suitable for environments that require quick decision-making, such as conference rooms or shared workspaces.

[0200] In addition, to ensure system flexibility and user satisfaction, it is recommended to implement a feedback mechanism that allows users to rate the lighting effects and adjust their preferences. This will not only improve the user experience, but also help the system optimize its performance and settings by learning from these feedbacks.

[0201] Although the present application is disclosed as above in the form of a preferred embodiment, it is not intended to limit the present application. Any technical personnel in this field may make possible changes and modifications without departing from the spirit and scope of the present application. Therefore, the scope of protection of the present application shall be based on the scope defined by the claims of the present application.

Claims

1. A multi-modal interactive intelligent office lighting system, characterized in that: include: A lighting unit for providing office lighting; A control unit, the control unit being configured to receive a first control signal provided by the speech recognition unit and a second control signal provided by the gesture recognition unit within a specified time window; If at least one of the first control signal and the second control signal is received within the specified time window, the lighting unit is set according to the received control signal; if neither the first control signal nor the second control signal is received within the specified time window, the lighting unit is set according to the user's preferred lighting settings recorded by the user preference recording unit; a speech recognition unit, communicating with the control unit, for receiving and analyzing a user's speech command and converting the speech command into a corresponding first control signal; sending the first control signal to the control unit; a gesture recognition unit, communicating with the control unit, configured to receive and analyze a user's gesture input, and convert the gesture input into a corresponding second control signal; The user preference recording unit is configured to record the user's preferred lighting settings based on the user's operation history.

2. The multimodal interactive intelligent office lighting system according to claim 1, characterized in that: The first control signal and the second control signal include the following information: Command types, including adjusting brightness, changing color temperature, and turning lighting on and off; The parameter value corresponding to the command type; Command priority; Timestamp, which indicates when the command was issued.

3. The multimodal interactive intelligent office lighting system according to claim 2, characterized in that: The control unit is specifically used for: When the first control signal and the second control signal have different command priorities, selecting the control signal with a higher priority among the control signals; and adjusting the lighting unit according to the control signal with a higher priority; When the first control signal and the second control signal have the same command priority, the control unit is configured to average or merge the parameter values ​​in the first control signal and the second control signal according to a preset ratio to form a comprehensive control signal, and adjust the lighting unit according to the comprehensive control signal.

4. The multimodal interactive intelligent office lighting system according to claim 2, characterized in that: The control unit is specifically used for: When the first control signal and the second control signal have the same command priority, the control unit is configured to average or fuse the parameter values ​​in the first control signal, the second control signal, and the user's preferred lighting settings recorded by the user preference recording unit in a preset ratio to form a comprehensive control signal, and adjust the lighting unit based on the comprehensive control signal.

5. The multi-modal interactive intelligent office lighting system according to claim 3, characterized in that: The control unit is provided with a user configuration interface, allowing the user to set the command priority of the first control signal and the second control signal.

6. The multi-modal interactive intelligent office lighting system according to claim 5, characterized in that: When the user sets the command priorities of the first control signal and the second control signal to be the same in the user configuration interface, the user configuration interface provides a dedicated configuration area to allow the user to select a fusion strategy; wherein the fusion strategy includes: Averaging the parameter values ​​in the first control signal and the second control signal or fusing them according to a preset ratio; The parameter values ​​in the first control signal and the second control signal and the user's preferred lighting settings recorded by the user preference recording unit are averaged or merged according to a preset ratio.

7. The multi-modal interactive intelligent office lighting system according to claim 1, characterized in that: The gesture recognition unit comprises: Depth camera, used to capture the user's three-dimensional gesture information; The gesture classification module is used to match the captured three-dimensional gesture information with the preset gesture library and identify the user's specific gesture instructions.

8. The multimodal interactive intelligent office lighting system according to claim 1, characterized in that: It also includes an emotion recognition unit for identifying the user's emotional state by analyzing the user's voice features and facial expressions; wherein the control unit is configured to adjust the color temperature and brightness of the lighting unit according to the user's emotional state recognized by the emotion recognition unit to improve the user's mood and work efficiency.

9. The multimodal interactive intelligent office lighting system according to claim 1, characterized in that: Also included is a multi-user identification unit for identifying multiple users within the office space; The control unit is configured to determine the final lighting setting by weighted averaging or voting mechanism based on the recognition result of the multi-user recognition unit and in combination with the preference settings of multiple users.

10. The multi-modal interactive intelligent office lighting system according to claim 1, characterized in that: The control unit determines the final control signal using the following formula: Among them, V represents the parameter value of the final integrated control signal, which is used to adjust the settings of the lighting unit, including the brightness or color temperature of the lighting unit; P1 and P2 represent the parameter values ​​in the first control signal and the second control signal, respectively, and the parameter values ​​include the brightness or color temperature of the lighting unit; U represents the parameter value in the user's preferred lighting settings recorded by the user preference recording unit; E represents the light intensity data detected by the environmental sensor; a and b are the weights set by the user for the first control signal and the second control signal, respectively; c and d are the weights corresponding to user preferences and environmental data, respectively; k1, k2, k3, k4 are adjustment parameters; W1 and W2 are the total weights used to adjust the control signals and the influence of user / environmental factors.

Images