Smart home central control system based on holographic technology

By integrating holographic projection, gesture recognition, and voice recognition through holographic technology, a three-dimensional interactive system for smart home control is achieved, solving the problem of inconvenient interaction in traditional control systems and improving user experience and the intelligence and compatibility of device control.

CN119024711APending Publication Date: 2024-11-26XIAMEN DNAKE INTELLIGENT TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411130695.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-16
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

Traditional smart home control systems are limited by screen size and touch sensitivity, resulting in a less intuitive and convenient user experience.

Method used

Using holographic technology, combined with a holographic projection unit, gesture recognition unit, voice recognition unit, control processing unit, and communication unit, intuitive interaction and control in three-dimensional space are achieved, including the integration of components such as holographic projectors, depth sensors, microphones, and central processing units.

Benefits of technology

It provides an intuitive and convenient user interface, enhances the interactive experience, supports intelligent control in various scenarios, has strong compatibility, seamless connection between devices, and improves users' intelligent control capabilities in home entertainment, kitchen cooking, home security, and environmental control.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119024711A_ABST
    Figure CN119024711A_ABST
Patent Text Reader

Abstract

A smart home central control system based on holographic technology comprises a holographic projection unit, a gesture recognition unit, a voice recognition unit, a control processing unit and a communication unit, the holographic projection unit comprises a holographic projector and a projection screen, and the gesture recognition unit comprises a depth sensor and a computer vision algorithm. The control interface is presented in the air through the holographic projection technology, a user can operate the control interface without the help of a physical screen, the interface is visual and cool, the interaction experience is enhanced, the user can directly interact with the interface in a three-dimensional space, operation is more natural and visual, and the user experience is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of smart home technology, and in particular to a smart home central control system based on holographic technology. Background Art

[0002] With the rapid development of technology, smart home systems have become an indispensable part of modern life. Traditional smart home central control systems mainly rely on touch screens or physical buttons for operation. This interactive method is limited by the size of the display and touch sensitivity, and the user experience is not intuitive and convenient enough; Holography is a technology that records and reproduces the interference image of light waves, and records and reproduces all the information of the object's light waves (including amplitude and phase). Its core is to use the principles of light interference and diffraction to capture and reproduce the complete three-dimensional information of the object. In addition, the characteristics of holographic technology are its strong three-dimensional sense, comprehensive information, and strong anti-interference. With the development of holographic projection technology, holographic display and gesture recognition technology provide new solutions for smart home central control systems, which can achieve a more intuitive, efficient and space-saving user experience. Summary of the invention

[0003] 1. Technical issues to be resolved In view of the deficiencies of the prior art, the present invention provides a smart home central control system based on holographic technology.

[0004] (II) Technical solution To achieve the above-mentioned purpose, the present invention provides the following technical solutions: a smart home central control system based on holographic technology, comprising a holographic projection unit, a gesture recognition unit, a voice recognition unit, a control processing unit and a communication unit, wherein the holographic projection unit comprises a holographic projector and a projection screen, the gesture recognition unit comprises a depth sensor and a computer vision algorithm, the voice recognition unit comprises a microphone and a voice recognition module, the control processing unit comprises a central processing unit (CPU) and a storage unit, and the communication unit comprises a wireless communication module and a network interface.

[0005] Further, the present invention is improved in that initializing the holographic projection unit includes the following steps: Step 1: Start the holographic projector; Step 2: Projection screen calibration.

[0006] Further, the present invention is improved in that initializing the gesture recognition unit includes the following steps: Step 1: Start the depth sensor; Step 2: Sensor calibration.

[0007] Further, the present invention is improved in that the initialization of the speech recognition unit includes the following steps: Step 1: Activate the microphone; Step 2: Speech recognition module calibration.

[0008] Further, the present invention is improved to include the following steps: Step 1: Load the user interface; Step 2: Waiting for user input, the system enters standby mode, waiting for the user to operate through gestures or voice.

[0009] Further, the present invention is improved in that if the user selects gesture input, the following operations are performed: 1) Gesture capture; 2) Gesture analysis; 3) Command generation; 4) Command execution; 5) Update holographic display; 6) Equipment control; 7) Equipment status feedback; 8) Update holographic display.

[0010] Further, the present invention is improved in that if the user selects voice input, the following operations are performed: 1) Voice capture; 2) The speech recognition module converts speech into text commands; 3) Parse voice commands, understand user intentions, and generate corresponding control commands; 4) Generate corresponding control commands according to the analysis results; 5) The control processing unit executes the control command and instructs the relevant equipment or interface elements to perform corresponding operations; 6) Update the holographic interface display in real time according to the command execution results and feedback the user's operation results; 7) Send control commands to corresponding smart home devices through the communication unit; 8) The smart home device returns the execution results and status information; 9) Update the holographic interface display based on device feedback information.

[0011] Further, the present invention is improved to include a home entertainment mode, which specifically includes the following steps: Step 1: User operation: The user selects "Cinema Mode" on the holographic central control screen through gestures; Step 2: System response: The system automatically adjusts the living room's lighting, sound, and curtains to provide the best viewing environment; Step 3: Feedback display: The holographic interface displays the light brightness, audio volume and curtain status in real time; The kitchen operation mode includes the following steps: Step 1: User operation: When cooking in the kitchen, the user selects a recipe through the holographic central control screen and sets the cooking time and temperature through gestures; Step 2: System response: The system automatically controls the oven and stove to ensure that the food is cooked accurately and deliciously; Step 3: Feedback display: The holographic interface displays the cooking steps and remaining time, and updates the cooking status in real time; Home security mode includes the following steps: Step 1: User operation: In away mode, the user sets up the security system through the holographic central control screen; Step 2: System response: The system automatically turns off all electrical appliances, starts locking doors and windows and surveillance cameras, and sends the away status to the user's mobile phone; Step 3: Feedback display: The holographic interface displays the status of each security device and updates the monitoring screen in real time; The environmental control mode includes the following steps: Step 1: User operation: Users can adjust indoor temperature, humidity and air quality through the holographic central control screen; Step 2: System response: The system adjusts the air conditioner, humidifier and air purifier according to the user's instructions; Step 3: Feedback display: The holographic interface will display the current temperature, humidity and air quality values, and update the environmental parameters in real time.

[0012] (III) Beneficial effects Compared with the prior art, the present invention provides a smart home central control system based on holographic technology, which has the following beneficial effects: 1. Intuitive and convenient user interface: The control interface is presented in the air using holographic projection technology. Users can operate without the help of a physical screen. The interface is intuitive and cool. 2. Enhanced interactive experience: Users can interact with the interface directly in three-dimensional space, making the operation more natural and intuitive, improving the user experience; 3. Intelligent control: The system can update the device status in real time and display feedback information on the holographic interface, so that users can understand the operation status of smart home devices at any time; 4. Wide applicability: Suitable for a variety of scenarios such as home entertainment, kitchen cooking, home security, environmental control, etc., to meet users' intelligent control needs in different environments; 5. Strong compatibility: The system can be linked with a variety of smart home devices and supports multiple communication protocols to ensure seamless connection and collaborative work between devices. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 A schematic diagram of a smart home central control system using holographic technology in the present invention; Figure 2 It is a schematic diagram of the system architecture of the present invention. DETAILED DESCRIPTION

[0014] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0015] See also Figure 1-2 , a smart home central control system based on holographic technology of the present invention comprises a holographic projection unit, a gesture recognition unit, a voice recognition unit, a control processing unit and a communication unit, wherein the holographic projection unit comprises a holographic projector and a projection screen, the gesture recognition unit comprises a depth sensor and a computer vision algorithm, the voice recognition unit comprises a microphone and a voice recognition module, the control processing unit comprises a central processing unit (CPU) and a storage unit, and the communication unit comprises a wireless communication module and a network interface; Holographic projector: Generates and projects three-dimensional images, and displays holographic images through light interference. The projector uses a high-resolution and high-brightness laser light source to ensure the clarity and brightness of the holographic image. Projection screen: Uses special transparent or translucent materials, such as transparent resin plates or glass, which can effectively carry holographic images and make them suspended in the air for display. Depth sensor: Captures user gestures and movements, and realizes gesture recognition in three-dimensional space by measuring the distance between the object and the sensor. The sensor uses ToF (Time of Flight) or structured light technology to accurately capture hand movements. Computer vision algorithm: Analyzes and processes data from depth sensors to recognize gestures and movements. The algorithm includes steps such as gesture feature extraction, action recognition, and command mapping. Microphone: Used to capture user voice commands. Voice recognition module: Converts voice commands into text, analyzes user intentions, and generates corresponding control commands. Central processing unit (CPU): Processes data from gesture recognition unit and holographic projection unit, and executes corresponding control commands. The CPU has high-performance computing power and multi-tasking capabilities. Storage unit: Stores system software, user data, and configuration files. The storage unit uses a solid-state drive (SSD) or flash memory to ensure fast data reading and writing. Wireless communication module: supports multiple communication protocols such as Wi-Fi, Zigbee, Bluetooth, etc. to achieve wireless connection and control with smart home devices. The communication module has the characteristics of high stability and low power consumption. Network interface: used to connect to the home LAN to ensure stable and efficient communication between the system and various smart home devices. The user starts the system and performs initial settings through the central control system interface, including basic configurations such as time, language, and region. The system is powered on, self-checked, and initialized to ensure that all modules are ready and that the equipment is connected to the system main control module; Furthermore, initializing the holographic projection unit includes the following steps: Step 1: Start the holographic projector, start the laser light source, calibrate the projector, and adjust the light interference to generate a clear three-dimensional image; Step 2: Projection screen calibration: the transparent or translucent projection screen is ready to ensure that the image is displayed suspended in the air.

[0016] Furthermore, initializing the gesture recognition unit includes the following steps: Step 1: The depth sensor is activated. The sensor starts to capture gesture data in three-dimensional space. Step 2: Sensor calibration, calibrate the depth sensor to ensure the accuracy and response speed of gesture recognition.

[0017] Further, initializing the speech recognition unit includes the following steps: Step 1: Microphone activation: The system activates the built-in microphone to capture the user's voice commands. Step 2: Speech recognition module calibration: calibrate the speech recognition module to ensure the accuracy and response speed of speech recognition.

[0018] Furthermore, the method further comprises the following steps: Step 1: Load the user interface. The system loads the smart home control interface and displays it in the air through holographic projection. Then the interface elements are initialized, and various control buttons, menus and real-time status displays are loaded; Step 2: Waiting for user input, the system enters standby mode, waiting for the user to operate through gestures or voice.

[0019] Furthermore, if the user selects gesture input, the following operations will be performed: 1) Gesture capture: the depth sensor captures the user's gestures, such as sliding, clicking, zooming, etc. 2) Gesture analysis: Computer vision algorithms analyze gesture data and identify specific gesture actions and intentions; 3) Command generation: Generate corresponding control commands based on gesture analysis results, such as device switch, parameter adjustment, etc. 4) Command execution: the control processing unit executes the control command and instructs the relevant equipment or interface elements to perform corresponding operations; 5) Update the holographic display, update the holographic interface display in real time according to the command execution results, and feedback the user's operation results; 6) Device control: sending control commands to corresponding smart home devices through the communication unit; 7) Device status feedback: smart home devices return execution results and status information; 8) Update the holographic display and update the holographic interface display according to the device feedback information.

[0020] Furthermore, if the user selects voice input, the following operations will be performed: 1) Voice capture: the system captures the user's voice commands through the built-in microphone; 2) The speech recognition module converts speech into text commands. The speech recognition module converts speech into text commands; 3) Parse voice commands, understand user intentions, and generate corresponding control commands; Parse voice commands, understand user intentions, and generate corresponding control commands; 4) Generate corresponding control commands according to the analysis results; Generate corresponding control commands according to the analysis results; 5) The control processing unit executes the control command and instructs the relevant equipment or interface elements to perform corresponding operations. The control processing unit executes the control command and instructs the relevant equipment or interface elements to perform corresponding operations; 6) Update the holographic display, update the holographic interface display in real time according to the command execution results, and feedback the user's operation results; 7) Send control commands to corresponding smart home devices through the communication unit; 8) The smart home device returns the execution results and status information; 9) Update the holographic interface display based on device feedback information.

[0021] Furthermore, it also includes a home entertainment mode, which specifically includes the following steps: Step 1: User operation: The user selects "Cinema Mode" on the holographic central control screen through gestures; Step 2: System response: The system automatically adjusts the living room's lighting, sound, and curtains to provide the best viewing environment; Step 3: Feedback display: The holographic interface displays the light brightness, audio volume and curtain status in real time; The kitchen operation mode includes the following steps: Step 1: User operation: When cooking in the kitchen, the user selects a recipe through the holographic central control screen and sets the cooking time and temperature through gestures; Step 2: System response: The system automatically controls the oven and stove to ensure that the food is cooked accurately and deliciously; Step 3: Feedback display: The holographic interface displays the cooking steps and remaining time, and updates the cooking status in real time; Home security mode includes the following steps: Step 1: User operation: In away mode, the user sets up the security system through the holographic central control screen; Step 2: System response: The system automatically turns off all electrical appliances, starts locking doors and windows and surveillance cameras, and sends the away status to the user's mobile phone; Step 3: Feedback display: The holographic interface displays the status of each security device and updates the monitoring screen in real time; The environmental control mode includes the following steps: Step 1: User operation: Users can adjust indoor temperature, humidity and air quality through the holographic central control screen; Step 2: System response: The system adjusts the air conditioner, humidifier and air purifier according to the user's instructions; Step 3: Feedback display: The holographic interface will display the current temperature, humidity and air quality values, and update the environmental parameters in real time.

[0022] In the description of this article, it should be noted that relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or apparatus including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or apparatus; This system has the following advantages: 1. Intuitive and convenient user interface: The control interface is presented in the air using holographic projection technology. Users can operate without the help of a physical screen. The interface is intuitive and cool. 2. Enhanced interactive experience: Users can interact with the interface directly in three-dimensional space, making the operation more natural and intuitive, improving the user experience; 3. Intelligent control: The system can update the device status in real time and display feedback information on the holographic interface, so that users can understand the operation status of smart home devices at any time; 4. Wide applicability: Suitable for a variety of scenarios such as home entertainment, kitchen cooking, home security, environmental control, etc., to meet users' intelligent control needs in different environments; 5. Strong compatibility: The system can be linked with a variety of smart home devices and supports multiple communication protocols to ensure seamless connection and collaborative work between devices.

[0023] Implementation method of holographic projection technology: Design and function of holographic projection unit: including configuration and technical details of projector and projection screen for generating and displaying 3D holographic images. Protect the clarity, stability and technical characteristics of holographic images displayed in air; Interaction methods of holographic interfaces: including how to provide a user interface through holographic images and realize interaction with other modules of the system.

[0024] Application of gesture recognition technology: Depth sensor configuration and calibration: Involves the technical details and calibration methods of the depth sensor used to capture user gestures to ensure its high accuracy and high response speed.

[0025] Gesture recognition algorithms: Protect the algorithms and models that parse user gestures, including how to process and recognize different gestures and convert them into system commands.

[0026] Implementation of speech recognition technology: Voice Capture and Recognition Modules: Protect the design and implementation details of the microphone and voice recognition module used to capture user voice commands, including how to convert voice into text commands.

[0027] Speech parsing algorithm: involves the technical details of parsing and understanding voice commands to ensure the accuracy and reliability of speech recognition.

[0028] Design of control processing unit: Functions of controller and processor: Design of protection control processing unit, including how to receive control commands from gesture recognition unit and voice recognition unit, and generate final control instructions; Command generation and execution mechanism: including how to convert gestures or voice instructions into specific control commands and coordinate the work of various parts of the system.

[0029] Design and functions of the communication unit: Wireless communication module: Protects the technical details used for wireless communication with smart home devices, including communication protocols and data transmission methods.

[0030] Device status feedback mechanism: Protect the feedback and update mechanism of device status, including how to feed back device status information to the holographic interface and update user information in real time.

[0031] While the embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that many changes, modifications, substitutions and variations can be made to the embodiments without departing from the principles and spirit of the invention.

Claims

1. A smart home central control system based on holographic technology, characterized by: It includes a holographic projection unit, a gesture recognition unit, a voice recognition unit, a control processing unit and a communication unit. The holographic projection unit includes a holographic projector and a projection screen. The gesture recognition unit includes a depth sensor and a computer vision algorithm. The voice recognition unit includes a microphone and a voice recognition module. The control processing unit includes a central processing unit (CPU) and a storage unit. The communication unit includes a wireless communication module and a network interface.

2. According to claim 1, a smart home central control system based on holographic technology is characterized by: Initializing the holographic projection unit includes the following steps: Step 1: Start the holographic projector; Step 2: Projection screen calibration.

3. The smart home central control system based on holographic technology according to claim 2, characterized in that: Initializing the gesture recognition unit involves the following steps: Step 1: Start the depth sensor; Step 2: Sensor calibration.

4. The smart home central control system based on holographic technology according to claim 3 is characterized by: When initializing the speech recognition unit The following steps are involved: Step 1: Activate the microphone; Step 2: Speech recognition module calibration.

5. The smart home central control system based on holographic technology according to claim 4 is characterized by: The following steps are also included: Step 1: Load the user interface; Step 2: Waiting for user input, the system enters standby mode, waiting for the user to operate through gestures or voice.

6. The smart home central control system based on holographic technology according to claim 5, characterized in that: If the user selects gesture input, the following actions are performed: 1) Gesture capture; 2) Gesture analysis; 3) Command generation; 4) Command execution; 5) Update holographic display; 6) Equipment control; 7) Equipment status feedback; 8) Update holographic display.

7. The smart home central control system based on holographic technology according to claim 6, characterized in that: If the user selects voice input, the following actions are performed: 1) Voice capture; 2) The speech recognition module converts speech into text commands; 3) Parse voice commands, understand user intentions, and generate corresponding control commands; 4) Generate corresponding control commands according to the analysis results; 5) The control processing unit executes the control command and instructs the relevant equipment or interface elements to perform corresponding operations; 6) Update the holographic interface display in real time according to the command execution results and feedback the user's operation results; 7) Send control commands to corresponding smart home devices through the communication unit; 8) The smart home device returns the execution results and status information; 9) Update the holographic interface display based on device feedback information.

8. The smart home central control system based on holographic technology according to claim 7, characterized in that: Also included is a Home Entertainment Mode, which includes the following steps: Step 1: User operation: The user selects "Cinema Mode" on the holographic central control screen through gestures; Step 2: System response: The system automatically adjusts the living room's lighting, sound, and curtains to provide the best viewing environment; Step 3: Feedback display: The holographic interface displays the light brightness, audio volume and curtain status in real time; The kitchen operation mode includes the following steps: Step 1: User operation: When cooking in the kitchen, the user selects a recipe through the holographic central control screen and sets the cooking time and temperature through gestures; Step 2: System response: The system automatically controls the oven and stove to ensure that the food is cooked accurately and deliciously; Step 3: Feedback display: The holographic interface displays the cooking steps and remaining time, and updates the cooking status in real time; Home security mode includes the following steps: Step 1: User operation: In away mode, the user sets up the security system through the holographic central control screen; Step 2: System response: The system automatically turns off all electrical appliances, starts locking doors and windows and surveillance cameras, and sends the away status to the user's mobile phone; Step 3: Feedback display: The holographic interface displays the status of each security device and updates the monitoring screen in real time; The environmental control mode includes the following steps: Step 1: User operation: Users can adjust indoor temperature, humidity and air quality through the holographic central control screen; Step 2: System response: The system adjusts the air conditioner, humidifier and air purifier according to the user's instructions; Step 3: Feedback display: The holographic interface will display the current temperature, humidity and air quality values, and update the environmental parameters in real time.