Intelligent panel based on sound intensity and response priority

Abstract

The invention belongs to the technical field of intelligent control, and particularly relates to an intelligent panel based on sound intensity and response priority. The system comprises a microphone module, a sound intensity identification module, a main control module and a plurality of intelligent panels. The microphone module receives sound emitted by a person and transmits the sound to the sound intensity identification module and the main control module in sequence, the sound intensity identification module measures the sound intensity I of the person, and the main control module calculates the distance between the person and each intelligent panel, finds out the distance with the minimum value, and sends an instruction to inform the person of the intelligent panel with the minimum distance. If the instruction is received or voice inquiry is continued, other intelligent panels do not carry out voice reply, and meanwhile, the intelligent controller carries out response according to the voice instruction of the person. The method has the beneficial effects that each intelligent panel judges the distance condition between an indoor person and the intelligent panel according to the sound intensity, and only the intelligent panel closest to the person in sound performs sound response, so that the phenomenon of sound disorder when a plurality of intelligent panels respond together is avoided.

Description

TECHNICAL FIELD

[0001] The application belongs to the technical field of intelligent control, and particularly relates to an intelligent panel based on sound intensity and response priority. BACKGROUND

[0002] The intelligent panel is widely applied in industrial occasions, and is mainly used for realizing functions such as device control, data monitoring and operation interaction, for example, is used as an operation terminal of a production line to control the start and stop of equipment, parameter adjustment and the like, or is used in places where temperature and environment monitoring is required. However, the current situation is that multiple intelligent panels will respond at the same time according to the sound of personnel. In the current intelligent control system, after the intelligent panel hears the sound of personnel, it is easy for multiple intelligent panels to give sound responses together, causing a phenomenon of sound disorder, which causes trouble to personnel. SUMMARY

[0003] The purpose of the application is to provide an intelligent panel based on sound intensity and response priority, which can judge the distance between indoor personnel and each panel according to the sound intensity of personnel, and only the nearest intelligent panel to the personnel responds, so as to avoid the sound disorder phenomenon when multiple intelligent panels respond together. At the same time, when the personnel is at the same distance from multiple intelligent panels, the intelligent panel will respond according to the response priority set in advance.

[0004] The technical scheme of the application is as follows: an intelligent panel based on sound intensity and response priority, comprising a microphone module, a sound intensity identification module, a main control module and multiple intelligent panels. The microphone module receives the sound emitted by personnel, and sequentially transmits the sound to the sound intensity identification module and the main control module. The sound intensity module measures the sound intensity I of the personnel, and the main control module calculates the distance between the personnel and each intelligent panel. After each intelligent panel receives the sound instruction of the personnel, it judges the distance between the personnel and itself , and then compares to find the minimum value , sends an instruction to inform the personnel of the nearest intelligent panel, such as "received instruction" or continues to ask questions by voice, and the other intelligent panels do not reply by voice. At the same time, the intelligent controller responds according to the sound instruction of the personnel.

[0005] The main control module calculates the distance between the personnel and each intelligent panel according to the formula = = , wherein I is the sound intensity, p is the sound pressure, d is the distance between the personnel and the intelligent panel, e is a natural constant, is the initial sound pressure of air, is the density of air, is the propagation speed of sound in air, The air and building sound absorption coefficient.

[0006] The intelligent controller controls each intelligent panel and each front-end equipment, including air conditioners and sensors, sets the response priority of the intelligent panel, and when there are two or more intelligent panels calculating the distance from the personnel At the same time, the panel priority set on the intelligent controller is responded to at this time.

[0007] The microphone module recognizes the voice of the personnel, the main control module performs natural language understanding and user intent recognition, and compares the existing voice text information in the database, if the voice of the personnel and the voice text information in the database are consistent, the consistent information is fed back to the intelligent controller, and the intelligent controller controls the lighting lamp or the air conditioner to respond.

[0008] The intelligent panel is based on a voice wake-up mode, and uses an acoustic model and a language model in the main control module to start the working mode when receiving the voice instruction of the personnel.

[0009] The intelligent panel is embedded with an intelligent voice APP, including registering an intelligent voice APP account, obtaining an API key, and installing an extension plug-in.

[0010] The database stores equipment running data, user interaction data, environment and system data, wherein the equipment running data refers to the state of various equipment such as on-off, running parameters such as energy consumption and speed, and equipment basic information such as model, IP address and connection state; the user interaction data refers to the operation record of the user through the panel such as touch and voice instruction, personalized setting such as timing task, account association information such as user IP address and permission level; the environment data refers to the environment data collected by the external sensor of the intelligent panel; and the system data refers to the system log of the intelligent panel, including firmware version, start-stop and fault record.

[0011] Further comprising a power module, the power module is connected with other modules of the intelligent panel, and supplies power to the intelligent panel.

[0012] The beneficial effects of the present application are: (1) Each intelligent panel determines the distance between the indoor personnel and it according to the sound intensity, only the intelligent panel closest to the personnel sound responds, thereby avoiding the sound disorder phenomenon when multiple intelligent panels respond together. And if the personnel sound and the intelligent panel distance are the same, the personnel can be responded according to the intelligent panel response priority set in advance on the intelligent controller, unless the panel fails, then the other panels respond in turn.

[0013] (2) The intelligent panel can also cooperate and embed with the existing intelligent voice APP on the market to provide more intelligent voice recognition and processing, such as question answering, file searching and the like.

[0014] (3) The intelligent panel is based on a voice wake-up mode, utilizes an acoustic model and a language model, and only starts a working mode when a voice instruction (a specific wake-up word, such as hello, xx) of a person is received; meanwhile, all devices of the system including the intelligent panel, the intelligent controller and various wireless terminal devices are based on a TWT (Target Wake Time) technology, and after data transmission, the devices automatically enter a sleep state to reduce power consumption. BRIEF DESCRIPTION OF DRAWINGS

[0015] Figure 1 A schematic view of distances between a person and the intelligent panel; Figure 2 A schematic view of a structure of the intelligent panel based on sound intensity and response priority provided by the application; Figure 3 A working flowchart. DETAILED DESCRIPTION

[0016] The application will be further described in detail below in combination with the drawings and specific embodiments.

[0017] The intelligent panel based on sound intensity and response priority provided by the application comprises a microphone module, a sound intensity recognition module, a main control module, a database, a plurality of intelligent panels, a display module and a power module. The database stores device running data, user interaction data, environment and system data. The device running data refers to the states of various devices such as on-off, running parameters such as energy consumption and rotating speed and device basic information such as model, IP address and connection state; the user interaction data refers to the operation records of the user through the panel such as touch and voice instructions, individualized settings such as timing tasks, account association information such as user IP address and permission level; the environment data refers to the environment data collected by the external sensors of the intelligent panel; and the system data refers to the system log of the intelligent panel such as firmware version, start-stop and fault records and the like.

[0018] The display module can display the contents according to the individualized customization of the user, such as the configuration interface such as parameter adjustment and device addition, the file search input bar and the contents of the control panel such as device start-stop buttons, operation interaction and the like; and the power module is connected with other modules of the intelligent panel to supply power to the entire intelligent panel.

[0019] The microphone module receives the sound emitted by the person, and then sequentially transmits the sound to the sound intensity recognition module and the main control module, the sound intensity module measures the sound intensity I (unit: watt per meter) of the person, and then the main control module calculates the distance D between the person and the intelligent panel according to the formula = = The distance d between the person and the smart panel is calculated. Where I is the sound intensity, p is the sound pressure; d is the distance between the person and the smart panel; e is a natural constant; is the initial sound pressure of air, about 101325 Pa; is the density of air, about 1.21 kg per cubic meter; is the propagation speed of sound in air, about 343 meters per second; is the sound absorption coefficient of air and building, about 0.03 in the middle.

[0020] After each smart panel receives the voice command of the person, it judges the distance between the person and itself , and then the smart controller compares , finds the smallest , and sends instructions to the smart panel closest to the person to reply to the person, such as "received instructions" or continue voice inquiry, and other smart panels do not voice reply, while the smart controller responds to the voice command of the person (such as turning on the air conditioner in a certain room).

[0021] The smart controller is the core control device of the entire smart system, which can control the smart panel and various front-end devices such as air conditioners, sensors, etc., set the response priority of the smart panel, and when there are two or more smart panels calculating the distance to the person at the same time, the panel priority set in advance on the smart controller is responded to, unless the panel fails, and other smart panels respond to the person in turn.

[0022] The microphone module of the smart panel can recognize the voice of the person (specific voice, such as turning on all the lights / turning on all the air conditioners / turning off all the lights / turning off all the air conditioners, etc.), and the main control module of the smart panel can perform natural language understanding and user intent recognition. Compare the voice and text information in the database, if the voice of the person and the voice and text information in the database are consistent, the consistent information is fed back to the smart controller, and the smart controller controls the front-end devices such as lighting or air conditioning to respond.

[0023] When the person says a vague control command such as "turn on the air conditioner", the smart controller can control the smart panel closest to the person to ask, such as "do you want to turn on all the air conditioners or the air conditioner in a certain room?", and then respond according to the voice command of the person.

[0024] The smart panel is based on a voice wake-up mode. Utilizing the acoustic and language models in the main control module, it only activates its working mode when it receives a voice command (a specific wake-up word, such as "hello" or "xx"). At the same time, all devices in this system, including the smart panel, smart controller, and various wireless terminal devices, are also based on TWT (Target Wake Time) technology. After transmitting data, they will automatically enter a sleep state to reduce power consumption.

[0025] The system containing the smart panel is scalable, and front-end devices such as air conditioners, lights, cameras, and circuit breakers can be added and controlled according to user needs.

[0026] The smart panel can also collaborate with existing smart voice apps on the market, meaning the smart voice app can be embedded into the smart panel. This includes registering a smart voice app account, obtaining an API (Application Programming Interface) key, and installing extension plugins, providing more intelligent voice recognition and processing, such as answering questions and searching for files.

[0027] The online or offline status of each controlled terminal can also be displayed on the smart panel or mobile APP, making it convenient for personnel to repair malfunctioning terminals.

[0028] Example: like Figure 1 As shown, considering that human voices rarely penetrate concrete walls, 'd' represents the actual distance between the human voice and the smart panel during sound transmission. The actual distance between the human voice and smart panel 1 is d1, the distance between the human voice and smart panel 2 is d2, the distance between the human voice and smart panel 3 is d3, and the distance between the human voice and smart panel 4 is d4. If d1 < d2 = d3 < d4, only smart panel 1 will respond to the human voice. If smart panel 1 malfunctions and cannot respond, the response will be based on the pre-set response priority of smart panels 2 and 3 by the smart controller.

[0029] like Figure 2 As shown, the smart panel includes a microphone module, a sound intensity recognition module, a main control module, a display module, and a power module. The microphone module is used to receive and emit sound from people; the sound intensity recognition module measures the sound intensity of people; the main control module is the control part of the smart panel, which can calculate the distance between the person's voice and the microphone module to emit sound to ask the person; the display module can customize the display content according to the user's preferences, such as the configuration interface, file search, and control panel content; the power module supplies power to the entire smart panel.

[0030] The microphone module is connected to the sound intensity recognition module and also to the main control module; the sound intensity recognition module is connected to both the main control module and the microphone intensity recognition module; the main control module is connected to the display module, the microphone module, and the sound intensity recognition module, and contains a database.

[0031] like Figure 3 As shown, when a person issues a voice command (Hello, xx), the microphone modules of each smart panel are activated after detecting the person's voice. They then sequentially transmit the information to their own voice intensity recognition module and main control module. The voice intensity recognition module measures the person's voice intensity I, and then the main control module calculates the intensity I according to the formula... = = The system calculates the distance *d* between the person's voice and itself and sends this information to the smart controller. The smart controller compares the distances *d* of each smart panel and selects the one with the smallest value, instructing the smart panel closest to the person's voice to respond. If several smart panels have the same distance *d*, the smart controller instructs them to respond according to a pre-set priority order. If the voice command received by a smart panel is unclear (e.g., turn on the air conditioner), the controller asks the user a question via voice (e.g., turn on all air conditioners or only the air conditioner in a specific room) until a clear voice command is received. Afterward, the smart controller controls the device to respond.

Claims

1. A smart panel based on sound intensity and response priority, characterized in that: It includes a microphone module, a sound intensity recognition module, a main control module, and multiple smart panels; The microphone module receives the sound emitted by the person and transmits it sequentially to the sound intensity recognition module and the main control module. The sound intensity module measures the sound intensity I of the person, and the main control module calculates the distance between the person and each smart panel. After receiving the person's voice command, each smart panel determines the distance between itself and the person. After that, Compare and find the one with the smallest value. The system sends a command to the smart panel closest to the user, such as "Command received" or to continue with a voice inquiry. Other smart panels do not respond with voice commands. Meanwhile, the smart controller responds to the user's voice commands.

2. The smart panel based on sound intensity and response priority as described in claim 1, characterized in that: The main control module is based on the formula = = The distance between the person and each smart panel is calculated, where I is the sound intensity, p is the sound pressure level, d is the distance between the person and the smart panel, and e is the natural constant. It is the initial sound pressure of the air. It is the density of air. It is the speed at which sound travels through the air. It is the sound absorption coefficient of air and buildings.

3. The smart panel based on sound intensity and response priority as described in claim 1, characterized in that: The intelligent controller controls various intelligent panels and front-end devices, including air conditioners and sensors, and sets the response priority of the intelligent panels. When two or more intelligent panels calculate the distance to a person... If the same condition is met, the response will be based on the panel priority set on the smart controller.

4. The smart panel based on sound intensity and response priority as described in claim 1, characterized in that: The microphone module recognizes the person's voice, and the main control module performs natural language understanding and user intent recognition. It compares the voice with the existing voice-text information in the database. If the person's voice matches the voice-text information in the database, the matching information is fed back to the intelligent controller, which then controls the lighting or air conditioning to respond.

5. A smart panel based on sound intensity and response priority as described in claim 1, characterized in that: The smart panel is based on a voice wake-up mode. It utilizes the acoustic and language models in the main control module to activate the working mode when it receives a voice command from a person.

6. The smart panel based on sound intensity and response priority as described in claim 1, characterized in that: The smart panel is embedded with a smart voice APP, which includes registering a smart voice APP account, obtaining an API key, and installing extension plugins.

7. A smart panel based on sound intensity and response priority as described in claim 4, characterized in that: The database stores device operation data, user interaction data, environmental and system data. Device operation data refers to the status of various devices, such as on / off status, operating parameters such as energy consumption and speed, and basic device information such as model, IP address, and connection status. User interaction data refers to user operation records through the panel, such as touch and voice commands, personalized settings such as scheduled tasks, and account association information such as user IP address and permission level. Environmental data refers to environmental data collected by external sensors connected to the smart panel. System data refers to the smart panel's system logs, including firmware version, start / stop records, and fault records.

8. The smart panel based on sound intensity and response priority as described in claim 1, characterized in that: It also includes a power module, which connects to other modules of the smart panel to supply power to the smart panel.

Images