Refrigerator management and interaction device based on multiple sensors

Abstract

The utility model discloses a refrigerator management and interaction device based on multiple sensors, and the device comprises a multi-sensor terminal which collects visual information, air quality information, illumination information and humidity information through a plurality of sensors, and uploads the information to a central server; the entity interaction terminal obtains data from the central server, is used for interacting with a user entity and has a screen and voice interaction mode; the applet interaction terminal is used for acquiring data from the central server and providing an operation interaction interface for a user; and the central server acquires information from the multi-sensor terminal, analyzes the information and issues analysis data to the entity interaction terminal and the applet interaction terminal. According to the utility model, various sensors are adopted, the detection and perception capability of the interior of the refrigerator can be effectively improved, meanwhile, various user interaction modes are provided, the usability and convenience of interaction are improved, and the refrigerator has the advantages of low cost, good acquisition effect, convenience in interaction and the like.

Description

Technical Field

[0001] The utility model relates to the technical field of smart home, and in particular to a refrigerator management and interaction device based on multiple sensors. Background Art

[0002] At present, the trend of intelligent and smart home appliances is in full swing. In the smart home industry, interaction, intelligence, safety, and portability are several important topics and functions. However, many refrigerators on the market still lack intelligent functions, and there are also a large number of non-intelligent refrigerators that have been sold. If all of them are to be replaced, it will cost a lot of money, so intelligent transformation is the best solution. In order to meet the above needs, this design proposes a refrigerator management and interaction device based on multiple sensors, which can be easily embedded in non-intelligent refrigerators, intelligently sense the food conditions and environmental conditions in the refrigerator and upload them, greatly improving the intelligence of the refrigerator. At the same time, this design also integrates physical interactive terminals and mini-program terminals, providing rich interactive methods such as voice, screen display, and mini-programs, greatly improving the convenience and experience of interaction. Utility Model Content

[0003] The purpose of the utility model is to overcome the shortcomings and deficiencies of the prior art and proposes a refrigerator management and interaction device based on multiple sensors, which can effectively improve the detection and perception capabilities of the inside of the refrigerator, while providing a variety of user interaction methods, improving the ease of use and convenience of the interaction, and has the advantages of low cost, good collection effect, and easy interaction.

[0004] To achieve the above-mentioned purpose, the technical solution provided by the utility model is: a refrigerator management and interaction device based on multiple sensors, comprising:

[0005] Multi-sensor terminal, which uses multiple sensors to collect visual information, air quality information, light information and humidity information, and uploads it to the central server;

[0006] The physical interaction terminal obtains data from the central server and is used to interact with the user entity, with screen and voice interaction modes;

[0007] Mini-program interactive terminal, which obtains data from the central server and provides an interactive interface for users;

[0008] The central server obtains and analyzes information from the multi-sensor terminals, and sends the analysis data to the physical interactive terminals and the mini-program interactive terminals;

[0009] Among them, the multi-sensor terminal, the entity interaction terminal and the mini-program interaction terminal are respectively connected to the central server in a one-to-one correspondence.

[0010] Furthermore, the multi-sensor terminal is composed of several sensor modules integrated on the same PCB board, and the several sensor modules are respectively: a visual acquisition module, an air quality detection module, a light detection module and a humidity sensor module, wherein:

[0011] The visual acquisition module consists of an ESP32cam development board and is equipped with an OV2640 camera for collecting image information. It interacts with the central server via WIFI.

[0012] The air quality detection module is composed of a ZP07 gas detection module and is connected to a visual acquisition module, which transmits the collected air data to the visual acquisition module through a connection;

[0013] The light detection module is composed of a photoresistor and is connected to the visual acquisition module, and transmits the collected light intensity data to the visual acquisition module through a connection line;

[0014] The humidity sensor module is connected to the visual acquisition module, and transmits the collected air humidity data to the visual acquisition module through a connection line.

[0015] Furthermore, the physical interaction terminal includes a central control processing module, a voice acquisition module, a serial port screen module and a voice output module, wherein:

[0016] The central control processing module is composed of an ESP32 single-chip microcomputer, which is used to realize data communication with the voice acquisition module, the serial port screen module and the voice output module, and obtain information from the central server through WIFI and process various information;

[0017] The voice acquisition module is composed of an INMP441 digital microphone, which is connected to the central control processing module and is used to collect audio information and send the audio information to the central control processing module;

[0018] The serial port screen module is connected to the central control processing module, and is used to exchange information with the central control processing module, display information on the screen, and interact with the user through the touch screen;

[0019] The speech output module is composed of a connected SYN6288 speech synthesis module and a loudspeaker, which is connected to the central control processing module, and is used to receive information from the central control processing module and convert the information into audio information and output it through the loudspeaker.

[0020] Furthermore, the mini-program interactive terminal is composed of a WeChat mini-program, which is connected to a central server via a network, obtains relevant information from the central server and displays the information through an interactive page, while interacting with the user.

[0021] Furthermore, the central server is composed of a computer, which is connected to the multi-sensor terminal, the physical interaction terminal and the mini-program interaction terminal through the network, and is used to analyze and identify the information uploaded by each terminal, and at the same time send the analyzed and identified data to each terminal to achieve data connectivity between the terminals.

[0022] Compared with the prior art, the utility model has the following advantages and beneficial effects:

[0023] 1. The utility model increases the ability to perceive the internal conditions of the refrigerator by collecting multiple information such as vision, light, gas, temperature and humidity. At the same time, it uses a central server to perform multiple information analyses, thereby improving the ability to perceive and analyze information. It provides users with accurate, diverse and intuitive information about the internal conditions of the refrigerator and the status of items, effectively improving the user experience.

[0024] 2. The utility model adopts a multi-interaction terminal and a multi-interaction mode design, with a physical interaction terminal and a mini-program interaction terminal; it has multiple interaction modes such as screen, voice, and mobile phone mini-programs, which can greatly facilitate user interaction and improve the interaction experience.

[0025] 3. The utility model adopts an embedded small device design and can be deployed inside a variety of refrigerators such as non-intelligent refrigerators. It has wide applicability and low cost.

[0026] 4. The utility model adopts a server-terminal architecture. The central server used can detect various types of information uploaded by each terminal in real time, and send the processed information to each terminal, which not only reduces the computing burden of each terminal and reduces costs, but also realizes information interaction between various components of the system. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1 This is an architectural diagram of a refrigerator management and interaction device based on multiple sensors.

[0028] Figure 2 This is an architectural diagram of a multi-sensor terminal.

[0029] Figure 3 This is an architectural diagram of a physical interaction terminal.

[0030] Figure 4 This is the architecture diagram of the mini program interactive terminal.

[0031] Figure 5 This is the architecture diagram of the central server. DETAILED DESCRIPTION

[0032] The present invention is further described in detail below in conjunction with embodiments and drawings, but the implementation manner of the present invention is not limited thereto.

[0033] like Figure 1 As shown, this embodiment discloses a refrigerator management and interaction device based on multiple sensors, including a multiple sensor terminal 1, a physical interaction terminal 2, a mini-program interaction terminal 3 and a central server 4;

[0034] The multi-sensor terminal 1 uses a variety of sensors to collect visual information, air quality information, light information and humidity information, and uploads it to the central server 4;

[0035] The entity interaction terminal 2 obtains data from the central server 4 and is used to interact with the user entity, with screen and voice interaction modes;

[0036] The mini program interactive terminal 3 obtains data from the central server 4 and provides an operation interactive interface for the user;

[0037] The central server 4 obtains and analyzes information from the multi-sensor terminal 1, and sends the analysis data to the physical interaction terminal 2 and the mini-program interaction terminal 3;

[0038] The multi-sensor terminal 1 , the physical interaction terminal 2 and the mini-program interaction terminal 3 are respectively connected to the central server 4 in a one-to-one correspondence.

[0039] like Figure 2 As shown, the multi-sensor terminal 1 is composed of several sensor modules integrated on the same PCB board, and the several sensor modules are: a visual acquisition module 11, an air quality detection module 12, a light detection module 13 and a humidity sensor module 14, wherein:

[0040] The visual acquisition module 11 is composed of an ESP32cam development board and is equipped with an OV2640 camera for collecting image information. It also serves as a local processing core to obtain information from the air quality detection module 12, the light detection module 13 and the humidity sensor module 14, and interacts with the central server 4 via WIFI.

[0041] The air quality detection module 12 is composed of a ZP07 gas detection module, which is used to collect corresponding air data, and transmits the air data to the visual acquisition module 11 through a connection;

[0042] The light detection module 13 is composed of a photoresistor and is used to collect light intensity data, which transmits the light intensity data to the visual acquisition module 11 through a connection;

[0043] The humidity sensor module 14 is used to detect air humidity data and transmit the collected air humidity data to the visual acquisition module 11 through a connection.

[0044] like Figure 3As shown, the physical interaction terminal 2 includes a central control processing module 21, a voice acquisition module 22, a serial port screen module 23, and a voice output module 24, wherein:

[0045] The central control processing module 21 is composed of an ESP32 single-chip microcomputer, which is used to realize data communication with the voice acquisition module 22, the serial port screen module 23 and the voice output module 24, and obtain information from the central server 4 through WIFI, and process various information;

[0046] The voice acquisition module 22 is composed of an INMP441 digital microphone and is connected to the central control processing module 21 to collect audio information and send the audio information to the central control processing module 21;

[0047] The serial port screen module 23 is connected to the central control processing module 21, and exchanges information with the central control processing module 21, displays information on the screen, and interacts with the user through the touch screen;

[0048] The speech output module 24 is composed of a connected SYN6288 speech synthesis module and a speaker, which is connected to the central control processing module 21, and is used to receive information from the central control processing module 21 and convert the information into audio information and output it through the speaker.

[0049] like Figure 4 As shown, the mini-program interactive terminal 3 is composed of a WeChat mini-program, which is connected to the central server 4 through the network, obtains relevant information from the central server 4 and displays the information through an interactive page, while interacting with the user.

[0050] like Figure 5 As shown, the central server 4 is composed of a computer, which is connected to the multi-sensor terminal 1, the physical interaction terminal 2 and the mini-program interaction terminal 3 through the network, analyzes and identifies the information uploaded by each terminal, and sends the analyzed and identified data to the physical interaction terminal 2 and the mini-program interaction terminal 3 to achieve data connectivity between the terminals.

[0051] The above embodiments are preferred implementation modes of the present invention, but the implementation modes of the present invention are not limited by the above embodiments. Any other changes, modifications, substitutions, combinations, and simplifications that do not deviate from the spirit and principle of the present invention should be equivalent replacement methods and are included in the protection scope of the present invention.

Claims

1. Refrigerator management and interaction device based on multi-sensor, It is characterized in that include: Multi-sensor terminal, which uses multiple sensors to collect visual information, air quality information, light information and humidity information, and uploads it to the central server; The physical interaction terminal obtains data from the central server and is used to interact with the user entity, with screen and voice interaction modes; Mini-program interactive terminal, which obtains data from the central server and provides an interactive interface for users; The central server obtains and analyzes information from the multi-sensor terminals, and sends the analysis data to the physical interactive terminals and the mini-program interactive terminals; Among them, the multi-sensor terminal, the entity interaction terminal and the mini-program interaction terminal are respectively connected to the central server in a one-to-one correspondence.

2. The refrigerator management and interaction device based on multiple sensors according to claim 1, It is characterized in that The multi-sensor terminal is composed of several sensor modules integrated on the same PCB board, and the several sensor modules are respectively: a visual acquisition module, an air quality detection module, a light detection module and a humidity sensor module, wherein: The visual acquisition module consists of an ESP32cam development board and is equipped with an OV2640 camera for collecting image information. It interacts with the central server via WIFI. The air quality detection module is composed of a ZP07 gas detection module and is connected to a visual acquisition module, which transmits the collected air data to the visual acquisition module through a connection; The light detection module is composed of a photoresistor and is connected to the visual acquisition module, and transmits the collected light intensity data to the visual acquisition module through a connection line; The humidity sensor module is connected to the visual acquisition module, and transmits the collected air humidity data to the visual acquisition module through a connection line.

3. The refrigerator management and interaction device based on multiple sensors according to claim 2, It is characterized in that The physical interactive terminal includes a central control processing module, a voice acquisition module, a serial port screen module and a voice output module, wherein: The central control processing module is composed of an ESP32 single-chip microcomputer, which is used to realize data communication with the voice acquisition module, the serial port screen module and the voice output module, and obtain information from the central server through WIFI and process various information; The voice acquisition module is composed of an INMP441 digital microphone, which is connected to the central control processing module and is used to collect audio information and send the audio information to the central control processing module; The serial port screen module is connected to the central control processing module, and is used to exchange information with the central control processing module, display information on the screen, and interact with the user through the touch screen; The speech output module is composed of a connected SYN6288 speech synthesis module and a loudspeaker, which is connected to the central control processing module, and is used to receive information from the central control processing module and convert the information into audio information and output it through the loudspeaker.

4. The refrigerator management and interaction device based on multiple sensors according to claim 3, It is characterized in that The mini-program interactive terminal is composed of a WeChat mini-program, which is connected to a central server via a network, obtains relevant information from the central server and displays the information through an interactive page, while interacting with the user.

5. The refrigerator management and interaction device based on multiple sensors according to claim 4, It is characterized in that The central server is composed of a computer, which is connected to the multi-sensor terminal, the physical interaction terminal and the mini-program interaction terminal through the network, and is used to analyze and identify the information uploaded by each terminal, and at the same time send the analyzed and identified data to each terminal to achieve data connectivity between the terminals.

Images