Smart home human-computer interaction device based on multimodal fusion and use method

Abstract

The present invention discloses a smart home human-computer interaction device based on multimodal fusion, which relates to the field of smart home technology, and includes a substrate, wherein the front surface of the substrate is symmetrically provided with first notches, and the bottoms of the two first notches are fixedly connected with slide rails. When in use, when the device is installed, after the mounting plate and the wall are fitted and installed, a ventilation channel can be provided for the mounting plate through the provision of a breathable groove, so that when the air humidity is high, more water vapor accumulates at the mounting position of the mounting plate, causing water vapor to erode the device and cause damage. With the support of a second spring and a telescopic rod, the sponge block can be placed in a state of being close to the mounting plate, and the sponge block can absorb water vapor at the wall position, so that the installation position of the device is in a relatively dry state, effectively preventing excessive condensation of water vapor into water droplets that erode the inside of the device, and improving the service life of the device.

Description

Technical Field

[0001] The present invention relates to the field of smart home technology, and in particular to a smart home human-computer interaction device based on multimodal fusion and a use method thereof. Background Art

[0002] Smart home human-computer interaction devices are devices used to realize interaction between smart home systems and users. They can use technologies such as machine learning and deep learning. Smart home systems can infer user intentions and needs and provide users with more intelligent home control and services.

[0003] Existing, such as the smart home control device in Chinese patent publication number: CN 208188599 U, discloses a smart home control host and an accessory switch, wherein the smart home control host is connected to the smart home device via wired and / or wireless connections, the smart home control host and the accessory switch are connected and communicate with each other, and the accessory switch controls the smart home device via the smart home control host. The smart home control device of the utility model realizes convenient control of home appliances in different scenarios through customized settings of control functions and free selection of connection between the smart home control host and different accessory switches. The advantage is that it can reduce the level of human-computer interaction, and the control operation of the device can be completed with one human-computer interaction; blind operation is realized through the physical buttons of the accessory switch, thereby improving the control fault tolerance rate.

[0004] In the prior art, when installing a smart home control device, the device is installed on a wall. After the installation is completed, the device is in close contact with the wall. When the air humidity in the installation environment of the device is high, saturated water vapor in the air will condense into water droplets on the wall, causing the device to be exposed to a high humidity environment for a long time. The water droplets may even corrode the inside of the device, causing the circuits, electronic components and sensors of the device to be corroded by moisture, thereby causing damage to the device and affecting the service life of the device.

[0005] Therefore, we proposed a smart home human-computer interaction device and usage method based on multimodal fusion to solve the above problems. Summary of the invention

[0006] The purpose of the present invention is to provide a smart home human-computer interaction device based on multimodal fusion and a method of use, so as to solve the problem that the device proposed in the above background technology is exposed to a high humidity environment for a long time, and even water droplets will corrode the inside of the device, causing the circuits, electronic components and sensors of the device to be corroded by moisture, thereby causing damage to the device and affecting the service life of the device.

[0007] To achieve the above-mentioned purpose, the present invention provides the following technical solutions: a smart home human-computer interaction device based on multimodal fusion and a method of use, comprising a substrate, a first notch is symmetrically opened on the front surface of the substrate, and the bottoms of the two first notches are fixedly connected to a slide rail, a second notch is opened on the front surface of the substrate, and the bottoms of the second notches are fixedly connected to a toothed plate, a back plate is fixedly connected to the rear surface of the substrate, an overhead plate is symmetrically fixedly connected to the rear surface of the back plate, and the rear surfaces of the two overhead plates are symmetrically fixedly connected to overhead rods, and a mounting plate is fixedly connected between the end surfaces of multiple overhead rods; a display component, the display component is slidably connected to the outer surface of the slide rail, the display component includes two sliders, and a support plate is fixedly connected between the front surfaces of the two sliders; a moisture-proof component, the moisture-proof component is fixedly connected to the rear surface of the back plate, the moisture-proof component includes a moisture-proof plate and a sponge block, a plurality of telescopic rods are evenly fixedly connected to the rear surface of the moisture-proof plate, the outer surfaces of the plurality of telescopic rods are sleeved with second springs, and a connecting seat is fixedly connected between the end surfaces of the plurality of telescopic rods.

[0008] Preferably, the rear surface of the support plate is fixedly connected to a base frame, the outer surface of the base frame is fixedly connected to a motor, the output end of the motor slides through the base frame, the output end of the motor is fixedly connected to a rotating shaft, the end face of the rotating shaft is rotatably connected to the inner surface of the base frame, the outer surface of the rotating shaft is fixedly connected to a gear, and the gear is meshingly connected to a gear plate.

[0009] Preferably, the rear surface of the support plate is symmetrically fixedly connected with a side frame, the inner surface of the second slot is symmetrically fixedly connected with a support seat, an accordion cover is fixedly connected between the support seat and the side frame, and the outer surface of the accordion cover is in contact with the inner surface of the second slot.

[0010] Preferably, a rotating seat is rotatably connected to the center of the front surface of the support plate, a supporting shaft is fixedly connected to the end surface of the rotating seat, a rotating plate is fixedly connected to the end surface of the supporting shaft, and a display screen is fixedly connected to the front surface of the rotating plate.

[0011] Preferably, a first coil is fixedly connected to the front surface of the support plate, a plurality of extension rods are evenly fixedly connected to the rear surface of the rotating plate, a second coil is fixedly connected between the end surfaces of the plurality of extension rods, the first coil is fitted with the second coil, and the second coil is electrically connected to the display screen.

[0012] Preferably, a sleeve is fixedly connected to the front surface of the support plate, a first spring is fixedly connected to the bottom inner side of the sleeve, a first retaining ring is fixedly connected to the end face of the first spring, a plurality of connecting rods are evenly fixedly connected to the front surface of the first retaining ring, a second retaining ring is fixedly connected between the end faces of the plurality of connecting rods, a ball is arranged between the first retaining ring and the second retaining ring, a sliding groove is provided on the rear surface of the rotating plate, a plurality of limiting holes are evenly provided on the bottom inner side of the sliding groove, an outer surface of the ball is slidably connected to an inner surface of the sliding groove, and the ball is located at an inner side of the limiting hole.

[0013] Preferably, the outer surface corners of the mounting plate are fixedly connected with mounting seats, and the outer surface of the mounting plate is evenly provided with a plurality of ventilation grooves, which match the positions of the connecting seats.

[0014] Preferably, a plurality of third springs are fixedly connected to the inner surfaces of both sides of the connecting seat at equal distances, and a clamping plate is fixedly connected between the end surfaces of the two groups of the third springs.

[0015] Preferably, the sponge block is located between two clamping plates, and outer surfaces of adjacent sides of the two clamping plates are fixedly connected with a plurality of spikes, and the sponge block is fitted with the mounting plate.

[0016] A method for using a smart home human-computer interaction device based on multimodal fusion comprises the following steps:

[0017] S1. When installing the device, the mounting plate is fixed on the wall by setting the mounting seat. With the support of the second spring and the telescopic rod, pressure can be applied to the connecting seat in the direction of the mounting plate, so that the connecting seat and the mounting plate are in a tightly fitted state. By fixing the sponge block on the inner side of the two clamping plates, the sponge block can be in a state of close contact with the mounting plate. The sponge block can absorb water vapor at the wall position, so that the installation position of the device is in a relatively dry state, effectively preventing excessive condensation of water vapor into water droplets that corrode the inside of the device;

[0018] S2. Through the setting of the display screen, the control system of the display screen is connected to the multi-modal fusion smart home control system. The smart home system controlled by the display screen can convert the user's operation instructions into executable operations. At the same time, with the voice, posture recognition and gesture control sensors on the side of the display screen, the multi-modal fusion control function can be realized. By integrating information from multiple perception modes and applying technologies such as machine learning and deep learning, the smart home system can infer the user's intentions and needs and provide users with more intelligent home control and services;

[0019] S3. When the display screen is in use, the starting motor can drive the gear to rotate. When the gear rotates, it can drive the support plate to move up and down through the meshing with the tooth plate. By moving the support plate up and down, the height of the display screen can be adjusted, so that users of different heights can perform touch control to complete smart home human-computer interaction.

[0020] S4. The support shaft can be freely rotated, and the rotating plate can be rotated to adjust the use angle of the display screen. The display screen can be freely rotated to adjust the horizontal screen or vertical screen, so that the display screen can be easily adapted to different smart home human-computer interaction pages for use.

[0021] Compared with the prior art, the present invention has the following beneficial effects:

[0022] (i) When the device is installed, after the mounting plate and the wall are fitted together, the ventilation groove can provide a ventilation channel for the mounting plate, which can prevent the accumulation of a lot of water vapor at the mounting position of the mounting plate when the air humidity is high, causing water vapor to erode the device and cause damage. The sponge block can be placed in a state of close contact with the mounting plate by using the support of the second spring and the telescopic rod. The sponge block can absorb the water vapor at the wall position, so that the installation position of the device is in a relatively dry state, effectively preventing excessive condensation of water vapor into water droplets that erode the inside of the device, and extending the service life of the device;

[0023] (ii) When in use, the starting motor can drive the gear to rotate accordingly. When the gear rotates, it can drive the support plate to move up and down through the meshing with the tooth plate. The up and down movement of the support plate can achieve the purpose of adjusting the height of the display screen, so that it can be adapted to users of different heights for touch control to complete the human-computer interaction of smart home. The support seats and side frames on both sides provide support for the accordion cover, so that the accordion cover completely covers the outer position of the second notch, thereby protecting the tooth plate, preventing dust from entering the second notch to affect the transmission accuracy of the tooth plate, and improving the stability of the operation of the up and down adjustment mechanism of the display screen;

[0024] 3. When in use, the support shaft can be freely rotated, and the rotating plate can be rotated to adjust the use angle of the display screen. The display screen can be freely rotated to adjust the horizontal screen or vertical screen, so that the display screen can be conveniently adapted to different smart home human-computer interaction pages for use. When the display screen is rotated and adjusted, the rotating plate rotates to cause the ball to disengage from the inner side of the limit hole. When the rotating plate rotates by ninety degrees, the ball is aligned with the next limit hole position. The ball will automatically reset and be stuck in the limit hole using the rebound of the first spring, thereby achieving the purpose of automatically limiting the rotation range of the display screen. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] Figure 1A three-dimensional diagram of a smart home human-computer interaction device based on multimodal fusion according to the present invention;

[0026] Figure 2 It is a rear view of the smart home human-computer interaction device based on multimodal fusion of the present invention;

[0027] Figure 3 This is a test diagram of the smart home human-computer interaction device based on multimodal fusion of the present invention;

[0028] Figure 4 It is a schematic diagram of the structure of the display component of the smart home human-computer interaction device based on multi-modal fusion of the present invention;

[0029] Figure 5 It is a schematic diagram of the ball structure of the smart home human-computer interaction device based on multi-modal fusion of the present invention;

[0030] Figure 6 It is a schematic diagram of the limiting hole structure of the smart home human-computer interaction device based on multi-modal fusion of the present invention;

[0031] Figure 7 This is a schematic diagram of the substrate structure of the smart home human-computer interaction device based on multimodal fusion of the present invention;

[0032] Figure 8 It is a schematic diagram of the structure of the installation board of the smart home human-computer interaction device based on multimodal fusion of the present invention;

[0033] Fig. 9 It is a schematic diagram of the structure of the moisture-proof component of the smart home human-computer interaction device based on multimodal fusion of the present invention.

[0034] In the figure:

[0035] 1. substrate; 2. display assembly; 201. slider; 202. support plate; 203. rotating plate; 204. display screen; 205. side frame; 206. bottom frame; 207. motor; 208. gear; 209. first coil; 210. rotating seat; 211. support shaft; 212. sleeve; 213. first spring; 214. first retaining ring; 215. connecting rod; 216. second retaining ring; 217. ball bearing; 218. extension rod; 219. second coil; 220, slide groove; 221, limit hole; 3, back plate; 4, moisture-proof component; 401, moisture-proof board; 402, telescopic rod; 403, second spring; 404, connecting seat; 405, third spring; 406, clamping plate; 407, spike; 408, sponge block; 5, overhead plate; 6, overhead rod; 7, mounting plate; 8, mounting seat; 9, ventilation groove; 10, first notch; 11, slide rail; 12, second notch; 13, tooth plate; 14, support seat; 15, accordion cover. DETAILED DESCRIPTION

[0036] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the implementation regulations described are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0037] Reference Figure 1-Figure 9 As shown: a smart home human-computer interaction device based on multimodal fusion, comprising a substrate 1, wherein a first notch 10 is symmetrically provided on the front surface of the substrate 1, and a slide rail 11 is fixedly connected to the bottom of the two first notches 10, a second notch 12 is provided on the front surface of the substrate 1, and a tooth plate 13 is fixedly connected to the bottom of the second notch 12, a back plate 3 is fixedly connected to the rear surface of the substrate 1, an overhead plate 5 is symmetrically fixedly connected to the rear surface of the back plate 3, and overhead rods 6 are symmetrically fixedly connected to the rear surfaces of the two overhead plates 5, and a mounting plate 7 is fixedly connected between the end surfaces of the plurality of overhead rods 6; Display component 2, display component 2 is slidably connected to the outer surface of the slide rail 11, display component 2 includes two sliders 201, and a support plate 202 is fixedly connected between the front surfaces of the two sliders 201; moisture-proof component 4, moisture-proof component 4 is fixedly connected to the rear surface of the back plate 3, moisture-proof component 4 includes a moisture-proof plate 401 and a sponge block 408, a plurality of telescopic rods 402 are evenly fixedly connected to the rear surface of the moisture-proof plate 401, a second spring 403 is sleeved on the outer surfaces of the plurality of telescopic rods 402, and a connecting seat 404 is fixedly connected between the end surfaces of the plurality of telescopic rods 402.

[0038] like Figure 3 and Figure 4 As shown, the rear surface of the support plate 202 is fixedly connected with a base frame 206, and the outer surface of the base frame 206 is fixedly connected with a motor 207. The output end of the motor 207 slides through the base frame 206, and the output end of the motor 207 is fixedly connected with a rotating shaft. The end face of the rotating shaft is rotatably connected to the inner surface of the base frame 206, and the outer surface of the rotating shaft is fixedly connected with a gear 208. The gear 208 is meshed with the tooth plate 13. When the display screen 204 is in use, starting the motor 207 can drive the rotating shaft to rotate, and the rotation of the rotating shaft can drive the gear 208 to follow the rotation. When the gear 208 rotates, it can drive the support plate 202 to move up and down through the meshing with the tooth plate 13. The support plate 202 will move up and down along the slide rail 11 through the connection of the slider 201. The matching setting of the slide rail 11 and the slider 201 can play a role in supporting and limiting the movement of the support plate 202. The up and down movement of the support plate 202 achieves the purpose of adjusting the use height of the display screen 204, so that it can adapt to users of different heights to perform touch control to complete smart home human-computer interaction.

[0039] like Figure 4 and Figure 7As shown, the rear surface of the support plate 202 is symmetrically fixedly connected with the side frame 205, the inner surface of the second slot 12 is symmetrically fixedly connected with the support seat 14, and the accordion cover 15 is fixedly connected between the support seat 14 and the side frame 205. The outer surface of the accordion cover 15 fits the inner surface of the second slot 12. When the support plate 202 is in a stationary state, the support seat 14 and the side frame 205 on both sides provide support for the accordion cover 15, so that the accordion cover 15 completely covers the outer position of the second slot 12, thereby protecting the tooth plate 13 and preventing dust from entering the second slot 12. The transmission accuracy of the internally-affected toothed plate 13 is improved, and the stability of the operation of the up-and-down adjustment mechanism of the display screen 204 is improved. While the support plate 202 is driven up and down by the motor 207, the support plate 202 will drive the side frames 205 on both sides to move respectively. When the side frames 205 move, the accordion covers 15 on both sides will follow the deformation to shrink or stretch. The accordion cover 15 can be freely deformed. While the support plate 202 moves to adjust the height, the accordion cover 15 can always be on the outside of the second slot 12 for covering, thereby playing a better protective role.

[0040] like Figure 4 As shown, a rotating seat 210 is rotatably connected at the center of the front surface of the support plate 202, a support shaft 211 is fixedly connected to the end surface of the rotating seat 210, a rotating plate 203 is fixedly connected to the end surface of the support shaft 211, and a display screen 204 is fixedly connected to the front surface of the rotating plate 203. Through the connection of the rotating seat 210, the support shaft 211 can rotate freely. Through the setting that the support shaft 211 can rotate freely, the rotating plate 203 can rotate to achieve the purpose of adjusting the use angle of the display screen 204. The display screen 204 can be freely rotated to adjust the horizontal screen or the vertical screen, so that the display screen 204 can be conveniently adapted to different smart home human-computer interaction pages for use.

[0041] like Figure 4 and Figure 6 As shown, a first coil 209 is fixedly connected to the front surface of the support plate 202, a plurality of extension rods 218 are evenly fixedly connected to the rear surface of the rotating plate 203, a second coil 219 is fixedly connected between the end surfaces of the plurality of extension rods 218, the first coil 209 is fitted with the second coil 219, the second coil 219 is electrically connected to the display screen 204, and the second coil 219 is always kept in a fitted state with the support of the extension rod 218. The first coil 209 and the second coil 219 are wireless charging coils adapted to be installed, so when the rotating plate 203 drives the display screen 204 to rotate, the second coil 219 and the first coil 209 are always kept in a fitted state, so that the display screen 204 can be continuously powered, and the rotation and horizontal and vertical adjustment of the display screen 204 will not be affected.

[0042] like Figure 4 and Figure 5As shown, the front surface of the support plate 202 is fixedly connected with a sleeve 212, the inner bottom of the sleeve 212 is fixedly connected with a first spring 213, the end surface of the first spring 213 is fixedly connected with a first retaining ring 214, the front surface of the first retaining ring 214 is evenly fixedly connected with a plurality of connecting rods 215, a second retaining ring 216 is fixedly connected between the end surfaces of the plurality of connecting rods 215, a ball 217 is arranged between the first retaining ring 214 and the second retaining ring 216, a slide groove 220 is provided on the rear surface of the rotating plate 203, a plurality of limiting holes 221 are evenly provided at the inner bottom of the slide groove 220, the outer surface of the ball 217 is slidably connected with the inner surface of the slide groove 220, the ball 217 is located at the inner side of the limiting hole 221, and when the display screen 2 04 when rotating and adjusting, the rebound force of the first spring 213 can be used to provide support for the first retaining ring 214, the connecting rod 215 and the second retaining ring 216, so that the ball 217 is always stuck in the inner side of the limiting hole 221. When the rotating plate 203 is rotated, the rotating plate 203 rotates so that the ball 217 is disengaged from the inner side of the limiting hole 221. Since the number of limiting holes 221 is set to four, when the rotating plate 203 rotates to ninety degrees, the ball 217 is aligned with the position of the next limiting hole 221. The ball 217 uses the rebound of the first spring 213 to automatically reset and get stuck in the limiting hole 221, thereby achieving the purpose of automatically limiting the rotation range of the display screen 204.

[0043] like Figure 8 As shown, the corners of the outer surface of the mounting plate 7 are fixedly connected with mounting seats 8, and a plurality of ventilation grooves 9 are evenly opened on the outer surface of the mounting plate 7, and the ventilation grooves 9 match the position of the connecting seat 404. When installing the device, the mounting plate 7 is fixedly installed on the wall by the setting of the mounting seat 8. After the mounting plate 7 and the wall are completed and installed, the setting of the ventilation grooves 9 can provide a ventilation channel for the mounting plate 7, which can avoid the accumulation of more water vapor at the installation position of the mounting plate 7 when the air humidity is high, resulting in water vapor erosion and damage to the device.

[0044] like Figure 8 and Fig. 9 As shown, multiple third springs 405 are fixedly connected to the inner surfaces of both sides of the connecting seat 404 at equal distances, and a clamping plate 406 is fixedly connected between the end surfaces of the two groups of third springs 405. After the mounting plate 7 and the wall are installed, the second spring 403 and the telescopic rod 402 can be used to support the connecting seat 404 in the direction of the mounting plate 7, so that the connecting seat 404 and the mounting plate 7 are in a tightly fitted state, and the sponge block 408 is fixed on the inner side of the two clamping plates 406. The sponge block 408 can be in a state of close contact with the mounting plate 7. During the use of the device after installation, in conjunction with the setting of the air permeable groove 9, the sponge block 408 can absorb water vapor at the wall position, so that the installation position of the device is in a relatively dry state, effectively preventing excessive condensation of water vapor into water droplets that erode the inside of the device, thereby increasing the service life of the device.

[0045] like Figure 8 and Fig. 9 As shown, the sponge block 408 is located between the two clamps 406, and the outer surfaces of the adjacent sides of the two clamps 406 are fixedly connected with multiple spikes 407. The sponge block 408 is fitted with the mounting plate 7, and the third springs 405 on both sides are arranged so that the clamps 406 can clamp and fix the sponge block 408. Through the arrangement of the spikes 407, when the clamps 406 clamp and fix the sponge block 408, the spikes 407 are inserted into the sponge block 408, which can improve the stability of the sponge block 408 clamping and fixing. The clamps 406 on both sides can be directly opened to take out the sponge block 408, so that the sponge block 408 can be disassembled and replaced conveniently.

[0046] In the present invention, when installing the device, the mounting plate 7 is fixedly mounted on the wall by the setting of the mounting seat 8. After the mounting plate 7 and the wall are fitted together, the ventilation groove 9 can provide a ventilation channel for the mounting plate 7, which can prevent the installation position of the mounting plate 7 from accumulating a lot of water vapor when the air humidity is high, causing water vapor to erode the device and cause damage. After the mounting plate 7 and the wall are installed, the second spring 403 and the telescopic rod 402 can be used to support the connection seat 404 to apply pressure in the direction of the mounting plate 7, so that the connection seat 404 and the mounting plate 7 are in a tightly fitted state. By fixing the sponge block 408 on the inner side of the two clamping plates 406, the sponge block 408 can be in a state of close contact with the mounting plate 7. During the use process after the installation is completed, in conjunction with the setting of the ventilation groove 9, the sponge block 408 can absorb the water vapor at the wall position, so that the installation position of the device is in a relatively dry state, effectively preventing excessive condensation of water vapor into water droplets that corrode the inside of the device, and improving the service life of the device. When the splint 406 clamps and fixes the sponge block 408, the spike 407 is inserted into the sponge block 408, which can improve the stability of the sponge block 408. After the device is installed, through the setting of the display screen 204, the control system of the display screen 204 is connected to the multi-modal fusion smart home control system. The smart home system controlled by the display screen 204 can convert the user's operation instructions into executable operations, and at the same time cooperate with the display screen 20 The voice, posture recognition and gesture control sensors on the side can realize multi-modal fusion control function. By integrating information from multiple perception modes and applying technologies such as machine learning and deep learning, the smart home system can infer the user's intentions and needs and provide users with more intelligent home control and services. When the display screen 204 is in use, the starting motor 207 can drive the gear 208 to rotate. When the gear 208 rotates, it can drive the support plate 202 to move up and down through the engagement with the toothed plate 13. Through the up and down movement of the support plate 202, the purpose of adjusting the use height of the display screen 204 is achieved, so that users of different heights can perform touch control to complete the smart home human-computer interaction. When the support plate 202 is in a stationary state, The support base 14 and the side frame 205 on both sides provide support for the accordion cover 15, so that the accordion cover 15 completely covers the outer position of the second slot 12, thereby protecting the tooth plate 13 and preventing dust from entering the second slot 12 and affecting the transmission accuracy of the tooth plate 13, thereby improving the stability of the up and down adjustment mechanism of the display screen 204. When the motor 207 drives the support plate 202 to move up and down, the accordion cover 15 will follow the deformation, and the accordion cover 15 can always be on the outside of the second slot 12 for covering. The support shaft 211 can be freely rotated, and the rotating plate 203 can be rotated to achieve the purpose of adjusting the use angle of the display screen 204. The display screen 204 can be freely rotated to adjust the horizontal screen or vertical screen.Therefore, the display screen 204 can be conveniently adapted to different smart home human-computer interaction pages for use. The second coil 219 and the first coil 209 always keep in contact with each other to provide continuous power supply to the display screen 204, which will not affect the horizontal and vertical rotation adjustment of the display screen 204. When the display screen 204 is rotated and adjusted, the rotating plate 203 rotates so that the ball 217 is disengaged from the inner side of the limiting hole 221. When the rotating plate 203 rotates by ninety degrees, the ball 217 is aligned with the position of the next limiting hole 221. The ball 217 automatically resets and is stuck in the limiting hole 221 by the rebound of the first spring 213, thereby achieving the purpose of automatically limiting the rotation range of the display screen 204.

[0047] The wiring diagram of the motor 207, the first coil 209, the second coil 219 and the display screen 204 in the present invention is common knowledge in the field, and its working principle is a well-known technology. The model is selected according to the actual use, so the control method and wiring arrangement of the motor 207, the first coil 209, the second coil 219 and the display screen 204 are no longer explained in detail.

[0048] Although the present invention has been described in detail with reference to the aforementioned embodiments, it is still possible for those skilled in the art to modify the technical solutions described in the aforementioned embodiments, or to make equivalent substitutions for some of the technical features therein. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. A smart home human-computer interaction device based on multimodal fusion, characterized in that: The invention comprises a base plate (1), wherein a first notch (10) is symmetrically provided on the front surface of the base plate (1), and a slide rail (11) is fixedly connected to the bottom of two first notches (10), a second notch (12) is provided on the front surface of the base plate (1), and a tooth plate (13) is fixedly connected to the bottom of the second notch (12), a back plate (3) is fixedly connected to the rear surface of the base plate (1), an overhead plate (5) is symmetrically fixedly connected to the rear surface of the back plate (3), and overhead poles (6) are symmetrically fixedly connected to the rear surfaces of two overhead plates (5), and a mounting plate (7) is fixedly connected between the end surfaces of a plurality of overhead poles (6); A display assembly (2), the display assembly (2) being slidably connected to the outer surface of the slide rail (11), the display assembly (2) comprising two sliders (201), and a support plate (202) being fixedly connected between the front surfaces of the two sliders (201); A moisture-proof component (4), the moisture-proof component (4) being fixedly connected to the rear surface of the back plate (3), the moisture-proof component (4) comprising a moisture-proof plate (401) and a sponge block (408), a plurality of telescopic rods (402) being evenly and fixedly connected to the rear surface of the moisture-proof plate (401), a second spring (403) being sleeved on the outer surfaces of the plurality of telescopic rods (402), and a connecting seat (404) being fixedly connected between the end surfaces of the plurality of telescopic rods (402); The rear surface of the support plate (202) is fixedly connected to a base frame (206), the outer surface of the base frame (206) is fixedly connected to a motor (207), the output end of the motor (207) slides through the base frame (206), the output end of the motor (207) is fixedly connected to a rotating shaft, the end surface of the rotating shaft is rotatably connected to the inner surface of the base frame (206), the outer surface of the rotating shaft is fixedly connected to a gear (208), and the gear (208) is meshingly connected to the toothed plate (13); The rear surface of the support plate (202) is symmetrically fixedly connected to a side frame (205); the inner surface of the second slot (12) is symmetrically fixedly connected to a support seat (14); an accordion cover (15) is fixedly connected between the support seat (14) and the side frame (205); the outer surface of the accordion cover (15) is in contact with the inner surface of the second slot (12); A rotating seat (210) is rotatably connected at the center of the front surface of the support plate (202); a support shaft (211) is fixedly connected to the end surface of the rotating seat (210); a rotating plate (203) is fixedly connected to the end surface of the support shaft (211); and a display screen (204) is fixedly connected to the front surface of the rotating plate (203); The front surface of the support plate (202) is fixedly connected with a first coil (209), the rear surface of the rotating plate (203) is evenly fixedly connected with a plurality of extension rods (218), the end surfaces of the plurality of extension rods (218) are fixedly connected with a second coil (219), the first coil (209) and the second coil (219) are attached to each other, and the second coil (219) is electrically connected to the display screen (204); The front surface of the support plate (202) is fixedly connected with a sleeve (212), the inner bottom of the sleeve (212) is fixedly connected with a first spring (213), the end surface of the first spring (213) is fixedly connected with a first retaining ring (214), the front surface of the first retaining ring (214) is evenly fixedly connected with a plurality of connecting rods (215), a second retaining ring (216) is fixedly connected between the end surfaces of the plurality of connecting rods (215), a ball (217) is arranged between the first retaining ring (214) and the second retaining ring (216), a sliding groove (220) is provided on the rear surface of the rotating plate (203), a plurality of limiting holes (221) are evenly provided on the inner bottom of the sliding groove (220), the outer surface of the ball (217) is slidably connected with the inner surface of the sliding groove (220), and the ball (217) is located at the inner side of the limiting hole (221); A plurality of third springs (405) are fixedly connected to the inner surfaces of both sides of the connection seat (404) at equal distances, and a clamping plate (406) is fixedly connected between the end surfaces of two groups of the third springs (405); The sponge block (408) is located between the two clamping plates (406), and the outer surfaces of the adjacent sides of the two clamping plates (406) are fixedly connected with a plurality of spikes (407), and the sponge block (408) is fitted with the mounting plate (7).

2. The smart home human-computer interaction device based on multimodal fusion according to claim 1, characterized in that: The outer corners of the mounting plate (7) are fixedly connected with mounting seats (8), and the outer surface of the mounting plate (7) is evenly provided with a plurality of ventilation grooves (9), and the positions of the ventilation grooves (9) and the connecting seats (404) are matched.

3. A method for using a smart home human-computer interaction device based on multimodal fusion, characterized in that: The smart home human-computer interaction device based on multimodal fusion described in claim 2 is used, comprising the following steps: S1. When installing the device, the mounting plate (7) is fixedly mounted on the wall by setting the mounting seat (8). With the support of the second spring (403) and the telescopic rod (402), pressure can be applied to the connecting seat (404) in the direction of the mounting plate (7), so that the connecting seat (404) and the mounting plate (7) are in a tightly fitted state. By fixing the sponge block (408) on the inner side of the two clamping plates (406), the sponge block (408) can be in a state of being in close contact with the mounting plate (7). The sponge block (408) can absorb water vapor at the wall position, so that the installation position of the device is in a relatively dry state, effectively preventing excessive condensation of water vapor into water droplets that corrode the inside of the device; S2. Through the setting of the display screen (204), the control system of the display screen (204) is connected to the multi-modal fusion smart home control system. The smart home system controlled by the display screen (204) can convert the user's operation instructions into executable operations. At the same time, in conjunction with the voice, posture recognition and gesture control sensors on the side of the display screen (204), a multi-modal fusion control function can be realized. By integrating information from multiple perception modes and applying technologies such as machine learning and deep learning, the smart home system can infer the user's intentions and needs, and provide the user with more intelligent home control and services; S3. When the display screen (204) is in use, the starting motor (207) can drive the gear (208) to rotate accordingly. When the gear (208) rotates, it can drive the support plate (202) to move up and down through meshing with the toothed plate (13). By moving the support plate (202) up and down, the height of the display screen (204) can be adjusted, so that users of different heights can perform touch control to complete smart home human-computer interaction. S4. The support shaft (211) can be freely rotated, and the rotating plate (203) can be rotated to adjust the use angle of the display screen (204). The display screen (204) can be freely rotated to adjust the horizontal screen or the vertical screen, so that the display screen (204) can be easily adapted to different smart home human-computer interaction pages for use.

Images