Multi-sensory-interaction dynamic visual communication display device

Abstract

The invention relates to the field of visual communication, and discloses a multi-sensory-interaction dynamic visual communication display device, which comprises a posture acquisition terminal used for acquiring human body sensory posture dynamic information; the gesture instruction acquisition terminal is matched with the data output port and the data analysis unit to acquire dynamic information of human sensory postures; the comprehensive processing terminal cooperates with the instruction matching unit to output a human body posture information instruction. Through a posture acquisition terminal, a gesture instruction acquisition terminal and a distance sensing element, posture and gesture information of a visitor can be acquired in real time. The real-time interaction capability enables the device to adjust the content according to the actual operation of the visitor or control the display state (such as zooming in, zooming out, rolling and the like) of the content through gestures. The dynamic feedback enables the visitor to accurately control the device through simple body and gesture operations, thereby improving the fluency and naturalness of the interactive experience.

Description

Technical Field

[0001] The present invention relates to the technical field of visual communication, and particularly to a dynamic visual communication display device for multi-sensory interaction. Background Art

[0002] Visual communication design is a design that is expressed and conveyed to the audience through visual media, reflecting the graphic design of the era characteristics of the design and rich connotations. The emergence of digital multimedia has continuously challenged and enriched the traditional visual communication methods, expanding the extension of contemporary visual communication design. Visual communication has gradually changed from the previous planar and static forms to dynamic and comprehensive directions, spanning from single media to multimedia, from two-dimensional planes to three-dimensional solids and spaces, and more traditional printed design products have been transformed into the conveyance of virtual information images. Advertising, as an important form of visual communication, has also undergone a qualitative leap under the promotion of digital multimedia technology.

[0003] In traditional exhibitions, audiences need to use traditional mice, touchscreens or buttons to operate. Although these operation methods can achieve basic functions, for audiences without technical experience, the operations may seem cumbersome and not intuitive enough. Traditional exhibition content is usually static and not easily adjusted dynamically according to the interests of different audiences. Although some interactive exhibitions provide touchscreens or other ways to select different content, these methods often cannot adapt to the specific needs of each audience in real time, and the displayed content is often presented in a fixed order. Traditional display devices such as touchscreens and monitors usually need to work continuously, and even when there is no audience contact, they will continue to consume power. This not only wastes energy but also may reduce the service life of the device. Traditional exhibitions usually rely only on vision to display information, especially static images or video content, lacking interactive experiences of other senses. Although some exhibits may add sound effects, the overall experience is still mainly visual and relatively monotonous. Summary of the Invention

[0004] In view of the deficiencies of the prior art, the present invention provides a dynamic visual communication display device for multi-sensory interaction, which solves the problems of cumbersome operation, single content, lack of interactivity and personalized experience in traditional exhibitions, and at the same time has low energy efficiency and usually only relies on visual display and cannot meet the diverse needs of audiences.

[0005] To achieve the above objectives, the present invention is realized through the following technical solutions: A dynamic visual communication display device for multi-sensory interaction, including a fixing frame and a suspended platform for fixing the structure of the dynamic visual communication display device for multi-sensory interaction;

[0006] An output display screen for visually communicating and displaying content;

[0007] A posture acquisition terminal for collecting dynamic information of human sensory postures;

[0008] The gesture instruction acquisition terminal, together with the data output port and the data analysis unit, is used for collecting dynamic information of the human sensory posture;

[0009] The comprehensive processing terminal, together with the instruction matching unit, is used for outputting human posture information instructions.

[0010] Preferably, the suspension platform is arranged on the fixed frame, the output display screens are distributed on the top of the fixed frame, the comprehensive processing terminal is arranged on the fixed frame, the posture analysis module and the instruction matching module are distributed on the comprehensive processing terminal, the posture acquisition terminal is connected to the gesture instruction acquisition terminal through an Ethernet data link signal, the gesture instruction acquisition terminal is connected to the comprehensive processing terminal through an Ethernet data link signal, the comprehensive processing terminal is connected to the output display screen through an Ethernet data link signal, and the gesture instruction acquisition terminal is provided with a posture analysis module and an instruction matching module.

[0011] Preferably, the posture acquisition terminal includes a distance sensing element, and both the distance sensing element and the camera acquisition element are connected to the posture acquisition element through an Ethernet data link signal.

[0012] Preferably, the comprehensive processing terminal includes an instruction signal input interface, the instruction signal input interface is connected to the application program processing unit and the gesture instruction processing module through an Ethernet data link signal, the application program processing unit and the gesture instruction processing module are respectively connected to the audio transmission element and the video transmission element through an Ethernet data link signal, the application program processing unit and the gesture instruction processing module are respectively connected to an audio synthesis unit and a video synthesis unit through the audio transmission element and the video transmission element, the audio synthesis unit is connected to the audio output interface through an Ethernet data link signal, and the video synthesis unit is connected to the video output interface through an Ethernet data link signal.

[0013] Preferably, the posture analysis module includes a situation data receiving unit, the situation data receiving unit is connected to the distance change statistics unit through a signal, the distance change statistics unit is respectively connected to the body sense posture displacement perception unit, the single-hand posture amplitude perception unit, the device output sleep unit and the two-hand posture amplitude perception unit through signals, the body sense posture displacement perception unit, the single-hand posture amplitude perception unit, the device output sleep unit and the two-hand posture amplitude perception unit are all connected to the posture perception acquisition unit through an Ethernet data link signal, the situation data receiving unit is respectively connected to the data output port through an Ethernet data link signal, and the posture perception acquisition unit is connected to the data analysis unit through an Ethernet data link signal.

[0014] Preferably, the instruction matching module includes an attitude data integration unit, which is connected to a single - hand motion matching unit, a two - hand motion matching unit, and a fingertip motion matching unit through an Ethernet data link signal. The single - hand motion matching unit, the two - hand motion matching unit, and the fingertip motion matching unit are connected to an instruction matching unit through an Ethernet data link signal.

[0015] Preferably, the attitude acquisition element is connected to a hand gesture capture unit, a torso gesture capture unit, and a distance gesture capture unit through an Ethernet data link signal.

[0016] Preferably, the input port of the instruction signal input interface is connected to the output port of the instruction matching unit through an Ethernet data link signal, and the video output interface is connected to an output display screen through an Ethernet data link signal.

[0017] Preferably, the output port of the data analysis unit is connected to the input port of the instruction confirmation unit through an Ethernet data link signal.

[0018] Preferably, the attitude data integration unit is connected to the data analysis unit through an Ethernet data link signal.

[0019] The present invention provides a multi - sensory interactive dynamic visual communication display device, which has the following beneficial effects:

[0020] 1. The present invention has a real - time dynamic interaction control effect: Through the attitude acquisition terminal, the gesture instruction acquisition terminal, and the distance sensing element, the device can collect the body posture and gesture information of the viewer in real time. This real - time interaction ability enables the device to adjust the content according to the actual operations of the viewer, whether it is adjusting the zooming or page - turning of the viewing content, or controlling the state of content display (such as magnifying, shrinking, scrolling, etc.) through gestures. This dynamic feedback allows the viewer to precisely control the device through simple body and gesture operations, thereby improving the fluency and naturalness of the interaction experience.

[0021] 2. The present invention has a diversified attitude and somatosensory recognition effect: The system collects different types of attitude data through multiple sensors, including the dynamic detection of fingers and palms. It can realize operations such as mouse pointer control, single - click, double - click, and drag. By the position, displacement, and movement changes of the torso, the display content can be adjusted. For example, by moving the arm or torso, the content can be paged or zoomed. The approach and departure of people can be captured through distance changes, further affecting the operation mode of the system. For example, when the viewer leaves, the system automatically enters the sleep mode, optimizing the energy management and user experience of the device. These diversified recognition capabilities not only provide gesture control but also enable the system to capture and respond to various body postures and movements more precisely, greatly improving the accuracy and intelligence of the interaction.

[0022] 3. The present invention has the effect of a flexible control method: According to the changes in the user's gestures and body postures, the system can match different control modes. Moving the outer side of the palm magnifies the image, moving the inner side shrinks the image, a circular hand movement controls rapid page turning, and moving the index finger controls the mouse cursor, etc. This method enables the user to control the device with intuitive and natural movements, making the interaction process smoother and easier to understand, and reducing the learning cost and usage threshold.

[0023] 4. The present invention has an accurate data analysis and feedback mechanism: The system combines various data collection and analysis modules such as a somatosensory gesture displacement perception unit, a single - hand / double - hand gesture amplitude perception unit, and a fingertip movement matching unit, and can process various posture data of the viewing personnel in real - time and accurately. Whether it is a single - hand fingertip click or a slow movement after the palm is opened, the system can match and analyze these actions through precise algorithms and quickly feedback to the device operation to achieve an instant response effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 is a three - dimensional schematic diagram of the display device structure of the present invention Figure 1 ;

[0025] Figure 2 is a three - dimensional schematic diagram of the display device structure of the present invention Figure 2 ;

[0026] Figure 3 is a schematic diagram of the integrated processing terminal of the present invention;

[0027] Figure 4 is a schematic diagram of the main system architecture of the present invention;

[0028] Figure 5 is a schematic diagram of the system architecture of the posture acquisition terminal of the present invention;

[0029] Figure 6 is a schematic diagram of the system architecture of the gesture instruction acquisition terminal of the present invention;

[0030] Figure 7 is a schematic diagram of the system architecture of the integrated processing terminal of the present invention;

[0031] Figure 8 is a schematic diagram of the system architecture of the posture analysis module of the present invention;

[0032] Figure 9 is a schematic diagram of the system architecture of the instruction matching module of the present invention.

[0033] Among them, 1. Fixed frame; 2. Suspension platform; 3. Output display screen; 4. Attitude acquisition terminal; 5. Gesture instruction acquisition terminal; 6. Comprehensive processing terminal; 7. Attitude analysis module; 8. Instruction matching module; 41. Distance sensing element; 42. Camera acquisition element; 43. Attitude acquisition element; 44. Hand gesture capture unit; 45. Trunk gesture capture unit; 46. Distance gesture capture unit; 47. Data output port; 61. Instruction signal input interface; 62. Application program processing unit; 63. Gesture instruction processing unit; 64. Audio transmission element; 65. Video transmission element; 66. Audio synthesis unit; 67. Video synthesis unit; 68. Video output interface; 69. Audio output interface; 71. Gesture data receiving unit; 72. Distance change statistics unit; 73. Somatosensory attitude displacement perception unit; 74. Single-hand attitude amplitude perception unit; 75. Device output sleep unit; 76. Two-hand attitude amplitude perception unit; 77. Attitude perception acquisition unit; 78. Data analysis unit; 79. Instruction confirmation unit; 81. Attitude data integration unit; 82. Single-hand movement matching unit; 83. Two-hand movement matching unit; 84. Finger-tip movement matching unit; 85. Instruction matching unit. Detailed implementation manners

[0034] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the accompanying drawings of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

[0035] Please refer to the attached Figure 1 - attached Figure 4, an embodiment of the present invention provides a multi-sensory interactive dynamic visual communication display device, including a fixing frame 1 and a suspension platform 2 for fixing the structure of the multi-sensory interactive dynamic visual communication display device. An output display screen 3 is used for visual communication display of content. The suspension platform 2 is arranged on the fixing frame 1, and the output display screens 3 are distributed on the top of the fixing frame 1. A comprehensive processing terminal 6 is arranged on the fixing frame 1. An attitude analysis module 7 and an instruction matching module 8 are distributed on the comprehensive processing terminal 6. An attitude acquisition terminal 4 is connected to a gesture instruction acquisition terminal 5 through an Ethernet data link signal, and the gesture instruction acquisition terminal 5 is connected to the comprehensive processing terminal 6 through an Ethernet data link signal. The comprehensive processing terminal 6 is connected to the output display screen 3 through an Ethernet data link signal. The gesture instruction acquisition terminal 5 is provided with an attitude analysis module 7 and an instruction matching module 8. First, the device can dynamically adjust the viewing instructions according to the body postures and hand postures of the viewers to adjust the viewing content. The overall device is fixed by the fixing frame 1 and the suspension platform 2 installed on the fixing frame 1. At the same time, the comprehensive processing terminal 6 installed on the fixing frame 1 and the attitude acquisition terminal 4 and the gesture instruction acquisition terminal 5 configured on the comprehensive processing terminal 6 are used to collect the personnel attitude information. Finally, it is converted into an attitude instruction through the attitude analysis module 7 and the instruction matching module 8, and finally adjusted and exhibited by the output display screen 3 installed on the fixing frame 1.

[0036] Please refer to the appendix Figure 1 - appendix Figure 5 , the attitude acquisition terminal 4 is used for collecting dynamic information of human body sensory postures. The attitude acquisition terminal 4 includes a distance sensing element 41. Both the distance sensing element 41 and the camera acquisition element 42 are connected to an attitude acquisition element 43 through an Ethernet data link signal. The attitude acquisition element 43 is connected to a hand gesture capture unit 44, a torso gesture capture unit 45, and a distance gesture capture unit 46 through an Ethernet data link signal. The attitude sensing information of the viewer to be viewed is obtained through the attitude acquisition terminal 4. The distance sensing element 41 and the camera acquisition element 42 real-time obtain the camera information of the viewer and the body standing distance of the viewer, and output them to the attitude acquisition element 43. The attitude acquisition element 43 captures the hand movement gesture of the viewer through the hand gesture capture unit 44, captures the torso movement gesture of the viewer through the torso gesture capture unit 45, and captures the distance between the torso of the viewer and the distance sensing element 41 through the distance gesture capture unit 46. Finally, it is transmitted to the gesture instruction acquisition terminal 5 in real time through the data output port 47, and the attitude analysis module 7 and the instruction distribution module obtain the action instructions of the viewer. The gesture data receiving unit 71 reads the capture data of the hand gesture capture unit 44, the torso gesture capture unit 45, and the distance gesture capture unit 46 in real time through an Ethernet data link read signal, and reads the viewer's approaching distance data captured by the hand gesture capture unit 44 according to the distance change statistical unit 72 and limits it within a certain range.

[0037] Please refer to the attached Figure 1 - Attachment Figure 6 , the gesture instruction acquisition terminal 5 cooperates with the data output port 47 and the data analysis unit 78 for collecting dynamic information of human sensory postures.

[0038] Please refer to the attached Figure 1 - Attachment Figure 7 , the comprehensive processing terminal 6 cooperates with the instruction matching unit 85 for outputting human posture information instructions. The comprehensive processing terminal 6 includes an instruction signal input interface 61. The instruction signal input interface 61 is connected to the application processing unit 62 and the gesture instruction processing module 63 through an Ethernet data link signal. The application processing unit 62 and the gesture instruction processing module 63 are respectively connected to the audio transmission element 64 and the video transmission element 65 through an Ethernet data link signal. The application processing unit 62 and the gesture instruction processing module 63 are respectively connected to an audio synthesis unit 66 and a video synthesis unit 67 through the audio transmission element 64 and the video transmission element 65. The audio synthesis unit 66 is connected to the audio output interface 69 through an Ethernet data link signal. The video synthesis unit 67 is connected to the video output interface 68 through an Ethernet data link signal. The input port of the instruction signal input interface 61 is connected to the output port of the instruction matching unit 85 through an Ethernet data link signal. The video output interface 68 is connected to the output display screen 3 through an Ethernet data link signal. The output instructions received by the comprehensive processing terminal 6 from the instruction matching unit 85 include gesture instructions and application output instructions, and are respectively parsed and output by the application processing unit 62 and the gesture instruction processing module, and are respectively transmitted to the audio synthesis unit 66 and the video synthesis unit 67 by the audio transmission element 64 and the video transmission element 65. Finally, the video data synthesized by the gesture instructions is transmitted to the output display screen 3 through the video output interface 68 for display and operation.

[0039] Please refer to the attached Figure 1 - Attachment Figure 8, the posture analysis module 7 includes a situation data receiving unit 71. The situation data receiving unit 71 is signal-connected to a distance change statistics unit 72. The distance change statistics unit 72 is respectively signal-connected to a body sensation posture displacement perception unit 73, a single-hand posture amplitude perception unit 74, a device output sleep unit 75, and a two-hands posture amplitude perception unit 76. The body sensation posture displacement perception unit 73, the single-hand posture amplitude perception unit 74, the device output sleep unit 75, and the two-hands posture amplitude perception unit 76 are all signal-connected to a posture perception acquisition unit 77 through Ethernet data link signals. The situation data receiving unit 71 is respectively signal-connected to a data output port 47 through Ethernet data link signals. The posture perception acquisition unit 77 is signal-connected to a data analysis unit 78 through Ethernet data link signals. The output port of the data analysis unit 78 is signal-connected to the input port of an instruction confirmation unit 79 through Ethernet data link signals. After contacting the viewer data within the range, it will read the torso displacement data of the viewer through the body sensation posture displacement perception unit 73, the two-hands posture amplitude perception unit 76 captures the two-hands dynamic amplitude data of the viewer, and the single-hand posture data of the single-hand posture amplitude perception unit 74. When not entering the range defined by the distance change statistics unit 72, the device output sleep unit 75 will put the device into sleep waiting for the next activation. The posture perception acquisition unit 77 will collect the data of the body sensation posture displacement perception unit 73, the single-hand posture amplitude perception unit 74, and the two-hands posture amplitude perception unit 76 of the viewer to be activated and perform real-time analysis through the data analysis unit 78. After the body sensation posture displacement perception unit 73 and the two-hands posture amplitude perception unit 76 capture that the viewer stretches the single hand forward and makes a grasping movement backward and downward, the system obtains the authorized position of the viewer, and the instruction confirmation unit 79 makes a judgment and controls the data analysis unit 78 to transmit to the instruction matching module 8. If there is no operation within a few seconds, the control right fails.

[0040] Please refer to the appendix Figure 1 - appendix Figure 9The instruction matching module 8 includes a posture data synthesis unit 81, which is connected to a single-hand motion matching unit 82, a double-hand motion matching unit 83 and a fingertip motion matching unit 84 via an Ethernet data link signal. The single-hand motion matching unit 82, the double-hand motion matching unit 83 and the fingertip motion matching unit 84 are connected to the instruction matching unit 85 via an Ethernet data link signal. The posture data synthesis unit 81 is connected to the data analysis unit 78 via an Ethernet data link signal. The posture data synthesis unit 81 included in the instruction matching module 8 directly receives the posture change data of the somatosensory posture displacement sensing unit 73, the single-hand posture amplitude sensing unit 74 and the double-hand posture amplitude sensing unit 76, and performs posture matching through the single-hand motion matching unit 82, the double-hand motion matching unit 83 and the fingertip motion matching unit 84. The instruction matching unit 85 drives the output display screen 3 to enter the zoom state, and the palm is turned outward. Move to enlarge the image, move the palm inward to reduce the image to control continuous zooming, match the viewer's palm moving to the chest, exit the zooming state, match the viewer's hand circling in front of the chest, start the fast scrolling and page turning state, the front half circle is downward, the flat surface scrolls downward, and vice versa, the viewer's hand is matched to move forward, move up and down slowly, move the hand backward, exit the fast scrolling and page turning state, and the content stays at the current position. At the same time, the fingertip motion matching unit 84 can be controlled according to the real-time gesture of the viewer's single fingertip matched by the single-hand motion matching unit 82, single-finger single-click to obtain the fingertip mouse state, single index finger movement to realize mouse movement, single index finger single-click to click on the icon, use five fingers open + slow movement to enter, match the index finger double-click action, immediately complete the click file opening, and use five fingers open plus slow movement to drag the file, and finally the matching hand can be returned to the chest to release the fingertip mouse state.

[0041] Working principle: First, the device can dynamically adjust the viewing instructions according to the body postures and hand postures of the viewers to adjust the viewing content. The overall device is fixed through the fixing frame 1 and the suspension platform 2 installed on the fixing frame 1. At the same time, the integrated processing terminal 6 installed on the fixing frame 1 and the posture acquisition terminal 4 and gesture instruction acquisition terminal 5 configured on the integrated processing terminal 6 are used to collect the personnel posture information. Finally, it is converted into posture instructions through the posture analysis module 7 and the instruction matching module 8, and finally adjusted and displayed by the output display screen 3 installed on the fixing frame 1. The posture acquisition terminal 4 is used to obtain the posture sensing information of the viewers to be viewed. The distance sensing element 41 and the camera acquisition element 42 obtain the camera information of the viewers and the body standing position distance of the viewers in real time, and output it to the posture acquisition element 43. The posture acquisition element 43 collects the hand movement postures of the viewers through the hand posture capture unit 44, collects the trunk movement postures of the viewers through the trunk posture capture unit 45, and collects the distance between the viewer's trunk and the distance sensing element 41 through the distance posture capture unit 46. Finally, it is transmitted to the gesture instruction acquisition terminal 5 in real time through the data output port 47, and the action instructions of the viewers are obtained by the posture analysis module 7 and the instruction distribution module. The posture data receiving unit 71 reads the capture data of the hand posture capture unit 44, the trunk posture capture unit 45, and the distance posture capture unit 46 in real time through the Ethernet data link, and reads the approaching distance data of the viewers captured by the hand posture capture unit 44 according to the distance change statistics unit 72 and limits it within a certain range. After contacting the viewer data within the range, the body posture displacement perception unit 73 will read the trunk displacement data of the viewers, the two-handed posture amplitude perception unit 76 captures the two-handed dynamic amplitude data of the viewers, and the single-handed posture amplitude data of the single-handed posture amplitude perception unit 74. When not entering the range defined by the distance change statistics unit 72, the device output sleep unit 75 will put the device into sleep waiting for the next startup, and the posture perception acquisition unit 77 will collect the data of the body posture displacement perception unit 73, the single-handed posture amplitude perception unit 74, and the two-handed posture amplitude perception unit 76 of the viewers to be viewed and perform real-time analysis through the data analysis unit 78. After the body posture displacement perception unit 73 and the two-handed posture amplitude perception unit 76 collect that the viewer's single hand opens and stretches forward and makes a grasping movement backward and downward, the system obtains the authorized viewer position, and the instruction confirmation unit 79 makes a judgment and controls the data analysis unit 78 to transmit it to the instruction matching module 8. If there is no operation within a few seconds, the control right fails. The posture data integration unit 81 included in the instruction matching module 8 directly receives the body posture change data of the body posture displacement perception unit 73, the single-handed posture amplitude perception unit 74, and the two-handed posture amplitude perception unit 76, and performs posture matching through the single-handed movement matching unit 82, the two-handed movement matching unit 83, and the fingertip movement matching unit 84.The instruction matching unit 85 correspondingly drives the output display screen 3 to enter the zoom state. At the same time, when the palm moves outward, the image is enlarged, and when the palm moves inward, the image is reduced to control continuous zooming. When it is matched that the viewer's palm moves to the chest, the zoom state is exited. After it is matched that the viewer's hand makes a circular motion in front of the chest, the fast scrolling and page turning state is enabled. For the first half of the circle forward, the screen scrolls downward, and vice versa for upward scrolling. When it is matched that the viewer's hand moves forward, it moves slowly up and down, and when the hand moves backward, the fast scrolling and page turning state is exited, and the content stays at the current position. At the same time, the fingertip motion matching unit 84 can be controlled according to the real-time posture of the viewer's single fingertip matched by the single-hand motion matching unit 82. Single-finger clicking obtains the fingertip mouse state, the single index finger moves to realize the movement of the mouse, and the single index finger clicks to perform the click of the icon. Spread the five fingers + move slowly to enter. When it is matched that the index finger double-clicks, the opening of the clicked file is immediately completed. And use the spread of the five fingers plus slow movement to perform the file dragging operation. Finally, by matching the hand retracted to the chest, the fingertip mouse state is released. The comprehensive processing terminal 6 receives the output instructions of the instruction matching unit 85, including gesture instructions and application output instructions, and respectively performs a parsing output through the application program processing unit 62 and the gesture instruction processing module, and is respectively transmitted to the audio synthesis unit 66 and the video synthesis unit 67 by the audio transmission component 64 and the video transmission component 65. Finally, the video output interface 68 transmits the video data synthesized by the gesture instructions to the output display screen 3 for display and operation.,

[0042] Although the embodiments of the present invention have been shown and described, it will be understood by those of ordinary skill in the art that various changes, modifications, substitutions and variations can be made in these embodiments without departing from the principles and spirit of the present invention. The scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. A multi-sensory interactive dynamic visual communication display device, characterized in that: include: The fixing frame (1) cooperates with the suspension platform (2) to fix the structure of the multi-sensory interactive dynamic visual communication display device; The output display screen (3) is used for visual communication display of the content; The posture collection terminal (4) is used for collecting dynamic information of human body sensory posture; The gesture command acquisition terminal (5) cooperates with the data output port (47) and the data analysis unit (78) to collect dynamic information of human sensory postures; The integrated processing terminal (6) cooperates with the instruction matching unit (85) to output human body posture information instructions.

2. A multi-sensory interactive dynamic visual communication display device according to claim 1, characterized in that: The suspension platform (2) is arranged on a fixed frame (1), the output display screen (3) is distributed on the top of the fixed frame (1), the integrated processing terminal (6) is arranged on the fixed frame (1), the gesture analysis module (7) and the instruction matching module (8) are distributed on the integrated processing terminal (6), the gesture acquisition terminal (4) is connected to the gesture instruction acquisition terminal (5) via an Ethernet data link signal, the gesture instruction acquisition terminal (5) is connected to the integrated processing terminal (6) via an Ethernet data link signal, the integrated processing terminal (6) is connected to the output display screen (3) via an Ethernet data link signal, and the gesture instruction acquisition terminal (5) is provided with a gesture analysis module (7) and an instruction matching module (8).

3. The multi-sensory interactive dynamic visual communication display device according to claim 1, characterized in that: The posture acquisition terminal (4) comprises a distance sensor element (41), and the distance sensor element (41) and the camera acquisition element (42) are both connected to the posture acquisition element (43) via an Ethernet data link signal.

4. The multi-sensory interactive dynamic visual communication display device according to claim 1, characterized in that: The integrated processing terminal (6) comprises a command signal input interface (61), wherein the command signal input interface (61) is connected to an application processing unit (62) and a gesture command processing module (63) via an Ethernet data link signal, wherein the application processing unit (62) and the gesture command processing module (63) are respectively connected to an audio transmission element (64) and a video transmission element (65) via an Ethernet data link signal, wherein the application processing unit (62) and the gesture command processing module (63) are respectively connected to an audio synthesis unit (66) and a video synthesis unit (67) via an audio transmission element (64) and a video transmission element (65), wherein the audio synthesis unit (66) is connected to an audio output interface (69) via an Ethernet data link signal, and wherein the video synthesis unit (67) is connected to a video output interface (68) via an Ethernet data link signal.

5. The multi-sensory interactive dynamic visual communication display device according to claim 1, characterized in that: The posture analysis module (7) comprises a posture data receiving unit (71), the posture data receiving unit (71) is connected to a distance change statistics unit (72) through signals, the distance change statistics unit (72) is respectively connected to a body-sensing posture displacement sensing unit (73), a single-hand posture amplitude sensing unit (74), a device output sleep unit (75) and a double-hand posture amplitude sensing unit (76) through signals, the body-sensing posture displacement sensing unit (73), the single-hand posture amplitude sensing unit (74), the device output sleep unit (75) and the double-hand posture amplitude sensing unit (76) are all connected to a posture sensing collection unit (77) through Ethernet data link signals, the posture data receiving unit (71) is respectively connected to a data output port (47) through Ethernet data link signals, and the posture sensing collection unit (77) is connected to a data analysis unit (78) through Ethernet data link signals.

6. The multi-sensory interactive dynamic visual communication display device according to claim 1, characterized in that: The instruction matching module (8) comprises a posture data integration unit (81), wherein the posture data integration unit (81) is connected to a single-hand motion matching unit (82), a double-hand motion matching unit (83) and a fingertip motion matching unit (84) via an Ethernet data link signal, and the single-hand motion matching unit (82), the double-hand motion matching unit (83) and the fingertip motion matching unit (84) are connected to an instruction matching unit (85) via an Ethernet data link signal.

7. The multi-sensory interactive dynamic visual communication display device according to claim 3, characterized in that: The posture acquisition element (43) is connected to the hand posture capture unit (44), the trunk posture capture unit (45) and the distance posture capture unit (46) via an Ethernet data link signal.

8. The multi-sensory interactive dynamic visual communication display device according to claim 4, characterized in that: The input port of the command signal input interface (61) is connected to the output port of the command matching unit (85) via an Ethernet data link signal, and the video output interface (68) is connected to the output display screen (3) via an Ethernet data link signal.

9. The multi-sensory interactive dynamic visual communication display device according to claim 5, characterized in that: The output port of the data analysis unit (78) is connected to the input port of the instruction confirmation unit (79) via an Ethernet data link signal.

10. The multi-sensory interactive dynamic visual communication display device according to claim 6, characterized in that: The posture data integration unit (81) is connected to the data analysis unit (78) via an Ethernet data link signal.

Images