Interactive multimedia display system and network-based control method thereof
By designing an interactive multimedia display system, utilizing displacement detection and human-computer interaction technology, combined with environmental sensors and actuators, the problem of lack of user interaction in existing multimedia display systems is solved, and a multimedia display effect that matches user control with environmental parameters is achieved.
Patent Information
- Application Number
- CN202010036483.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-01-14
- Publication Date
- 2025-09-19
- Estimated Expiration
- 2040-01-14
AI Technical Summary
The existing multimedia display system lacks user interaction and cannot realize the interaction between the user and the multimedia display system, which reduces the user experience satisfaction.
An interactive multimedia display system was designed, including a display device, a controller, a loading platform, a manipulation device, a displacement detection device, a switch device, a human-computer interaction device, a data storage device, and other components. Displacement detection and human-computer interaction enable users to control multimedia data, and environmental sensors and actuators are combined to adjust environmental parameters to match the scene requirements of the multimedia data.
It realizes the user's control experience of the multimedia display system, enriches the user's sensory experience, and enhances the user's interactivity with the multimedia display system and the on-site experience effect.
Smart Images

Figure CN111078036B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of multimedia display systems, and in particular to an interactive multimedia display system and a network-based control method thereof. Background Art
[0002] In recent years, with the development of the country's economy, science and technology, education and culture and the improvement of comprehensive national strength, multimedia technology has developed rapidly, and the application of multimedia display has penetrated into various fields of human life with extremely strong penetration, such as museums, science and technology museums, cultural centers, corporate exhibition halls, theme parks, tourist attractions, etc.
[0003] Current multimedia displays mainly present the following characteristics: first, the display occasions are more extensive; second, the display content is richer, that is, the content displayed can range from promoting policies and reflecting economic growth; to revealing a phenomenon, demonstrating a law, explaining a scientific principle; to establishing a corporate image, introducing a product, etc. There are tens of thousands of contents and information that need to be conveyed.
[0004] Although existing multimedia display solutions have met people's needs for obtaining diverse information and enriched the forms of publicity to a certain extent, ordinary users who are not multimedia managers are still recipients of multimedia content. There is a lack of interaction between users and multimedia display systems, and they cannot truly integrate into the transmission process of multimedia content. It is difficult to achieve interaction between users and multimedia display systems, which greatly reduces people's expectations for existing multimedia display systems. Summary of the Invention
[0005] The first technical problem to be solved by the present invention is to provide an interactive multimedia display system for the above-mentioned prior art.
[0006] The second technical problem to be solved by the present invention is to provide a network-based control method for the interactive multimedia display system.
[0007] The third technical problem to be solved by the present invention is to provide another network-based control method for the interactive multimedia display system.
[0008] The technical solution adopted by the present invention to solve the first technical problem is: an interactive multimedia display system, comprising:
[0009] display device;
[0010] A controller connected to a display device;
[0011] A loading platform having a slide rail arranged along its length;
[0012] It is characterized in that the display device has at least two display screens, and the interactive multimedia display system further includes:
[0013] A control device is slidably located in the slide rail, and comprises a counterweight and an operating rod, wherein the operating rod is arranged on the counterweight;
[0014] A displacement detection device connected to the controller, the displacement detection device is used to detect the movement distance of the counterweight block; the displacement detection device is arranged at one end of the slide rail;
[0015] A switch device, comprising at least a local area network switch, one end of the local area network switch being connected to the displacement detection device, and the other end of the local area network switch being connected to the controller;
[0016] A human-computer interaction device having an input device for receiving user instructions, the human-computer interaction device being connected to the switch device;
[0017] A data storage device is connected to the display device and the controller respectively, and the data storage device has a first data storage area for storing environmental parameter data and a second data storage area for storing multimedia data; the second data storage area stores multimedia data; wherein the multimedia data is at least one of video data, audio data, image data and text data.
[0018] Improved, the interactive multimedia display system further includes:
[0019] A projection device comprising an electric bracket capable of 360-degree rotation and a projector located on the electric bracket, wherein the electric bracket and the projector are respectively connected to a controller, and the projector is connected to a data storage device;
[0020] A light-emitting device having a light-emitting driver chip and a plurality of LED lamps that respectively emit light of different colors, wherein the light-emitting driver chip is connected to a controller;
[0021] An audio playback device is connected to the controller and the data storage device respectively;
[0022] The human infrared sensor is connected to the controller and the data storage device respectively, and the human infrared sensor is set on the human-computer interaction device;
[0023] a gesture recognition device connected to a controller;
[0024] A light intensity sensor is connected to the controller and the data storage device respectively;
[0025] Temperature sensor, connected to the controller and data storage respectively;
[0026] Humidity sensor, connected to the controller and data storage respectively;
[0027] Wind speed sensor, connected to the controller and data storage device respectively;
[0028] A smoke release device having a smoke release unit capable of emitting smoke of different colors;
[0029] Blowing device, connected to the controller;
[0030] Heating device, connected to the controller;
[0031] Refrigeration unit, connected to the controller;
[0032] The camera is connected to the controller and the data storage device respectively;
[0033] An audio acquisition device, connected to the controller, for acquiring voice commands issued by the user;
[0034] An audio recognition device is connected to the audio acquisition device, the controller and the data storage device respectively;
[0035] Wherein, the human-computer interaction device has a Bluetooth device capable of connecting to a user's mobile terminal.
[0036] Specifically, in the interactive multimedia display system, the displacement detection device is a rangefinder capable of emitting infrared rays to the counterweight.
[0037] The technical solution adopted by the present invention to solve the second technical problem is: a network-based control method for the interactive multimedia display system, characterized by comprising the following steps:
[0038] Step 1: The displacement detection device detects the distance moved by the counterweight block in the control device and sends the detected counterweight block displacement data to the controller;
[0039] Step 2: The controller makes a judgment based on the received counterweight displacement data:
[0040] When the displacement data of the counterweight reaches a preset displacement value, the controller instructs the display screen corresponding to the preset displacement value to call the corresponding multimedia data in the data memory, and the process proceeds to step 3; otherwise, the controller does not send a command to any display screen; wherein each display screen corresponds to a preset displacement value, and there is a one-to-one correspondence between each preset displacement value and the multimedia data in the data memory;
[0041] In step 3, the display screen displays the multimedia data it has called, and the audio playing device plays the audio data contained in the multimedia data.
[0042] The technical solution adopted by the present invention to solve the third technical problem is: a network-based control method for the interactive multimedia display system, characterized by comprising the following steps:
[0043] Step a1, the human infrared sensor starts detecting infrared signals from the human body;
[0044] Step a2: When the human infrared sensor detects a human infrared signal, the human infrared sensor sends the detection result to the controller; otherwise, the human infrared sensor does not send any information to the controller;
[0045] Step a3, the controller instructs the displacement detection device to start detection;
[0046] Step a4, the displacement detection device detects the distance moved by the counterweight block in the control device, and sends the detected counterweight block displacement data to the controller;
[0047] Step a5: The controller makes a judgment based on the received counterweight displacement data:
[0048] When the displacement data of the counterweight reaches a preset displacement value, the controller instructs the display screen corresponding to the preset displacement value to call the corresponding multimedia data in the data memory, and the process proceeds to step a6. Otherwise, the controller does not send the command to any display screen. Each display screen corresponds to a preset displacement value, and there is a one-to-one correspondence between each preset displacement value and the multimedia data in the data memory.
[0049] In step a6, the controller analyzes the multimedia data called by the display screen and processes the data according to the analysis result:
[0050] When the content corresponding to the multimedia data contains an environmental scene, go to step a8; otherwise, go to step a7;
[0051] Step a7, the display screen displays the called multimedia data, and the audio playing device plays the audio data contained in the multimedia data;
[0052] In step a8, the controller instructs the device corresponding to the environmental scene to start working and receives data sent by the environment-related sensor corresponding to the environmental scene; wherein the device corresponding to the environmental scene is at least one of a light-emitting device, a smoke-releasing device, a blasting device, a heating device, or a cooling device; and correspondingly, the environment-related sensor corresponding to the environmental scene is at least one of a light intensity sensor, a wind speed sensor, a temperature sensor, or a humidity sensor;
[0053] In step a9, the controller determines the current environment of the user based on the received sensor data related to the environment:
[0054] When the data of the environment-related sensors all match the environmental data corresponding to the environmental scene, the controller does not process them; otherwise, the controller commands the device corresponding to the environmental scene to adjust its working state so that the data of the environment-related sensors after adjustment all match the environmental data corresponding to the environmental scene.
[0055] Further improved, in the network-based control method of the interactive multimedia display system, before transitioning from step a2 to step a3, the method further includes:
[0056] Step a21, the audio collection device collects external voice data and sends the voice data to the audio recognition device;
[0057] Step a22: If the audio recognition device determines that the voice data is consistent with a control instruction pre-stored in the audio recognition device, the audio recognition device sends the control instruction to the controller and the process proceeds to step a23; otherwise, the audio recognition device does not perform any processing and the process proceeds to step a24;
[0058] Step a23, the controller instructs the device corresponding to the control instruction to execute the action corresponding to the control instruction, and then proceeds to step a24;
[0059] Step a24: the gesture recognition device judges the gesture of the person appearing at the human-computer interaction device:
[0060] When the person's gesture is consistent with the control instruction pre-stored in the gesture recognition device, the gesture recognition device sends the control instruction to the controller and the process goes to step a25; otherwise, the gesture recognition device does not perform any processing and the process goes to step a26;
[0061] Step a25, the controller instructs the device corresponding to the control instruction to execute the action corresponding to the control instruction, and then proceeds to step a26;
[0062] In step a26, the controller instructs the camera to start recording and saves the recorded data into a data storage device.
[0063] As a further improvement, in the network-based control method of the interactive multimedia display system, the controller receives an external input instruction sent by the input device of the human-computer interaction device, and commands the device corresponding to the external input instruction to perform the action corresponding to the external input instruction.
[0064] Further improved, in the network-based control method of the interactive multimedia display system, after step a9, the method further includes:
[0065] Step a10, the Bluetooth device of the human-computer interaction device receives a pairing communication request sent by the user's mobile terminal;
[0066] Step a11: After the human-computer interaction device establishes Bluetooth communication with the user's mobile terminal, the human-computer interaction device receives the data to be displayed sent by the mobile terminal;
[0067] Step a12, the human-computer interaction device sends the data to be displayed to the controller through the switch device;
[0068] In step a13, the controller determines the legitimacy of the data to be displayed:
[0069] When the data to be displayed is legal data, the controller randomly commands a display screen in an idle state to display the data to be displayed; otherwise, the controller does not process the data and does not feed back any information to the user's mobile terminal.
[0070] Compared with the prior art, the advantages of the present invention are:
[0071] First, the interactive multimedia display system of the present invention is provided with a control device having a counterweight and an operating rod. The displacement detection device sends displacement detection data of the counterweight to the controller for processing. The controller then commands the display screen to display corresponding multimedia data based on the displacement of the counterweight, thus achieving the control experience of the multimedia display system as an ordinary user.
[0072] Secondly, by setting up interactive machine equipment, the displacement detection device, controller and human-computer interaction equipment establish data interaction based on the local area network, making the structure of the entire multimedia display system simpler and wiring and maintenance more convenient;
[0073] Again, by setting different environment-related execution devices (such as light-emitting devices, smoke release devices, blowing devices, heating devices and cooling devices) and sensors for detecting environmental parameters (such as light intensity sensors, wind speed sensors, temperature sensors and humidity sensors), the controller can adjust the operation of the corresponding above-mentioned execution devices according to the data sent by such sensors, so that the parameters of the user's current environment meet the environmental scene corresponding to the multimedia data currently displayed on the display screen, satisfying the user's on-site personal experience of the displayed multimedia data, enriching the sensory experience presented to the user by the multimedia display system, and making it more fun. BRIEF DESCRIPTION OF THE DRAWINGS
[0074] Figure 1A schematic diagram of an interactive multimedia display system according to an embodiment of the present invention;
[0075] Figure 2 A schematic diagram of the arrangement structure between the slide rail, the control device and the displacement detection device in an embodiment of the present invention;
[0076] Figure 3 for Figure 2 A magnified schematic diagram of part A in FIG;
[0077] Figure 4 for Figure 2 A top view of the arrangement shown;
[0078] Figure 5 for Figure 2 An exploded schematic diagram of the setup shown;
[0079] Figure 6 This is a flow chart of a first network-based control method for an interactive multimedia display system according to an embodiment of the present invention;
[0080] Figure 7 2 is a flow chart of a second network-based control method for an interactive multimedia display system in an embodiment of the present invention. DETAILED DESCRIPTION
[0081] The present invention will be described in further detail below with reference to the accompanying drawings and embodiments.
[0082] like Figures 1 to 5 As shown, this embodiment provides an interactive multimedia display system, including:
[0083] A display device 101, the display device 101 having three display screens 1011;
[0084] A controller 102 connected to the display device 101;
[0085] A loading platform having a slide rail 103 arranged along its length;
[0086] A control device 104 is slidably located within the slide rail 103 . The control device 104 includes a counterweight 1041 and an operating rod 1042 . The operating rod 1042 is disposed on the counterweight 1041 .
[0087] A displacement detection device 105 is connected to the controller 102 and is used to detect the movement distance of the counterweight 1041. The displacement detection device 105 is disposed at one end of the slide rail 103. For example, in this embodiment, the displacement detection device 105 is a rangefinder capable of emitting infrared rays toward the counterweight 1041.
[0088] The switch device 106 includes a local area network switch 1061 , one end of the local area network switch 1061 is connected to the displacement detection device 105 , and the other end of the local area network switch 1061 is connected to the controller 102 ;
[0089] The human-computer interaction device 107 has an input device 1071 for receiving user commands and a Bluetooth device 1072 capable of connecting to a user's mobile terminal. The human-computer interaction device 107 is connected to the switch device 106. The user can establish a communication connection with the human-computer interaction device through his or her own mobile terminal with Bluetooth function.
[0090] A data storage device 108 is connected to the display device 101 and the controller 102, and includes a first data storage area 1081 for storing environmental parameter data and a second data storage area 1082 for storing multimedia data. The second data storage area 1082 stores multimedia data, wherein the multimedia data is at least one of video data, audio data, image data, and text data.
[0091] Projection device 109 includes a motorized support 1091 capable of 360-degree rotation and a projector 1092 located on motorized support 1091. Motorized support 1091 and projector 1092 are each connected to controller 102. Projector 1092 is connected to data storage 108. Motorized support 1091 can rotate within a 360-degree range under the control of controller 102.
[0092] The light emitting device 110 includes a light emitting driver chip and a plurality of LED lights that emit light of different colors. The light emitting driver chip is connected to the controller 102.
[0093] The audio playback device 111 is connected to the controller 102 and the data storage 108 respectively; the audio playback device 111 can play the audio data stored in the data storage 108;
[0094] A human infrared sensor 112 is connected to the controller 102 and the data storage device 108, and is provided on the human-computer interaction device 107. By providing the human infrared sensor 112, it is possible to detect whether there is a person walking near the human-computer interaction device 107, so that the controller 102 can command other devices to start working as needed.
[0095] A gesture recognition device 113 is connected to the controller 102; the gesture recognition device 113 is preferably provided adjacent to the human-computer interaction device 107 to recognize the user's gesture and obtain the control instruction to be conveyed by the user's gesture;
[0096] A light intensity sensor 114 is connected to the controller 102 and the data storage 108 respectively; the light intensity sensor 114 is used to detect the light intensity of the user's current environment, so that the controller 102 can adjust the light intensity to an appropriate range by controlling related devices;
[0097] The temperature sensor 115 is connected to the controller 102 and the data storage 108 respectively; the temperature sensor 115 is used to detect the temperature of the user's current environment so that the controller 102 can adjust the temperature to an appropriate range by controlling related devices;
[0098] A humidity sensor 116 is connected to the controller 102 and the data storage 108 respectively; the humidity sensor 116 is used to detect the humidity of the user's current environment so that the controller 102 can adjust the humidity to an appropriate range by controlling related devices;
[0099] A wind speed sensor 117 is connected to the controller 102 and the data storage 108 respectively; the wind speed sensor 117 is used to detect the wind speed of the user's current environment, so that the controller 102 can adjust the wind speed to an appropriate range by controlling related devices;
[0100] The smoke releasing device 118 has a smoke releasing unit capable of emitting smoke of different colors;
[0101] A blower 119 is connected to the controller 102; the blower 119 can be started or adjusted according to the instructions of the controller 102 so that the wind speed in the user's current environment reaches an appropriate range;
[0102] A heating device 120 is connected to the controller 102; the heating device 120 can be started or adjusted according to the instructions of the controller 102 so that the temperature of the user's current environment reaches an appropriate range;
[0103] A refrigeration device 121 is connected to the controller 102; the refrigeration device 121 can be started or adjusted according to the instructions of the controller 102 to reduce the temperature of the user's current environment to an appropriate range;
[0104] The camera 122 is connected to the controller 102 and the data storage 108 respectively;
[0105] An audio collection device 123, connected to the controller 102, for collecting voice commands issued by the user;
[0106] The audio recognition device 124 is connected to the audio collection device 123, the controller 102 and the data storage device 108 respectively; the audio recognition device 124 can recognize the user's voice instructions based on the user's voice instructions collected by the audio collection device 123, and send it to the controller 102 for processing;
[0107] The user's mobile terminal can receive multimedia data from the data storage after being verified by the human-computer interaction device, and display the content of the mobile terminal on the display screen.
[0108] The interactive multimedia display system is provided with a control device having a counterweight block and an operating rod, and the displacement detection device sends displacement detection data of the movement of the counterweight block to the controller for processing, so that the controller commands the display screen to display corresponding multimedia data according to the displacement of the counterweight block, thereby realizing the control experience effect of the multimedia display system as an ordinary user; in addition, by providing an interactive machine device, the displacement detection device, the controller and the human-computer interaction device establish data interaction based on the local area network, making the structure of the entire multimedia display system simpler and wiring and maintenance more convenient.
[0109] See also Figure 6 As shown, this embodiment provides a network-based control method for the above-mentioned interactive multimedia display system. Figures 1 to 5 The network-based control method of the interactive multimedia display system includes the following steps:
[0110] Step 1: The displacement detection device 105 detects the distance moved by the counterweight 1041 in the control device 104 and sends the detected displacement data of the counterweight to the controller 102;
[0111] Step 2: The controller 102 makes a judgment based on the received displacement data of the counterweight:
[0112] When the displacement data of the counterweight reaches the preset displacement value, it indicates that the counterweight 1041 has been moved by the user to the position where the multimedia data should be played. At this time, the controller 102 instructs the display screen 1011 corresponding to the preset displacement value to call the corresponding multimedia data in the data storage 108, and the process goes to step 3. Otherwise, the controller 102 does not send the command to any display screen. Each display screen corresponds to a preset displacement value, and there is a one-to-one correspondence between each preset displacement value and the multimedia data in the data storage 108.
[0113] In step 3, the display screen 1011 displays the retrieved multimedia data, and the audio playback device 111 plays the audio data contained in the multimedia data.
[0114] Furthermore, this embodiment also provides another network-based control method for the above-mentioned interactive multimedia display system. Figure 7 , and combined with Figures 1 to 5 The network-based control method of the interactive multimedia display system includes the following steps:
[0115] Step a1: the human infrared sensor 112 starts detecting infrared signals from the human body;
[0116] Step a2: When the human infrared sensor 112 detects a human infrared signal, it indicates that a person is walking at the human-computer interaction device 107, and the human infrared sensor 112 sends the detection result to the controller 102; otherwise, the human infrared sensor 112 does not send any information to the controller 102;
[0117] Step a3: the controller 102 instructs the displacement detection device 105 to start detection;
[0118] Step a4: the displacement detection device 105 detects the distance moved by the counterweight 1041 in the control device 104 and sends the detected displacement data of the counterweight to the controller 102;
[0119] Step a5: The controller 102 makes a judgment based on the received counterweight displacement data:
[0120] When the displacement data of the counterweight reaches the preset displacement value, it indicates that the user has moved the counterweight 1041 to the position where the multimedia data should be played. The controller 102 instructs the display screen 10111 corresponding to the preset displacement value to call the corresponding multimedia data in the data memory 108, and the process proceeds to step a6. Otherwise, the controller 108 does not send the command to any display screen. Each display screen corresponds to a preset displacement value, and there is a one-to-one correspondence between each preset displacement value and the multimedia data in the data memory 108.
[0121] In step a6, the controller 102 analyzes the multimedia data called by the display screen 1011 and processes the data according to the analysis result:
[0122] When the content corresponding to the multimedia data contains an environmental scene, go to step a8; otherwise, go to step a7;
[0123] Step a7: the display screen 1011 displays the retrieved multimedia data, and the audio playback device 111 plays the audio data contained in the multimedia data;
[0124] In step a8, the controller 102 instructs the device corresponding to the environmental scene to start working and receives data sent by the environment-related sensor corresponding to the environmental scene; wherein the device corresponding to the environmental scene is at least one of the light-emitting device 110, the smoke release device 118, the air blowing device 119, the heating device 120, or the cooling device 121; correspondingly, the environment-related sensor corresponding to the environmental scene is at least one of the light intensity sensor 114, the wind speed sensor 117, the temperature sensor 115, or the humidity sensor 116;
[0125] In step a9, the controller 102 determines the current environment of the user based on the received sensor data related to the environment:
[0126] When the data of the environment-related sensors all match the environmental data corresponding to the environmental scene, the controller does not process them; otherwise, the controller 102 commands the device corresponding to the environmental scene to adjust the working state so that the data of the environment-related sensors after adjustment all match the environmental data corresponding to the environmental scene.
[0127] The following explanation is given for step a9. Assuming that the multimedia data is video data after analysis by the controller and contains a scene about wind, then the controller will command the blower to start the blowing operation to blow out wind. If the controller determines that the wind speed sensor detects that the current wind speed has reached the wind speed value required by the windy scene in the multimedia data, the controller commands the blower to maintain the current state; if the controller determines that the wind speed sensor detects that the current wind speed deviates from the wind speed value range required by the windy scene in the multimedia data, the controller commands the blower to reduce or increase the blowing power so that the wind speed detected by the wind speed sensor is within the required wind speed value range.
[0128] By setting different environment-related execution devices (such as light-emitting devices, smoke release devices, blowing devices, heating devices and cooling devices) and sensors for detecting environmental parameters (such as light intensity sensors, wind speed sensors, temperature sensors and humidity sensors), the controller can adjust the operation of the corresponding above-mentioned execution devices according to the data sent by such sensors, so that the parameters of the user's current environment meet the environmental scene corresponding to the multimedia data currently displayed on the display screen, satisfying the user's on-site personal experience of the displayed multimedia data, enriching the sensory experience presented to the user by the multimedia display system, and making it more interesting.
[0129] Of course, as a link for realizing interaction between the user and the interactive multimedia display system, the network-based control method of the interactive multimedia display system further includes the following steps before transitioning from step a2 to step a3:
[0130] Step a21, the audio collection device 123 collects external voice data and sends the voice data to the audio recognition device 124;
[0131] In step a22, if the audio recognition device 124 determines that the voice data is consistent with the control instruction pre-stored in the audio recognition device, the audio recognition device 124 sends the control instruction to the controller 102 and the process proceeds to step a23; otherwise, the audio recognition device 124 does not perform any processing and the process proceeds to step a24;
[0132] In step a23, the controller 102 instructs the device corresponding to the control instruction to execute the action corresponding to the control instruction, and then proceeds to step a24;
[0133] In step a24, the gesture recognition device 113 determines the gesture of the person appearing at the human-computer interaction device 107:
[0134] When the person's gesture is consistent with the control instruction pre-stored in the gesture recognition device, the gesture recognition device 113 sends the control instruction to the controller 102 and the process proceeds to step a25; otherwise, the gesture recognition device 113 does not perform any processing and the process proceeds to step a26;
[0135] In step a25, the controller 102 instructs the device corresponding to the control instruction to execute the action corresponding to the control instruction, and then proceeds to step a26;
[0136] In step a26 , the controller 102 instructs the camera 122 to start recording and save the recorded data into the data storage 108 .
[0137] Of course, the controller 102 may also receive an external input instruction sent by the input device 1071 of the human-computer interaction device 107 , and instruct the device corresponding to the external input instruction to execute the action corresponding to the external input instruction.
[0138] In order to further enhance the user's participation experience, the network-based control method of the interactive multimedia display system of this embodiment further includes, after step a9:
[0139] Step a10: the Bluetooth device 1072 of the human-computer interaction device 107 receives a pairing communication request sent by the user's mobile terminal;
[0140] Step a11: After the human-computer interaction device 107 establishes Bluetooth communication with the user's mobile terminal, the human-computer interaction device 107 receives the data to be displayed sent by the mobile terminal;
[0141] Step a12: the human-computer interaction device 107 sends the data to be displayed to the controller 102 via the switch device 106;
[0142] In step a13, the controller 102 determines the legitimacy of the data to be displayed:
[0143] When the data to be displayed is legal data, the controller 102 randomly commands the display screen 1011 in an idle state to display the data to be displayed; otherwise, the controller 102 does not process the data and does not feed back any information to the user's mobile terminal.
Claims
1. A control method for an interactive multimedia display system, characterized in that: The interactive multimedia display system includes: A display device having at least two display screens; A controller connected to a display device; A loading platform having a slide rail arranged along its length; A control device is slidably located in the slide rail, and comprises a counterweight and an operating rod, wherein the operating rod is arranged on the counterweight; A displacement detection device connected to the controller, the displacement detection device is used to detect the movement distance of the counterweight block; the displacement detection device is arranged at one end of the slide rail; A data storage device is connected to the display device and the controller, and includes a first data storage area for storing environmental parameter data and a second data storage area for storing multimedia data; the second data storage area stores the multimedia data; A human-computer interaction device having an input device for receiving user instructions; The audio playback device and the human infrared sensor are connected to the controller and the data storage device respectively; wherein the human infrared sensor is arranged on the human-computer interaction device; An audio acquisition device, connected to the controller, for acquiring voice commands issued by the user; an audio recognition device connected to an audio acquisition device; a gesture recognition device connected to a controller; The control method comprises the following steps: Step 1: The displacement detection device detects the distance moved by the counterweight block in the control device and sends the detected counterweight block displacement data to the controller; Step 2: The controller makes a judgment based on the received counterweight displacement data: When the displacement data of the counterweight reaches a preset displacement value, the controller instructs the display screen corresponding to the preset displacement value to call the corresponding multimedia data in the data memory, and the process proceeds to step 3; otherwise, the controller does not send a command to any display screen; wherein each display screen corresponds to a preset displacement value, and there is a one-to-one correspondence between each preset displacement value and the multimedia data in the data memory; Step 3: The display screen displays the multimedia data it has called.
2. The control method for an interactive multimedia display system according to claim 1, characterized in that: Step 3 also includes: a step of playing the audio data in the multimedia data.
3. The control method for an interactive multimedia display system according to claim 1, characterized in that: The step 1 also includes the following steps: Step a1, the human infrared sensor starts detecting infrared signals from the human body; Step a2: When the human infrared sensor detects a human infrared signal, the human infrared sensor sends a detection result to the controller; otherwise, the human infrared sensor does not send any information to the controller; In step a3, the controller instructs the displacement detection device to start detection.
4. The control method for an interactive multimedia display system according to claim 3, characterized in that: The step 2 further includes the following steps: Step a6: The controller analyzes the multimedia data called by the display screen and performs processing according to the analysis result: When the content corresponding to the multimedia data contains an environmental scene, go to step a8; otherwise, go to step a7; Step a7, the display screen displays the called multimedia data, and the audio playing device plays the audio data contained in the multimedia data; In step a8, the controller instructs the device corresponding to the environmental scene to start working and receives data sent by the environment-related sensor corresponding to the environmental scene; wherein the device corresponding to the environmental scene is at least one of a light-emitting device, a smoke-releasing device, a blasting device, a heating device, or a cooling device; and correspondingly, the environment-related sensor corresponding to the environmental scene is at least one of a light intensity sensor, a wind speed sensor, a temperature sensor, or a humidity sensor; In step a9, the controller determines the current environment of the user based on the received sensor data related to the environment: When the data of the environment-related sensors all match the environmental data corresponding to the environmental scene, the controller does not process them; otherwise, the controller commands the device corresponding to the environmental scene to adjust its working state so that the data of the environment-related sensors after adjustment all match the environmental data corresponding to the environmental scene.
5. The control method for an interactive multimedia display system according to claim 4, characterized in that: The process of transitioning from step a2 to step a3 also includes: Step a21, the audio collection device collects external voice data and sends the voice data to the audio recognition device; Step a22: If the audio recognition device determines that the voice data is consistent with a control instruction pre-stored in the audio recognition device, the audio recognition device sends the control instruction to the controller and the process proceeds to step a23; otherwise, the audio recognition device does not perform any processing and the process proceeds to step a24; Step a23, the controller instructs the device corresponding to the control instruction to execute the action corresponding to the control instruction, and then proceeds to step a24; Step a24: the gesture recognition device judges the gesture of the person appearing at the human-computer interaction device: When the person's gesture is consistent with the control instruction pre-stored in the gesture recognition device, the gesture recognition device sends the control instruction to the controller and the process goes to step a25; otherwise, the gesture recognition device does not perform any processing and the process goes to step a26; Step a25, the controller instructs the device corresponding to the control instruction to execute the action corresponding to the control instruction, and then proceeds to step a26; In step a26, the controller instructs the camera to start recording and saves the recorded data into a data storage device.
6. The control method for an interactive multimedia display system according to claim 5, characterized in that: The controller receives an external input instruction sent by an input device of the human-computer interaction device, and instructs a device corresponding to the external input instruction to execute an action corresponding to the external input instruction.
7. The control method for an interactive multimedia display system according to claim 6, characterized in that: After step a9, the following steps are also included: Step a10, the Bluetooth device of the human-computer interaction device receives a pairing communication request sent by the user's mobile terminal; Step a11: After the human-computer interaction device establishes Bluetooth communication with the user's mobile terminal, the human-computer interaction device receives the data to be displayed sent by the mobile terminal; Step a12, the human-computer interaction device sends the data to be displayed to the controller through the switch device; Step a13: The controller determines the legitimacy of the data to be displayed: When the data to be displayed is legal data, the controller randomly commands a display screen in an idle state to display the data to be displayed; otherwise, the controller does not process the data and does not feed back any information to the user's mobile terminal.
Citation Information
Patent Citations
All-weather bi-directional analogue simulation image shooting training system
CN101915517A
Slip interactive installation
CN206920993U
Interactive multimedia display system
CN210924530U