Safety education interactive system based on augmented reality and its interactive control method

Abstract

The present invention relates to an augmented reality-based safety education interactive system and an interactive control method thereof. A camera is used to collect the actual scene of an experiencer's environment and the actions taken by the experiencer. A first projector fuses the actual scene with its own pre-stored virtualized safety scene to obtain a virtual-real integrated safety education scene, and projects the virtual-real integrated safety education scene onto a main display screen. In addition, according to the experiencer's dissuasive actions taken on the unsafe behaviors of a virtual object, the virtualized scene corresponding to the different dissuasive results projected onto the main display screen can be adjusted, thereby enhancing the experience effect of the experiencer on safety education in a virtual-real combination manner. In addition, according to the distance between the experiencer and the virtual object in the virtual-real integrated safety education scene, different virtual scenes can be displayed in the actual environment between the experiencer and the virtualized scene, thereby further enhancing the sense of reality of the safety education.

Description

Technical Field

[0001] The present invention relates to the field of safety education, and in particular to an augmented reality-based safety education interactive system and an interactive control method thereof. Background Art

[0002] As people's economic level continues to improve, more and more residents like to travel or go shopping. While enjoying the fun of traveling or shopping, travel safety is still a major problem that bothers people.

[0003] For example, when going out, many residents have poor safety awareness, especially traffic safety awareness and safety awareness in tourist destinations, which makes accidents very easy to happen. At the very least, public facilities may be damaged, and at worst, the health of tourists may be endangered, and even people's lives may be endangered.

[0004] When ordinary residents have not suffered harm from unsafe behaviors or have not witnessed the accident scene, their safety awareness is generally not taken seriously or improved. Although many departments now provide safety education activities on safe behaviors, such as lectures or on-site experiences, they still cannot really leave a deep impression on the minds of ordinary tourists, and thus cannot achieve the real purpose and effect of safety education.

[0005] Therefore, how to ensure the physical health and safety of residents while allowing them to truly experience safety education activities and enhance their mental impression of safety awareness has become an important topic in current safety education. Summary of the invention

[0006] The first technical problem to be solved by the present invention is to provide a safety education interactive system based on augmented reality in view of the above-mentioned prior art.

[0007] The second technical problem to be solved by the present invention is to provide an interactive control method of the safety education interactive system.

[0008] The technical solution adopted by the present invention to solve the first technical problem is: a safety education interactive system based on augmented reality, characterized in that it includes:

[0009] Main display screen;

[0010] A camera is set in front of the main display screen, and the camera captures the actual scene including the environment and actions of the experiencer;

[0011] A first projector projects a safety education scene obtained by integrating a virtualized safety education scene with the actual scene onto a main display screen;

[0012] Network switch, connecting cameras;

[0013] Audio playback device;

[0014] The controller is respectively connected to the main display screen, the first projector, the network switch and the audio playing device.

[0015] In order to further enhance the interactive effect when the experiencer touches the wall, the main display screen is improved so that it is arranged on the wall, a first laser radar is arranged on the wall, a second laser radar is arranged on the ground contacted by the wall, and both the first laser radar and the second laser radar are connected to the controller.

[0016] In order to obtain the position of the experiencer on the ground, so as to timely trigger the projector to change the virtual safety education scene projected onto the main display screen, a further improvement is made in that, in the safety education interactive system based on augmented reality, a second projector is arranged on the ground, and the second projector is connected to a controller.

[0017] Preferably, the camera is a wide-angle camera, and the camera is arranged above the ground.

[0018] According to the actual delivery needs of the virtualized safety education scene, the safety education interactive system in the present invention can also include a secondary display screen, which is composed of multiple display units spliced ​​together, and the controller is connected to each display unit through an HDMI distributor. In other words, the display unit here is a spliced ​​screen or an LED screen.

[0019] In order to play the audio adapted to the virtualized safety education scene to prompt the experiencer of the safety education interactive system, it is further improved that the controller here is connected to the audio playback device through a power amplifier device.

[0020] The technical solution adopted by the present invention to solve the second technical problem is: an interactive control method of the safety education interactive system, characterized in that it includes the following steps:

[0021] Step 1, the camera captures the actual scene including the environment and actions of the experiencer, and the first projector fuses the virtualized safety education scene pre-stored in the projector with the actual scene captured by the camera to obtain a fused safety education scene;

[0022] Step 2, the first projector projects the integrated safety education scene onto the main display screen, and the main display screen displays it; wherein the virtualized safety education scene at least contains unsafe behaviors displayed by the virtual object;

[0023] Step 3, when the experiencer faces the main display screen and displays a dissuasive action to dissuade the unsafe behavior, the camera collects and recognizes the experiencer's dissuasive action, and sends the recognition result of the dissuasive action to the controller;

[0024] Step 4: the controller makes a judgment on the received dissuasion action recognition result:

[0025] When the controller determines that the dissuasion action recognition result is a preset correct dissuasion action, the controller commands the first projector to project a scene in which the virtual person displays a safe behavior after dissuasion; otherwise, the controller commands the first projector to project a scene in which the virtual person suffers a dangerous result corresponding to the unsafe behavior;

[0026] Step 5: the first projector projects the scene corresponding to the command onto the main display screen according to the command of the controller.

[0027] In order to monitor the real-time distance between the experiencer and the main display screen when the experiencer moves toward the main display screen, so as to adjust the virtualized safety education scene projected on the main display screen, the interactive control method further includes:

[0028] When the experiencer faces the main display screen, the second laser radar obtains the distance between the experiencer and the virtual object in the fused safety education scene;

[0029] The second laser radar sends the acquired distance to the controller for processing;

[0030] The controller commands the projector to adjust the virtual distance between the virtual object and the experiencer according to the received distance;

[0031] The second projector adjusts the distance between the virtual object in the integrated safety education scene and the experiencer according to the virtual distance, and projects the adjusted safety education scene onto the main display screen.

[0032] Optionally, the virtual object is a person or / and an object. That is to say, in the interactive control method of safety education, the virtual object can be a person or an object, or both a person and an object.

[0033] Furthermore, the interactive control method in the invention also includes: the second projector adjusts the distance between the virtual object in the safety education scene and the experiencer according to the virtual distance, and projects and displays the virtual object at a position between the main display screen and the experiencer.

[0034] Furthermore, the interactive control method also includes: the second projector projects the integrated safety education scene corresponding to the moving distance of the experiencer to the main display screen onto the main display screen according to the moving distance of the experiencer to the main display screen.

[0035] Compared with the prior art, the advantages of the present invention are: in the safety education interactive solution based on augmented reality of the present invention, the actual scene of the experiencer's environment and the actions made by the experiencer are collected by a camera, and then the first projector fuses the above-mentioned actual scene with its own pre-stored virtualized safety scene to obtain a virtual-real integrated safety education scene, and projects the virtual-real integrated safety education scene onto the main display screen. In addition, according to the experiencer's dissuasive actions against the unsafe behaviors of the virtual object, the virtual scene corresponding to the different dissuasion results projected on the main display screen can be adjusted, thereby enhancing the experience effect of the experiencer on safety education in a virtual-real combination manner. In addition, according to the distance between the experiencer and the virtual object in the virtual scene, different virtual scenes can be displayed in the actual environment between the experiencer and the virtual scene, further enhancing the sense of reality of the safety education. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] Figure 1 Schematic diagram of a safety education interactive system based on augmented reality in an embodiment of the present invention;

[0037] Figure 2 for Figure 1 The flowchart of the interactive control method of the safety education interactive system is shown. DETAILED DESCRIPTION

[0038] The present invention is further described in detail below with reference to the accompanying drawings.

[0039] like Figure 1 As shown, this embodiment provides a safety education interactive system based on augmented reality. Specifically, the safety education interactive system includes:

[0040] The main display screen 1 is arranged on the wall 71; wherein a first laser radar 81 is arranged on the wall 71, and a second laser radar 82 is arranged on the ground 72 that the wall 71 contacts; here, by arranging the first laser radar 81 on the wall, the first laser radar 81 detects the touch position of the experiencer on the wall; the second laser radar 82 can not only detect the distance between the experiencer and the main display screen, but also detect the position of the experiencer on the ground projection range;

[0041] The camera 2 is arranged in front of the main display screen 1, and the camera 2 captures the actual scene including the environment in which the experiencer is located and the actual scene of the action; that is, the camera can capture the actual scene in which the experiencer is located, and can also capture the scene image when the experiencer is performing an action; the camera 2 adopts a wide-angle camera, and the camera 2 is arranged above the ground 72;

[0042] The first projector 31 projects the virtualized safety education scene stored in the projector 31 and the safety education scene after fusion of the actual scene onto the main display screen 11; wherein the fused safety education scene here can also be referred to as a virtual-real fusion safety education scene;

[0043] Network switch 4, connected to camera 2;

[0044] Audio playback device 5; the audio playback device 5 may be a commonly used speaker device;

[0045] The controller 6 is respectively connected to the main display screen 11, the first projector 31, the network switch 4, the audio playback device 5, the first laser radar 81 and the second laser radar 82. The controller 6 is connected to the audio playback device 5 via the power amplifier 92.

[0046] In addition, a secondary display screen 12 may be added to the safety education interactive system. The secondary display screen 12 may be a spliced ​​screen, that is, the spliced ​​screen is spliced ​​by multiple display units 10. The controller 6 may be connected to each display unit 10 via an HDMI distributor 91. The display unit 10 may be an LED display screen. The virtualized scene of safety education may also be displayed on the secondary display screen 12 as needed.

[0047] In order to obtain the position of the experiencer on the ground, so as to timely trigger the projector to change the safety education scene projected on the main display screen, in this embodiment, a second projector 32 is arranged on the ground 72, and the second projector 32 is connected to the controller 6. The second projector 32 can project the corresponding virtual scene on the main display screen located on the wall according to the address of the experiencer on the ground.

[0048] See also Figure 2 As shown, this embodiment also provides an interactive control method of the above safety education interactive system. Specifically, the interactive control method of the safety education interactive system includes the following steps:

[0049] Step 1, the camera 2 captures the actual scene including the environment and actions of the experiencer, and the first projector 31 fuses the virtualized safety education scene pre-stored in the projector 31 with the actual scene captured by the camera to obtain a fused safety education scene; the fused safety education scene here is a scene that combines virtuality and reality, so that the experiencer can truly feel the effect of augmented reality;

[0050] Step 2: The first projector 31 projects the above-mentioned integrated safety education scene onto the main display screen 11, and the main display screen 11 displays it; wherein the virtualized safety education scene here at least contains unsafe behaviors displayed by the virtual object; for example, the virtual object here is a tourist; the unsafe behavior performed by the tourist (virtual object) here may be running a red light when crossing the road;

[0051] Step 3, when the user faces the main display screen 11 and displays a dissuasive action to dissuade unsafe behavior, the camera 2 collects and recognizes the user's dissuasive action, and sends the recognition result of the dissuasive action to the controller 6; the user's dissuasive action can be waving a hand to indicate that the virtual object cannot run a red light or other dissuasive actions, and these dissuasive actions can be collected by the camera 2 and then sent to the controller 6 for judgment processing;

[0052] Step 4, the controller 6 makes a judgment on the received dissuasion action recognition result:

[0053] When the controller 6 determines that the dissuasion action recognition result is a preset correct dissuasion action, the controller 6 commands the first projector 31 to project a scene in which the virtual person shows a safe behavior after being dissuaded; otherwise, the controller 6 commands the first projector 31 to project a scene in which the virtual person suffers a dangerous result corresponding to the unsafe behavior; for example, if the unsafe behavior here is running a red light, then the corresponding dangerous result scene is being scratched by a motor vehicle driving normally on the road;

[0054] Step 5: The first projector 31 projects the scene corresponding to the command onto the main display screen 1 according to the command of the controller 6 .

[0055] In order to monitor the real-time distance between the experiencer and the main display screen when the experiencer moves toward the main display screen, so as to adjust the safety education scene projected on the main display screen, in this embodiment, when the experiencer faces the main display screen, the second laser radar 82 obtains the distance between the experiencer and the virtual object in the fused safety education scene;

[0056] The second laser radar 82 sends the acquired distance to the controller 6 for processing;

[0057] The controller 6 commands the second projector 32 to adjust the virtual distance between the virtual object and the experiencer according to the received distance;

[0058] The second projector 32 adjusts the distance between the virtual object in the integrated safety education scene and the experiencer according to the virtual distance, and projects the adjusted safety education scene onto the main display screen 1.

[0059] Of course, the second projector 32 can also adjust the distance between the virtual object in the integrated safety education scene and the experiencer according to the virtual distance, and project and display the virtual object at a position between the main display screen and the experiencer.

[0060] The second projector 32 can also project a fused safety education scene corresponding to the moving distance of the experiencer to the main display screen 1 onto the main display screen 1 .

[0061] In addition, in the interactive control method corresponding to the safety education interactive system, the controller can obtain the specific physical position of the wall being hit by the first laser radar based on the action of the tourist hitting the wall captured by the camera, and then convert the specific physical position of the hit into the corresponding coordinates on the main display screen. The projector then adjusts the virtual safety education scene projected on the main display screen according to the converted coordinates, so that the experiencer can experience the effect closer to the real situation in the virtual scene.

Claims

1. An interactive control method for a safety education interactive system, the safety education interactive system include: A main display screen (11) is arranged on a wall (71), a first laser radar (81) is arranged on the wall (71), and a second laser radar (82) and a second projector (32) are arranged on the ground (72) contacted by the wall (71); A camera (2) is arranged in front of the main display screen (11), and the camera (2) collects the actual scene of the environment in which the experiencer is located and the action of the experiencer; wherein the camera (2) is a wide-angle camera, and the camera (2) is arranged above the ground (72); A first projector (31) projects a safety education scene obtained by integrating a virtualized safety education scene with an actual scene onto a main display screen (11); A network switch (4) connected to the camera (2); Audio playback device (5); A controller (6) is respectively connected to the main display screen (11), the first projector (31), the network switch (4), the audio playback device (5), the first laser radar (81), the second laser radar (82) and the second projector (32); and, a secondary display screen (12), the secondary display screen (12) being formed by splicing a plurality of display units (10), the controller (6) being connected to each display unit (10) via an HDMI distributor (91); the controller (6) being connected to an audio playback device (5) via a power amplifier device (92); Characterized in that the interactive control method comprises the following steps: Step 1, the camera captures the actual scene including the environment and actions of the experiencer, and the first projector fuses the virtualized safety education scene pre-stored in the projector with the actual scene captured by the camera to obtain a fused safety education scene; Step 2, the first projector projects the integrated safety education scene onto the main display screen, and the main display screen displays it; wherein the virtualized safety education scene at least contains unsafe behaviors displayed by the virtual object; Step 3, when the experiencer faces the main display screen and displays a dissuasive action to dissuade the unsafe behavior, the camera collects and recognizes the experiencer's dissuasive action, and sends the recognition result of the dissuasive action to the controller; Step 4: the controller makes a judgment on the received dissuasion action recognition result: When the controller determines that the dissuasion action recognition result is a preset correct dissuasion action, the controller commands the first projector to project a scene in which the virtual person displays a safe behavior after dissuasion; otherwise, the controller commands the first projector to project a scene in which the virtual person suffers a dangerous result corresponding to the unsafe behavior; Step 5: the first projector projects the scene corresponding to the command onto the main display screen according to the command of the controller.

2. The interactive control method according to claim 1, It is characterized in that Also includes: When the experiencer faces the main display screen, the second laser radar obtains the distance between the experiencer and the virtual object in the fused safety education scene; The second laser radar sends the acquired distance to the controller for processing; The controller commands the projector to adjust the virtual distance between the virtual object and the experiencer according to the received distance; The second projector adjusts the distance between the virtual object in the integrated safety education scene and the experiencer according to the virtual distance, and projects the adjusted safety education scene onto the main display screen.

3. The interactive control method according to claim 2, It is characterized in that Also includes: The second projector adjusts the distance between the virtual object in the safety education scene and the experiencer according to the virtual distance, and projects and displays the virtual object at a position between the main display screen and the experiencer.

4. The interactive control method according to claim 1, It is characterized in that Also includes: The second projector projects the integrated safety education scene corresponding to the moving distance of the experiencer to the main display screen onto the main display screen.

5. The interactive control method according to claim 1, It is characterized in that The virtual object is a person or / and an object.

Images