Simulation light driving simulation device based on augmented reality

Abstract

The utility model provides a simulation light driving simulation device based on augmented reality. The simulation light driving simulation device comprises a vehicle, a first server, a second server and an AR display device. The vehicle is used for being taken by a driver, the first server is arranged in a machine room, the second server is arranged in the vehicle, and the second server is in wireless communication connection with the first server. And the second server can obtain the light simulation examination content and broadcast the content through voice. And the AR display device is in communication connection with the second server, is worn by a driver and can display a light simulation examination image. A driver wearing the AR display device can see the light simulation test image when listening to the prompt voice of the light simulation test. In this way, an examiner can easily understand a real scene corresponding to the voice broadcast content, so that the mastering degree of driving skills can be improved.

Description

Technical Field

[0001] This application belongs to the technical field of simulation driving, and more specifically, relates to a simulation lighting simulation driving device based on augmented reality. Background Art

[0002] In the driver's license examination, the lighting simulation examination is an indispensable part of the driver's license examination, and it is of great significance for cultivating driving habits, enhancing driving skills, adapting to the actual driving environment, and improving traffic safety awareness. The lighting simulation examination is one of the important ways to cultivate driving habits.

[0003] In the lighting simulation examination, the road conditions and driving states are played through voice, and it is difficult for the examinees to understand the real scenes corresponding to the voice broadcasts, so the examinees have a poor mastery of driving skills. Utility Model Content

[0004] The purpose of the embodiments of this application is to provide a simulation lighting simulation driving device based on augmented reality to solve the problems in the prior art that it is difficult for examinees to understand the real scenes corresponding to the voice broadcasts and the examinees have a poor mastery of driving skills.

[0005] To achieve the above object, the technical solution adopted in this application is: to provide a simulation lighting simulation driving device based on augmented reality, and the simulation lighting simulation driving device includes a vehicle, a first server, a second server, and an AR display device.

[0006] The vehicle is for the driver to ride in. Among them, the driver includes the driver and the co-driver. The driver is the examinee, and the co-driver can be an invigilator or a coach. The main driver sits on the driver's seat in the main driving position, and the co-driver sits on the co-driver's seat in the co-driving position.

[0007] The first server is set in the computer room, and the second server is set in the vehicle. The second server is wirelessly communicatively connected to the first server. The first server can be wirelessly communicatively connected to the second servers in multiple vehicles and can obtain the examination information of examinees in different vehicles. The second server can obtain the content of the lighting simulation examination and broadcast it through voice.

[0008] The AR display device is communicatively connected to the second server and is for the driver to wear and can display the lighting simulation examination images. When the driver wears the AR display device, the driver can see the lighting simulation examination images when listening to the lighting simulation examination prompt voice.

[0009] In this way, it is easy for the examinees to understand the real scenes corresponding to the voice broadcasts, so that the mastery of driving skills can be improved.

[0010] In some embodiments of the present application, the simulated lighting driving device includes a simulated lighting system, and the simulated lighting system is installed in one of the first server, the second server, and the AR display device. In this way, the AR display device can display the lighting simulation exam image through the simulated lighting system.

[0011] In some embodiments of the present application, there are two AR display devices, which are respectively communicatively connected to the second server. One AR display device is for the main driver to wear, and the other AR display device is for the co-driver to wear. In this way, the main driver and the co-driver can simultaneously see the lighting simulation exam image, and the co-driver can real-time master the simulation exam situation of the main driver.

[0012] In some embodiments of the present application, the AR display device is communicatively connected to the second server by wire, or the AR display device is communicatively connected to the second server wirelessly. The AR display device being communicatively connected to the second server by wire is beneficial to avoid the loss of the AR display device and has good signal stability. The AR display device being communicatively connected to the second server wirelessly is convenient for the driver to wear.

[0013] In some embodiments of the present application, the simulated lighting driving device further includes an exam road, and the vehicle is located on the exam road. In this way, the driver can conduct a simulation exam in a situation closer to the real scene.

[0014] In some embodiments of the present application, the exam road is a straight road, and the length of the exam road is greater than or equal to 100 m. In this way, the exam road can provide an open field of vision, and the driver conducts a simulation exam under an open field of vision, which is closer to the real scene.

[0015] In some embodiments of the present application, the AR display device includes a glasses body and a projection display component. The glasses body is for the driver to wear, and the projection display component is arranged on the glasses body and is used to display the lighting simulation exam image. In this way, it is convenient for the driver to wear the AR display device.

[0016] In some embodiments of the present application, the glasses body includes a glasses frame and glasses legs, the projection display component is arranged on the glasses frame, and the glasses legs are connected to the glasses frame. In this way, the shape of the AR display device is close to that of ordinary glasses, and the driver can conduct a simulation exam in a situation closer to the real scene.

[0017] In some embodiments of the present application, the AR display device further includes a speaker, and the speaker is used to play the lighting simulation exam prompt sound. In this way, the AR display device can play the lighting simulation exam prompt sound, and the driver can clearly hear the lighting simulation exam prompt sound.

[0018] In some embodiments of the present application, the speaker is disposed at one end of the temple away from the spectacle frame. In this way, after the driver wears the AR display device, the speaker is close to the ear, and the driver can hear the prompt sound of the simulated lighting examination more clearly. Description of the Drawings

[0019] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0020] Figure 1 Structural schematic of the augmented reality-based simulated lighting driving device provided by the embodiment of the present application Figure 1 ;

[0021] Figure 2 Structural schematic of the vehicle provided by the embodiment of the present application;

[0022] Figure 3 Internal structural schematic of the vehicle provided by the embodiment of the present application;

[0023] Figure 4 Structural schematic of the AR display device provided by the embodiment of the present application;

[0024] Figure 5 Schematic of the driver wearing the AR display device provided by the embodiment of the present application;

[0025] Figure 6 Structural schematic of the augmented reality-based simulated lighting driving device provided by the embodiment of the present application Figure 2 ;

[0026] Figure 7 Schematic of the lighting simulation examination image displayed by the AR display device provided by the embodiment of the present application Figure 1 ;

[0027] Figure 8 Schematic of the lighting simulation examination image displayed by the AR display device provided by the embodiment of the present application Figure 2 ;

[0028] Figure 9 Schematic of the lighting simulation examination image displayed by the AR display device provided by the embodiment of the present application Figure 3 .

[0029] Among them, the reference numerals in the figures:

[0030] 1 - Vehicle; 101 - Driver's seat; 102 - Passenger seat; 11 - Central console; 12 - Second server; 13 - Front windshield; 2 - AR display device; 21 - Glasses body; 211 - Temple; 212 - Frame; 22 - Projection display component; 23 - Speaker; 3 - Examination road; 4 - Virtual vehicle; 5 - Virtual crosswalk; Detailed implementation manner

[0031] In order to make the technical problems, technical solutions and beneficial effects to be solved by the present application clearer and more understandable, the present application will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0032] It should be noted that when an element is referred to as being "fixed to" or "disposed on" another element, it can be directly on the other element or indirectly on the other element. When an element is referred to as being "connected to" another element, it can be directly connected to the other element or indirectly connected to the other element.

[0033] It should be understood that the orientation or positional relationship indicated by the terms "length", "width", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", etc. is based on the orientation or positional relationship shown in the accompanying drawings, and is only for the convenience of describing the present application and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation to the present application.

[0034] In addition, the terms "first" and "second" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly indicating the quantity of the indicated technical features. Thus, the features defined with "first" and "second" may explicitly or implicitly include one or more of such features. In the description of the present application, "a plurality" means two or more unless otherwise specifically defined.

[0035] In the driver's license examination, the lighting simulation examination is an essential part of the driver's license examination, and it is of great significance for cultivating driving habits, enhancing driving skills, adapting to the actual driving environment, and improving traffic safety awareness. The lighting simulation examination is one of the important ways to cultivate driving habits. In the driving process, the correct use of lights is an important factor to ensure safety. Through the lighting simulation examination, one can master the methods of using lights in different situations proficiently and develop good driving habits. At the same time, the lighting simulation examination is an important link to enhance driving skills. The lighting simulation examination can help one master the relevant knowledge and skills proficiently and lay a solid foundation for safe driving in the future.

[0036] Drivers need to master the use of lights in different situations and correctly identify traffic lights and signs. These skills are very important in actual driving and can improve driving skills and enhance safety awareness. Furthermore, the lighting simulation test can help candidates adapt to the actual driving environment. At night or in bad weather such as rain and fog, the correct use of lights can increase visibility and the probability of being noticed by other vehicles, thereby improving driving safety.

[0037] Augmented Reality (AR) technology is a technology that cleverly integrates virtual information with the real world. It widely uses a variety of technical means such as multimedia, three-dimensional modeling, real-time tracking and registration, intelligent interaction, and sensing. It simulates computer-generated virtual information such as text, images, three-dimensional models, music, and videos, and applies them to the real world. The two types of information complement each other, thereby achieving "enhancement" of the real world.

[0038] In the related art, the lighting simulation test uses voice to play the road conditions and driving status. It is difficult for the examinee to understand the real scene corresponding to the voice broadcast content, and thus the mastery of driving skills is poor.

[0039] See also Figure 1 Now, the simulated light driving simulation device based on augmented reality provided in the embodiment of the present application is described. The simulated light driving simulation device includes a vehicle, a first server, a second server and an AR display device.

[0040] See also Figure 2 and Figure 3 The vehicle 1 includes a center console 11, a main driving seat 101 and a co-pilot seat 102. The center console 11 is located between the main driving seat 101 and the co-pilot seat 102. The second server 12 is arranged in the vehicle 1 and installed on the center console 11. The vehicle 1 is used for the driver to ride, wherein the driver includes the driver and the co-pilot. The driver is the examiner, and the co-pilot can be the invigilator or the coach. The main driver sits in the main driving seat 101 (not shown in the figure), and the co-pilot sits in the co-pilot seat 102 (not shown in the figure). The driver can see the road conditions ahead through the front windshield 13 in the car.

[0041] The first server (not shown in the figure) is arranged in a machine room (not shown in the figure), and the second server 12 is arranged in the vehicle 1, and the second server 12 is wirelessly connected to the first server. The first server can be wirelessly connected to the second servers 12 in multiple vehicles 1, and can obtain the test information of the examinees in different vehicles 1. The second server 12 can obtain the content of the lighting simulation test and broadcast it through voice.

[0042] It can be understood that the first server is a terminal server, and the second server 12 is a relay server. Exemplarily, both the first server and the second server 12 can be PowerEdge R750 servers produced by Dell EMC, which can be used for data storage and management, data processing and analysis, content distribution, network connection, etc. The specific performance parameters can be: processor: Intel Gold Generation 3, Xeon Gold 6330, 2GHz, intelligent acceleration main frequency 3.1GHz; cores: twenty-eight cores; number of threads: fifty-six threads; memory: DDR4, 64GB; storage: SAS, 1.8TB, 2 pieces of 900GB 15K RPM SAS12Gbps 512n 2.5-inch hot-swappable hard disks; network controller: dual gigabit network cards.

[0043] The AR display device (not shown in the figure) is communicatively connected to the second server 12 and is for the driver to wear and can display the light simulation exam image. When the driver wears the AR display device, they can see the light simulation exam image while listening to the light simulation exam prompt voice.

[0044] In this way, it is easy for the examinee to understand the real scene corresponding to the voice broadcast content, thereby improving the mastery of driving skills.

[0045] Please refer to Figure 4 and Figure 5 , in some embodiments of the present application, the AR display device 2 includes a glasses body 21 for the driver to wear, and the driver can wear the AR display device 2 through the glasses body 21. The AR display device 2 can be worn like ordinary glasses, so that it is convenient for the driver to wear the AR display device 2.

[0046] The glasses body 21 includes a glasses frame 212 and temple arms 211. The projection display component 22 is disposed on the glasses frame 212, and the temple arms 211 are connected to the glasses frame 212. There are two temple arms 211, and the two temple arms 211 are spaced apart along the width direction of the glasses frame 212 (such as Figure 4 the A direction in the figure), and the two temple arms 211 are respectively connected to both ends of the glasses frame 212 in the width direction, that is, one temple arm 211 is connected to one end of the glasses frame 212 in the width direction, and the other temple arm 211 is connected to one end of the glasses frame 212 in the width direction.

[0047] One end of the temple arm 211 in the length direction (such as Figure 4 the B direction in the figure) is connected to the glasses frame 212, and the other end is clamped on the ear. Among them, the A direction and the B direction intersect. Exemplarily, the A direction and the B direction are perpendicular to each other. In this way, the shape of the AR display device 2 is close to that of ordinary glasses, and the driver can perform the simulation exam in a situation closer to the real scene.

[0048] Please continue to refer to Figure 4 and Figure 5 The AR display device 2 further includes a projection display component 22, which is arranged on the spectacle body 21 and is used for displaying the light simulation examination image.

[0049] The spectacle frame 212 has two holes, and ordinary lenses can be arranged at the two holes. After the driver wears the AR display device 2 conveniently, the driver can view the road conditions ahead through the holes. The projection display component 22 is arranged at the two holes and is located on the back side of the spectacle frame 212 (the side where the spectacle leg 211 is located). The AR display device 2 can be worn like ordinary glasses, so that the driver can wear the AR display device 2 conveniently.

[0050] It can be understood that the AR display device 2 is a product well-known to those skilled in the art, and the detailed principles and structures of the AR display device 2 will not be elaborated here.

[0051] In some embodiments of the present application, please continue to refer to Figure 4 and Figure 5 The AR display device 2 further includes a speaker 23, and the speaker 23 is used for playing the light simulation examination prompt sound. In this way, the speaker 23 can replace the second server 12 to play the light simulation examination prompt sound, and the driver can clearly hear the light simulation examination prompt sound. While the projection display component 22 displays the light simulation examination image, the speaker 23 can play the light simulation examination prompt sound, and the synchronization of the light simulation examination image and the light simulation examination prompt sound is good.

[0052] Exemplarily, the speaker 23 is arranged at one end of the spectacle leg 211 far from the spectacle frame 212. In this way, after the driver wears the AR display device 2, the speaker 23 is close to the ear, and the driver can more clearly hear the light simulation examination prompt sound.

[0053] Exemplarily, the speaker 23 can be an in-ear speaker 23, and is in wired or wireless communication connection with the second server 12, and the driver can more clearly hear the light simulation examination prompt sound.

[0054] In some embodiments of the present application, the simulated light simulation driving device includes a simulated light simulation system, and the simulated light simulation system is installed in one of the first server, the second server 12 and the AR display device 2. In this way, the AR display device 2 can display the light simulation examination image through the simulated light simulation system.

[0055] Exemplarily, the simulated light simulation system is installed in the first server.

[0056] Exemplarily, the simulated light simulation system is installed in the second server 12.

[0057] Exemplarily, the simulation lighting simulation system is installed in the AR display device 2.

[0058] It can be understood that the lighting simulation system is formed through 3D modeling. Exemplarily, the lighting simulation system is formed through Unity modeling.

[0059] Unity is a well-known real-time 3D interactive content creation and operation platform for those skilled in the art. The Unity platform provides a complete set of software solutions that can be used to create, operate, and monetize any real-time interactive 2D and 3D content, and the supported platforms include mobile phones, tablets, PCs, game consoles, augmented reality, and virtual reality devices. Those skilled in the art can use Unity to form the lighting simulation system.

[0060] For example, the simulated lighting simulation system will form corresponding scene picture information through previous Unity modeling. At this time, the scene picture information is transmitted to the video signal access end of the flexible printed circuit (FPC) of the optical waveguide module in the projection display component 22 through a video signal.

[0061] Unity modeling is a well-known technical means for those skilled in the art and will not be elaborated here.

[0062] Since the image information of the left and right eyes with image differences is input, there is a certain parallax, so the seen virtual vehicle pictures will have different distances of near and far. At this time, different distances of the vehicle 1 moving straight ahead and moving left and backward can be realized. The AR display device 2 and the second server 12 will be connected for wired or wireless transmission. The first server in the computer room is wirelessly connected to the second server 12 in the vehicle 1, so that the examination signal of the first server can enter the AR display device 2 through the second server 12, enabling the driver to receive the information of the next scene.

[0063] In some embodiments of the present application, there are two AR display devices 2, which are respectively communicatively connected to the second server 12. After one AR display device 2 is connected to the second server 12, it is for the main driver to wear, and the main driver can watch the lighting simulation examination image through the worn AR display device 2. After the other AR display device 2 is connected to the second server 12, it is for the co-driver to wear, and the co-driver can also watch the lighting simulation examination image through the worn AR display device 2. In this way, the main driver and the co-driver can see the lighting simulation examination image at the same time, and the co-driver can grasp the simulation examination situation of the main driver in real time.

[0064] In some embodiments of the present application, the AR display device 2 is in wired communication connection with the second server 12, and the AR display device 2 and the second server 12 are connected through a communication line. If the driver forgets to remove the AR display device 2, the communication line connects the AR display device 2, and the driver cannot take away the AR display device 2, which is conducive to avoiding the loss of the AR display device 2. In addition, the communication line is less affected by the outside world, and the signal stability of the wired communication connection between the AR display device 2 and the second server 12 is good.

[0065] In some other embodiments of the present application, the AR display device 2 is in wireless communication connection with the second server 12, without being restricted by the communication line, which is convenient for the driver to wear and remove.

[0066] Please refer to Figure 6 , in some embodiments of the present application, the simulation lighting simulation driving device further includes a test road 3, and the vehicle 1 is located on the test road 3. In this way, the driver can conduct a simulation test under a more realistic scenario.

[0067] Exemplarily, the test road 3 is a straight road. Exemplarily, the length of the test road 3 is greater than or equal to 100 m. Exemplarily, the length of the test road 3 is equal to 100 m. In this way, the test road 3 can provide an open field of vision, and the driver can conduct a simulation test under the open field of vision, which is closer to the real scenario.

[0068] It can be understood that the application of augmented reality technology to simulation driving is of great significance. AR technology can combine the virtual world and the real world to provide a more real and intuitive driving experience for the driver.

[0069] Through AR technology, the driver can see a more realistic road scene in simulation driving, including road signs, traffic lights, the vehicle 1, etc., so as to more truly feel the actual situation of driving. Through AR technology, the driver can receive more realistic driving training in simulation driving and improve driving skills. In simulation driving, the driver can more clearly see the state of the vehicle 1 and the situation of the road, so as to better master driving skills and improve driving skills. With the continuous development and improvement of technology, the application of AR technology in the automotive industry will be more and more extensive, providing a more convenient, safe and interesting driving experience for the driver.

[0070] In the embodiment of the present application, the vehicle 1 is located on the test road 3, and through the AR display device 2, the lighting simulation test image can be combined with the actual test road 3 to provide a more real and intuitive simulation driving test for the driver.

[0071] In an embodiment of the present application, the real examination vehicle 1 is parked on the examination road 3 with an open view, and the driver is sitting inside the examination vehicle 1. The driver wears the AR display device 2 with a simulation lighting system. The front end of the AR display device 2 is similar to an ordinary spectacle lens and can display in a transmissive and transparent manner. Those skilled in the art can understand that the operator can normally see the information inside the real vehicle 1 and the real scene information of the examination road 3 through the spectacle lens.

[0072] In the traditional lighting simulation examination, the examination vehicle 1 emits voice prompts corresponding to the scenarios, and the operator performs corresponding lighting simulation operations. In an embodiment of the present application, the driver wears the AR display device 2. The optical waveguide of the AR display device 2 has an appearance similar to an ordinary spectacle lens and can display augmented reality image information, and can form a virtual collocation with a preset size at a preset distance in front of a person. When the local virtual information is black, that is, there is no light, it is displayed in a transmissive manner.

[0073] Exemplarily, the preset distance is greater than or equal to 3m and less than or equal to 5m. Exemplarily, the preset distance is 3m or 5m.

[0074] Exemplarily, the preset size is greater than or equal to 30 inches and less than or equal to 80 inches. Exemplarily, the preset size is 30 inches or 80 inches.

[0075] When the driver conducts the lighting simulation examination, the items of the lighting simulation examination include overtaking the vehicle in front at night, following a vehicle closely in the same direction at night, meeting other vehicles, passing through a crosswalk, etc.

[0076] Overtaking the vehicle in front at night: First turn on the left turn signal, then alternately use the high and low beams (alternate the high and low beams at least twice), and finally turn on the right turn signal; Following a vehicle closely in the same direction at night: Keep the headlight (low beam) on; Meeting other vehicles: Keep the headlight (low beam) on; Passing through a crosswalk: Alternately use the high and low beams (alternate the high and low beams at least twice).

[0077] Please refer to Figure 7 , when the driver conducts the lighting simulation examinations of overtaking the vehicle 1 in front at night and following a vehicle closely in the same direction at night, through the AR display device 2, the driver will see Figure 7 the real examination road 3 in , and there is a virtual vehicle 4 moving ahead on the road, providing a real and intuitive driving experience.

[0078] Please refer to Figure 8 , when the driver conducts the lighting simulation examination of meeting other vehicles 1, through the AR display device 2, the driver will see Figure 8In the real test road 3 and the virtual vehicle 4, there is a virtual vehicle 4 traveling in the opposite direction on the reverse lane, providing a real and intuitive driving experience.

[0079] Please refer to Figure 9 , when the driver is taking the light simulation test for passing through a crosswalk, through the AR display device 2, the driver will see Figure 9 the real test road 3 and the virtual crosswalk 5 in , providing a real and intuitive driving experience.

[0080] It can be understood that when the driver uses the AR display device 2 to take the light simulation test, the driver can watch a dynamic scene.

[0081] For example, when performing the light simulation of overtaking the vehicle in front at night, the virtual display screen will prompt that the next scene is overtaking the vehicle in front at night. At this time, through the AR display device 2, a virtual vehicle 4 can be seen traveling in front of the test road 3. Subsequently, the driver operates the alternating high and low beam lights, and finally turns on the right turn signal. At this time, the vehicle at night in the direct front gradually moves to the position of the left rear, realizing the overtaking scene on the road in the real scene.

[0082] The above description is only for the specific scene of overtaking the vehicle in front at night. The simulation light simulation can also include the simulation operations of road signs, tunnels and other scenes.

[0083] The above are only the preferred embodiments of the present application and are not intended to limit the present application. Any modifications, equivalent replacements, and improvements made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims

1. An augmented reality-based simulation lighting driving device, characterized in that, Including: A vehicle for a driver to ride in; A first server installed in a computer room; A second server installed in the vehicle and wirelessly communicatively connected to the first server; And, An AR display device communicatively connected to the second server, for the driver to wear and capable of displaying a simulated lighting exam image; The simulated lighting driving device includes a simulated lighting simulation system installed in one of the first server, the second server and the AR display device; There are two AR display devices, respectively communicatively connected to the second server. One AR display device is for the main driver to wear, and the other AR display device is for the co-driver to wear.

2. The simulation lighting driving device according to claim 1, wherein The AR display device is communicatively connected to the second server by wire, or the AR display device is wirelessly communicatively connected to the second server.

3. The simulation lighting driving device according to claim 1, wherein The simulated lighting driving device further includes an exam road, and the vehicle is located on the exam road.

4. The simulated lighting driving device according to claim 3, wherein The exam road is a straight road, and the length of the exam road is greater than or equal to 100 m.

5. The simulated lighting driving device according to claim 1, wherein The AR display device includes: A glasses body for the driver to wear; and, A projection display component disposed on the glasses body for displaying a simulated lighting exam image.

6. The simulated lighting driving device according to claim 5, wherein The glasses body includes: A glasses frame, and the projection display component is disposed on the glasses frame; and, Glasses legs connected to the glasses frame.

7. The simulation lighting driving device according to claim 6, wherein, The AR display device further includes a speaker for playing a simulated lighting exam prompt sound.

8. The simulated lighting driving device according to claim 7, characterized in that, The speaker is disposed at one end of the glasses leg away from the glasses frame.

Images