Vehicle-road cooperative voice interaction system

Abstract

The present application provides a vehicle-road cooperative voice interaction system, comprising: at least one set of first directional sound-transmitting and receiving devices arranged along the lanes for covering at least one lane, forming directional sound coverage of a section of the lane as a coverage area; the vehicle is equipped with a second directional sound-transmitting and receiving device; wherein the first directional sound-transmitting and receiving device and the second directional sound-transmitting and receiving device are arranged opposite to each other; if it is detected that the vehicle is about to enter the coverage area, the first and second directional sound-transmitting and receiving devices are turned on in advance to form directional sound communication between the first directional sound-transmitting and receiving device and the second directional sound-transmitting and receiving device, thereby completing the directional transmission and reception of sound information of vehicle-road cooperation; the present application breaks through the limitation that there is no direct audio information communication between roads and vehicles, and the relevant management departments cannot obtain the information in the vehicle in the first time, and the vehicle cannot obtain the latest road information in the first time, thereby realizing vehicle-road cooperative communication to the greatest extent; the present application also breaks through the barrier of sound isolation caused by the good sealing of the vehicle to ensure information privacy.

Description

Technical Field

[0001] The present application relates to the field of directional sound transmission technology, and also to the field of intelligent transportation, and in particular to a vehicle-road collaborative voice interaction system. Background Art

[0002] Traffic signs are commonly used on highways, city roads, expressways, and all other dedicated roads to manage traffic, indicate driving directions, and ensure smooth and safe traffic flow, thereby alerting drivers. For example, related technologies use either visual warnings or traditional voice or video announcements to achieve this purpose. In highly reflective areas like tunnels, this can minimize sound reflections and echoes, improving the accuracy of sound content captured by vehicles.

[0003] However, due to the airtightness of vehicles, voice broadcasts cannot be effectively delivered directly into the vehicle, and they also cause severe noise interference to surrounding vehicles or areas. Therefore, a method for vehicle-road cooperative interaction that does not cause strong sound interference to the surrounding area and does not require opening the car windows is urgently needed.

[0004] Application Contents

[0005] In view of the shortcomings of the existing technology mentioned above, the purpose of this application is to provide a vehicle-road cooperative voice interaction system to solve the problem in the existing technology that the volume of the vehicle-road cooperative voice interaction system is too loud, causing sound pollution, and at the same time, it is impossible to achieve directional sound reception and transmission between the vehicle and the road and real-time broadcast transmission.

[0006] To achieve the above objectives and other related objectives, the present application provides a vehicle-road cooperative voice interaction system, including:

[0007] At least one set of first directional sound transmitting and receiving devices is arranged along the lanes to cover at least one lane, forming a coverage area for directional sound coverage of a section of the lane;

[0008] A vehicle is traveling on the lane, and the vehicle is equipped with a second directional sound transmitting and receiving device; wherein the first directional sound transmitting and receiving device and the second directional sound transmitting and receiving device are arranged facing each other;

[0009] If it is detected that a vehicle is about to enter the coverage area, the first directional sound transmitting and receiving device in the lane and the second directional sound transmitting and receiving device in the vehicle are turned on in advance, so that directional sound communication is established between the first directional sound transmitting and receiving device and the second directional sound transmitting and receiving device, thereby completing the directional transmission and reception of sound information for vehicle-road collaboration;

[0010] Among them, the first and second directional sound receiving and transmitting devices include a directional microphone array and a directional sound-emitting loudspeaker. The directional microphone array is used for directionally receiving sound information; the directional sound-emitting loudspeaker is used for directionally sending sound information.

[0011] In one embodiment of the present application, the first directional sound transmitting and receiving device is obliquely arranged above the lane, and the second directional sound transmitting and receiving device is obliquely arranged on the top of the vehicle and inside the vehicle.

[0012] In one embodiment of the present application, the directional sound speaker includes an ultrasonic parametric array or a full-range speaker line array.

[0013] In one embodiment of the present application, it further includes:

[0014] The first location acquisition module is used to obtain the current location information of the vehicle in real time;

[0015] a first control module, connected to the first directional sound transceiver and the first position acquisition module, respectively, and, based on the position information, when detecting that the vehicle has entered the preset coverage area, turning on the first directional sound transceiver and, at the same time, sending a first trigger instruction to control the directional sound speaker on the lane to emit directional sound information, and to control the directional microphone array on the lane to receive the directional sound information, wherein the road management agency manages turning on or off the first directional sound transceiver and the content of the pre-cached sound information by controlling the first control module;

[0016] A second control module is installed on the vehicle and is respectively connected to the second directional sound receiving and transmitting device and the first position acquisition module. Based on the position information, when it is monitored that the vehicle is driving into the preset coverage area, the second directional sound receiving and transmitting device of the vehicle is turned on. At the same time, a second trigger instruction is sent to control the directional sound speaker on the vehicle to emit the directional sound information, and to control the directional microphone array on the vehicle to receive the directional sound information from the first directional sound receiving and transmitting device. The road management agency or the vehicle driver manages the opening or closing of the second directional sound receiving and transmitting device by controlling the second control module.

[0017] In one embodiment of the present application, it further includes:

[0018] A first image acquisition module acquires license plate numbers of vehicles traveling on lanes in or near the coverage area;

[0019] The second location acquisition module is used to obtain the current location information of the vehicle in real time;

[0020] The third control module is respectively connected to the first directional sound receiving and transmitting device, the first image acquisition module and the second position acquisition module, and is used to determine the vehicle information entering the coverage area based on the position information and the license plate number; if the vehicle information has associated mapped sound information, a third trigger instruction is sent to control the directional sound speaker on the lane to emit associated mapped sound information, and control the directional microphone array on the lane to receive the sound information from the vehicle and forward it to the designated department; if the vehicle information does not have associated mapped sound information, a fourth trigger instruction is sent to control the directional sound speaker on the lane to emit preset sound information, and control the directional microphone array on the lane to receive the sound information from the vehicle and forward it to the designated department.

[0021] In one embodiment of the present application, the first control module provides a first control port to the road management department or the traffic police control center for managing the opening or closing of the first directional transceiver and the content of the pre-cached sound information; the second control module provides a second control port to the road management agency or the vehicle driver for managing the opening or closing of the second directional transceiver.

[0022] In one embodiment of the present application, the third control module provides a second control port to the road management department or the traffic police control center for receiving the corresponding sound information of the illegal vehicle; or, further for receiving preset sound information.

[0023] In one embodiment of the present application, it further includes:

[0024] The vehicle is equipped with a direction-adjustable rotating mechanism; wherein the second directional sound transmitting and receiving device is installed on the rotating mechanism;

[0025] A fourth control module is connected to the rotating mechanism and the second directional sound-receiving and transmitting device, respectively, and is used to adjust the inclination angle of the rotating mechanism according to the inclination angle and coverage range corresponding to the coverage area formed by the next first directional sound-receiving and transmitting device at the lane installation position, so that the inclination angle and coverage range of the second directional sound-receiving and transmitting device match the inclination angle and coverage range of the next first directional sound-receiving and transmitting device.

[0026] In one embodiment of the present application, it also includes: a noise collection microphone arranged in the vehicle and connected to the fourth control module, which is used to collect the ambient noise in the vehicle, and the ambient noise refers to the sound other than the sound emitted by the sender of the voice signal; the fourth control module also includes: a noise elimination module, which subtracts the collected user's voice signal from the ambient noise to determine the sound information.

[0027] In one embodiment of the present application, it also includes: the sound information directionally sent by the first directional sound transmitting and receiving device is randomly encrypted, the directional microphone array corresponding to the second directional sound transmitting and receiving device of the vehicle directionally receives the encrypted sound information, and the encrypted sound information is decrypted using the secret key pre-stored in the vehicle, and the sound information is played in the vehicle; each of the vehicles corresponds to an encryption and decryption key.

[0028] As described above, the vehicle-road cooperative voice interaction system of the present application has the following beneficial effects:

[0029] First, this application enables directional sound broadcasting to vehicles traveling in designated lanes or areas without causing any interference, noise pollution, or misleading sound to the surrounding environment or lanes. It also provides necessary and timely sound prompts or warnings to vehicles in designated locations, ensuring maximum road safety. Second, this application includes a road-based directional sound transmission and reception system (i.e., a first directional sound transmission and reception device) and an on-board directional sound transmission and reception system (i.e., a second directional sound transmission and reception device). Both systems possess directional sound transmission and reception capabilities, forming a closed loop of vehicle-road sound interaction. This overcomes the barrier of sound isolation inherent in the vehicle's airtightness, allowing the sound broadcast from the directional loudspeaker in the tunnel to reach the interior of the vehicle through the on-board directional microphone array, allowing the driver to clearly hear and receive information from relevant traffic management departments immediately, ensuring vehicle safety. Furthermore, the application also provides isolation and shielding from other unrelated vehicles or environmental noise outside the vehicle. Third, through this application, regular, standardized and humanized voice warnings or anti-fatigue prompts will be provided for sections or areas that are prone to long-term dangers, have poor road conditions or changeable environments; traffic accidents will be avoided to the greatest extent, and scientific management of roads and vehicles will be achieved, further realizing intelligent vehicle-road collaboration. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] Figure 1 The display shows a structural block diagram of a vehicle-road cooperative voice interaction system provided by this application;

[0031] Figure 2 The display shows an implementation effect diagram of an embodiment of a vehicle-road cooperative voice interaction system provided by the present application;

[0032] Figure 3 Shown is an application scenario diagram of an embodiment of a vehicle-road collaborative voice interaction system provided by the present application. DETAILED DESCRIPTION

[0033] The following describes the implementation of the present application through specific embodiments. People familiar with this technology can easily understand other advantages and effects of the present application from the contents disclosed in this specification.

[0034] See also Figures 1 to 3. It should be noted that the structures, proportions, sizes, etc. illustrated in the drawings of this specification are only used to match the contents disclosed in the specification for people familiar with this technology to understand and read, and are not used to limit the limiting conditions for the implementation of this application. Therefore, they have no substantive technical significance. Any modification of the structure, change in the proportional relationship or adjustment of the size should still fall within the scope of the technical content disclosed in this application without affecting the efficacy and purpose that can be achieved by this application. At the same time, the terms such as "upper", "lower", "left", "right", "middle" and "one" quoted in this specification are only for the convenience of description, and are not used to limit the scope of the implementation of this application. Changes or adjustments in their relative relationships should also be regarded as the scope of the implementation of this application without substantially changing the technical content.

[0035] See also Figure 1 , this application provides a perspective structure diagram of a vehicle-road cooperative voice interaction system, including:

[0036] At least one set of first directional sound transmitting and receiving devices is arranged along the lanes to cover at least one lane, forming a coverage area for directional sound coverage of a section of the lane;

[0037] A vehicle is traveling on the lane, and the vehicle is equipped with a second directional sound transmitting and receiving device; wherein the first directional sound transmitting and receiving device and the second directional sound transmitting and receiving device are arranged facing each other;

[0038] If it is detected that a vehicle is about to enter the coverage area, the first directional sound transmitting and receiving device in the lane and the second directional sound transmitting and receiving device in the vehicle are turned on in advance, so that directional sound communication is established between the first directional sound transmitting and receiving device and the second directional sound transmitting and receiving device, thereby completing the directional transmission and reception of sound information for vehicle-road collaboration;

[0039] Among them, the first and second directional sound receiving and transmitting devices include a directional microphone array and a directional sound-emitting loudspeaker. The directional microphone array is used for directionally receiving sound information; the directional sound-emitting loudspeaker is used for directionally sending sound information.

[0040] It should be noted that the present application can install a directional sound transceiver system (i.e., a first directional sound transceiver device) at a designated location on a road, highway or tunnel, and cooperate with a vehicle-mounted directional sound transceiver system (i.e., a second directional sound transceiver device) to establish directional sound communication between the first directional sound transceiver device and the second directional sound transceiver device to perform directional broadcasting and voice interaction with vehicles in the designated lane.

[0041] The directional sound speaker includes an ultrasonic parametric array or a full-range speaker line array. For example, the directional sound speaker, that is, an ultrasonic array speaker, is used to modulate audio signals (mainly referring to audible sounds, such as human voices, or sounds with a frequency of 20HZ~20000HZ) into ultrasonic signals (frequency greater than 20KHZ) for transmission; that is, the audio signal is modulated into the ultrasonic signal using the ultrasonic signal as a carrier, and the low-frequency audio signal is modulated into a high-frequency ultrasonic signal; wherein, the ultrasonic array speaker 1 includes a plurality of evenly arranged ultrasonic transducers, and an ultrasonic array speaker composed of ultrasonic transducers, wherein the shape of the array can be square or circular, and the external shape of the ultrasonic transducer can be square, circular, elliptical, hemispherical, or cylindrical. Here, its shape is preferably circular, and the resonant frequency of the ultrasonic transducer is between 20~500khz.

[0042] In another example, the invention further includes: a reflector, which is arranged at an angle in the transmission direction of the ultrasonic array speaker to directionally reflect the ultrasonic signal.

[0043] Specifically, the use of angled reflection reduces the noise of the ultrasonic signal caused by speaker resonance. At the same time, the use of angled reflection allows receivers at a slightly closer distance to hear it clearly without having to wait for the noise in the ultrasonic signal to be eliminated by air propagation.

[0044] For example, the reflector is set in the sound transmission direction of the ultrasonic array speaker, and the two are at an angle. When the ultrasonic signal emitted by the ultrasonic array speaker is evenly reflected by the reflector and output, the ultrasonic signal will consume the resonance noise caused by the speaker resonance after reflection, but the more times of reflection, the faster the signal attenuates. Given the frequency range of the ultrasonic signal, its signal strength is just enough to not generate too much interference signal after one reflection. At the same time, the remaining noise can be consumed through air propagation, and it can also be transmitted to the receiver in a directionally similar to light. Therefore, the reflected ultrasonic signal can be self-demodulated into audible sound during the transmission process, achieving directional transmission. At the same time, it avoids signal attenuation caused by multiple reflections, so that the receiver can hear clearly.

[0045] In another example, the directional microphone array is a microphone array for collecting directional ultrasonic speech. It should be noted that the sound collection range of the directional microphone array overlaps as closely as possible with the coverage area of the directional sound-emitting speaker, ensuring that the directional sound information emitted by the second directional sound-transmitting and receiving device 2 on the vehicle is simultaneously captured by the directional microphone array on the road.

[0046] In this embodiment, the limitation of no direct audio information communication between roads and vehicles is broken, the relevant management departments cannot obtain the information inside the vehicle in the first time, and the vehicles cannot obtain the latest road information in the first time, thus realizing the vehicle-road collaborative communication to the greatest extent; this application also breaks through the barrier of sound isolation caused by the good airtightness of the vehicle to ensure the privacy of information; at the same time, it realizes the sound protection of the surrounding environment and eliminates noise interference.

[0047] In other embodiments, the first directional sound transmitting and receiving device is tilted above the road, and the second directional sound transmitting and receiving device is tilted on the top of the vehicle or inside the vehicle.

[0048] Specifically, the second directional sound transmitting and receiving device on the vehicle is in the same direction as the vehicle's travel, while the first directional sound transmitting and receiving device on the road is set up in an inclined direction opposite to the vehicle's travel direction, ensuring that when the vehicle travels to the preset area, that is, the coverage area, the two parties can normally exchange directional sound information through ultrasonic signals under the establishment of a directional ultrasonic communication mechanism. Figure 2 , I will not go into details here.

[0049] In one example, if the second directional transceiver on the vehicle is installed to transmit ultrasonic signals or receive ultrasonic signals in the direction behind the vehicle, that is, opposite to the driving direction of the vehicle, ultrasonic directional voice communication can also be achieved by driving the vehicle to the preset area.

[0050] Through the above method, as long as the second directional sound-transmitting and receiving device on the vehicle is arranged opposite to the first directional sound-transmitting and receiving device on the road, and the ultrasonic coverage ranges formed by the ultrasonic signals emitted by each of them overlap with each other, on the one hand, it is beneficial for the vehicle to collect the directional sounds emitted by the lane when emitting directional sounds; on the other hand, it is beneficial for the lane to collect the directional sounds emitted by the vehicle when emitting directional sounds.

[0051] In other embodiments, the vehicle-road cooperative voice interaction system further includes:

[0052] The first location acquisition module is used to obtain the current location information of the vehicle in real time;

[0053] a first control module, connected to the first directional sound transceiver and the first position acquisition module, respectively, and, based on the position information, when detecting that the vehicle has entered the preset coverage area, turning on the first directional sound transceiver and, at the same time, sending a first trigger instruction to control the directional sound speaker on the lane to emit directional sound information, and to control the directional microphone array on the lane to receive the directional sound information, wherein the road management agency manages turning on or off the first directional sound transceiver and the content of the pre-cached sound information by controlling the first control module;

[0054] A second control module is installed on the vehicle and is respectively connected to the second directional sound receiving and transmitting device and the first position acquisition module. Based on the position information, when it is monitored that the vehicle is driving into the preset coverage area, the second directional sound receiving and transmitting device of the vehicle is turned on. At the same time, a second trigger instruction is sent to control the directional sound speaker on the vehicle to emit the directional sound information, and to control the directional microphone array on the vehicle to receive the directional sound information from the first directional sound receiving and transmitting device. The road management agency or the vehicle driver manages the opening or closing of the second directional sound receiving and transmitting device by controlling the second control module.

[0055] The first location acquisition module may be a location information module, such as a GPS positioning module, a Beidou positioning module, etc.

[0056] The first control module can be set on the road or on the background service end. By monitoring the location information, when it is detected that a vehicle is about to or begins to enter the coverage area, it controls the directional sound speaker on the road to emit directional sound information by sending a first trigger instruction, and controls the directional microphone array on the road to receive the directional data information.

[0057] For example, the first control module provides a first control port to the road management department or the traffic police control center for managing the opening or closing of the first directional transceiver and the content of the pre-cached sound information; the second control module provides a second control port to the road management agency or the vehicle driver for managing the opening or closing of the second directional transceiver, so as to facilitate the management department or the traffic police management center to send the corresponding sound information in advance.

[0058] For example, the first directional sound transceiver can be enabled through the first control port by the management department or traffic police management center. Alternatively, if the number of vehicles on a lane is different, such as during trial operation, opening, or traffic control, the first directional sound transceiver can be disabled, thereby saving energy. Alternatively, by pre-recording or saving the corresponding sound information to be transmitted to the driver of a vehicle, the sound information can be played in a targeted manner once the vehicle arrives at a designated coverage area.

[0059] Of course, the second control port can also be used to turn on the second directional sound transmitting and receiving device on the vehicle when the vehicle is about to enter the coverage area or enters the coverage area, so as to establish directional sound communication with the first directional sound transmitting and receiving device as soon as possible to complete the directional transmission and reception of sound information for vehicle-road collaboration.

[0060] In addition, the second control module can be set on the vehicle or on the background server. By monitoring the location information, when it is detected that the vehicle is about to or begins to enter the coverage area, it sends a second trigger instruction to control the directional sound speaker on the vehicle to emit the directional sound information, and controls the directional microphone array on the vehicle to receive the directional sound information. For example, through the directional sound information reporting, a traffic accident or landslide occurs on a certain section of road, so that the traffic management department can be aware of it and deal with it in a timely manner.

[0061] Herein, vehicle refers to passenger cars, light trucks, cars, trucks, new energy vehicles, etc. The vehicle has a front, a rear, a left side, and a right side, wherein the terms front, rear, left, and right are to be understood from the perspective of an operator of the vehicle sitting in the driver's seat in a standard operating position, i.e., facing the steering wheel.

[0062] For example, a vehicle-road cooperative voice interaction system could be installed at designated road locations, using ultrasound to carry sound. This system would broadcast targeted audio to vehicles in a specific lane or area, allowing drivers to clearly hear the content without causing interference, noise pollution, or misleading audio to other lanes, the direction of travel, or surrounding areas.

[0063] For example, when a vehicle reaches a designated location or area, a dedicated trigger device used by the road or traffic management department sends an activation command, turning on the vehicle's directional microphone array system and forcing the driver or passengers to receive a broadcast, including warnings, urgent road or weather conditions, ensuring safer driving and smoother road conditions.

[0064] This approach enables targeted voice messaging to be sent in specific areas (tunnels) and lanes, even when the vehicle is driving with its windows closed. For example, road management agencies or traffic control centers can remotely provide directional, lane-specific, and vehicle-specific voice information to specific vehicles in a specific location or lane. This can range from a single vehicle to all vehicles passing through a specific timeframe. The sound broadcast from the directional speaker can be transmitted directly into the vehicle through the onboard directional microphone array, ensuring the driver clearly understands and receives timely information from relevant traffic management authorities, ensuring vehicle safety. Simultaneously, by activating a secondary directional audio transmitter and receiver, the system intelligently blocks out unrelated traffic and ambient noise. This ensures vehicle safety and privacy while preventing authorities from accessing information about the vehicle.

[0065] In other embodiments, the vehicle-road cooperative voice interaction system further includes:

[0066] The first image acquisition module acquires the license plate number of a vehicle traveling on a lane within or near the coverage area.

[0067] The second position acquisition module is used to acquire the current position information of the vehicle in real time.

[0068] The third control module is respectively connected to the first directional sound transceiver, the first image acquisition module and the second position acquisition module, and is used to determine the vehicle information of the vehicle entering the coverage area according to the position information and the license plate number; if there is associated mapped voice information for the vehicle information, it sends a third trigger instruction to control the directional sound speaker on the lane to emit the associated mapped voice information, and controls the directional microphone array on the lane to receive the voice information from the vehicle and forward it to a designated department; if there is no associated mapped voice information for the vehicle information, it sends a fourth trigger instruction to control the directional sound speaker on the lane to emit preset voice information, and controls the directional microphone array on the lane to receive the voice information from the vehicle and forward it to a designated department.

[0069] For example, the third control module provides a third control port to a road management department or a traffic police control center for receiving the corresponding voice information of a violating vehicle; or, it is also used to receive preset voice information. For example, only a road management department or a traffic police has the right to forcibly activate and turn on the directional sound receiving microphone array system installed on the vehicle itself. Any other vehicle or individual does not have the corresponding function, so as to ensure timely and effective warning prompts and safety warnings for the vehicle, ensure smooth roads and vehicle driving safety, and at the same time take into account the protection of the privacy of the vehicle interior space.

[0070] Specifically, the first image acquisition module takes pictures of the license plate numbers of vehicles about to enter a specific lane or the coverage area, so as to know in advance which vehicles are about to enter the coverage area. If the current vehicle does not have an on-vehicle second directional sound transceiver, when it enters the coverage area, it can only receive the voice information of directional ultrasound and cannot perform directional voice interaction. On the contrary, if the current vehicle has an on-vehicle second directional sound transceiver, it can transmit and receive voice information directionally.

[0071] It should be noted that if the vehicle has a violation or illegal act, by combining the position information and the license plate information for identification, specific voice information can be sent to the vehicle. For example, "The vehicle with license plate number 'Beijing A000000' has a speeding behavior on a certain section of the road", "The vehicle with license plate number 'Beijing A000000' has a behavior of illegally driving in the emergency lane on a certain section of the road", etc., to notify the corresponding driver for the purpose of reminder or warning.

[0072] Through the above method, certain vehicles can be specifically notified. During the directional sound interaction process, personalized notification of vehicles can be achieved, and private information that does not belong to the vehicle will not be broadcast in a targeted manner, thereby protecting the information security and privacy of the corresponding vehicle owners, and also protecting the surrounding environment from being disturbed by noise.

[0073] In the above embodiment, a directional sound pickup microphone array system is installed in addition to the corresponding road-directed sound-emitting speaker array system. The driver's voice is transmitted to the road-directed sound pickup microphone array system through the vehicle's built-in directional sound-emitting speaker system. This enables real-time voice communication between the occupant and road management or traffic police while the vehicle is in motion, without stopping or making phone calls. There's no need to search for the owner or driver's phone number, the driver doesn't have to answer or make phone calls, and there's no need to worry about missed calls or other errors preventing immediate communication with the driver. There's no need to roll down the window or step out of the vehicle. The driver remains in the vehicle and can communicate instantly, without interrupting driving. Furthermore, when this feature is enabled and sounds, the driver can immediately identify it as an emergency notification from back-end management, drawing their attention to it, making driving safer and communication more convenient.

[0074] In other embodiments, the vehicle-road cooperative voice interaction system further includes:

[0075] The vehicle is equipped with a direction-adjustable rotating mechanism; wherein the second directional sound transmitting and receiving device is installed on the rotating mechanism;

[0076] For example, the rotating mechanism can be driven by a driving motor or other components, and its direction is adjustable. The direction adjustment direction can be horizontal or vertical, thereby adjusting the installation tilt angle of the second directional sound receiving and transmitting device.

[0077] A fourth control module is connected to the rotating mechanism and the second directional sound-receiving and transmitting device, respectively, and is used to adjust the inclination angle of the rotating mechanism according to the inclination angle and coverage range corresponding to the coverage area formed by the next first directional sound-receiving and transmitting device at the lane installation position, so that the inclination angle and coverage range of the second directional sound-receiving and transmitting device match the inclination angle and coverage range of the next first directional sound-receiving and transmitting device.

[0078] It should be noted that, based on the vehicle's current position, the lane installation location of the next first directional sound receiving and transmitting device corresponding to the current position is obtained and prompt information is issued, such as which lane has a coverage area. This allows the vehicle driver to be informed in advance and use this prompt information as a reference to change lanes in advance and enter the corresponding lane. For example, based on the tilt angle and coverage area corresponding to the lane installation location (lane number) of the next first directional sound receiving and transmitting device, such as the installation height and coverage area of the next first directional sound receiving and transmitting device, the tilt angle of the rotating mechanism on the vehicle is adjusted based on this reference to ensure that the tilt angle and coverage area of the second directional sound receiving and transmitting device match the tilt angle and coverage area of the next first directional sound receiving and transmitting device.

[0079] Through the above method, before entering the coverage area, the tilt angle and coverage range of the second directional sound transmitting and receiving device are adjusted in advance, so that when entering the coverage area, it can accurately transmit and receive directional sound information, avoiding the vehicle entering the non-coverage area and being unable to complete directional sound communication.

[0080] In other embodiments, the vehicle-road cooperative voice interaction system further includes:

[0081] A noise collection microphone is arranged in the vehicle and connected to the fourth control module, and is used to collect the ambient noise in the vehicle. The ambient noise refers to the sound other than the sound emitted by the sender of the voice signal; the fourth control module also includes: a noise elimination module, which subtracts the collected user's voice signal from the ambient noise to determine the voice information.

[0082] In this embodiment, when collecting the user's voice signal inside the vehicle, there is often noise. In order to improve the accuracy of the voice signal, by filtering the environmental noise, the user's voice signal can be accurately converted into voice information, which facilitates directional transmission and reception of normal interactive communication.

[0083] In other embodiments, the vehicle-road cooperative voice interaction system further includes:

[0084] The sound information directionally transmitted by the first directional sound transmitting and receiving device is randomly encrypted according to the vehicle information. The directional microphone array corresponding to the second directional sound transmitting and receiving device of the vehicle directionally receives the encrypted sound information, decrypts the encrypted sound information using the secret key pre-stored in the vehicle, and plays the sound information in the vehicle; each of the vehicles corresponds to an encryption and decryption key.

[0085] Among them, it should be noted that when the vehicle is initialized, a unique key is assigned to each vehicle based on vehicle information, such as the license plate number. The key is stored at one end of the vehicle and the end corresponding to the first directional transceiver device, and can be randomly encrypted according to the vehicle information. Regardless of whether it is a directional transceiver device corresponding to the vehicle or lane, the key can be used for encryption or decryption.

[0086] Here, vehicles equipped with the second directional transceiver are equipped with a secret key to facilitate decryption of randomly encrypted sound information. On the contrary, vehicles that are not equipped with the second directional transceiver are not equipped with a secret key and cannot decrypt the encrypted information. Therefore, even if such vehicles enter the coverage area, they cannot receive the sound information sent by the first directional transceiver because they cannot decode the sound information, thereby preventing interference with other normal vehicles.

[0087] In summary, first, this application enables directional sound broadcasting to vehicles traveling in designated lanes or areas without causing sound interference, noise pollution, or misleading sound to the surrounding environment or lanes. It also provides necessary and timely sound prompts or warnings to vehicles in designated locations, ensuring road safety to the greatest extent possible. Second, this application includes a road-based directional sound transmission and reception system (i.e., a first directional sound transmission and reception device) and an on-board directional sound transmission and reception system (i.e., a second directional sound transmission and reception device). Both systems have directional sound transmission and reception capabilities and together form a closed loop of vehicle-road sound interaction. This overcomes the sound isolation barrier of the vehicle's airtightness, allowing the broadcast sound from the directional loudspeaker in the tunnel to reach the interior of the vehicle through the on-board directional microphone array, allowing the driver to clearly hear and immediately receive information from relevant traffic management departments, ensuring vehicle safety. Furthermore, the application can also isolate and shield other unrelated vehicles or environmental noise outside the vehicle. Third, through this application, regular, standardized and humanized voice warnings or anti-fatigue prompts will be provided for sections or areas that are prone to long-term dangers, have poor road conditions or changeable environments; traffic accidents will be avoided to the greatest extent, and scientific management of roads and vehicles will be achieved, further realizing intelligent vehicle-road collaboration.

[0088] The above embodiments are merely illustrative of the principles and effects of this application and are not intended to limit this application. Anyone skilled in the art may modify or alter the above embodiments without departing from the spirit and scope of this application. Therefore, all equivalent modifications or alterations made by one of ordinary skill in the art without departing from the spirit and technical concepts disclosed in this application shall be covered by the claims of this application.

Claims

1. A vehicle-road cooperative voice interaction system, characterized in that: include: At least one set of first directional sound transmitting and receiving devices is arranged along the lanes to cover at least one lane, forming a coverage area for directional sound coverage of a section of the lane; A vehicle is traveling on the lane, and the vehicle is equipped with a second directional sound transmitting and receiving device; wherein the first directional sound transmitting and receiving device and the second directional sound transmitting and receiving device are arranged opposite to each other, the first directional sound transmitting and receiving device is arranged obliquely above the lane, and the second directional sound transmitting and receiving device is arranged obliquely on the top of the vehicle or inside the vehicle; a direction-adjustable rotating mechanism is installed on the vehicle; wherein the second directional sound transmitting and receiving device is installed on the rotating mechanism; a fourth control module is respectively connected to the rotating mechanism and the second directional sound transmitting and receiving device, and is used to adjust the inclination angle of the rotating mechanism according to the inclination angle and coverage range corresponding to the coverage area formed by the next first directional sound transmitting and receiving device at the installation position of the lane, so that the inclination angle and coverage range of the second directional sound transmitting and receiving device match the inclination angle and coverage range of the next first directional sound transmitting and receiving device; If it is detected that a vehicle is about to enter the coverage area, the first directional sound transmitting and receiving device and the second directional sound transmitting and receiving device are turned on in advance to establish directional sound communication between the first directional sound transmitting and receiving device and the second directional sound transmitting and receiving device, thereby completing the directional transmission and reception of sound information for vehicle-road collaboration; The first and second directional sound receiving and transmitting devices include a directional microphone array and a directional sound-emitting loudspeaker. The directional microphone array is used to receive sound information in a directional manner; the directional sound-emitting loudspeaker is used to send sound information in a directional manner. The first image acquisition module is used to acquire the license plate number of the vehicle traveling on the lane in the coverage area or near the coverage area; the second position acquisition module is used to obtain the current position information of the vehicle in real time; the third control module is connected to the first directional sound transceiver, the first image acquisition module and the second position acquisition module respectively, and is used to determine the vehicle information entering the coverage area based on the position information and the license plate number; if the vehicle information has associated mapped sound information, A third trigger instruction is sent to control the directional sound speaker on the lane to emit associated mapped sound information, and to control the directional microphone array on the lane to receive the sound information from the vehicle and forward it to the designated department; if there is no associated mapped sound information for the vehicle information, a fourth trigger instruction is sent to control the directional sound speaker on the lane to emit preset sound information, and to control the directional microphone array on the lane to receive the sound information from the vehicle and forward it to the designated department.

2. The vehicle-road cooperative voice interaction system according to claim 1, characterized in that: The directional sound-emitting loudspeaker includes an ultrasonic parametric array or a full-range loudspeaker line array.

3. The vehicle-road cooperative voice interaction system according to claim 1 or 2, characterized in that: Also includes: The first location acquisition module is used to obtain the current location information of the vehicle in real time; a first control module, connected to the first directional sound transceiver and the first position acquisition module, respectively, and, based on the position information, when detecting that the vehicle has entered the preset coverage area, turning on the first directional sound transceiver and, at the same time, sending a first trigger instruction to control the directional sound speaker on the lane to emit directional sound information, and to control the directional microphone array on the lane to receive the directional sound information, wherein the road management agency manages turning on or off the first directional sound transceiver and the content of the pre-cached sound information by controlling the first control module; A second control module is installed on the vehicle and is respectively connected to the second directional sound receiving and transmitting device and the first position acquisition module. Based on the position information, when it is monitored that the vehicle is driving into the preset coverage area, the second directional sound receiving and transmitting device of the vehicle is turned on. At the same time, a second trigger instruction is sent to control the directional sound speaker on the vehicle to emit the directional sound information, and to control the directional microphone array on the vehicle to receive the directional sound information from the first directional sound receiving and transmitting device. The road management agency or the vehicle driver manages the opening or closing of the second directional sound receiving and transmitting device by controlling the second control module.

4. The vehicle-road cooperative voice interaction system according to claim 1, characterized in that: The first control module provides a first control port to the road management department or the traffic police control center for managing the opening or closing of the first directional sound transceiver and the content of the pre-cached sound information; The second control module provides a second control port to the road management agency or the vehicle driver, for managing the opening or closing of the second directional sound transmitting and receiving device.

5. The vehicle-road cooperative voice interaction system according to claim 4, characterized in that: The third control module provides a second control port to the road management department or the traffic police control center for receiving the corresponding sound information of the illegal vehicle; or, further for receiving preset sound information.

6. The vehicle-road cooperative voice interaction system according to claim 1, characterized in that: Also includes: a noise collection microphone provided in the vehicle and connected to the fourth control module, for collecting ambient noise in the vehicle, wherein the ambient noise refers to sounds other than the sound emitted by the sender of the voice signal; The fourth control module further includes: a noise elimination module, which subtracts the collected user's voice signal from the environmental noise to determine the sound information.

7. The vehicle-road cooperative voice interaction system according to claim 1, characterized in that: Also includes: The sound information directionally transmitted by the first directional sound transmitting and receiving device is randomly encrypted. The directional microphone array corresponding to the second directional sound transmitting and receiving device of the vehicle directionally receives the encrypted sound information, decrypts the encrypted sound information using the secret key pre-stored in the vehicle, and plays the sound information in the vehicle; each of the vehicles has a corresponding encryption and decryption key.

Images