Intelligent vehicle-mounted equipment supporting vehicle-road cooperation application

Abstract

The invention belongs to the technical field of vehicle-mounted electronic equipment, and discloses intelligent vehicle-mounted equipment supporting vehicle-road cooperation application, and the vehicle-mounted equipment comprises a high-precision positioning module, a sensor module, a communication module, a voice interaction module, a data processing and analysis module, and a data storage module. The sensor module comprises a camera and a G-Sensor, the communication module comprises a long-distance communication module and a short-distance communication module, and the voice interaction module comprises a microphone and a loudspeaker; all modules of the vehicle-mounted equipment are matched to realize lane-level navigation service, a driving video recording function and a voice interaction function aiming at consumers, and meanwhile, data of the vehicle-mounted equipment of the consumers can be applied to intelligent management and optimization of urban traffic by an urban traffic management center. According to the invention, low-cost and high-precision vehicle-road cooperation is realized technically, a new possibility is created in a business mode, and powerful support is provided for wide application and marketization progress of the vehicle-road cooperation technology.

Description

Technical Field

[0001] The present invention belongs to the technical field of vehicle-mounted electronic equipment, and more specifically, relates to an intelligent vehicle-mounted device that supports vehicle-road collaborative applications. Background Art

[0002] As a cutting-edge transportation information technology, the core goal of vehicle-road collaboration is to significantly enhance the safety and efficiency of road traffic through real-time information exchange between vehicles and the surrounding environment (including other vehicles, road infrastructure, pedestrians and cloud service platforms). The implementation of this technology is expected to promote the development of transportation systems in a more intelligent, efficient and safe direction.

[0003] However, in the current vehicle-road cooperative system, perception capabilities mainly rely on expensive and limited-life equipment such as roadside cameras and lidar. The deployment and maintenance costs of these devices are high, and their perception accuracy may drop significantly under severe weather conditions (such as heavy rain, fog, etc.), which in turn affects the accuracy and reliability of the entire vehicle-road cooperative system and poses a safety hazard.

[0004] In addition, the current construction and operation of the vehicle-road cooperative system mainly relies on government promotion and financial support, and a mature market-oriented operation model has not yet been formed. This dependence not only limits the promotion speed of vehicle-road cooperative technology, but also leads to the lack of self-sustaining ability of the system, making it difficult to operate stably in the long term. Therefore, how to stimulate market vitality, let user groups such as automakers and consumers see the actual value brought by vehicle-road cooperation, and be willing to pay extra fees for it, has become a key factor restricting the further promotion of vehicle-road cooperative technology.

[0005] To this end, the present invention provides an intelligent vehicle-mounted device that supports vehicle-road collaborative applications. Summary of the invention

[0006] In view of the above-mentioned problems existing in the existing technology, the purpose of the present invention is to provide an intelligent vehicle-mounted device that supports vehicle-road collaborative applications. It not only realizes low-cost and high-precision vehicle-road collaboration in technology, but also creates new possibilities in business models, providing strong support for the widespread application and marketization process of vehicle-road collaborative technology.

[0007] The purpose of the present invention can be achieved by the following technical solutions: An intelligent vehicle-mounted device supporting vehicle-road cooperative applications, the vehicle-mounted device comprising a high-precision positioning module, a sensor module, a communication module, a voice interaction module, a data processing and analysis module, and a data storage module; The sensor module includes a camera and a G-Sensor, the communication module includes a long-distance communication module and a short-distance communication module, and the voice interaction module includes a microphone and a speaker; The various modules of the vehicle-mounted equipment cooperate to realize lane-level navigation services, driving video recording functions and voice interaction functions for consumers. At the same time, the data of consumers' vehicle-mounted equipment can be applied to the intelligent management and optimization of urban traffic by the urban traffic management center.

[0008] As a further preferred technical solution of the present invention, the vehicle-mounted device obtains high-precision positioning data in the following steps: S1: A mobile station consisting of a high-precision positioning module and a communication module is integrated on the vehicle-mounted device; S2: The high-precision positioning module receives satellite positioning signals and calculates the mobile station's own location data, time and motion status data to provide positioning information at any time; S3: Establish a base station with known three-dimensional coordinates on the ground, obtain satellite positioning coordinate data, compare the satellite positioning coordinate data with its own precise coordinate data, and send the "correction number" result to the mobile station through the long-distance communication module of the communication module; S4: Based on the base station data and its own data, the mobile station corrects the spatial error and tropospheric and ionospheric error according to the differential data to obtain centimeter-level high-precision positioning.

[0009] As a further preferred technical solution of the present invention, the high-precision positioning module adopts RTK technology to obtain GNSS data, and the high-precision positioning module is composed of a high-precision positioning module chip and a high-precision positioning antenna; The location data of the mobile station includes longitude information, latitude information and altitude information, and the time and motion state data of the mobile station includes speed information and heading information; The long-distance communication module of the communication module is provided with a wireless communication link, and the wireless communication link includes one of a 4G or 5G communication link, and the short-distance communication module is provided with Bluetooth and WIFI.

[0010] As a further preferred technical solution of the present invention, the base station is set up at a reference point with known coordinates, and continuously receives all visible GNSS satellite signals. The base station sends the coordinates of the measuring station, pseudorange observation values, carrier phase observation values, satellite tracking status and base station working status to the high-precision positioning module through a wireless data link; The high-precision positioning module receives the data transmitted by the base station through the communication module while receiving the navigation satellite signal, and calculates the three-dimensional coordinates of the mobile station and its accuracy in real time based on the principle of relative positioning.

[0011] As a further preferred technical solution of the present invention, after the vehicle-mounted device obtains high-precision positioning data, it provides lane-level navigation services through the following methods and steps: S1: The vehicle-mounted device establishes a data communication link with the Bluetooth of the mobile phone terminal through the Bluetooth of the short-range communication module, and sends the high-precision positioning data of the vehicle-mounted device to the map navigation APP interface; S2: After the mobile terminal receives the high-precision satellite positioning information, it combines the accurate map data built into the map navigation APP to display the high-precision lane-level navigation positioning results.

[0012] As a further preferred technical solution of the present invention, the vehicle-mounted device utilizes a sensor module, a data processing and analysis module, a data storage module, and a communication module to realize the function of driving video recording through the following methods and steps: S1: The vehicle-mounted device uses one or more sensor modules’ cameras to capture real-time video in front of the vehicle and in other directions around it. The real-time video is encoded and compressed by the data processing and analysis module and stored in the data storage module to form a video record. S2: The user views the real-time video and historical video records of the vehicle-mounted device through the mobile phone APP software of the mobile phone terminal bound to the vehicle-mounted device. When the distance to the vehicle-mounted device is close, the user connects and communicates through the short-distance communication module. When the distance to the vehicle-mounted device is far away, the user connects and communicates through the long-distance communication module.

[0013] As a further preferred technical solution of the present invention, the video stored in the data storage module to form a video record uses the H.264 video encoding format; The function of the user viewing the real-time video of the vehicle-mounted device through the mobile phone APP software of the mobile phone terminal bound to the vehicle-mounted device is achieved by using the device-side RTMP protocol to push the stream or uploading the video file to the cloud platform and playing the video on demand through the streaming media service of the cloud platform.

[0014] As a further preferred technical solution of the present invention, the vehicle-mounted device uses a voice interaction module, a data processing and analysis module, and a communication module to realize the voice interaction function through the following methods and steps: S1: When the user issues a voice command, the microphone of the vehicle device collects these sound signals; S2: Use one or more specific wake-up words to activate the voice interaction system of the vehicle-mounted device, so that it enters the listening mode from the standby mode; S3: After the wake-up word activates the voice interaction system, the user's subsequent voice is recognized offline or online and converted into text. If it is online voice recognition, the voice file needs to be sent to the cloud service through the Internet through the long-distance communication module for processing; S4: Analyze the converted text to understand the user's intention; S5: Perform corresponding operations based on the understood user intention; S6: Using a speaker to play a preset voice file or a voice file generated by speech synthesis, provide the user with verbal confirmation or result report to inform the user whether the request is successfully completed or answer the user's specific question; S7: If the user's subsequent voice is monitored, jump to S3 to enter the next round of voice interaction, otherwise exit the voice interaction until the next wake-up word is activated.

[0015] As a further preferred technical solution of the present invention, the voice interaction system adopts a combination of offline and online methods. The offline SDK realizes wake-up word recognition and voice segmentation, and voice recognition and voice synthesis are performed after the voice file is uploaded to the cloud platform.

[0016] As a further preferred technical solution of the present invention, the various modules of the vehicle-mounted equipment cooperate to realize lane-level navigation services, driving video recording functions and voice interaction functions for consumers. At the same time, the data or information of the lane-level navigation services and driving video recording functions are uploaded to the vehicle-road cooperative system and the urban traffic management center. After receiving the vehicle data, the urban traffic management center applies intelligent management and optimization of urban traffic.

[0017] As described above, the intelligent vehicle-mounted device supporting vehicle-road cooperative application provided by the present invention has the following beneficial effects: 1. Low-cost vehicle-road collaboration implementation method: The present invention provides a vehicle-road collaboration implementation method that does not rely on expensive roadside cameras, lidar and other equipment. Traditional vehicle-road collaboration systems usually require the installation of a large number of sensors and cameras on the road. These devices are not only costly but also complex to maintain. The present invention uses innovative technical means to achieve accurate perception of the vehicle's position without adding additional hardware costs. This solution not only reduces the initial construction and long-term operation and maintenance costs of the system, but also can operate around the clock under various weather conditions, improving the reliability and stability of the system.

[0018] 2. Promote the marketization process of vehicle-road collaboration: At present, the construction of the vehicle-road collaboration system mainly relies on government support and lacks a mature profit model, resulting in a slow marketization process. The intelligent vehicle-mounted equipment proposed in the present invention can provide a complete series of consumer-level applications. These applications themselves have high commercial value and can attract consumers to actively purchase and use them. For example, functions such as lane-level navigation, driving video recording, and voice chat can not only enhance the driving experience, but also enhance driving safety. In addition, these applications can be continuously enriched and improved through software updates to bring continuous value to users. Without increasing hardware costs, the same modules are reused to realize the value-added services brought by vehicle-road collaboration applications, which greatly improves the economy and market competitiveness of the system.

[0019] 3. Promote large-scale application of vehicle-road collaboration: The intelligent vehicle-mounted equipment of the present invention not only achieves a breakthrough in technology, but also provides new ideas in the business model. By combining the vehicle-road collaboration function with consumer-level applications, more value-added services can be provided to users without increasing hardware costs. This model can not only attract more users to use the vehicle-road collaboration system, but also promote the development of related industrial chains and accelerate the popularization and application of vehicle-road collaboration technology. Ultimately, this will help build a more intelligent, efficient, and safer transportation ecosystem and promote the construction and development of smart cities.

[0020] Additional aspects and advantages of the present invention will be given in part in the following description and in part will be obvious from the following description, or will be learned through practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0022] Figure 1 This is a schematic block diagram of modules and data flow of an intelligent vehicle-mounted device supporting vehicle-road cooperative applications of the present invention; Figure 2 Method and steps for obtaining high-precision positioning data for the intelligent vehicle-mounted device provided by the present invention; Figure 3 Methods and steps for implementing lane-level navigation services for the intelligent vehicle-mounted device provided by the present invention; Figure 4 Methods and steps for realizing the driving video recording function of the intelligent vehicle-mounted device provided by the present invention; Figure 5Methods and steps for realizing voice interaction function of the intelligent vehicle-mounted device provided by the present invention; Figure 6 A schematic diagram of a specific embodiment of the intelligent vehicle-mounted device provided by the present invention to realize the voice interaction function and the real-time information release of the vehicle-road cooperative system. DETAILED DESCRIPTION

[0023] The following is a description of the implementation of the present invention by means of specific embodiments. Those skilled in the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification.

[0024] It should be noted that the structures, proportions, sizes, etc. illustrated in the drawings of this specification are only used to match the contents disclosed in the specification for people familiar with this technology to understand and read, and are not used to limit the limiting conditions that the present invention can be implemented, so they have no substantial technical significance. Any modification of the structure, change in the proportional relationship, or adjustment of the size should still fall within the scope of the technical content disclosed by the present invention without affecting the effects that the present invention can produce and the purposes that can be achieved. At the same time, the terms such as "upper", "lower", "left", "right", "middle" and "one" quoted in this specification are only for the convenience of description, and are not used to limit the scope of the implementation of the present invention. The change or adjustment of the relative relationship should also be regarded as the scope of the implementation of the present invention without substantial changes in the technical content. The specific structure can be described with reference to the drawings of the patent application.

[0025] The present invention provides an intelligent vehicle-mounted device that supports vehicle-road cooperative applications. Figures 1 to 6 As shown, the vehicle-mounted equipment includes a high-precision positioning module, a sensor module, a communication module, a voice interaction module, a data processing and analysis module, and a data storage module. Figure 1 As shown; The sensor module includes a camera and a G-Sensor, the communication module includes a long-distance communication module and a short-distance communication module, and the voice interaction module includes a microphone and a speaker; The various modules of the vehicle-mounted equipment cooperate to realize lane-level navigation services, driving video recording functions and voice interaction functions for consumers. At the same time, the data of consumers' vehicle-mounted equipment can be applied to the intelligent management and optimization of urban traffic by the urban traffic management center.

[0026] See also Figure 2 As shown, the vehicle-mounted device obtains high-precision positioning data in the following steps: S1: A mobile station consisting of a high-precision positioning module and a communication module is integrated on the vehicle-mounted device; S2: The high-precision positioning module receives satellite positioning signals and calculates the mobile station's own location data, time and motion status data to provide positioning information at any time; S3: Establish a base station with known three-dimensional coordinates on the ground, obtain satellite positioning coordinate data, compare the satellite positioning coordinate data with its own precise coordinate data, and send the "correction number" result to the mobile station through the long-distance communication module of the communication module; S4: Based on the base station data and its own data, the mobile station corrects the spatial error and tropospheric and ionospheric error according to the differential data to obtain centimeter-level high-precision positioning.

[0027] The high-precision positioning module adopts RTK technology to obtain GNSS data. The high-precision positioning module is composed of a high-precision positioning module chip and a high-precision positioning antenna; The location data of the mobile station includes longitude information, latitude information and altitude information, and the time and motion state data of the mobile station includes speed information and heading information; The long-distance communication module of the communication module is provided with a wireless communication link, and the wireless communication link includes one of a 4G or 5G communication link, and the short-distance communication module is provided with Bluetooth and WIFI.

[0028] The base station is set up at a reference point with known coordinates and continuously receives all visible GNSS satellite signals. The base station sends the coordinates of the measuring station, pseudorange observations, carrier phase observations, satellite tracking status and base station working status to the mobile station through a wireless data link. The high-precision positioning module is initialized first, and after completing the search and solution of the unknown numbers in the whole week, it enters dynamic operation. While receiving the navigation satellite signal, the high-precision positioning module receives the data transmitted by the base station through the communication module, and according to the principle of relative positioning, the three-dimensional coordinates and accuracy of the mobile station are solved in real time (that is, the WGS-84 coordinates of each point obtained by adding the coordinate difference △x, △y, △H between the base station and the mobile station to the base coordinates, and the plane coordinates x, y and altitude H of each point of the mobile station are obtained through the coordinate conversion parameters).

[0029] In the final stage, the mobile terminal establishes communication with the high-precision positioning module via Bluetooth, and transmits the three-dimensional coordinate data of the mobile station calculated by the high-precision positioning module to the mobile terminal via Bluetooth, and then transmits it to the navigation software interface, combines it with the navigation map, displays the high-precision lane-level navigation positioning results, and outputs high-precision positioning data.

[0030] It should be noted that RTK technology relies on observation data from base stations, which can effectively eliminate ionospheric errors, tropospheric errors, satellite clock errors and receiver clock errors. RTK also uses carrier observations for position calculation. The vehicle-mounted terminal calculates the three-dimensional coordinates of the mobile station and its accuracy in real time in the following way: The first step is to obtain double difference observations, where the double difference observations include double difference of pseudorange and double difference of carrier phase. The second step is to obtain the floating point positioning solution and the corresponding floating point ambiguity; The third step is to estimate the current integer ambiguity based on the obtained floating-point positioning solution, floating-point ambiguity, the variance matrix of the positioning solution and ambiguity, and the covariance matrix between them. The most popular algorithm to complete this step is the LAMBDA algorithm. However, when the observation quality of the pseudorange and carrier is poor, it is difficult to obtain a fixed solution based on the LAMBDA algorithm. In addition, even if a fixed solution is obtained, the positioning error may reach the meter level. Therefore, the BIE (Best Integer Estimator) algorithm proposed by Professor Peter JG Teunissen is used to use weighted average for multi-hypothesis position estimation to estimate the current integer ambiguity. The fourth step is to estimate the integer ambiguity and obtain a fixed solution based on a verification process, then theoretically centimeter-level positioning accuracy can be achieved.

[0031] Through theoretical calculations, the BIE (Best Integer Estimator) algorithm can effectively avoid the Localminimum problem. Based on the BIE algorithm, the conclusion is: the BIE algorithm can achieve better or similar results than the traditional LAMBDA algorithm in challenging scenarios, and in open scenarios, the BIE algorithm can achieve similar results to the LAMBDA algorithm.

[0032] See also Figure 3 As shown, after the vehicle-mounted device obtains high-precision positioning data, it provides lane-level navigation services through the following methods and steps: S1: The vehicle-mounted device establishes a data communication link with the Bluetooth of the mobile phone terminal through the Bluetooth of the short-range communication module, and sends the high-precision positioning data of the vehicle-mounted device to the map navigation APP interface; S2: After the mobile terminal receives the high-precision satellite positioning information, it combines the accurate map data built into the map navigation APP to display the high-precision lane-level navigation positioning results.

[0033] It should be noted that high-precision lane-level navigation means that users can get sub-meter lane navigation provided by the mobile navigation application while driving. When the driver needs to change lanes, such as when approaching a turning intersection or a highway ramp, lane-level navigation will provide more detailed lane-level action guidance.

[0034] Lane-level navigation provides more detailed lane guidance than ordinary navigation in scenarios such as highways and elevated exits. If a lane is congested due to a traffic accident, lane-level navigation will identify it in advance and inform the user to avoid the abnormal lane so that they can pass quickly in other lanes.

[0035] See also Figure 4 As shown, the vehicle-mounted device utilizes a sensor module, a data processing and analysis module, a data storage module, and a communication module to realize the function of driving video recording through the following methods and steps: S1: The vehicle-mounted device uses one or more sensor modules’ cameras to capture real-time video in front of the vehicle and in other directions around it. The real-time video is encoded and compressed by the data processing and analysis module and stored in the data storage module to form a video record. S2: The user views the real-time video and historical video records of the vehicle-mounted device through the mobile phone APP software of the mobile phone terminal bound to the vehicle-mounted device. When the distance to the vehicle-mounted device is close, the user connects and communicates through the short-distance communication module. When the distance to the vehicle-mounted device is far away, the user connects and communicates through the long-distance communication module.

[0036] The video stored in the data storage module to form a video record uses the H.264 video encoding format to reduce storage space and data transmission bandwidth; The function of the user viewing the real-time video of the vehicle-mounted device through the mobile phone APP software of the mobile phone terminal bound to the vehicle-mounted device is achieved by using the device-side RTMP protocol to push the stream or uploading the video file to the cloud platform and playing the video on demand through the streaming media service of the cloud platform.

[0037] See also Figure 5 As shown, the vehicle-mounted device uses a voice interaction module, a data processing and analysis module, and a communication module to implement the voice interaction function through the following methods and steps: S1: When the user issues a voice command, the microphone of the vehicle device collects these sound signals; S2: Use one or more specific wake-up words to activate the voice interaction system of the vehicle-mounted device, so that it enters the listening mode from the standby mode; S3: After the wake-up word activates the voice interaction system, the user's subsequent voice is recognized offline or online and converted into text. If it is online voice recognition, the voice file needs to be sent to the cloud service through the Internet through the long-distance communication module for processing; S4: Analyze the converted text to understand the user's intention; S5: Perform corresponding operations based on the understood user intention; S6: Using a speaker to play a preset voice file or a voice file generated by speech synthesis, provide the user with verbal confirmation or result report to inform the user whether the request is successfully completed or answer the user's specific question; S7: If the user's subsequent voice is monitored, jump to S3 to enter the next round of voice interaction, otherwise exit the voice interaction until the next wake-up word is activated.

[0038] The voice interaction system adopts a combination of offline and online methods. The offline SDK realizes wake-up word recognition and voice segmentation, and voice recognition and voice synthesis are performed after the voice file is uploaded to the cloud platform.

[0039] Combination Figure 6 As shown, a specific embodiment of the intelligent vehicle-mounted device provided by the present invention to realize the voice interaction function and the real-time information release of the vehicle-road cooperative system is described: First, the user says "Xiao Ma Xiao Ma", which hits the preset wake-up word. The in-vehicle device plays the offline preset voice file and answers "Hello, master".

[0040] The user continues to say "Where is the nearby gas station?" At this time, the on-board device uploads the voice file segmented by the voice segmentation algorithm to the backend system through the IoT cloud platform. The backend system calls the online voice recognition API to generate text; the text understanding module then recognizes the content of the text. When the module recognizes that this interaction request requires the use of a third-party service interface, it calls the relevant service interface and passes the service return content text to the online speech synthesis API to generate a voice file; the voice file is forwarded via the IoT cloud platform and pushed to the on-board device for playback, answering "The nearest gas station to you is at..."

[0041] The user continues to say "let's navigate there now". Just like the last interaction, the in-vehicle device uploads the voice file, generates text through the online voice recognition API, and sends it to the text understanding module. When the text understanding module recognizes that this interaction request is an operation instruction supported by the device, it pushes the device operation message to the in-vehicle device through the IoT cloud platform, triggers the navigation to start through the device interface, plays the offline preset voice file, and answers "Navigation has been turned on for you".

[0042] The user continues to say "You are awesome, tell me a joke". Just like the last interaction, the in-vehicle device uploads the voice file, generates text through the online voice recognition API, and sends it to the text understanding module. When the text understanding module recognizes that this interaction request is a chat content outside the business, it calls the text big model API to reply, and generates a voice file for the reply text content through the online speech synthesis API. The voice file is forwarded through the IoT cloud platform and pushed to the in-vehicle device for playback, and the answer is: "Thank you for your compliment. Let me tell you a joke: (content of the joke)".

[0043] When the device backend platform system receives the information release broadcast information sent by the vehicle-road cooperative system through the Internet to vehicles within a certain geographical range, the information release text is generated into a voice file through the online speech synthesis API; the voice file is forwarded via the IoT cloud platform and pushed to the vehicle-mounted device for playback, informing the user that "there has been a landslide on the ** road section ahead, please use the vehicle to take emergency shelter."

[0044] The modules of the vehicle-mounted equipment cooperate to realize lane-level navigation services, driving video recording functions and voice interaction functions for consumers. At the same time, the data or information of the lane-level navigation services and driving video recording functions are uploaded to the vehicle-road cooperative system and the urban traffic management center. After receiving the vehicle data, the urban traffic management center applies intelligent management and optimization of urban traffic to improve traffic efficiency, safety and service quality. Specific application scenarios include but are not limited to: 1. Real-time monitoring of traffic flow and historical data analysis: Real-time monitoring of the number and distribution of vehicles on the road, identifying traffic bottlenecks and congestion points. At the same time, more comprehensive and accurate traffic OD data (i.e. traffic start and end point survey data) can be obtained. Traffic OD data is an indispensable part when planning new roads or improving existing infrastructure, and can help design a safer and more efficient transportation network. By performing trend analysis on historical data, future traffic flow changes can be predicted, providing a basis for the transformation and expansion of transportation facilities.

[0045] 2. Traffic signal optimization and dynamic signal control: High-precision positioning allows traffic signal control systems to more accurately grasp the location of each vehicle, thereby enabling dynamic signal control based on the actual arrival of vehicles. This means that traffic lights can adjust the duration of green lights based on real-time traffic demand rather than operating on a fixed cycle.

[0046] 3. Rapid location and evacuation of accidents: The accident site can be quickly located through vehicle trajectory data, and rescue forces can be dispatched in time. After the accident, traffic signals can be quickly adjusted and detour suggestions can be issued to reduce the impact of the accident on traffic. For emergency vehicles (such as ambulances, fire trucks, etc.), high-precision positioning can ensure that they can obtain priority and reach their destination faster.

[0047] 4. Real-time traffic condition release and precise traffic control: High-precision positioning data supports precise traffic control measures, such as dynamic traffic restrictions, intelligent speed limits, and intelligent route planning, which improves overall traffic efficiency and effectively alleviates urban traffic congestion. The traffic management center can provide drivers with various real-time control instructions, traffic event releases, real-time road condition information, etc., thereby realizing a closed loop of traffic management and control.

[0048] Channels for information release include mobile phone APP, navigation system, etc. As a preferred technical solution of the present invention, information release can be sent by the traffic management center through the vehicle-road cooperative system to the vehicle installed with the intelligent vehicle-mounted device described in the present invention, and the driver can be notified in the form of voice broadcast, avoiding the safety hazards caused by the driver checking the mobile phone.

[0049] It will be apparent to those skilled in the art that the invention is not limited to the details of the exemplary embodiments described above and that the invention can be implemented in other specific forms without departing from the spirit or essential features of the invention. Therefore, the embodiments should be considered exemplary and non-limiting in all respects, and the scope of the invention is defined by the appended claims rather than the foregoing description, and it is intended that all variations falling within the meaning and scope of the equivalent elements of the claims be included in the invention. Any reference numeral in a claim should not be considered as limiting the claim to which it relates.

Claims

1. An intelligent vehicle-mounted device supporting vehicle-road cooperative applications, characterized in that: The vehicle-mounted equipment includes a high-precision positioning module, a sensor module, a communication module, a voice interaction module, a data processing and analysis module, and a data storage module; The sensor module includes a camera and a G-Sensor, the communication module includes a long-distance communication module and a short-distance communication module, and the voice interaction module includes a microphone and a speaker; The various modules of the vehicle-mounted equipment cooperate to realize lane-level navigation services, driving video recording functions and voice interaction functions for consumers. At the same time, the data of consumers' vehicle-mounted equipment can be applied to the intelligent management and optimization of urban traffic by the urban traffic management center.

2. The intelligent vehicle-mounted device supporting vehicle-road cooperative applications according to claim 1, characterized in that: The vehicle-mounted device obtains high-precision positioning data in the following steps: S1: A mobile station consisting of a high-precision positioning module and a communication module is integrated on the vehicle-mounted device; S2: The high-precision positioning module receives satellite positioning signals and calculates the mobile station's own location data, time and motion status data to provide positioning information at any time; S3: Establish a base station with known three-dimensional coordinates on the ground, obtain satellite positioning coordinate data, compare the satellite positioning coordinate data with its own precise coordinate data, and send the "correction number" result to the mobile station through the long-distance communication module of the communication module; S4: Based on the base station data and its own data, the mobile station corrects the spatial error and tropospheric and ionospheric error according to the differential data to obtain centimeter-level high-precision positioning.

3. The intelligent vehicle-mounted device supporting vehicle-road cooperative application according to claim 2, characterized in that: The high-precision positioning module adopts RTK technology to obtain GNSS data. The high-precision positioning module is composed of a high-precision positioning module chip and a high-precision positioning antenna; The location data of the mobile station includes longitude information, latitude information and altitude information, and the time and motion state data of the mobile station includes speed information and heading information; The long-distance communication module of the communication module is provided with a wireless communication link, and the wireless communication link includes one of a 4G or 5G communication link, and the short-distance communication module is provided with Bluetooth and WIFI.

4. The intelligent vehicle-mounted device supporting vehicle-road cooperative application according to claim 3, characterized in that: The base station is set up at a reference point with known coordinates and continuously receives all visible GNSS satellite signals. The base station sends the coordinates of the measuring station, pseudorange observations, carrier phase observations, satellite tracking status and base station working status to the high-precision positioning module via a wireless data link; The high-precision positioning module receives the data transmitted by the base station through the communication module while receiving the navigation satellite signal, and calculates the three-dimensional coordinates of the mobile station and its accuracy in real time based on the principle of relative positioning.

5. The intelligent vehicle-mounted device supporting vehicle-road cooperative application according to claim 2, characterized in that: After the vehicle-mounted device obtains high-precision positioning data, it provides lane-level navigation services through the following methods and steps: S1: The vehicle-mounted device establishes a data communication link with the Bluetooth of the mobile phone terminal through the Bluetooth of the short-range communication module, and sends the high-precision positioning data of the vehicle-mounted device to the map navigation APP interface; S2: After the mobile terminal receives the high-precision satellite positioning information, it combines the accurate map data built into the map navigation APP to display the high-precision lane-level navigation positioning results.

6. The intelligent vehicle-mounted device supporting vehicle-road cooperative application according to claim 5, characterized in that: The vehicle-mounted device uses a sensor module, a data processing and analysis module, a data storage module, and a communication module to achieve the function of driving video recording through the following methods and steps: S1: The vehicle-mounted device uses one or more sensor modules’ cameras to capture real-time video in front of the vehicle and in other directions around it. The real-time video is encoded and compressed by the data processing and analysis module and stored in the data storage module to form a video record. S2: The user views the real-time video and historical video records of the vehicle-mounted device through the mobile phone APP software of the mobile phone terminal bound to the vehicle-mounted device. When the distance to the vehicle-mounted device is close, the user connects and communicates through the short-distance communication module. When the distance to the vehicle-mounted device is far away, the user connects and communicates through the long-distance communication module.

7. The intelligent vehicle-mounted device supporting vehicle-road cooperative application according to claim 6, characterized in that: The video stored in the data storage module to form a video record uses the H.264 video encoding format; The function of the user viewing the real-time video of the vehicle-mounted device through the mobile phone APP software of the mobile phone terminal bound to the vehicle-mounted device is achieved by using the device-side RTMP protocol to push the stream or uploading the video file to the cloud platform and playing the video on demand through the streaming media service of the cloud platform.

8. The intelligent vehicle-mounted device supporting vehicle-road cooperative application according to claim 6, characterized in that: The vehicle-mounted device uses a voice interaction module, a data processing and analysis module, and a communication module to implement the voice interaction function through the following methods and steps: S1: When the user issues a voice command, the microphone of the vehicle device collects these sound signals; S2: Use one or more specific wake-up words to activate the voice interaction system of the vehicle-mounted device, so that it enters the listening mode from the standby mode; S3: After the wake-up word activates the voice interaction system, the user's subsequent voice is recognized offline or online and converted into text. If it is online voice recognition, the voice file needs to be sent to the cloud service through the Internet through the long-distance communication module for processing; S4: Analyze the converted text to understand the user's intention; S5: Perform corresponding operations based on the understood user intention; S6: Using a speaker to play a preset voice file or a voice file generated by speech synthesis, provide the user with verbal confirmation or result report to inform the user whether the request is successfully completed or answer the user's specific question; S7: If the user's subsequent voice is monitored, jump to S3 to enter the next round of voice interaction, otherwise exit the voice interaction until the next wake-up word is activated.

9. The intelligent vehicle-mounted device supporting vehicle-road cooperative application according to claim 8, characterized in that: The voice interaction system adopts a combination of offline and online methods. The offline SDK realizes wake-up word recognition and voice segmentation, and voice recognition and voice synthesis are performed after the voice file is uploaded to the cloud platform.

10. The intelligent vehicle-mounted device supporting vehicle-road cooperative application according to claim 8, characterized in that: The various modules of the vehicle-mounted equipment cooperate to realize lane-level navigation services, driving video recording functions and voice interaction functions for consumers. At the same time, the data or information of the lane-level navigation services and driving video recording functions are uploaded to the vehicle-road cooperative system and the urban traffic management center. After receiving the vehicle data, the urban traffic management center applies intelligent management and optimization of urban traffic.

Images