Method and related device for accident data hinting

Abstract

This application provides a method and related equipment for accident data alerts, including the following steps: acquiring a first image via a first electronic device; identifying road sign information in the first image using a road sign recognition model to determine the road sign type included in the first image; in response to the road sign type being a preset road sign type, acquiring warning data corresponding to the preset road sign type via a second electronic device, wherein the second electronic device establishes a communication connection with the first electronic device; and outputting alert information based on the warning data and vehicle data, wherein the vehicle data describes the current driving status of the vehicle. This application embodiment enables vehicles to alert drivers by recognizing roadside road signs, reducing the risk to drivers and ensuring driving safety.

Description

Technical Field

[0001] This application relates to the field of automotive transportation, and more particularly to a method and related equipment for displaying accident data. Background Technology

[0002] With the continuous development of technology, mobile phone navigation functions are becoming increasingly rich, and drivers are relying on it more and more. However, when driving on highways or complex road sections, mobile phone navigation does not have the function of prompting drivers with road sign information. Moreover, drivers usually do not actively check roadside signs, so it cannot be guaranteed that drivers will be promptly reminded when passing signs indicating high-frequency accidents. In addition, since most vehicles do not have sufficient internet functionality, intelligent traffic accident prevention methods that rely on the internet cannot interact with the vehicle, resulting in the vehicle being unable to provide drivers with relevant information such as accident detection, location, and reminders, posing a great safety hazard to drivers and increasing the safety risks while driving. Summary of the Invention

[0003] One objective of this application is to provide a method and related equipment for providing accident data alerts, which enables vehicles to alert drivers by recognizing roadside signs. Its advantage is that drivers can be promptly alerted when passing signs indicating high-frequency accidents, reducing the risk to drivers and ensuring their driving safety.

[0004] Another objective of this application is to provide a method and related equipment for accident data alerts, which can acquire images of roadside signs through a first electronic device and acquire warning data corresponding to the road signs through a second electronic device. This allows the system to output alert information to the driver even when the first electronic device lacks sufficient internet functionality. Its advantage lies in lowering the configuration threshold of the first electronic device while ensuring driver safety, and acquiring warning data through the second electronic device when the vehicle itself lacks sufficient internet functionality.

[0005] Another objective of this application is to provide a method and related equipment for accident data alerts, which can process and analyze roadside images acquired by a first electronic device through a second electronic device to obtain warning data, thereby realizing the sharing of computing power and network resources of the second electronic device.

[0006] Another objective of this application is to provide a method and related equipment for accident data alerts. Based on the identification of the type of roadside sign by a first electronic device, a second electronic device can further obtain warning data in addition to the information indicated by the roadside sign. Furthermore, the second electronic device can obtain warning data through a server or application software based on the roadside sign information. In scenarios involving dangerous driving, this provides drivers with more comprehensive and accurate information about the roadside sign, enhances drivers' vigilance, and strengthens the warning effect of the roadside sign.

[0007] Another objective of this application is to provide a method and related equipment for providing accident data alerts, which can provide drivers with highly relevant warning data about roadside signs when the vehicle is within the preset range of the road sign, thereby preventing the vehicle from receiving warning data about roadside signs when it is outside the preset range of the road sign, and preventing drivers from receiving unrelated roadside sign alert information in non-reminder sections.

[0008] Another objective of this application is to provide a method and related equipment for accident data alerts, which can acquire and issue alerts only when the type of roadside sign is identified as a preset sign type, and not issue alerts for roadside signs that do not involve dangerous driving, thereby achieving timely alerts in scenarios involving dangerous driving.

[0009] Another objective of this application is to provide a method and related equipment for accident data prompting, which can identify the type of roadside sign and monitor the vehicle's driving status in real time. It can obtain corresponding prompt information by combining the driving status corresponding to the current scenario of the vehicle and the warning data corresponding to the type of road sign. It can detect the vehicle's driving status in real time, compare the driving data corresponding to the vehicle's driving status (such as following distance or speed) with the warning data corresponding to the warning data (such as dangerous following distance or dangerous driving speed), and output prompt information in the corresponding scenario to further reduce driving risks.

[0010] To achieve the above objectives, in a first aspect, embodiments of this application provide a method for accident data notification, the method comprising the following steps:

[0011] The first image is acquired through the first electronic device;

[0012] The road sign information in the first image is identified by the road sign recognition model to determine the road sign type included in the first image;

[0013] In response to the fact that the road sign type included in the first image is a preset road sign type, the second electronic device acquires the warning data corresponding to the preset road sign type, and the second electronic device establishes a communication connection with the first electronic device; and

[0014] The system outputs a prompt message based on the warning data and vehicle data, wherein the vehicle data is used to describe the current driving status of the vehicle.

[0015] In the above method, the vehicle acquires roadside signs through a first electronic device (e.g., a dashcam), obtains the corresponding road sign type through a road sign recognition model, and if the road sign type is a preset type, then the corresponding warning data is obtained through a second electronic device (e.g., a terminal). This method does not rely on the vehicle's internet-connected intelligent traffic accident prevention methods to provide warning data to the driver, nor does it obtain driving data or route information through mobile phone navigation while ignoring warning data about roadside signs. This method can acquire road sign images using the vehicle's own first electronic device (e.g., a dashcam) and indirectly obtain the warning data corresponding to preset road signs using the network function of the second electronic device (e.g., a terminal) when the vehicle's own internet function is insufficient, and then provide the driver with instruction information, reducing the risk to the driver and ensuring the driver's driving safety.

[0016] In one possible implementation of the first aspect, the preset road sign type includes at least one of accident-prone area road signs, rear-end collision road signs, and speed range warning road signs.

[0017] In another possible implementation of the first aspect, the method of responding to the road sign type included in the first image being a preset road sign type, and obtaining the warning data corresponding to the preset road sign type through the second electronic device includes the following steps:

[0018] In response to the road sign type being the accident-prone area road sign, the second electronic device acquires either the historical accident count or the accident warning message. The historical accident count refers to the number of traffic accidents corresponding to the road sign that have occurred within a preset range of the road sign's location in the past. The preset range includes a first preset range, a second preset range, and a third preset range. The effective range corresponding to the accident-prone area road sign is the first preset range, the effective range corresponding to the rear-end collision road sign is the second preset range, and the effective range corresponding to the speed warning range road sign is the third preset range.

[0019] In response to the road sign type being a rear-end collision road sign, the second electronic device acquires either a dangerous following distance or a historical accident count, wherein the dangerous following distance is determined based on the following distances of vehicles involved in traffic accidents within a second preset range of the road sign's location in the past; and

[0020] In response to the road sign type being the speed warning range road sign, the warning data includes either historical dangerous driving speed or the number of historical accidents, wherein the historical dangerous driving speed is used to characterize the speed of a vehicle that was involved in a traffic accident in the same scenario as the current driving scenario within a third preset range at the location of the road sign in the past.

[0021] In the above method, the road sign type of the road sign included in the first image is a preset road sign type, that is, the specific preset road sign type corresponding to the road sign of the preset road sign type is determined. Different preset road sign types obtain different warning data through the second electronic device, which can ensure that when the vehicle passes through different preset road sign types during driving, it provides the driver with different warning data corresponding to different preset road sign types, improves the accuracy of the warning data, and increases the safety of the driver when driving.

[0022] In another possible implementation of the first aspect, acquiring the warning data corresponding to the preset road sign type via a second electronic device includes the following steps:

[0023] Determine the first location of the road sign included in the first image; and

[0024] The warning data corresponding to the preset road sign type at the first location is obtained through a second electronic device.

[0025] In the above method, a first image of the roadside sign is acquired via a first electronic device on the vehicle. After filtering out the first image of the road sign with a preset road sign type, the first electronic device (e.g., a dashcam) or a vehicle positioning system acquires the first location of the road sign in the first image. A second electronic device then acquires the corresponding warning data based on the first location of the road sign. It should be noted that the second electronic device can input the first location of the road sign into a mobile application (APP) to obtain the corresponding warning data, or it can send the first location of the road sign to a server (e.g., a traffic management server) to obtain the corresponding warning data. In other words, this method can achieve the acquisition of the first location through devices such as dashcams even when the vehicle's internet functionality is insufficient. The second electronic device then obtains the corresponding warning data of the road sign based on the first location, improving driver safety while ensuring the accuracy of the road sign warning data.

[0026] In another possible implementation of the first aspect, acquiring the warning data corresponding to the preset road sign type at the first location via a second electronic device includes the following steps:

[0027] The second electronic device sends the first location of the road sign and the preset road sign type to the server; and

[0028] The second electronic device receives warning data corresponding to the preset road sign type at the first location, obtained from the server.

[0029] In the above method, the second electronic device sends the first location of the road sign to the server (e.g., a traffic management server). The server then sends the relevant warning data of the road sign corresponding to the first location to the second electronic device. It should be noted that a communication connection (e.g., Bluetooth connection) can be established between the server and the second electronic device. The server stores a historical hazard warning database for the road sign, including historical dangerous following distances, historical dangerous driving speeds corresponding to different weather conditions, and historical accident counts. After receiving the first location and type of the road sign, the server selects the type of road sign and the warning data corresponding to the first location from its historical hazard warning database and sends it to the second electronic device. In other words, this method can obtain the warning data corresponding to the road sign through the relay of the second electronic device when the vehicle's Internet function is insufficient, improving the driver's safety while driving and ensuring the accuracy of the obtained road sign warning data.

[0030] In another possible implementation of the first aspect, prior to acquiring the first image, the following steps are further included:

[0031] Acquire the plurality of second images, wherein the second images are roadside images captured by the first electronic device during vehicle travel;

[0032] Extract the target second image that includes the target road sign from the plurality of second images;

[0033] Detect N second images within a preset time period before and after the target second image, where N is a positive integer greater than or equal to 1;

[0034] Extract at least one second image from the N second images, wherein the at least one second image includes the target road sign; and

[0035] The first image is obtained by fusing the at least one second image and the target second image.

[0036] In the above method, the first image is used to represent the image of the target road sign including image enhancement (clarification). That is, during the vehicle's operation, the first electronic device (e.g., a dashcam) captures multiple roadside images of the vehicle (i.e., multiple second images). A target second image including the target road sign is selected, and N second images within a preset time period before and after the target second image are detected. At least one second image from the N second images is extracted, and the at least one second image is fused with the target second image to obtain the first image including the clarified target road sign. This method can obtain a clear target road sign, which facilitates the recognition of the target road sign by the preset road sign model in the vehicle and more accurately determines the type of the target road sign.

[0037] In another possible implementation of the first aspect, extracting at least one second image from the N second images includes the following steps:

[0038] Extract the road sign features corresponding to each of the N second images, wherein the road sign features are used to characterize the integrity and clarity of the road signs in each second image; and

[0039] The first second image is extracted from the N second images based on the road sign features, wherein the first second image is the second image in the N second images in which the integrity and clarity of the road sign both meet preset conditions.

[0040] It should be noted that extracting at least one of the N second images, that is, obtaining at least one second image with the highest clarity while ensuring the integrity of the road sign, and fusing it with the target second image, can yield a clearer first image of the target road sign.

[0041] In another alternative solution of the first aspect, the step of outputting prompt information based on the warning data and vehicle data includes the following steps:

[0042] When the warning data includes the number of historical accidents, and the vehicle data determines that the current second location of the vehicle is within the range of the first preset location, the prompt information is output, wherein the prompt information indicates either the number of historical accidents or the accident prompt message;

[0043] When the warning data includes the dangerous following distance, and it is determined from the vehicle data that the vehicle's current following distance is within the dangerous following distance range, the prompt message is output, indicating the dangerous following distance; and

[0044] When the warning data includes the historical dangerous driving speed, and it is determined from the vehicle data that the current driving speed of the vehicle exceeds the historical dangerous driving speed, the prompt information is output, and the prompt information indicates the historical dangerous driving speed.

[0045] In the above method, after obtaining the warning data corresponding to the road sign in the first image, when the vehicle is within the preset position range of the road sign, the vehicle outputs the prompt information corresponding to the warning data to the driver. It should be noted that the preset position range is different for different types of road signs, and the effective range of different types of road signs is also different. That is to say, when the driver passes by a road sign while driving, he can receive the prompt information about the road sign within the preset position range of the road sign. After exceeding the preset position range, the vehicle stops outputting the prompt information corresponding to the warning data to the driver. It can output the prompt information corresponding to different road signs in road sections with dense road signs, which increases the accuracy of the prompt information corresponding to the road signs.

[0046] Thirdly, embodiments of this application provide an electronic device, including a transceiver, a processor, and a memory. The memory is used to store a computer program, and the processor calls the computer program to execute the first aspect of this application and any one of the accident data prompting methods of the first aspect.

[0047] Fourthly, embodiments of this application provide a computer storage medium storing a computer program, which, when executed by a processor, implements the first aspect of the present application and any one of the accident data prompting methods of the first aspect.

[0048] Fifthly, embodiments of this application provide a computer program product that, when run on an electronic device, causes the electronic device to execute the first aspect of this application and any one of the accident data prompting methods of the first aspect.

[0049] Sixthly, embodiments of this application provide an electronic device that includes the methods or apparatus described in any embodiment of this application. The electronic device is, for example, a chip.

[0050] It should be understood that the descriptions of technical features, technical solutions, beneficial effects, or similar language in this application do not imply that all features and advantages can be achieved in any single embodiment. Rather, it is understood that the description of a feature or beneficial effect means that a specific technical feature, technical solution, or beneficial effect is included in at least one embodiment. Therefore, the descriptions of technical features, technical solutions, or beneficial effects in this specification do not necessarily refer to the same embodiment. Furthermore, the technical features, technical solutions, and beneficial effects described in this embodiment can be combined in any suitable manner. Those skilled in the art will understand that embodiments can be implemented without one or more specific technical features, technical solutions, or beneficial effects of a particular embodiment. In other embodiments, additional technical features and beneficial effects may be identified in specific embodiments that do not embody all embodiments. Attached Figure Description

[0051] The accompanying drawings used in the embodiments of this application are described below.

[0052] Figure 1 This is a schematic diagram of the structure of an accident data notification system 110 provided in an embodiment of this application;

[0053] Figure 2 This is a flowchart illustrating a method for providing accident data alerts according to an embodiment of this application;

[0054] Figure 3 This is a schematic diagram of a scenario where a target road sign is photographed using a first electronic device, as provided in an embodiment of this application.

[0055] Figure 4 This is another schematic diagram of a scenario where a target road sign is photographed using a first electronic device, as provided in an embodiment of this application.

[0056] Figure 5 This is a scene diagram of the first image provided in an embodiment of this application;

[0057] Figure 6 This is a schematic diagram of a road sign prediction device provided in an embodiment of this application;

[0058] Figure 7 This is a schematic diagram of a scenario where a vehicle road sign has a preset location range, as provided in an embodiment of this application.

[0059] Figure 8 This is a schematic diagram of a scenario for obtaining the first location corresponding to a road sign, provided in an embodiment of this application.

[0060] Figure 9 This is a schematic diagram illustrating a scenario where a second electronic device obtains warning data from a traffic management server, as provided in an embodiment of this application.

[0061] Figure 10 This is a schematic diagram illustrating a scenario for determining following distance provided in an embodiment of this application;

[0062] Figure 11 This is a schematic diagram of the structure of an electronic device 1100 related to an embodiment of this application. Detailed Implementation

[0063] The technical solutions in the embodiments of this application will be described more clearly below with reference to the accompanying drawings. The terminology used in the implementation section of the embodiments of this application is only used to explain the specific embodiments of this application and is not intended to limit this application.

[0064] When drivers are driving on highways or complex road sections, in order to ensure that drivers are promptly alerted when passing signs indicating high-frequency accidents, and to provide drivers with relevant information such as accident detection, location, and alerts, thereby reducing safety hazards and risks for drivers, a system 110 corresponding to an accident data alert method is proposed, as described in detail below:

[0065] like Figure 1 As shown, Figure 1 This is a schematic diagram of the structure of an accident data notification system 110 provided in an embodiment of this application. The system 110 includes a first electronic device 101, a second electronic device 102, and a server 103. The first electronic device 101 includes a processor 10 and a memory 20. The first electronic device 101 and the second electronic device 102 establish a communication connection, and the second electronic device 102 and the server 103 establish an internet connection. The first electronic device can be a dashcam, other camera devices on the vehicle, or in-vehicle devices that communicate with the dashcam or camera. The second electronic device can be a mobile phone, tablet, or other terminal.

[0066] Typically, during vehicle operation, the first electronic device 101 (e.g., a dashcam) is used to capture images or videos of the roadside. It should be noted that while the first electronic device 101 captures roadside images while the driver is driving, these images may contain road signs. However, the driver's mobile phone navigation system usually cannot provide warning data based on these road signs. Furthermore, due to insufficient internet connectivity in the vehicle, the system cannot provide the driver with information about dangerous road signs. Consequently, the driver may not receive the corresponding warning information about road signs while driving, increasing the risk of dangerous driving and raising the probability of traffic accidents.

[0067] To address the aforementioned shortcomings, the images captured by the first electronic device 101 are stored in the memory 20. The memory 20 stores computer programs or data, such as multiple images of roadside signs. The processor 10 calls the computer programs or data stored in the memory 20 to perform operations such as inputting the target road sign to identify the road sign type and obtaining information about the target road sign type. It also obtains warning data about the road sign from the second electronic device 102 (e.g., a terminal). In cases where the vehicle's network connectivity is insufficient, the second electronic device 102 uses this warning data combined with real-time driving data to issue a prompt message to the driver. When the second electronic device sends a prompt message to the first electronic device 101, the memory 20 of the first electronic device 101 stores relevant computer programs or data. The processor 10 calls the computer programs or data stored in the memory 20 to broadcast the prompt message to the driver.

[0068] Specifically, after the first electronic device 101 captures a roadside image during the driver's journey, it obtains a first image of a clear target road sign based on the roadside image including the road sign. The road sign image included in the first image is input into a road sign prediction model to obtain the road sign type included in the first image. The processor 10, responding to the road sign type in the first image being a preset road sign type, obtains the first location corresponding to the road sign via the first electronic device 101 or the vehicle positioning system. The second electronic device 102 can obtain warning data corresponding to the road sign included in the first image from the application software APP based on the first location, or it can send the first location and road sign type of the road sign included in the first image to the server 103. Server 103 stores a historical hazard warning database. Based on the first location and type of the road sign, server 103 retrieves the warning data corresponding to the first location of the road sign from the historical hazard warning database. Within a preset distance range of the vehicle approaching the road sign, the server 103 broadcasts a warning message to the driver, taking into account the vehicle's real-time driving data. This ensures that even when the mobile phone / vehicle navigation system cannot provide the driver with warning information based on the road sign, and the vehicle's internet connectivity is insufficient, the warning data of the road sign included in the first image can be obtained through the second electronic device 102. This allows the driver to receive the warning information corresponding to the road sign on the road segment while driving, increasing the likelihood of safe driving and reducing the probability of traffic accidents.

[0069] Please see Figure 2 , Figure 2 This is a flowchart illustrating a method for providing accident data alerts according to an embodiment of this application. This method can be based on... Figure 1 The system 110 shown can be implemented, or it can be implemented based on other architectures. The method includes, but is not limited to, the following steps:

[0070] S201: The vehicle acquires a first image through a first electronic device.

[0071] The first image is used to represent the road sign image, including the image after image enhancement (clarification), that is, the image taken while the vehicle is in motion, such as... Figure 1 The first electronic device 101 shown captures multiple second images of the roadside. These second images may or may not include road signs (e.g., they may include roadside scenery during driving). Therefore, it is necessary to select a target second image that includes a road sign from the multiple second images and input it into the road sign prediction model to identify the type of the target second image. However, due to high vehicle speed or poor weather, the target second image may be unclear, causing the road sign prediction model to identify the wrong type of the target second image. Therefore, it is necessary to sharpen the target second image to obtain the first image, which can increase the clarity of the road sign and improve the accuracy and efficiency of the road sign recognition model in identifying the type of road sign.

[0072] In some embodiments, before the vehicle acquires the first image, it is also necessary to acquire multiple second images, wherein the second images are roadside images collected by the first electronic device 101 during the vehicle's driving process. The first electronic device 101 extracts the target second image, which includes the target road sign, from the multiple second images through the processor 10, detects N second images collected within a preset time before and after the target second image, where N is a positive integer greater than or equal to 1, and performs fusion processing (image enhancement processing) on ​​at least one second image and the target second image to obtain the first image.

[0073] like Figure 3 As shown, Figure 3 This application provides a schematic diagram of a scenario where a target road sign is photographed using a first electronic device. The first electronic device 101 can be a dashcam, another camera device on the vehicle, or an in-vehicle device that is communicatively connected to a dashcam or camera. This application does not limit the specific device to this type. In this application, we will analyze the case where the first electronic device 101 is a dashcam. The first electronic device 101 (e.g., a dashcam) can capture roadside images or record video footage during the vehicle's journey. It can also display the vehicle's real-time speed (e.g., 60 km / h), the vehicle's mileage (e.g., 40 km), the current time (e.g., January 11, 2022, 10:32:33), locate the vehicle's position using a Global Positioning System (GPS), and display the vehicle's driving direction (left, straight, or right, etc.), the vehicle's left and right turn signals, and whether the doors are closed.

[0074] During the vehicle's movement, the first electronic device 101 captures multiple second images of the roadside scene, such as... Figure 3 As shown, a second image including a target road sign (e.g., a rear-end collision sign) taken at 10:32:33 on January 11, 2022, is selected as the target second image. It should be noted that the road sign in this target second image has the highest integrity and clarity among multiple second images including the road sign. Specifically, any one of multiple second images including the road sign can be selected as the target second image (this target second image may be blurry). In this embodiment, the target second image with the highest integrity and clarity among multiple second images including the road sign is selected for analysis. Figure 3 As shown, the target second image includes a rear-end collision sign and roadside scenery (e.g., trees). The processor 10 detects N second images (e.g., 100 second images) collected within a preset time (e.g., 5 seconds before and after) before and after the target second image, extracts at least one second image from the 100 second images, and the at least one second image includes the target sign (rear-end collision sign). The at least one second image is fused with the target second image to obtain the first image.

[0075] It should be noted that selecting at least one second image to fuse with the target second image can be understood as selecting one second image including the target road sign to fuse with the target second image, or selecting multiple second images including the target road sign to fuse with the target second image. This application embodiment does not limit this. In this application embodiment, the case of selecting one second image including the target road sign to fuse with the target second image is analyzed.

[0076] In some embodiments, a second image is selected from at least one second image including the target road sign. During the selection process, a second image with high integrity and clarity of the target road sign needs to be chosen and fused with the target second image. Specifically, road sign features can be extracted from each of the N second images. These road sign features characterize the integrity and clarity of the road sign in each second image. Then, a second image is extracted from the N second images based on the road sign features. The selected second image is one where the integrity and clarity of the road sign among the N second images both meet a preset condition. This preset condition can be that the road sign has 100% integrity while possessing the highest clarity among the N second images. Figure 4 As shown, Figure 4 This is a schematic diagram illustrating another scenario of photographing a target road sign using a first electronic device, as provided in an embodiment of this application. Figure 4The image shown is a second image taken by the first electronic device 102 at 10:32:36 on January 11, 2022. This second image shows 100% integrity of the target road sign (i.e., the rear-end collision road sign) and has the highest clarity among the N second images. Figure 5 As shown, Figure 5 The scene diagram of the first image provided in the embodiments of this application can be selected. Figure 4 The image shown is Figure 3 The target image is fused (image enhancement) to obtain the following result: Figure 5 The first image shown includes a complete and clearly visible rear-end collision sign.

[0077] It should be noted that... Figure 3 The second image of the target shown is... Figure 4 After fusing the second image shown, a sharpened image is obtained that includes the complete rear-end collision sign and roadside scenery (such as trees). At this point, the complete sign portion can be extracted from the sharpened image, resulting in... Figure 5 The first image shown illustrates that removing roadside objects (such as trees) helps to eliminate interference, increase the clarity of the target road sign, and improve the efficiency of the road sign recognition model in recognizing the target road sign.

[0078] S202: The vehicle identifies the road sign information in the first image through the road sign recognition model and determines the road sign type included in the first image.

[0079] After acquiring the first image, it is input into the road sign prediction model. The road sign prediction model can be a model stored in the second electronic device 102, a road sign prediction model included in application software running on the second electronic device, a model stored in the first electronic device 101, a model running on a server, or other models; this embodiment does not limit the specific model. Understandably, the road sign prediction model includes a large number of roadside road sign images and type information. The model is pre-trained using this information to obtain a historical database of road sign information. Since this road sign prediction model is a pre-trained model storing a large amount of road sign information, it does not require network connectivity. The road sign prediction model is used to identify the type of the first image. The type of the first image can be a rear-end collision road sign, an accident-prone area road sign, a speed limit indication road sign, a road segment length road sign, etc. Figure 6 As shown, Figure 6 This is a schematic diagram of a road sign prediction device provided in an embodiment of this application. For example, obtaining... Figure 5 After the first image shown, input the first image as follows: Figure 6In the road sign prediction model shown, the model identifies the type of the first image as a rear-end collision road sign.

[0080] It should be noted that the road sign prediction model can be the road sign prediction model corresponding to the prediction software included in the second electronic device 102. In this case, the road sign prediction model has network connectivity and can be updated in real time based on the collected road signs. When the road sign prediction device does not have network connectivity, the road sign prediction model stores historical data about various road signs. This can be understood as storing historical data about various road sign types in the road sign recognition model. When the vehicle's internet connectivity is insufficient, the first image can be input into the road sign recognition model, and the first image can be compared with the historical data of various road sign types to identify the type of road sign included in the first image.

[0081] S203: The vehicle responds to the fact that the road sign type included in the first image is a preset road sign type, and obtains the warning data corresponding to the preset road sign type through the second electronic device, and the second electronic device establishes a communication connection with the first electronic device.

[0082] Different preset road sign types correspond to different warning data. If the road sign type included in the first image is a preset road sign type, then the warning data corresponding to that road sign type is obtained through the second electronic device 102. It should be noted that in the case of insufficient vehicle networking capabilities, the second electronic device 102 (e.g., a mobile phone or tablet) has networking capabilities and can obtain the warning data corresponding to the preset road signs through the second electronic device 102.

[0083] In some embodiments, the preset road sign type can be one of rear-end collision road signs, accident-prone area road signs, and speed limit indication road signs. The preset road sign type is used to characterize road signs that include dangerous driving information. It should be noted that the road sign type included in the first image can be a rear-end collision road sign, an accident-prone area road sign, a speed limit indication road sign, a road segment length road sign, etc. If the road sign included in the first image is a preset road sign type, the first image of the road sign including the preset road sign type (i.e., including dangerous driving information) is selected for analysis. If it is a non-preset road sign model (a road sign that does not involve dangerous driving issues of the driver), then no analysis is performed on that road sign.

[0084] For example, if the first image includes a road length sign, which indicates the distance of a vehicle's journey from its destination and does not involve dangerous driving by the driver, then there is no need to provide the driver with information about the road length sign. Therefore, the first image including the road length sign will not be analyzed. Figure 5The first image shown includes a rear-end collision sign. This sign is used to warn vehicles that the section of road where the sign is located is a high-risk area for rear-end collisions. This rear-end collision sign is one of the preset sign types, relating to dangerous driving by the driver. In this case, it is necessary to provide the driver with relevant information about rear-end collisions. Figure 5 The first image shown is analyzed.

[0085] In some embodiments, if the vehicle's current location is within a preset location range of the target road sign, the second electronic device acquires warning data about the target road sign (road sign type is a preset road sign) within the preset location range corresponding to the target road sign. For example... Figure 7 As shown, Figure 7 This illustration shows a scenario of a preset location range for a vehicle road sign, as provided in this application embodiment. The preset location range characterizes the effective range corresponding to the target road sign. This range can be the effective range for the second electronic device to acquire warning data from the target road sign, or the effective range for the vehicle to issue a prompt message to the driver. The preset location range can be a circular area centered on the target road sign and with a radius equal to the distance from the farthest effective point N1 of the target road sign to the target road sign. It can also be an elliptical area, or other types of areas. This application embodiment does not limit this type of area. It can be understood that when the vehicle's position is within the preset location range, the second electronic device can acquire the warning data from the target road sign, and simultaneously, the vehicle issues a prompt message to the driver based on the vehicle's real-time driving data and the warning data.

[0086] In this embodiment, the preset location range of the road sign includes a first preset range, a second preset range, and a third preset range. Specifically, the effective range of the road sign for accident-prone areas is the first preset range, the effective range of the rear-end collision road sign is the second preset range, and the effective range of the speed warning road sign is the third preset range. It should be noted that the preset location ranges for different road signs may be the same or different; this embodiment does not limit this.

[0087] In some embodiments, when the warning data acquired by the second electronic device 102 includes the number of historical accidents, it should be noted that when the preset road sign type is an accident-prone area road sign, a rear-end collision road sign, and a speed warning range road sign, the warning data corresponding to all three types of road signs includes the number of historical accidents. The number of historical accidents refers to the number of traffic accidents corresponding to the road sign that have occurred in the past within a preset range of the location of the road sign. That is, if it is an accident-prone area road sign, the number of historical accidents is the number of traffic accidents that have occurred in the past within a first preset range of the location of the accident-prone area road sign; if it is a rear-end collision road sign, the number of historical accidents is the number of traffic accidents that have occurred in the past within a second preset range of the location of the rear-end collision road sign; and if it is a speed warning range road sign, the number of historical accidents is the number of traffic accidents that have occurred in the past within a third preset range of the location of the speed warning range road sign. For example, it can be understood that when the target road sign is a sign for an accident-prone area, the historical accident count is historical data calculated based on historical traffic conditions within a first preset range. This could be the cumulative number of traffic accidents involving vehicles within the first preset range or the average number of traffic accidents occurring daily, etc. The calculation method for the historical accident count can also be determined through other means, and this application does not limit this. Furthermore, it should be noted that the second electronic device will only acquire the warning data corresponding to the accident-prone road sign within the first preset range. Figure 7 As shown, if the road sign type is an accident-prone area road sign, the first preset range can be a circular area with the accident-prone area road sign as the center and the distance from the farthest valid point N1 of the accident-prone area road sign to the accident-prone area road sign as the radius X1, or it can be other types of areas. This application embodiment does not limit this.

[0088] In some embodiments, when the warning data acquired by the second electronic device includes a dangerous following distance, the dangerous following distance is determined based on the following distances of vehicles involved in traffic accidents within a second preset range of the road sign's location historically. The second preset range characterizes the effective range of the rear-end collision road sign; that is, the dangerous following distance is also historical data calculated based on historical traffic conditions within the second preset range. The average following distance of vehicles involved in traffic accidents within the second preset range can be used as the dangerous following distance. The dangerous following distance can also be determined in other ways, which this application does not limit. Furthermore, it should be noted that the second electronic device only acquires the warning data or prompt information corresponding to the rear-end collision road sign within the second preset range. Figure 7 As shown, if the road sign type is a rear-end collision road sign, the second preset range can be a circular area with the rear-end collision road sign as the center and the distance from the farthest valid point N1 of the rear-end collision road sign to the rear-end collision road sign as the radius X1, or it can be other types of areas. This application embodiment does not limit this.

[0089] In some embodiments, the warning data acquired by the second electronic device includes historical dangerous driving speeds, wherein the historical dangerous driving speed is used to characterize the speed of a vehicle that was involved in a traffic accident in the same scenario as the current driving scenario within a third preset range at the location of the road sign in the past. The driving scenario can be understood as the weather conditions (e.g., rain, snow, sunny) and vehicle type (e.g., car, bus) corresponding to the vehicle being next to the roadside road sign. It should be noted that the historical dangerous driving speeds acquired by the same roadside road sign are different in different driving scenarios. For example, when the driving scenario of the speed range road sign is severe weather (rain) and the vehicle type is a bus, the historical dangerous driving speed is usually relatively low, such as 30 km / h. On the other hand, when the driving scenario is good weather (sunny) and the vehicle type is a car, the historical dangerous driving speed is usually higher than that in severe weather, such as 45 km / h. The third preset range is used to characterize the effective range of the speed warning sign. In other words, the dangerous driving distance is also historical data calculated based on historical traffic conditions within the third preset range. The average driving speed of vehicles involved in traffic accidents within the third preset range can be used as the dangerous driving speed. Historical dangerous driving speeds can also be determined in other ways, which this application does not limit. Furthermore, it should be noted that the second electronic device only acquires the warning data or information corresponding to the speed warning sign within the third preset range, such as... Figure 7 As shown, if the road sign type is a speed warning road sign, the third preset range can be a circular area with the speed warning road sign as the center and the distance from the farthest valid point N1 of the speed warning road sign to the speed warning road sign as the radius X1. It can also be other types of areas. This application embodiment does not limit this.

[0090] In some embodiments, if the road signs included in the first image are of different types, the warning data obtained by the second electronic device will also be different. The processor 10 of the first electronic device, in response to the road sign type being an accident-prone area road sign, obtains either the number of historical accidents or the accident warning message through the second electronic device; the processor 10, in response to the road sign type being a rear-end collision road sign, obtains either the dangerous following distance or the number of historical accidents through the second electronic device; and the processor 10, in response to the road sign type being a speed range warning road sign, obtains the warning data including either the historical dangerous driving speed or the number of historical accidents.

[0091] Different road signs correspond to different warning data. That is, if the road sign is a high-accident-occurrence road sign, the second electronic device obtains the warning data corresponding to the high-accident-occurrence road sign as either the historical accident count or the accident prompt. The historical accident count refers to the number of traffic accidents corresponding to the road sign that have occurred within a first preset range of the location of the road sign in the past. It can be a historical cumulative number (e.g., "the cumulative number of traffic accidents that have occurred within the first preset range of the location of the high-accident-occurrence road sign in the past is 560") or a historical average number within a preset time period (e.g., "the number of traffic accidents that have occurred within the first preset range of the location of the high-accident-occurrence road sign in the past is an average of 3 times per day"). This application embodiment does not limit this.

[0092] It should be noted that the types of road signs in accident-prone areas can be those that directly display the warning "Accident-prone road section, please slow down"; or they can be road signs that display information such as low-lying roads, uneven roads, or icy roads in words or pictures, with corresponding accident warnings such as "Current road surface is low-lying and uneven," "Current road surface is icy," or "Accident-prone area."

[0093] In some embodiments, the first location corresponding to the road sign is obtained. For example... Figure 8 As shown, Figure 8 This is a schematic diagram illustrating a scenario for obtaining the first location corresponding to a road sign, provided by an embodiment of this application. During vehicle operation, the vehicle can obtain its location A (second location) through the GPS positioning function of the first electronic device 101 (e.g., a dashcam), or through other means; this embodiment does not limit this method. At this time, an image of the target road sign is acquired using the shooting function of the first electronic device 101. The distance X2 between the vehicle and the target road sign in the image is extracted. The vehicle location A is then added to the distance X2 to obtain the first location of the target road sign, which is location B. It should be noted that if the vehicle happens to pass by the road sign while driving, the distance X1 between the vehicle and the target road sign is 0, and in this case, the vehicle's location A is the first location of the road sign.

[0094] In some embodiments, the second electronic device 102 obtains corresponding warning data based on a preset road sign type. This requires first determining the first position of the road sign included in the first image; and then obtaining the warning data corresponding to the preset road sign type at the first position through the second electronic device 102. It should be noted that the second electronic device 102 can obtain the warning data corresponding to the road sign based on the first position of the road sign within an application software (APP), or it can obtain the warning data corresponding to the road sign based on the server 103. That is, the second electronic device 102 has interconnectivity. If the warning data is obtained through the application software (APP), the application software (APP) can store network data when the second electronic device 102 is connected to the internet. This network data can be a database of warning data corresponding to preset road sign types and locations. This database can include historical information such as dangerous following distance at the road segment where the road sign is located, dangerous driving speeds under different weather conditions, and the number of historical accidents. The first electronic device 101 can then obtain the warning data based on the road sign type. The first location and road sign type are obtained from the application software (APP) to obtain the warning data corresponding to the road sign. If the warning data corresponding to the road sign is obtained through the server 103, the second electronic device 102 can send the first location and road sign type of the road sign to the server 103 (e.g., a server). The server 103 stores a database of warning data corresponding to preset road signs. The database of warning data may include information such as the dangerous following distance of the road segment where the road sign is located, the dangerous driving speed corresponding to different weather conditions, and the number of historical accidents. The server 103 obtains the warning data corresponding to the road sign from the warning database according to the first location and road sign type of the road sign. In this embodiment of the application, the case where the second electronic device 102 obtains the warning data from the server 103 is analyzed.

[0095] In some embodiments, the vehicle sends the first location and preset road sign type of a road sign to the server 103 via a second electronic device 102; and the vehicle receives warning data corresponding to the preset road sign type at the first location obtained by the second electronic device from the server. Figure 9 As shown, Figure 9 This is a schematic diagram of a scenario where a second electronic device obtains warning data from a server, as provided in an embodiment of this application. The second electronic device 102 sends the first location of a road sign to the server 103. The server 103 obtains the warning data corresponding to the road sign from the warning database based on the first location and type of the road sign, and then sends the warning data corresponding to the road sign to the second electronic device 102. The second electronic device 102 then obtains the warning data corresponding to the road sign.

[0096] S204: The vehicle outputs a prompt message based on the warning data and vehicle data;

[0097] After obtaining the warning data corresponding to the road sign based on its type and initial position, the vehicle collects real-time vehicle data describing its current driving status. This vehicle data may include real-time vehicle speed, following distance from the vehicle in front, etc. By comparing the warning data with the vehicle data, the system outputs prompts to the driver, and can also broadcast corresponding prompts via voice.

[0098] In some embodiments, the second electronic device 102 combines real-time vehicle driving data and warning data to output prompt information. Specifically, the second electronic device (with network connectivity) acquires warning data about preset roadside signs, such as dangerous following distance or dangerous driving speed; real-time driving data (e.g., following distance or driving speed) can be acquired by the first electronic device (which may not have network connectivity), or by the second electronic device or through other devices, which is not limited in this embodiment. If the real-time driving data is collected by the first electronic device, the first electronic device sends the real-time driving data to the second electronic device, and the second electronic device outputs prompt information in combination with the warning data; if the real-time driving data is collected by the second electronic device, the second electronic device outputs prompt information in combination with the real-time vehicle driving data and the warning data about the road signs it has acquired.

[0099] In some embodiments, the corresponding prompt information is broadcast to the driver via voice. This can be done by the first electronic device 101, the second electronic device 102, or other methods, which are not limited in this application. It should be noted that if the second electronic device 102 uses its own network function to directly output the prompt information to the driver via voice, the output method could be by installing mobile phone voice broadcast software, etc.; if a communication connection is established between the second electronic device 102 and the first electronic device 101, the processor 10 in the first electronic device 101 (e.g., a dashcam) calls the relevant program or data stored in the memory 20 to execute the step of broadcasting the prompt information to the driver via voice, and the broadcast method could be by using the broadcast function of the dashcam, etc.

[0100] It should be noted that the prompt information to the driver can be delivered via voice broadcast, or by converting the prompt information into spoken text and displaying it on the screen of the first electronic device 101, or on the screen of other devices that have a communication connection with the first electronic device 101, or in other forms. This embodiment of the application does not limit this to any particular form. In this embodiment, the prompt information is delivered to the driver via voice broadcast.

[0101] In some embodiments, vehicle data may include real-time vehicle speed, which can be obtained by means of, for example... Figure 3 The first electronic device 101 shown obtains the real-time vehicle speed as 60km / h. Alternatively, the real-time vehicle speed can be detected by a second electronic device or obtained through other means. This application embodiment does not limit this.

[0102] In some embodiments, vehicle data may include the following distance between the vehicle and the vehicle in front, such as... Figure 10 As shown, Figure 10 This application provides a schematic diagram of a scenario for determining following distance in an embodiment of the present application. The vehicle uses the camera function of the first electronic device 101 to capture an image including the vehicle in front. The processor 10 extracts the distance between the front of the vehicle and the rear of the vehicle in front in the image. Figure 10 As shown, when the road sign type is a rear-end collision road sign, the distance between the front of the driving vehicle and the rear of the vehicle in front is X3. It should be noted that the following distance between the vehicle and the vehicle in front can also be obtained through other means, and this application embodiment does not limit this.

[0103] In some embodiments, in response to a preset road sign type, the processor 10 outputs a prompt message to the driver based on vehicle data, warning data, and the relationship between the vehicle's position and the preset location range of the road sign. For example, if the preset road sign type is as follows... Figure 5 As shown in the rear-end collision sign, the vehicle processor 10 responds to warning data including dangerous following distance, through, for example... Figure 10 The following distance X3 between the driving vehicle and the vehicle in front is obtained in the manner shown, and by means of... Figure 7 The method shown obtains the preset location range of the road sign corresponding to the rear-end collision sign. For example, it can be understood that when the road sign is a rear-end collision sign, the warning data obtained by the second electronic device 102 may include dangerous following distance "the dangerous following distance of the current road sign segment is 1.5m". Figure 10 The following distance X3 between the vehicle and the vehicle in front is obtained as 1.3m in the method shown. Figure 7 The distance X1 = 15m to the farthest effective point N1 corresponding to the rear-end collision road sign is obtained in the manner shown. The preset range of the rear-end collision road sign is a circular area with the rear-end collision road sign as the center and the distance X1 = 15m to the farthest effective point as the radius. When the vehicle travels into the preset effective range of the road sign corresponding to the rear-end collision road sign, the vehicle compares the dangerous following distance of 1.5m with the following distance of 1.3m between the vehicle and the vehicle in front through the processor 10. If it is determined that the following distance between the vehicle and the vehicle in front is within the dangerous following distance range, the vehicle will issue a prompt message to the driver: "Notice that your following distance is within the dangerous following distance range. Please slow down and increase the following distance!"

[0104] In some embodiments, if the vehicle's current location is within a preset location range of the target road sign, the vehicle outputs a prompt message based on warning data and real-time vehicle data, such as... Figure 7 As shown, the preset location range is used to characterize the effective range from which the vehicle issues a warning message. The preset location range can be a circular area centered on the target road sign and with a radius equal to the distance from the farthest effective point of the target road sign to the road sign itself. It can also be other types of areas; this application embodiment does not limit this. In this application embodiment, the road sign preset location range can include a first preset range, a second preset range, and a third preset range, consistent with the preset range corresponding to the acquired warning data, and will not be elaborated further. It can be understood that when the vehicle's position is within the preset location range, the vehicle issues a warning message to the driver based on the vehicle's real-time data and warning data. For example, if the target road sign is a rear-end collision sign, such as... Figure 7 As shown. The distance from the farthest effective point N1 of the rear-end collision road sign to the rear-end collision road sign is X1. The preset position range of the rear-end collision road sign (i.e., the second preset range) can be a circular area with the rear-end collision road sign as the center and the farthest effective distance X1 as the radius. Within the preset position range of the rear-end collision road sign, the vehicle can issue a prompt message to the driver based on the vehicle's real-time data and warning data.

[0105] Specifically, when the processor 10 of vehicle 10 responds to warning data including the number of historical accidents, and determines, based on vehicle data, that the vehicle's current second location A is within a first preset location range, the vehicle outputs a prompt message based on the warning data and vehicle data. The prompt message indicates the number of historical accidents or an accident warning, etc. The specific content of the prompt message will not be elaborated further. Alternatively, when the vehicle processor 10 responds to warning data including dangerous following distance, and determines, based on vehicle data, that the vehicle's current following distance is within a dangerous following distance range, and the vehicle's current second location A is within the second preset range, the vehicle outputs a prompt message based on the warning data and vehicle data. The prompt message indicates the dangerous following distance. And when the vehicle processor 10 responds to warning data including historical dangerous driving speed, and determines, based on vehicle data, that the vehicle's current speed exceeds the historical dangerous driving speed, and the vehicle's current second location A is within the third preset range, the vehicle outputs a prompt message based on the warning data and vehicle data. The prompt message indicates the historical dangerous driving speed. It should be noted that the preset ranges for different road signs can be the same or different, and this embodiment does not limit this.

[0106] exist Figure 2In the method shown, the vehicle acquires roadside signs through a first electronic device (e.g., a dashcam), obtains the corresponding road sign type through a road sign recognition model, and if the road sign type is a preset type, then the corresponding warning data is obtained through a second electronic device (e.g., a terminal). This method does not rely on the vehicle's internet-connected intelligent traffic accident prevention methods to provide warning data to the driver, nor does it obtain driving data or route information through mobile phone navigation while ignoring warning data about roadside signs. This method can acquire road sign images using the vehicle's own first electronic device (e.g., a dashcam) and indirectly obtain the warning data corresponding to preset road signs using the network function of the second electronic device (e.g., a terminal) when the vehicle's own internet function is insufficient, and then provide the driver with instruction information, reducing the risk to the driver and ensuring the driver's driving safety.

[0107] Simultaneously, after acquiring the first image of the roadside sign via the first electronic device on the vehicle and filtering out the road sign type as a preset type, the first electronic device (e.g., a dashcam) or the vehicle positioning system obtains the first location of the road sign in the first image. The second electronic device then obtains the corresponding warning data through the first location of the road sign. It should be noted that the second electronic device can input the first location of the road sign into a mobile application (APP) to obtain the corresponding warning data, or it can send the first location of the road sign to a server (e.g., a traffic management server) to obtain the corresponding warning data. In other words, this method can achieve the goal of obtaining the first location through devices such as dashcams even when the vehicle's internet function is insufficient. The second electronic device then obtains the corresponding warning data of the road sign through the first location of the road sign, improving the safety of the driver while driving and ensuring the accuracy of the road sign warning data. Simultaneously, after retrieving the warning data corresponding to the road sign in the first image, when the vehicle is within the preset position range of the road sign, the vehicle outputs the corresponding warning information to the driver. It should be noted that the preset position range is different for different types of road signs, and the effective range of different types of road signs is also different. That is to say, when the driver passes by a road sign while driving, he can receive the warning information about the road sign within the preset position range of the road sign. After exceeding the preset position range, the vehicle stops outputting the warning information corresponding to the warning data to the driver. It can output the corresponding warning information for different road signs in road sections with dense road signs, increasing the accuracy of the corresponding warning information.

[0108] refer to Figure 11 , Figure 11 A schematic diagram of the structure of an electronic device 1100 related to an embodiment of this application is shown. For example... Figure 11As shown, device 1100 may include: one or more network device processors 1101, memory 1102, communication interface 1103, transmitter 1104, and receiver 1105. These components can be connected via a bus or other means. Figure 11 Taking a bus connection as an example:

[0109] Processor 1101 may be implemented as one or more central processing unit (CPU) chips, cores (e.g., multi-core processors), field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), and / or digital signal processors (DSPs), and / or may be part of one or more ASICs. Processor 1101 can be used to perform any of the schemes described in the above embodiments of the invention, including data transmission methods. Processor 1101 may be implemented in hardware or a combination of hardware and software.

[0110] Memory 1102 is coupled to processor 1101 and is used to store various software programs and / or sets of instructions. Specifically, memory 1102 may include high-speed random access memory and may also include non-volatile memory, such as one or more disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. Memory 1102 may also store network communication programs that can be used to communicate with one or more auxiliary devices, one or more terminal devices, or one or more network devices.

[0111] The communication interface 1103 can be used by device 1100 to communicate with other communication devices, such as terminal devices. Specifically, the communication interface 1103 may include a wired interface, such as a twisted-pair interface. Device 1100 connects to a twisted-pair cable through this twisted-pair interface, thereby enabling wired communication with the terminal device. In addition, device 1100 may also be configured with a wireless interface, such as one or more of the following: Global System for Mobile Communications (GSM) (2G) communication interface, Wideband Code Division Multiple Access (WCDMA) (3G) communication interface, and Long Term Evolution (LTE) (4G) communication interface, or a 5G or future New Radio (NR) communication interface. This wireless interface is used for wireless communication between device 1100 and the terminal device.

[0112] Transmitter 1104 can be used as an output device of terminal device 1100. For example, it can transmit data out of terminal device 1100. Receiver 1105 can be used as an input device of terminal device 1100, for example, it can transmit data into terminal device 1100. Furthermore, transmitter 1104 may include one or more optical transmitters and / or one or more electrical transmitters. Receiver 1105 may include one or more optical receivers and / or one or more electrical receivers. Transmitter 1104 / receiver 1105 may take the form of a modem, modem group, Ethernet card, Universal Serial Bus (USB) interface card, serial interface, token ring card, Fiber Distributed Data Interface (FDDI) card, etc.

[0113] The processor 1101 can be used to read and execute computer-readable instructions. Specifically, the processor 1101 can be used to call a program stored in the memory 1102, such as the implementation program of the data transmission method on the network device side provided in one or more embodiments of this application, and execute the instructions contained in the program.

[0114] In this embodiment, the processor 1101 can be used to read and execute computer-readable instructions. Specifically, the processor 1101 can be used to call a program stored in the memory 1102, such as the implementation program of the data transmission method on the network device side provided in one or more embodiments of this application, and execute the instructions contained in the program.

[0115] The memory 1102 is coupled to the terminal device processor 1101 and is used to store various software programs and / or multiple sets of instructions. Specifically, the memory 1102 may include auxiliary memory, read-only memory (ROM), or random access memory (RAM).

[0116] Auxiliary storage typically includes one or more disk drives or tape drives for non-volatile data storage, and serves as an overflow data storage device if RAM capacity is insufficient to store all working data. Auxiliary storage can be used to store programs, which are loaded into RAM when selected for execution. ROM is used to store instructions read during program execution, as well as any data that may be read. ROM is a non-volatile storage device, and its storage capacity is typically small compared to the larger storage capacity of auxiliary storage. RAM is used to store volatile data and may also be used to store instructions. Access to both ROM and RAM is generally faster than access to auxiliary storage.

[0117] It should be noted that, Figure 11The electronic device 1100 shown is merely one implementation of the embodiments of this application. In actual applications, the electronic device 1100 may include more or fewer components, which is not limited here.

[0118] It should be noted that the electronic devices involved in this application can be a first electronic device, a second electronic device, or a road sign prediction device. The first electronic device establishes a communication connection with the second electronic device, and the second electronic device establishes a network connection with a server or application software (APP). The road sign prediction device can establish communication connections with both the first and second electronic devices. The road sign prediction device includes a road sign prediction model that stores a large amount of data on road sign images and types. The target road sign is input into the road sign prediction model and compared with existing road sign types to output the type of the target road sign. This road sign prediction device can be used without a network connection. The first electronic device can be a dashcam in a vehicle, other camera devices in the vehicle, or an in-vehicle device that communicates with a dashcam or camera. The first electronic device may not have network connectivity, but when powered on or connected to Bluetooth positioning, it can capture images, locate the vehicle's position, and detect the vehicle's real-time speed. The second electronic device can be a mobile phone or tablet or other device with network connectivity. Among its various network-connected functions, the second electronic device can also detect the vehicle's real-time speed, locate the vehicle's position, and establish a network connection with a server or its own application software (APP) to obtain warning data.

[0119] This application also provides a computer-readable storage medium storing a computer program that, when run on a processor, implements... Figure 2 The method flow is shown.

[0120] This invention also provides a computer program product that, when run on a processor, implements... Figure 2 The method flow is shown.

[0121] In summary, by implementing the embodiments of this application, the vehicle acquires roadside signs through a first electronic device (e.g., a dashcam), obtains the corresponding road sign type through a road sign recognition model, and if the road sign type is a preset road sign type, then the corresponding warning data is obtained through a second electronic device (e.g., a terminal). This method does not rely on the vehicle's internet-connected intelligent traffic accident prevention method to provide warning data to the driver, nor does it obtain driving data or route information through mobile phone navigation while ignoring the prompts about roadside signs. This method can acquire road sign images using the vehicle's own first electronic device (e.g., a dashcam) and indirectly obtain the warning data corresponding to the preset road signs using the network function of the second electronic device (e.g., a terminal) when the vehicle's own internet function is insufficient, and then provide prompts to the driver, thereby reducing the risk to the driver and ensuring the driver's driving safety.

[0122] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program using computer program-related hardware. The computer program can be stored in a computer-readable storage medium, and when executed, it can include the processes described in the above method embodiments. The aforementioned storage medium includes various media capable of storing computer program code, such as read-only memory (ROM) or random access memory (RAM), magnetic disks, or optical disks.

Claims

1. A method for providing accident data alerts, characterized in that, Includes the following steps: The first image is acquired through the first electronic device; The road sign information in the first image is identified by the road sign recognition model to determine the road sign type included in the first image; In response to the road sign type included in the first image being a preset road sign type, a second electronic device acquires the warning data corresponding to the preset road sign type, and the second electronic device establishes a communication connection with the first electronic device; the preset road sign type includes accident-prone area road signs, rear-end collision road signs, and speed range warning road signs. The process of acquiring the warning data corresponding to the preset road sign type via the second electronic device in response to the road sign type included in the first image comprising the following steps: In response to the road sign being an accident-prone area road sign, the second electronic device acquires historical accident counts and accident warning messages. The historical accident counts are the number of traffic accidents corresponding to the road sign that have occurred within a preset range of the road sign's location in the past. The preset range includes a first preset range, a second preset range, and a third preset range. The effective range corresponding to the accident-prone area road sign is the first preset range, the effective range corresponding to the rear-end collision road sign is the second preset range, and the effective range corresponding to the speed warning range road sign is the third preset range. In response to the road sign type being a rear-end collision road sign, the dangerous following distance and the historical accident count are obtained via the second electronic device, wherein the dangerous following distance is determined based on the following distances of vehicles involved in traffic accidents within a second preset range of the road sign's location in the past; and In response to the road sign type being the speed warning range road sign, the warning data includes historical dangerous driving speeds and the number of historical accidents, wherein the historical dangerous driving speeds are used to characterize the speeds of vehicles that were involved in traffic accidents in the same scenario as the current driving scenario within the third preset range at the location of the road sign in the past; and The system outputs a prompt message based on the warning data and vehicle data, wherein the vehicle data is used to describe the current driving status of the vehicle.

2. The method according to claim 1, wherein obtaining the warning data corresponding to the preset road sign type through the second electronic device includes the following steps: Determine the first position of the road sign included in the first image; as well as The warning data corresponding to the preset road sign type at the first location is obtained through the second electronic device.

3. The method according to claim 2, wherein obtaining the warning data corresponding to the preset road sign type at the first location via a second electronic device includes the following steps: The second electronic device sends the first location of the road sign and the preset road sign type to the server. as well as The second electronic device receives warning data corresponding to the preset road sign type at the first location, obtained from the server.

4. The method according to any one of claims 1-3, further comprising the following step before acquiring the first image: Multiple second images are acquired, wherein the second images are roadside images captured by the first electronic device during vehicle movement; Extract the target second image that includes the target road sign from the plurality of second images; N second images were collected within a preset time period before and after detecting the target second image, where N is a positive integer greater than or equal to 1; Extract at least one second image from the N second images, wherein the at least one second image includes the target road sign; and The first image is obtained by fusing the at least one second image and the target second image.

5. The method according to claim 4, wherein extracting at least one second image from the N second images comprises the following steps: Extract the road sign features corresponding to each of the N second images, wherein the road sign features are used to characterize the integrity and clarity of the road signs in each second image; and Based on the road sign features, one second image is extracted from the N second images, wherein the second image is the second image in the N second images whose integrity and clarity of the road sign both meet preset conditions.

6. The method according to claim 3, wherein outputting prompt information based on the warning data and vehicle data includes the following steps: In response to the warning data including the number of historical accidents, and the determination based on the vehicle data that the current second location of the vehicle is within the first preset range, the prompt information is output, wherein the prompt information indicates either the number of historical accidents or the accident prompt message; In response to the warning data including the dangerous following distance, and based on the vehicle data determining that the vehicle's current following distance is within the dangerous following distance range, and that the vehicle's current second location is within the second preset range, the system outputs the prompt information, which indicates the dangerous following distance; and In response to the warning data including the historical dangerous driving speed, and based on the vehicle data determining that the vehicle's current speed exceeds the historical dangerous driving speed, and the vehicle's current second location being within the third preset range, the system outputs the prompt information, which indicates the historical dangerous driving speed.

7. An electronic device, characterized in that, It includes a transceiver, a processor, and a memory, wherein the memory is used to store a computer program, and the processor invokes the computer program to perform the method as described in any one of claims 1-6.

8. A computer-readable storage medium, characterized in that, The computer-readable storage medium is used to store a computer program, which, when executed by a processor, implements the method according to any one of claims 1-6.

Images