Reminder method, reminder system, storage medium, and electronic device
By detecting pedestrian and vehicle information on sidewalks and lanes, determining the reminder mode and transmitting avoidance information, the problem that the existing traffic reminder system cannot transmit avoidance information in a timely manner, and improving the traffic safety of pedestrians and vehicles.
Patent Information
- Application Number
- CN202110856131.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-07-28
- Publication Date
- 2025-01-14
- Estimated Expiration
- 2041-07-28
AI Technical Summary
The existing traffic reminder system is difficult to effectively ensure the safety of pedestrians, especially when the driver does not respond in time or the device hardware is restricted, it cannot transmit evasion information in time, resulting in the occurrence of safety accidents.
By detecting pedestrian and vehicle information on sidewalks and lanes, confirm reminder modes and promptly transmit avoidance information, including screen text and voice broadcast reminders, and even extend traffic light time to increase safety time, identify and record risky vehicles, and improve the passage of pedestrians and vehicles. Safety.
It realizes the timely transmission of avoidance information based on traffic conditions, improves the traffic safety of pedestrians and vehicles, reduces the occurrence of safety accidents, and enhances the ability to actively avoid pedestrians.
Smart Images

Figure CN115691093B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of traffic safety, and in particular to a reminder method, a reminder system, a computer-readable storage medium and an electronic device. Background Art
[0002] In the related art, monitoring devices installed at traffic light intersections and intelligent reminder devices installed on cars are used to remind drivers of the real-time situation at traffic light intersections, helping drivers to pass more safely. However, this technology mainly reminds or restricts drivers, but when drivers do not pay attention to reminders or do not respond in time, or when there are hardware limitations on the device, it is still easy to cause safety accidents and fail to ensure the safety of pedestrians. Summary of the invention
[0003] The present invention aims to solve at least one of the technical problems in the related art to a certain extent. To this end, the first object of the present invention is to provide a reminder method to timely transmit avoidance reminder information to pedestrians and vehicle owners according to traffic conditions, thereby improving the traffic safety of pedestrians and vehicles.
[0004] The second object of the present invention is to provide a reminder system.
[0005] A third object of the present invention is to provide a computer-readable storage medium.
[0006] A fourth object of the present invention is to provide an electronic device.
[0007] To achieve the above object, a first embodiment of the present invention provides a reminder method, comprising the following steps:
[0008] When pedestrians are detected in a preset area, the lane information of the lane corresponding to the sidewalk and the vehicle information on the corresponding lane are obtained; based on the lane information and the vehicle information, the pedestrian reminder mode is determined and it is judged whether it is necessary to remind the car owner; the pedestrian is reminded according to the determined pedestrian reminder mode, and the corresponding car owner is reminded when it is necessary to remind the car owner.
[0009] According to one embodiment of the present invention, determining the pedestrian reminder mode and judging whether it is necessary to remind the vehicle owner based on the lane information and the vehicle information includes: judging whether all vehicles in the corresponding lane are in a waiting state based on the lane information and the vehicle information; if so, determining that the pedestrian reminder mode is a screen text reminder, and it is not necessary to remind the vehicle owner; if not, determining that the pedestrian reminder mode is a screen text and voice broadcast reminder, and it is necessary to remind the vehicle owner.
[0010] Furthermore, after determining that there is a vehicle that is not in a waiting state on the corresponding lane, the method also includes: judging whether there is a risk vehicle among the vehicles that are not in a waiting state based on the lane information and the vehicle information; if so, recording the identity information of the risk vehicle, and transmitting the identity information of the risk vehicle to the traffic management platform.
[0011] According to one embodiment of the present invention, after determining that a pedestrian is about to cross the sidewalk, the method further includes: judging whether there is an inattentive pedestrian based on the pedestrian information; if so, determining that the pedestrian reminder mode is screen text and voice broadcast reminder, or voice broadcast reminder.
[0012] Furthermore, when the pedestrian is concentrating and the vehicles in the corresponding lane are in a waiting state, a two-wheeled vehicle is detected approaching, the pedestrian reminder mode is determined to be screen text and voice broadcast reminder, and reminder information of the approaching two-wheeled vehicle is added to the reminder information for the pedestrian.
[0013] Furthermore, judging whether there are inattentive pedestrians based on pedestrian information includes: obtaining pedestrian information around the sidewalk, wherein the pedestrian information includes pedestrian images; identifying the pedestrian images to determine the line of sight positions of pedestrians passing through the sidewalk; and determining the presence of inattentive pedestrians if the line of sight of some pedestrians does not fall on the vehicle on the corresponding lane.
[0014] According to one embodiment of the present invention, judging whether all vehicles in the corresponding lane are in a waiting state based on the lane information and the vehicle information includes: judging whether there is an empty lane based on the lane information and the vehicle information, wherein the empty lane is a lane in which no vehicles exist in the parking waiting area of the corresponding lane; if so, judging whether there is a vehicle in the empty lane heading towards the sidewalk based on the vehicle information; if so, determining whether there is a vehicle in the corresponding lane that is not in a waiting state.
[0015] According to one embodiment of the present invention, the determining whether there is a risk vehicle among the vehicles that are not in a waiting state comprises: determining the driving condition of the vehicle on the empty lane based on the vehicle information; if the vehicle on the empty lane accelerates, calculating a first deceleration distance when the vehicle on the empty lane decelerates to a speed of zero at the current vehicle speed and a preset deceleration; determining whether the first deceleration distance is greater than the distance between the current position of the vehicle on the empty lane and the sidewalk; if so, determining that there is a risk vehicle among the vehicles that are not in a waiting state.
[0016] Furthermore, after determining that there is a risky vehicle among the vehicles that are not in a waiting state, the method also includes: extending the red light time of the traffic light corresponding to the sidewalk, and adding a first preset information to the reminder information for pedestrians to remind them that there is a danger in the empty lane.
[0017] According to one embodiment of the present invention, if the vehicle on the empty lane decelerates, a second deceleration distance when the vehicle on the empty lane decelerates to a speed of zero at the current speed and deceleration is calculated; a determination is made as to whether the second deceleration distance is greater than the distance between the current position of the vehicle on the empty lane and the sidewalk; if so, a second preset information is added to the reminder information for the owner of the vehicle on the empty lane to provide a deceleration reminder.
[0018] According to the reminder method of the embodiment of the present invention, pedestrians are reminded through the determined pedestrian reminder mode and the corresponding car owners are reminded when it is necessary to remind the car owners, so that avoidance reminder information is transmitted to pedestrians and car owners in time according to traffic conditions, thereby improving the traffic safety of pedestrians and vehicles.
[0019] To achieve the above-mentioned purpose, a second aspect of the present invention proposes a reminder system, which includes: an acquisition module, which is used to acquire lane information of a lane corresponding to the sidewalk and vehicle information on the corresponding lane when pedestrians are detected in a preset area; a determination module, which is used to determine the pedestrian reminder mode and judge whether it is necessary to remind the car owner based on the lane information and the vehicle information; a reminder module, which is used to remind pedestrians according to the determined pedestrian reminder mode, and remind the corresponding car owner when it is necessary to remind the car owner.
[0020] According to the reminder system of the embodiment of the present invention, pedestrians are reminded through the determined pedestrian reminder mode and the corresponding car owners are reminded when it is necessary to remind the car owners, so that avoidance reminder information is transmitted to pedestrians and car owners in time according to traffic conditions, thereby improving the traffic safety of pedestrians and vehicles.
[0021] To achieve the above-mentioned purpose, a third aspect of the present invention provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the reminder method is implemented.
[0022] To achieve the above-mentioned purpose, a fourth aspect of the present invention proposes an electronic device, comprising a memory, a processor and a computer program stored in the memory, wherein when the computer program is executed by the processor, the reminder method is implemented.
[0023] Additional aspects and advantages of the present invention will be given in part in the following description and in part will be obvious from the following description, or will be learned through practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS
[0024] Figure 1 is a flowchart of a reminder method according to an embodiment of the present invention;
[0025] Figure 2 It is a schematic diagram of the structure of a reminder system according to an embodiment of the present invention. DETAILED DESCRIPTION
[0026] Embodiments of the present invention are described in detail below, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present invention, and should not be construed as limiting the present invention.
[0027] Please refer to the following Figure 1-2 The reminder method, reminder system, storage medium and electronic device according to the embodiments of the present invention are described.
[0028] Figure 1 FIG. 1 is a flow chart of a reminder method according to an embodiment of the present invention. Figure 1 As shown, the reminder method comprises the following steps:
[0029] S101. When a pedestrian is detected in a preset area, lane information of a lane corresponding to the sidewalk and vehicle information on the corresponding lane are obtained.
[0030] Specifically, it is possible to detect whether there are pedestrians in a preset area by using a camera device (such as a camera, a visual sensor) installed on a pedestrian traffic light, an infrared sensing module, a laser radar, etc. installed in the waiting area of the sidewalk, wherein the preset area may be the waiting area of the sidewalk, or the waiting area of the sidewalk and the area where the sidewalk is located. If there are pedestrians in the preset area, it is determined that a pedestrian is passing through the sidewalk. When a pedestrian passes through the sidewalk, the lane corresponding to the sidewalk and the vehicle on the corresponding lane can be identified by the camera device of the pedestrian traffic light, and the lane information of the lane corresponding to the sidewalk and the vehicle information on the corresponding lane can be obtained. It should be noted that if there are vehicles in all lanes around the sidewalk, the lane where the vehicle that needs to pass through the sidewalk is located is the corresponding lane of the sidewalk. Among them, the lane information of the lane corresponding to the sidewalk may be the number, direction, lane line, etc. of the lane corresponding to the sidewalk, and the vehicle information on the corresponding lane may be the speed of the vehicle, the acceleration of the vehicle, etc.
[0031] Optionally, a camera device may also be provided on the traffic light to identify the lane corresponding to the sidewalk and the vehicles on the corresponding lane.
[0032] S102: Determine a pedestrian reminder mode and judge whether a reminder is needed for the vehicle owner according to the lane information and the vehicle information.
[0033] S103: Remind pedestrians according to the determined pedestrian reminder mode, and remind corresponding car owners when it is necessary to remind the car owners.
[0034] Therefore, the reminder method can timely transmit avoidance reminder information to pedestrians and vehicle owners according to traffic conditions, thereby improving the traffic safety of pedestrians and vehicles.
[0035] In one embodiment of the present invention, step S102 may include: judging whether all vehicles in the corresponding lane are in a waiting state according to the lane information and the vehicle information; if yes, determining that the pedestrian reminder mode is a screen text reminder, and no reminder to the vehicle owner is required; if no, determining that the pedestrian reminder mode is a screen text and voice broadcast reminder, and the vehicle owner is required to be reminded. A display screen and a voice broadcast device may be provided corresponding to the pedestrian traffic light.
[0036] Specifically, the camera device of the pedestrian traffic light can be used to identify the lanes corresponding to the sidewalk and the vehicles on the lanes to determine whether there are vehicles parked in each corresponding lane and waiting for the red light. If there are vehicles parked in each lane, pedestrians will be reminded in the form of screen text reminders, and there is no need to remind the owners of the vehicles in the corresponding lanes; if there are vehicles that have not stopped in a lane, pedestrians will be reminded in the form of screen text reminders and voice broadcast reminders, and the owners of the vehicles that have not stopped will need to be reminded. Therefore, by determining the pedestrian reminder mode and whether it is necessary to remind the owner, and timely transmitting the avoidance reminder information to pedestrians and car owners, the traffic safety of pedestrians and vehicles is improved.
[0037] It should be noted that, referring to Table 1, if the camera device of the pedestrian traffic light recognizes that there are no vehicles in the corresponding lanes of the sidewalk, the pedestrian traffic light may not remind pedestrians in the form of screen text reminders, nor will it remind the owners of vehicles in the corresponding lanes.
[0038] As an example, after determining that a pedestrian is about to cross the sidewalk, the reminder method may also include: judging whether there are inattentive pedestrians based on the pedestrian information; if so, determining the pedestrian reminder mode to be screen text and voice broadcast reminder, or voice broadcast reminder.
[0039] Specifically, judging whether there are inattentive pedestrians based on pedestrian information may include: obtaining pedestrian information around the sidewalk, wherein the pedestrian information includes pedestrian images; identifying the pedestrian images to determine the line of sight positions of pedestrians passing through the sidewalk; and determining that there are inattentive pedestrians if the line of sight of some pedestrians does not fall on the vehicle in the corresponding lane.
[0040] Specifically, the images of pedestrians around the sidewalk can be obtained by using the camera device (such as a camera, a visual sensor) installed on the pedestrian traffic light, an infrared sensing module installed in the waiting area of the sidewalk, a laser radar, etc. Furthermore, by identifying the pedestrian image, the line of sight position of the pedestrians passing through the sidewalk can be obtained. If the line of sight of some pedestrians does not fall on the vehicles in the corresponding lane, it is determined that there are inattentive pedestrians. Referring to Table 1, if there are inattentive pedestrians, when the vehicles in the corresponding lanes of the sidewalk are all in a waiting state, the pedestrian reminder mode is determined to be a screen text reminder and a voice broadcast reminder, or a voice broadcast reminder. In this way, the pedestrian reminder mode is determined, and the avoidance reminder information is transmitted to the pedestrian, thereby improving the safety of the pedestrian.
[0041] Furthermore, the reminder method may also include: when the pedestrian's attention is concentrated and the vehicles in the corresponding lane are in a waiting state, a two-wheeled vehicle is detected approaching, the pedestrian reminder mode is determined to be screen text and voice broadcast reminder, and reminder information of the approaching two-wheeled vehicle is added to the reminder information for the pedestrian.
[0042] Specifically, when there are no inattentive pedestrians and the vehicles in the corresponding lanes of the sidewalk are in a waiting state, it is detected whether there is a two-wheeled vehicle approaching. It is possible to detect whether there is a two-wheeled vehicle approaching by using a camera device (such as a camera, a visual sensor) installed on the pedestrian traffic light, an infrared sensing module, a laser radar, etc. installed in the waiting area of the sidewalk. When a two-wheeled vehicle is approaching, the pedestrian reminder mode is determined to be a screen text reminder and a voice broadcast reminder, and a reminder message of the approaching two-wheeled vehicle is added to the reminder message to the pedestrian, such as: Please note that there is a two-wheeled vehicle approaching in front. In this way, the pedestrian reminder mode is determined, and the avoidance reminder message is transmitted to the pedestrian, thereby improving the safety of the pedestrian.
[0043] It should be noted that, referring to Table 1, when the camera device of the pedestrian traffic light recognizes that there are no pedestrians preparing to cross the sidewalk, the pedestrian traffic light may not remind pedestrians by way of screen text reminders, nor will it remind the owners of vehicles in the corresponding lanes.
[0044] As an example, judging whether all vehicles in the corresponding lane are in a waiting state based on the lane information and the vehicle information may include: judging whether there is an empty lane based on the lane information and the vehicle information, wherein the empty lane is a lane in which no vehicles exist in the parking and waiting area of the corresponding lane; if so, judging whether there is a vehicle in the empty lane heading towards the sidewalk based on the vehicle information; if so, determining whether there is a vehicle in the corresponding lane that is not in a waiting state.
[0045] Specifically, the camera device of the pedestrian traffic light can be used to identify the lanes corresponding to the sidewalk and the vehicles on the corresponding lanes to determine whether there are empty lanes in each lane, wherein the empty lane can be a lane without vehicles in the parking waiting area of the corresponding lane (such as: the distance between the corresponding lane and the sidewalk is greater than the preset distance). If there is an empty lane, it is determined based on the vehicle information whether there is a vehicle on the empty lane heading towards the sidewalk. If there is a vehicle heading towards the sidewalk, there is a vehicle that is not in a waiting state in the lane corresponding to the sidewalk; if there is an empty lane and no vehicle is heading towards the sidewalk, or there is no empty lane and no vehicle is heading towards the sidewalk (that is, the vehicles on the lanes corresponding to the sidewalk are all in a waiting state), at this time, the pedestrians are reminded in the form of screen text reminders, and there is no need to remind the owners of the vehicles driving in the corresponding lanes. It should be noted that the above-mentioned situation where there are vehicles that are not in a waiting state is the same logic as the situation where all corresponding lanes are empty lanes but there are vehicles ready to drive through.
[0046] Optionally, the empty lane can be determined based on signs set up next to the lane. For example, a signboard can be set up next to the lane at a preset distance from the sidewalk, and the empty lane can be detected by identifying whether there are vehicles in the range between the signboard and the sidewalk.
[0047] Furthermore, after determining that there is a vehicle that is not in a waiting state in the corresponding lane, the reminder method may also include: judging whether there is a risky vehicle among the vehicles that are not in a waiting state based on the lane information and the vehicle information; if so, recording the identity information of the risky vehicle, and transmitting the identity information of the risky vehicle to the traffic management platform.
[0048] Specifically, determining whether there is a risk vehicle among the vehicles that are not in a waiting state may include: determining the driving condition of the vehicle on the empty lane based on the vehicle information; if the vehicle on the empty lane accelerates, calculating the first deceleration distance when the vehicle on the empty lane decelerates to a speed of zero at the current speed and a preset deceleration; determining whether the first deceleration distance is greater than the distance between the current position of the vehicle on the empty lane and the sidewalk; if so, determining that there is a risk vehicle among the vehicles that are not in a waiting state.
[0049] Specifically, when there is a vehicle that is not in a waiting state in the lane corresponding to the sidewalk, the vehicle state detection can be performed on the vehicle closest to the sidewalk to obtain vehicle information (such as vehicle speed, vehicle acceleration, etc.). Furthermore, the vehicle state closest to the sidewalk can be synchronized to the pedestrian traffic light for display and prediction through the vehicle-road cooperative technology. Optionally, the prediction can be based on the current weather information (which can be used to determine the vehicle's adhesion to the road surface, such as the same lane, the road adhesion is different on rainy days and sunny days, and the corresponding preset deceleration is different) and vehicle information to determine the driving conditions of the vehicle on the empty lane, wherein the current weather information can be obtained through the server. For example, if the vehicle on the empty lane maintains a certain speed and the acceleration is greater than or equal to 0, it is determined that the vehicle is in an accelerated driving state. At this time, the current speed of the vehicle on the empty lane and the preset deceleration for immediate deceleration at the current speed can be obtained, and the first deceleration distance when the preset deceleration decelerates to zero speed can be calculated. Determine whether the first deceleration distance is greater than the distance between the current position of the vehicle on the empty lane and the sidewalk. If the first deceleration distance is greater than the distance between the current position of the vehicle on the empty lane and the sidewalk, it is determined that there is a risky vehicle among the vehicles that are not in the waiting state. At this time, pedestrians are reminded by screen text reminders and voice broadcast reminders, and the identity information of the risky vehicle is recorded, such as sending a picture containing the license plate number of the risky vehicle to the traffic management platform. If the first deceleration distance is less than or equal to the distance between the current position of the vehicle on the empty lane and the sidewalk, it is determined that there is no risky vehicle among the vehicles that are not in the waiting state, and pedestrians are reminded by screen text reminders and voice broadcast reminders, and the identity information of the risky vehicle is not recorded. As a result, when the vehicle is unable to effectively avoid pedestrians in an emergency, pedestrians can be actively reminded and pedestrians can take the initiative to avoid them, which greatly increases the safety of pedestrians.
[0050] Furthermore, after determining that there is a risky vehicle among the vehicles not in the waiting state, the reminder method may also include: extending the red light time of the traffic light corresponding to the sidewalk, and adding first preset information to the reminder information for pedestrians to remind them that there is a danger in the empty lane. The initial reminder information for pedestrians may be fixed, such as: Please pay attention to avoid vehicles.
[0051] Specifically, referring to Table 1, after determining that there is a risky vehicle among the vehicles that are not in the waiting state, the red light time of the traffic light corresponding to the sidewalk can be extended, and the first preset information (such as: be careful to avoid vehicles in the ** lane) can be added to the reminder information for pedestrians to remind pedestrians that there is a danger in the empty lane, where the ** lane is an empty lane. Among them, the first preset information can be used to remind pedestrians in two ways: screen text reminder and voice broadcast reminder. At the same time, the warning information (such as: please pay attention to avoid pedestrians) is transmitted to the vehicle, and the owner can be reminded by voice broadcast (such as voice broadcast through the vehicle terminal). It is also possible to take photos and record the risky vehicle, and send the identity information of the risky vehicle back to the traffic management platform so that the traffic police department can warn, investigate or punish the risky vehicle. Therefore, by timely transmitting the avoidance reminder information to pedestrians and car owners according to the traffic conditions, the traffic safety of pedestrians and vehicles is improved.
[0052] Furthermore, the reminder method may also include: if the vehicle in the empty lane decelerates, then calculating the second deceleration distance when the vehicle in the empty lane decelerates to zero speed at the current speed and deceleration; judging whether the second deceleration distance is greater than the distance between the current position of the vehicle in the empty lane and the sidewalk; if so, adding the second preset information to the reminder information for the owner of the vehicle in the empty lane to remind the deceleration. Among them, the initial reminder information for the owner can be fixed, such as: please pay attention to avoid pedestrians.
[0053] Specifically, if the vehicle on the empty lane maintains a certain speed and the acceleration is less than 0, it is determined that the vehicle is in a state of decelerating. At this time, the current speed of the vehicle on the empty lane and the preset deceleration for immediate deceleration at the current speed can be obtained, and the second deceleration distance when the preset deceleration decelerates to zero speed is calculated. It is determined whether the second deceleration distance is greater than the distance between the current position of the vehicle on the empty lane and the sidewalk. If the second deceleration distance is greater than the distance between the current position of the vehicle on the empty lane and the sidewalk, the second preset information (such as: please slow down) is added to the reminder information for the owner of the vehicle on the empty lane, so as to remind the owner to pay attention to avoid pedestrians while reminding the owner to slow down. Among them, the second preset information can remind the owner by voice broadcast reminder, and at the same time, the pedestrians are reminded to be careful to avoid the vehicle by two reminder methods: screen text reminder and voice broadcast reminder. Therefore, by intervening and reminding the deceleration of the vehicle, it has a guiding role for vehicles that do not decelerate in time, and improves the traffic safety of pedestrians and vehicles.
[0054] Table 1
[0055]
[0056] To summarize, the reminder method determines the pedestrian reminder mode and whether it is necessary to remind the car owner through pedestrian information, lane information of the lane corresponding to the sidewalk, and vehicle information on the lane corresponding to the sidewalk, reminds the pedestrian according to the determined pedestrian reminder mode, and reminds the corresponding car owner when it is necessary to remind the car owner, thereby realizing the timely transmission of avoidance reminder information to pedestrians and car owners according to traffic conditions, thereby improving the traffic safety of pedestrians and vehicles.
[0057] Figure 2 It is a schematic diagram of the structure of a reminder system according to an embodiment of the present invention.
[0058] like Figure 2 As shown, the reminder system 100 includes: an acquisition module 10, which is used to obtain lane information of the lane corresponding to the sidewalk and vehicle information on the corresponding lane when pedestrians are detected in a preset area; a determination module 20, which is used to determine the pedestrian reminder mode and determine whether it is necessary to remind the car owner based on the lane information and vehicle information; a reminder module 30, which is used to remind pedestrians according to the determined pedestrian reminder mode, and remind the corresponding car owner when it is necessary to remind the car owner.
[0059] Specifically, the acquisition module 10 can be used to detect whether there are pedestrians in the preset area, wherein the preset area can be the waiting area of the sidewalk, or the waiting area of the sidewalk and the area where the sidewalk is located. If there are pedestrians in the preset area, it is determined that a pedestrian is passing through the sidewalk. When a pedestrian passes through the sidewalk, the lane corresponding to the sidewalk and the vehicle on the corresponding lane can also be identified by the acquisition module 10 to obtain the lane information of the lane corresponding to the sidewalk and the vehicle information on the corresponding lane. It should be noted that if there are vehicles in all lanes around the sidewalk, the lane where the vehicle that needs to pass through the sidewalk is located is the corresponding lane of the sidewalk. Among them, the lane information of the lane corresponding to the sidewalk can be the number, direction, lane line, etc. of the lane corresponding to the sidewalk, and the vehicle information on the corresponding lane can be the speed of the vehicle, the acceleration of the vehicle, etc.
[0060] Optionally, a camera device may also be provided on the traffic light to identify the lane corresponding to the sidewalk and the vehicles on the corresponding lane.
[0061] Furthermore, the acquisition module 10 can be used to identify the lanes corresponding to the sidewalks and the vehicles on the corresponding lanes, and it can be obtained whether there are vehicles parked in each lane and the status of waiting at a red light. If there are vehicles parked in each lane, the reminder module 30 will remind pedestrians in the form of screen text reminders, and there is no need to remind the car owners driving on this road section; if there are vehicles that have not stopped in a certain lane, the reminder module 30 will remind pedestrians in two ways: screen text reminders and voice broadcast reminders, and it is necessary to remind the car owners driving on this road section. Therefore, by determining the pedestrian reminder mode and reminding the corresponding car owners when it is necessary to remind the car owners, the avoidance reminder information is transmitted to pedestrians and car owners in time according to the traffic conditions, thereby improving the traffic safety of pedestrians and vehicles. Among them, the reminder module 30 can be set corresponding to the pedestrian traffic light.
[0062] It should be noted that, referring to Table 1, if the acquisition module 10 recognizes that there are no vehicles in the corresponding lanes of the sidewalk, the reminder module 30 may not remind pedestrians in the form of screen text reminders, and will not remind the owners of the vehicles in the corresponding lanes.
[0063] As an example, the pedestrian images around the sidewalk can be acquired by the acquisition module 10. Furthermore, the sight positions of pedestrians passing through the sidewalk can be obtained by identifying the pedestrian images. If the sight lines of some pedestrians do not fall on the vehicles in the corresponding lanes, it is determined that there are inattentive pedestrians. Referring to Table 1, if there are inattentive pedestrians, when the vehicles in the corresponding lanes of the sidewalk are all in a waiting state, the determination module 20 determines that the pedestrian reminder mode is a screen text reminder and a voice broadcast reminder, or a voice broadcast reminder. In this way, the pedestrian reminder mode is determined, and the avoidance reminder information is transmitted to the pedestrian, thereby improving the safety of the pedestrian.
[0064] Furthermore, when there are no inattentive pedestrians and the vehicles on the corresponding lanes of the sidewalk are in a waiting state, it is detected whether there is a two-wheeled vehicle approaching. The acquisition module 10 can be used to detect whether there is a two-wheeled vehicle approaching. When a two-wheeled vehicle is approaching, the determination module 20 determines that the pedestrian reminder mode is a screen text reminder and a voice broadcast reminder, and adds a reminder message of the two-wheeled vehicle approaching to the reminder message to the pedestrian, such as: Please note that there is a two-wheeled vehicle approaching in front. In this way, the pedestrian reminder mode is determined, and the avoidance reminder message is transmitted to the pedestrian, thereby improving the safety of the pedestrian.
[0065] It should be noted that, referring to Table 1, when the acquisition module 10 recognizes that there are no pedestrians passing through the sidewalk, the reminder module 30 may not remind the pedestrians in the form of screen text reminders, and will not remind the owners of the vehicles in the corresponding lanes.
[0066] As an example, the lanes corresponding to the sidewalk and the vehicles on the corresponding lanes can be identified by the acquisition module 10 to determine whether there are empty lanes in each lane, wherein the empty lane can be a lane without vehicles in the parking waiting area of the corresponding lane (such as: the distance between the corresponding lane and the sidewalk is greater than the preset distance). If there is an empty lane, it is determined based on the vehicle information whether there is a vehicle on the empty lane heading towards the sidewalk. If there is a vehicle heading towards the sidewalk, there is a vehicle that is not in a waiting state in the lane corresponding to the sidewalk; if there is an empty lane and no vehicle is heading towards the sidewalk, or there is no empty lane and no vehicle is heading towards the sidewalk (that is, the vehicles on the lanes corresponding to the sidewalk are all in a waiting state), at this time, the reminder module 30 reminds pedestrians in the form of screen text reminders, and there is no need to remind the owners of the vehicles in the corresponding lanes. It should be noted that the above-mentioned situation where there are vehicles that are not in a waiting state is the same logic as the situation where all corresponding lanes are empty lanes but there are vehicles ready to drive through.
[0067] Optionally, the empty lane can be determined based on signs set up next to the lane. For example, a signboard can be set up next to the lane at a preset distance from the sidewalk, and the empty lane can be detected by identifying whether there are vehicles in the range between the signboard and the sidewalk.
[0068] Furthermore, when there is a vehicle that is not in a waiting state in the lane corresponding to the sidewalk, the vehicle status can be detected for the vehicle closest to the sidewalk to obtain vehicle information (such as vehicle speed, vehicle acceleration, etc.). Furthermore, the vehicle status closest to the sidewalk can be synchronized to the pedestrian traffic light for display and prediction through vehicle-road cooperative technology. Optionally, the prediction can be based on the current weather information (which can be used to determine the condition of the vehicle's adhesion to the road surface, such as the same lane, the road adhesion conditions are different on rainy days and sunny days, and the corresponding preset deceleration is different) and vehicle information to determine the driving conditions of the vehicle on the empty lane, wherein the current weather information can be obtained through the server. For example: if the vehicle on the empty lane maintains a certain speed and the acceleration is greater than or equal to 0, it is determined that the vehicle is in an accelerated driving state. At this time, the current speed of the vehicle on the empty lane and the preset deceleration for immediate deceleration at the current speed can be obtained, and the first deceleration distance when the preset deceleration decelerates to zero speed can be calculated. Determine whether the first deceleration distance is greater than the distance between the current position of the vehicle on the empty lane and the sidewalk. If the first deceleration distance is greater than the distance between the current position of the vehicle on the empty lane and the sidewalk, it is determined that there is a risky vehicle among the vehicles that are not in the waiting state. At this time, pedestrians are reminded by two reminder methods, namely, screen text reminder and voice broadcast reminder, and the identity information of the risky vehicle is recorded, such as sending a picture containing the license plate number of the risky vehicle to the traffic management platform. If the first deceleration distance is less than or equal to the distance between the current position of the vehicle on the empty lane and the sidewalk, it is determined that there is no risky vehicle among the vehicles that are not in the waiting state, and at this time, the reminder module 30 reminds pedestrians by two reminder methods, namely, screen text reminder and voice broadcast reminder, and does not record the identity information of the risky vehicle. As a result, when the vehicle encounters an emergency and cannot effectively avoid pedestrians, pedestrians can be actively reminded and pedestrians can take the initiative to avoid them, which greatly increases the safety of pedestrians.
[0069] Further, referring to Table 1, after determining that there is a risky vehicle among the vehicles that are not in the waiting state, the red light time of the traffic light corresponding to the sidewalk can be extended, and the first preset information (such as: be careful to avoid the vehicle in the ** lane) can be added to the reminder information for pedestrians to remind pedestrians that there is a danger in the empty lane, wherein the ** lane is an empty lane, and the initial reminder information for pedestrians can be fixed (such as: pay attention to avoid vehicles). Among them, the reminder module 30 can remind pedestrians of the first preset information in two reminder methods: screen text reminder and voice broadcast reminder, and at the same time transmit the warning information (such as: pay attention to avoid pedestrians) to the vehicle, and can remind the owner by voice broadcast (such as voice broadcast through the vehicle terminal). It is also possible to take photos and record the risky vehicle, and send the identity information of the risky vehicle back to the traffic management platform so that the traffic police department can warn, investigate or punish the risky vehicle. Therefore, by timely transmitting the avoidance reminder information to pedestrians and car owners according to the traffic conditions, the traffic safety of pedestrians and vehicles is improved.
[0070] Further, if the vehicle on the empty lane maintains a certain speed and the acceleration is less than 0, it is determined that the vehicle is in a state of decelerating. At this time, the current speed of the vehicle on the empty lane and the preset deceleration for immediate deceleration at the current speed can be obtained, and the second deceleration distance when the preset deceleration is decelerated to zero speed is calculated. It is judged whether the second deceleration distance is greater than the distance between the current position of the vehicle on the empty lane and the sidewalk. If the second deceleration distance is greater than the distance between the current position of the vehicle on the empty lane and the sidewalk, the second preset information (such as: please slow down) is added to the reminder information for the owner of the vehicle on the empty lane, so as to remind the owner to pay attention to avoid pedestrians while reminding the owner to slow down. The initial reminder information for the owner can be fixed, such as: please pay attention to avoid pedestrians. The second preset information can remind the owner by voice broadcast reminder, and the reminder module 30 reminds pedestrians to be careful to avoid vehicles in two reminder methods: screen text reminder and voice broadcast reminder. Therefore, by intervening and reminding the deceleration of the vehicle, it has a guiding role for vehicles that do not decelerate in time, thereby improving the safety of pedestrians.
[0071] To summarize, the reminder system determines the pedestrian reminder mode and whether it is necessary to remind the car owner through pedestrian information, lane information of the lane corresponding to the sidewalk, and vehicle information on the lane corresponding to the sidewalk, reminds pedestrians according to the determined pedestrian reminder mode, and reminds the corresponding car owner when it is necessary to remind the car owner, thereby realizing the timely transmission of avoidance reminder information to pedestrians and car owners according to traffic conditions, thereby improving the traffic safety of pedestrians and vehicles.
[0072] The present invention also provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the above-mentioned reminder method is implemented.
[0073] The computer-readable storage medium of an embodiment of the present invention, when the computer program corresponding to the above-mentioned reminder method is stored thereon and is executed by a processor, determines the pedestrian reminder mode and whether it is necessary to remind the car owner through pedestrian information, lane information of the lane corresponding to the sidewalk, and vehicle information on the lane corresponding to the sidewalk, reminds the pedestrian according to the determined pedestrian reminder mode, and reminds the corresponding car owner when it is necessary to remind the car owner, thereby realizing the timely transmission of avoidance reminder information to pedestrians and car owners according to traffic conditions, thereby improving the traffic safety of pedestrians and vehicles.
[0074] The present invention also provides an electronic device, comprising a memory, a processor and a computer program stored in the memory, and when the computer program is executed by the processor, the above-mentioned reminder method is implemented.
[0075] Specifically, the electronic device in the embodiment of the present invention may be a server, which can communicate with the camera device, display screen, voice broadcast device, and vehicle installed on the traffic light. The camera device installed on the traffic light sends the information obtained by recognizing the image to the server, and the server controls the display screen, voice broadcast device, and vehicle installed on the traffic light to make corresponding screen text reminders and / or voice broadcast reminders.
[0076] The electronic device of the embodiment of the present invention, when the computer program corresponding to the above-mentioned reminder method stored in its memory is executed by the processor, determines the pedestrian reminder mode and whether it is necessary to remind the car owner through pedestrian information, lane information of the lane corresponding to the sidewalk, and vehicle information on the lane corresponding to the sidewalk, reminds the pedestrian according to the determined pedestrian reminder mode, and reminds the corresponding car owner when it is necessary to remind the car owner, thereby realizing the timely transmission of avoidance reminder information to pedestrians and car owners according to traffic conditions, thereby improving the traffic safety of pedestrians and vehicles.
[0077] It should be noted that the logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing logical functions, and can be specifically implemented in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purposes of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in combination with these instruction execution systems, devices or apparatuses. More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection portion with one or more wirings (electronic device), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or processing in other suitable ways if necessary, and then stored in a computer memory.
[0078] It should be understood that the various parts of the present invention can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, a plurality of steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.
[0079] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "examples", "specific examples", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.
[0080] In the description of the present invention, it is to be understood that the terms “center”, “longitudinal”, “lateral”, “length”, “width”, “thickness”, “up”, “down”, “front”, “back”, “left”, “right”, “vertical”, “horizontal”, “top”, “bottom”, “inside”, “outside”, “clockwise”, “counterclockwise”, “axial”, “radial”, “circumferential”, etc., indicating orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the referred device or element must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as limiting the present invention.
[0081] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In the description of the present invention, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.
[0082] In the present invention, unless otherwise clearly specified and limited, the terms "installed", "connected", "connected", "fixed" and the like should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium, it can be the internal connection of two elements or the interaction relationship between two elements, unless otherwise clearly defined. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.
[0083] In the present invention, unless otherwise clearly specified and limited, a first feature being "above" or "below" a second feature may mean that the first and second features are in direct contact, or the first and second features are in indirect contact through an intermediate medium. Moreover, a first feature being "above", "above" or "above" a second feature may mean that the first feature is directly above or obliquely above the second feature, or simply means that the first feature is higher in level than the second feature. A first feature being "below", "below" or "below" a second feature may mean that the first feature is directly below or obliquely below the second feature, or simply means that the first feature is lower in level than the second feature.
[0084] Although the embodiments of the present invention have been shown and described above, it is to be understood that the above embodiments are exemplary and are not to be construed as limitations of the present invention. A person skilled in the art may change, modify, replace and vary the above embodiments within the scope of the present invention.
Claims
1. A reminder method, characterized in that: The method comprises the following steps: When a pedestrian is detected in a preset area, lane information of a lane corresponding to the sidewalk and vehicle information on the corresponding lane are obtained; Determining a pedestrian reminder mode and judging whether it is necessary to remind the vehicle owner according to the lane information and the vehicle information, including: judging whether all vehicles in the corresponding lane are in a waiting state according to the lane information and the vehicle information; if yes, determining that the pedestrian reminder mode is a screen text reminder, and it is not necessary to remind the vehicle owner; if not, determining that the pedestrian reminder mode is a screen text and voice broadcast reminder, and it is necessary to remind the vehicle owner; Remind pedestrians according to the determined pedestrian reminder mode, and remind the corresponding vehicle owner when it is necessary to remind the vehicle owner; After detecting the presence of pedestrians in the preset area, the method further includes: Determining whether there are inattentive pedestrians based on pedestrian information: obtaining pedestrian information around the sidewalk, wherein the pedestrian information includes pedestrian images; identifying the pedestrian images to determine the sight positions of pedestrians passing through the sidewalk; if there are some pedestrians whose sight lines do not fall on the vehicles on the corresponding lanes, it is determined that there are inattentive pedestrians; If there is a pedestrian who is not paying attention and the vehicles in the corresponding lane are in a waiting state, the pedestrian reminder mode is determined to be screen text and voice broadcast reminder, or voice broadcast reminder.
2. The reminder method according to claim 1, characterized in that: After determining that there is a vehicle that is not in a waiting state on the corresponding lane, the method further includes: Determining whether there is a risk vehicle among the vehicles that are not in a waiting state according to the lane information and the vehicle information; If so, the identity information of the risk vehicle is recorded and transmitted to the traffic management platform.
3. The reminder method according to claim 1, characterized in that: The method further comprises: When the pedestrian is concentrating and the vehicles in the corresponding lane are in a waiting state, a two-wheeled vehicle is detected approaching, the pedestrian reminder mode is determined to be screen text and voice broadcast reminder, and a reminder message of the approaching two-wheeled vehicle is added to the reminder message for the pedestrian.
4. The reminder method according to claim 2, characterized in that: The determining, based on the lane information and the vehicle information, whether all vehicles in the corresponding lane are in a waiting state includes: Determining whether there is an empty lane according to the lane information and the vehicle information, wherein the empty lane is a lane in which no vehicle exists in the parking waiting area of the corresponding lane; If so, determining whether there is a vehicle on the empty lane driving towards the sidewalk according to the vehicle information; If yes, it is determined that there is a vehicle that is not in a waiting state on the corresponding lane.
5. The reminder method according to claim 4, characterized in that: The determining whether there is a risky vehicle among the vehicles that are not in the waiting state includes: Determining the driving condition of the vehicle on the vacant lane according to the vehicle information; If the vehicle on the empty lane accelerates, then a first deceleration distance when the vehicle on the empty lane decelerates to zero speed at the current speed and the preset deceleration is calculated; Determining whether the first deceleration distance is greater than the distance between the current position of the vehicle on the empty lane and the sidewalk; If so, it is determined that there is a risk vehicle among the vehicles that are not in the waiting state.
6. The reminder method according to claim 5, characterized in that: After determining that there is a risk vehicle among the vehicles that are not in the waiting state, the method further includes: The red light time of the traffic light corresponding to the sidewalk is extended, and a first preset information is added to the reminder information for pedestrians to remind them that the empty lane is dangerous.
7. The reminder method according to claim 5, characterized in that: The method further comprises: If the vehicle on the empty lane is decelerating, a second deceleration distance when the vehicle on the empty lane decelerates to zero speed at the current speed and deceleration is calculated; Determining whether the second deceleration distance is greater than the distance between the current position of the vehicle on the empty lane and the sidewalk; If yes, then the second preset information is added to the reminder information for the owner of the vehicle in the empty lane to provide a deceleration reminder.
8. A reminder system, characterized in that: The reminder system comprises: The acquisition module is used to acquire lane information of a lane corresponding to the sidewalk and vehicle information on the corresponding lane when pedestrians are detected in a preset area; the acquisition module is also used to: determine whether there is an inattentive pedestrian based on the pedestrian information: acquire pedestrian information around the sidewalk, wherein the pedestrian information includes pedestrian images; identify the pedestrian images to determine the sight positions of pedestrians passing through the sidewalk; if some pedestrians' sight lines do not fall on the vehicles on the corresponding lane, it is determined that there are inattentive pedestrians; A determination module, used to determine the pedestrian reminder mode and judge whether it is necessary to remind the owner according to the lane information and the vehicle information, including: judging whether the vehicles in the corresponding lane are all in a waiting state according to the lane information and the vehicle information; if so, determining that the pedestrian reminder mode is a screen text reminder, and it is not necessary to remind the owner; if not, determining that the pedestrian reminder mode is a screen text and voice broadcast reminder, and it is necessary to remind the owner; the determination module is also used to: if there is an inattentive pedestrian and the vehicles in the corresponding lane are all in a waiting state, determining that the pedestrian reminder mode is a screen text and voice broadcast reminder, or a voice broadcast reminder; The reminder module is used to remind pedestrians according to the determined pedestrian reminder mode, and remind the corresponding car owner when it is necessary to remind the car owner to enter.
9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the reminder method according to any one of claims 1 to 7 is implemented.
10. An electronic device comprising a memory, a processor, and a computer program stored in the memory, characterized in that: When the computer program is executed by the processor, the reminder method according to any one of claims 1 to 7 is implemented.
Citation Information
Patent Citations
Driver-oriented passenger safe road crossing reminding system and method thereof
CN109448437A
Method and device for providing feedback to outside of vehicle, device, and storage medium
US20200074847A1
KR1016732110000B1