Program, information processing method, information processing terminal and map information providing device

Abstract

[Problem] To provide a program to output, to a driver, an appropriate danger warning in advance, and the like. [Solution] This program causes a computer to execute processing for determining, on the basis of map information indicating a dangerous spot at which a dangerous event tends to occur, and positional information of a vehicle, whether or not the dangerous spot overlaps with a first region set within a first distance from the vehicle and a second region set within a second distance shorter than the first distance from the vehicle. The program causes the computer to execute processing for generating a first warning output command if the dangerous spot is determined to overlap with the first region, and deleting the first warning output command if the dangerous spot is determined to overlap with the second region.

Description

[Technical Field]

[0001] The present invention relates to a program, an information processing method, an information processing terminal, and a map information providing device. [Background technology]

[0002] Patent Document 1 discloses a factor analysis device that estimates the cause of a vehicle accident with high accuracy and issues a warning to the driver. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6545940 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the invention of Patent Document 1 may give excessive warnings to the driver, which may cause discomfort to the driver. [Means for solving the problem]

[0005] A program according to one aspect of the present invention causes a computer to execute a process for determining whether a first area set within a first distance from the vehicle and a second area set within a second distance from the vehicle that is shorter than the first distance, based on map information indicating dangerous areas where dangerous events are likely to occur and vehicle position information. The program then causes the computer to execute a process for generating an output command for a first warning when it is determined that the dangerous area overlaps the first area, and for erasing the output command for the first warning when it is determined that the dangerous area overlaps the second area. [Effects of the Invention]

[0006] According to one aspect of the present invention, it is possible to output an appropriate danger warning to a driver in advance. [Brief explanation of the drawings]

[0007] [Figure 1] 1 is an explanatory diagram showing an overview of a pre-hazard warning system. [Figure 2] FIG. 2 is a block diagram showing an example of the configuration of a vehicle terminal; [Figure 3] FIG. 2 is a block diagram illustrating an example of the configuration of a server. [Figure 4] FIG. 2 is an explanatory diagram illustrating an example of a record layout of a detection information DB. [Figure 5] FIG. 1 is an explanatory diagram for detecting a dangerous event in a vehicle. [Figure 6] FIG. 10 is an explanatory diagram showing an example of a screen displaying map information. [Figure 7] FIG. 2 is an explanatory diagram showing the relationship between a vehicle and various areas. [Figure 8] FIG. 10 is an explanatory diagram regarding a first warning based on a dangerous location. [Figure 9] 10 is a flowchart showing a procedure for detecting a dangerous event. [Figure 10] 10 is a flowchart showing a procedure for a warning process of a dangerous spot. [Figure 11] 10 is a flowchart showing a processing procedure when the first area is enlarged in accordance with the traveling speed of the vehicle. [Figure 12] FIG. 10 is a block diagram showing an example of the configuration of a server according to a second embodiment. [Figure 13] FIG. 10 is an explanatory diagram illustrating an example of a record layout of a user DB. [Figure 14] 10 is a flowchart showing a processing procedure when the third distance is changed depending on the age of the user. DETAILED DESCRIPTION OF THE INVENTION

[0008] The present invention will be described in detail below with reference to the drawings showing embodiments thereof.

[0009] (Embodiment 1) The first embodiment relates to a system that detects dangerous events (such as pedestrians suddenly jumping out into the road, ignoring traffic lights, etc.) that may occur in a vehicle in which a user is riding, from an image captured of the surroundings of the vehicle, and warns the user, as well as warns the user of dangerous locations on a map obtained by analyzing dangerous events that have occurred in multiple vehicles. Fig. 1 is an explanatory diagram showing an overview of a pre-hazard warning system. The system of this embodiment includes information processing terminals 1, 1, 1... and an information processing device 2, and each device transmits and receives information via a network N such as the Internet.

[0010] The information processing terminal 1 is a terminal device that is installed in a vehicle and that acquires map information, detects dangerous events in the vehicle, or outputs danger warnings. The information processing terminal 1 is an information processing device such as a smartphone, a tablet, a navigation device equipped with an automotive navigation system, or a personal computer. If the information processing terminal 1 is a smartphone or a tablet, it may be placed in a holder or the like installed on the dashboard while driving the vehicle. Hereinafter, the information processing terminal 1 will be read as a vehicle terminal 1.

[0011] The information processing device 2 is an information processing device that processes, stores, and transmits / receives various information including map information. The information processing device 2 is, for example, a server device or a personal computer. In this embodiment, the information processing device 2 is assumed to be a server device, and for the sake of brevity, will be referred to as server 2 below.

[0012] The vehicle terminal 1 according to this embodiment captures images of the surroundings of the vehicle (for example, the front), detects a dangerous event from the image of the surroundings of the vehicle, and outputs a warning (second warning) to the user (see FIG. 5). Furthermore, when a dangerous event is detected, the vehicle terminal 1 transmits detection information including an image of the dangerous event detected, the time of detection, and location information at the time of detection to the server 2, and reports the dangerous event.

[0013] The server 2 acquires detection information from the vehicle terminals 1, 1, 1... of each of the multiple vehicles. Then, the server 2 generates map information indicating dangerous spots (locations) on a map where dangerous events are likely to occur, based on the detection information from each vehicle. The map information is map data displayed on a car navigation system or the like, to which data indicating points or areas on a map where dangerous events are likely to occur and times or time periods when the dangerous events are likely to occur is added. In this embodiment, the map information is also referred to as a hazard map. The server 2 statistically processes the information on dangerous events reported from each vehicle terminal 1, generates map information, and distributes it to each vehicle terminal 1.

[0014] The vehicle terminal 1 receives and displays map information from the server 2 (see FIG. 6). When the vehicle approaches a dangerous spot indicated in the map information, the vehicle terminal 1 outputs a warning (first warning) notifying the driver that the vehicle has approached a dangerous spot. In this way, the vehicle terminal 1 outputs the first warning when the vehicle approaches a dangerous spot on the map, and outputs the second warning when a dangerous event is detected from an image of the vehicle's surroundings.

[0015] 2 is a block diagram showing an example configuration of the vehicle terminal 1. The vehicle terminal 1 includes a control unit 11, a storage unit 12, a communication unit 13, an input unit 14, a display unit 15, an image capturing unit 16, an auxiliary storage unit 17, a GPS (Global Positioning System) module 18, and a speaker 19. Each component is connected by a bus B.

[0016] The control unit 11 includes an arithmetic processing device such as a CPU (Central Processing Unit), an MPU (Micro-Processing Unit), and a GPU (Graphics Processing Unit), and performs various information processing, control processing, and the like related to the vehicle terminal 1 by reading and executing a control program 1P stored in the storage unit 12. Note that although the control unit 11 is described in FIG. 2 as being a single processor, it may be a multi-processor.

[0017] The storage unit 12 includes memory elements such as RAM (Random Access Memory) and ROM (Read Only Memory), and stores the control program 1P or data required for the control unit 11 to execute processing. The storage unit 12 also temporarily stores data required for the control unit 11 to execute arithmetic processing. The communication unit 13 is a communication module for performing communication-related processing, and transmits and receives information to and from the server 2, etc. via the network N.

[0018] The input unit 14 may be a keyboard, a mouse, or a touch panel integrated with the display unit 15. The display unit 15 is a liquid crystal display, an organic EL (electroluminescence) display, or the like, and displays various information according to instructions from the control unit 11.

[0019] The photographing unit 16 is a photographing device such as a CCD (Charge Coupled Device) camera or a CMOS (Complementary Metal Oxide Semiconductor) camera. The photographing unit 16 may be composed of multiple photographing devices. The photographing unit 16 may not be built into the vehicle terminal 1, but may be externally connected directly to the vehicle terminal 1 and configured to be capable of photographing. The auxiliary storage unit 17 is a non-volatile storage area such as a large-capacity memory or a hard disk, and includes a recording medium such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive). The GPS module 18 is a module for acquiring vehicle position information using GPS satellites. The speaker 19 is a device for converting electrical signals into sound.

[0020] 3 is a block diagram showing an example of the configuration of the server 2. The server 2 includes a control unit 21, a storage unit 22, a communication unit 23, a reading unit 24, and a large-capacity storage unit 25. Each component is connected by a bus B.

[0021] The control unit 21 includes an arithmetic processing unit such as a CPU, an MPU, a GPU, etc., and performs various information processing, control processing, etc. related to the server 2 by reading and executing a control program 2P stored in the storage unit 22. Note that although the control unit 21 is described in Fig. 3 as being a single processor, it may be a multiprocessor.

[0022] The storage unit 22 includes memory elements such as RAM and ROM, and stores the control program 2P or data required for the control unit 21 to execute processing. The storage unit 22 also temporarily stores data required for the control unit 21 to execute arithmetic processing. The communication unit 23 is a communication module for performing communication-related processing, and transmits and receives information to and from the vehicle terminal 1, etc. via the network N.

[0023] The reading unit 24 reads a portable storage medium 2a including a CD (Compact Disc)-ROM or a DVD (Digital Versatile Disc)-ROM. The control unit 21 may read the control program 2P from the portable storage medium 2a via the reading unit 24 and store it in the mass storage unit 25. Alternatively, the control unit 21 may download the control program 2P from another computer via the network N or the like and store it in the mass storage unit 25. Furthermore, the control unit 21 may read the control program 2P from the semiconductor memory 2b.

[0024] The mass storage unit 25 includes a recording medium such as an HDD or SSD. The mass storage unit 25 includes a map database (DB) 251 and a detection information DB 252. The map DB 251 stores map information indicating dangerous locations where dangerous events are likely to occur. The map information may be stored in an external dedicated map database. The detection information DB 252 stores detection information of dangerous events detected for the vehicle.

[0025] In this embodiment, the storage unit 22 and the large-capacity storage unit 25 may be configured as an integrated storage device. Furthermore, the large-capacity storage unit 25 may be configured by a plurality of storage devices. Furthermore, the large-capacity storage unit 25 may be an external storage device connected to the server 2.

[0026] In this embodiment, the server 2 is described as being one information processing device, but it may be configured as a plurality of devices for distributed processing, or may be configured as a virtual machine.

[0027] FIG. 4 is an explanatory diagram showing an example of a record layout of the detection information DB 252. As shown in FIG. The detection information DB 252 includes a detection ID sequence, a vehicle ID sequence, an image sequence, a detection time sequence, a location information sequence, and a dangerous event sequence. The detection ID sequence stores a detection ID for identifying the detection information. The vehicle ID sequence stores a vehicle ID for identifying the vehicle. The image sequence stores an image when a dangerous event is detected. The detection time sequence stores the time when the dangerous event is detected. The location information sequence stores location information (e.g., location name, latitude, longitude, etc.) of the location where the dangerous event occurred. The dangerous event sequence stores the content of the dangerous event (e.g., a person running out into the road, a person being hit, or running a red light, etc.).

[0028] 5 is an explanatory diagram for detecting dangerous events involving a vehicle. The dangerous events involving a vehicle include external dangerous events such as a pedestrian suddenly jumping out into the road, being hit by another vehicle, or approaching another vehicle, and / or internal dangerous events (dangerous driving) involving the vehicle itself, such as running a red light or ignoring a stop sign.

[0029] The vehicle terminal 1 mounted on the vehicle acquires images of the surroundings of the vehicle. For example, as shown in FIG. 5, the vehicle terminal 1 acquires an image of the area in front of the vehicle. The image may be captured by the image capturing unit 16 of the vehicle terminal 1, or may be captured by an external image capturing device. The image may include images of not only the area in front of the vehicle, but also the area behind and to the sides of the vehicle. Alternatively, the vehicle terminal 1 may acquire images captured in all directions using a 360-degree camera or the like.

[0030] The vehicle terminal 1 detects dangerous events involving vehicles in acquired images. For example, as shown in the figure, when a pedestrian 11a moves from the sidewalk to the roadway, the event is detected as a dangerous event. There are no particular limitations on the method for detecting dangerous events; for example, the vehicle terminal 1 may use pattern matching to detect specific objects (such as a pedestrian running into the roadway or a red light) based on the shape, size, color, etc. of the object in the image. Alternatively, the vehicle terminal 1 may detect dangerous events by preparing a machine learning model (such as a neural network) that has been trained to detect dangerous events when a captured image is input.

[0031] The vehicle terminal 1 may detect dangerous events from the entire image (all regions). However, in this embodiment, the vehicle terminal 1 detects dangerous events from a region of interest 11b (ROI: Region of Interest) that is a part of the captured image. For example, the region of interest 11b is a region of interest (image region) that corresponds to an area on the roadway within a predetermined distance from the vehicle. In FIG. 5, the region of interest 11b is illustrated by hatching. Note that the region of interest 11b shown in FIG. 5 is an example. For example, the region of interest 11b may include a sidewalk in addition to the roadway (road), or the entire roadway that can be recognized from the image may be the region of interest. The position, shape, range, etc. of the region of interest 11b within the image are not particularly limited. The vehicle terminal 1 detects dangerous events by detecting specific objects from the region of interest within a predetermined distance from the vehicle.

[0032] The vehicle terminal 1 outputs a second warning when it detects a dangerous event involving the vehicle. The second warning is a warning to alert the driver when a dangerous event involving the vehicle is detected. For example, the vehicle terminal 1 may output a second warning audio signal, such as "A pedestrian has been spotted running out in front of you. Please be careful!", a predetermined number of times (e.g., three times) via the speaker 19. The second warning may also be output repeatedly, without being limited to a predetermined number of times. In this case, for example, the vehicle terminal 1 may erase the second warning after the vehicle reaches the vicinity of the location (point) where the dangerous event was detected. Furthermore, the text content of the warning may be displayed on the screen simultaneously with the output (playback) of the second warning.

[0033] The vehicle terminal 1 transmits detection information of a dangerous event detected for the vehicle to the server (map information providing device) 2. The detection information includes the vehicle ID, an image of the dangerous event when it was detected, the detection time, location information (such as the location name or longitude and latitude), or details of the dangerous event (for example, running a red light, a person running into the road, etc.). The server 2 receives the detection information transmitted from the vehicle terminal 1 and stores the received detection information in the detection information DB 252. Specifically, the server 2 assigns a detection ID and stores the vehicle ID, image, detection time, location information, and details of the dangerous event as one record in the detection information DB 252.

[0034] The server 2 generates map information indicating dangerous locations on a map where dangerous events are likely to occur, based on the detection information for each vehicle stored in the detection information DB 252. The map information is map data supplemented with data indicating points or areas on a map where dangerous events are likely to occur and the time or time period when the dangerous events are likely to occur. For example, the map information may include information indicating the longitude and latitude of the dangerous locations, the occurrence rate of dangerous events for each dangerous location (e.g., 25%), a danger level set according to the occurrence rate of dangerous events, a time period when dangerous events are likely to occur (e.g., 7:00 to 8:00), or the nature of the dangerous event at the time of detection (e.g., running a red light, a person running into another vehicle, etc.). Based on the detection information received from each vehicle terminal 1, the server 2 compiles the number of occurrences, frequency of occurrence, occurrence rate, etc. of dangerous events at each location or area on the map by time or time period, and generates map information indicating dangerous locations where the danger level determined according to the occurrence rate, etc. is above a certain level.

[0035] The server 2 statistically processes the detection information in real time each time it receives it from the vehicle terminal 1, or every fixed period (for example, one week, one month, etc.), and updates the map information. The server 2 transmits updated map information according to the detection information to the vehicle terminal 1 installed in each vehicle. Each vehicle terminal 1 receives the map information transmitted from the server 2 and displays it on its screen.

[0036] 6 is an explanatory diagram showing an example of a screen displaying map information. The screen includes a map display field 12a, a dangerous place display field 12b, and a dangerous event icon 12c. The map display field 12a is a display field for displaying a map. The dangerous place display field 12b is a display field for displaying a mark representing a dangerous place (area). The dangerous event icon 12c is an icon for indicating a dangerous event.

[0037] The server 2 acquires map (hazard map) information from the map DB 251. The server 2 transmits the acquired map information to the vehicle terminal 1. The vehicle terminal 1 displays a hazard map on the screen based on the map information transmitted from the server 2. As shown in the figure, marks indicating dangerous locations where dangerous events involving vehicles are likely to have occurred in the past, the occurrence rate of dangerous events for each dangerous location (e.g., 25%), time periods when dangerous events are likely to occur (e.g., 7:00-8:00), and icons set according to the content of the dangerous events (e.g., a jump-out icon, an entrapment icon, etc.) are superimposed on the hazard map.

[0038] Specifically, the vehicle terminal 1 displays the map data contained in the received map information in the map display field 12a, displays marks representing dangerous locations in the dangerous location display field 12b, and displays icons indicating dangerous events in the dangerous event icon 12c.

[0039] FIG. 7 is an explanatory diagram showing the relationship between a vehicle and various areas. FIG. 8 is an explanatory diagram related to a first warning based on a dangerous location. In this embodiment, when the vehicle approaches a dangerous location, the vehicle terminal 1 outputs a first warning indicating that the vehicle is approaching a dangerous location, in addition to the second warning described above. Here, the vehicle terminal 1 performs the following process to prevent the first warning from being output excessively.

[0040] First, the vehicle terminal 1 acquires the current location information of the vehicle via the GPS module 18. Next, the vehicle terminal 1 determines whether the vehicle is approaching a dangerous location based on the acquired current location information and the location information of the dangerous location indicated by the map information. Specifically, the vehicle terminal 1 determines whether the dangerous location overlaps with the first area shown in FIG. 7A.

[0041] For example, as shown in Fig. 7A, the first area is a sector-shaped area set within a first distance forward from the vehicle, with the vehicle position as the center of the concentric circle. Note that the first area is not limited to a sector-shaped area, and may be, for example, an annular sector-shaped area set between the first distance and a second distance (described later) with the vehicle as the center of the concentric circle. Alternatively, the first area may be a rectangular area. In this way, the first area may be an area set within the first distance from the vehicle, and its shape, position (distance), range, etc. are not particularly limited.

[0042] The vehicle terminal 1 then determines whether the dangerous spot overlaps with a second area set within a second distance that is shorter than the first distance. If the vehicle terminal 1 determines that the dangerous spot overlaps with the second area, it erases the command to output the first warning. The second area is a sector-shaped area set in front of the vehicle with the vehicle position as the center of the circle, as shown by the white area surrounded by a dashed line in FIG. 7B, for example, and is an area that constitutes a part of the first area. Note that, like the first area, the second area may also be set as an annular sector or a rectangular area, as long as it is within the second distance that is shorter than the first distance.

[0043] FIG. 8 illustrates a state in which a vehicle gradually approaches a dangerous area. For example, as shown in FIG. 8, if the dangerous area is set as a certain area on a map (an elliptical area in FIG. 8), and the first area overlaps with the area corresponding to the dangerous area (the second state from the top in FIG. 8), the vehicle terminal 1 generates a command to output a first warning and outputs the first warning. The first warning is a warning to alert the driver based on the distance from the vehicle to the dangerous area. For example, the vehicle terminal 1 may output a first warning audio signal, such as "You will soon enter a dangerous area where accidents are likely to occur. Be careful!", via the speaker 19 a predetermined number of times (e.g., three times). Note that the number of times the first warning is output is not limited to a predetermined number. For example, the vehicle terminal 1 starts outputting the first warning when the first area overlaps with the dangerous area, and continues to output the first warning thereafter.

[0044] Thereafter, the vehicle terminal 1 determines whether the dangerous spot overlaps with the second area. If it is determined that the dangerous spot overlaps with the second area (the third state from the top in FIG. 8), the vehicle terminal 1 erases the command to output the first warning that is being output.

[0045] In this way, the vehicle terminal 1 generates a command to output a first warning when a dangerous location overlaps with a first area set within a first distance from the vehicle, and deletes the command to output the first warning when the dangerous location overlaps with a second area set within a second distance shorter than the first distance. This allows for control to issue an advance warning with the first warning when approaching a dangerous location, and to only output the second warning when approaching a further dangerous location, thereby suppressing excessive output of the first warning and enabling appropriate avoidance of dangerous events.

[0046] In the above description, it is assumed that the vehicle goes straight toward the dangerous spot, overlapping the first area and then the second area. However, if the vehicle turns right or left, for example, It is also possible that the dangerous location overlaps the first area but does not overlap the second area and thus leaves the first area. In this case, the vehicle terminal 1 may continue to output the first warning, or may end output of the first warning after a certain time has elapsed since the dangerous location left the first area. In this way, there are no particular limitations on the exception handling when the dangerous location does not overlap the second area.

[0047] Furthermore, although the above description has been given assuming that the second area is part of the first area, the first area and the second area may not overlap with each other (for example, the first area is a circular sector area from the first distance to the second distance, and the second area is a sector area closer to the vehicle than the first area), or the first area and the second area may only overlap partially.

[0048] Furthermore, when a dangerous location overlaps the second area, the vehicle terminal 1 preferably changes the content of the dangerous event detection process so that the dangerous event can be detected with high sensitivity. Specifically, when the second area overlaps a dangerous location, the vehicle terminal 1 expands the region of interest 11b illustrated in FIG. 5. For example, the vehicle terminal 1 extends the distance from the vehicle to the tip of the region of interest 11b (the upper edge of the region of interest 11b at the top of FIG. 5) and expands the area on the road that is the detection target. This makes it possible to increase detection sensitivity when a dangerous location overlaps the second area, that is, when the vehicle enters a place where a dangerous event is likely to occur, and to preferably avoid the dangerous event.

[0049] While the above example illustrates expanding the region of interest as a processing example when a dangerous location overlaps the second region, the present embodiment is not limited to this. For example, the vehicle terminal 1 may change the parameters (thresholds) used as a reference when detecting dangerous events from an image. For example, when detecting dangerous events using a machine learning model for object detection, the threshold used for comparison with the output value from the learning model (for example, the probability that an object recognized from an image is a specific object such as a passerby or a red light) is lowered. In this case, too, the detection sensitivity of dangerous events can be improved in the same way as described above.

[0050] Although the above describes the process of expanding the region of interest or changing the threshold when a dangerous location overlaps the second region, the present embodiment is not limited to this. For example, as shown in FIG. 7C , a third region may be set within a third distance from the vehicle that is shorter than the first distance, and when a dangerous location overlaps the third region, the process of expanding the region of interest or changing the threshold may be performed similarly to the process described above. That is, a second region for erasing the command to issue the first warning and a third region for expanding the region of interest or changing the threshold may be set separately. However, hereinafter, for convenience, unless otherwise described, the second region and the third region will be treated as the same region as shown in FIG. 7B.

[0051] Fig. 9 is a flowchart showing a processing procedure for detecting a dangerous event. For ease of explanation, in the flowchart of Fig. 9, the vehicle terminal 1 that has detected a dangerous event is represented by reference symbol 1a, and the other vehicle terminals 1 are represented by reference symbol 1b.

[0052] The control unit 11 of the vehicle terminal 1a acquires map information indicating dangerous locations where dangerous events are likely to occur from the map DB 251 of the server 2 via the communication unit 13, and displays the map information on the display unit 15 (step S01). The control unit 11 acquires an image of the surroundings of the vehicle via the communication unit 13 or the image capturing unit 16 (step S02). For example, the control unit 11 acquires an image with the area in front of the vehicle as the image capturing range. The control unit 11 detects a dangerous event for the vehicle from a region of interest in the acquired image using pattern matching, a machine learning model, or the like (step S03). The control unit 11 determines whether a dangerous event for the vehicle has occurred based on the detection result of the dangerous event (step S04).

[0053] If the control unit 11 determines that a dangerous event involving the vehicle has not occurred (NO in step S04), the process returns to step S02. If the control unit 11 determines that a dangerous event involving the vehicle has occurred (YES in step S04), the control unit 11 outputs a second warning via the speaker 19 (step S05). The control unit 11 transmits detection information including the vehicle ID, an image of the dangerous event at the time of detection, the time of detection, location information, and details of the dangerous event to the server 2 via the communication unit 13 (step S06).

[0054] The control unit 21 of the server 2 receives the detection information transmitted from the vehicle terminal 1a via the communication unit 23 and stores it in the detection information DB 252 (step S07). The control unit 21 analyzes the detection information from each vehicle terminal 1a stored in the detection information DB 252 (step S08). For example, the control unit 21 calculates the number of occurrences, occurrence frequency, occurrence probability, etc. of the dangerous event at each point or area on the map by time or time zone, based on the detection time, position information, etc. of the dangerous event indicated in the detection information from each vehicle terminal 1a.

[0055] Based on the analysis result of step S08, the control unit 21 generates map information indicating dangerous locations on the map where dangerous events are likely to occur, and updates the map DB 251 based on the generated map information (step S09). For example, the control unit 21 compares the number of occurrences of dangerous events at each time or time zone with a predetermined threshold to determine the danger level of each point or area on the map, and generates map information designating points or areas with a danger level above a certain level as dangerous locations. The control unit 21 transmits the updated map information to each vehicle terminal 1 via the communication unit 23 (step S10).

[0056] The processes of steps S07 to S09 may be performed every time detection information is received (step S06), or may be performed at regular intervals.

[0057] The control unit 11 of the vehicle terminal 1a receives the updated map information transmitted from the server 2 via the communication unit 13 (step S11). The control unit 11 displays the received map information on the display unit 15 (step S12) and ends the process. The control unit 11 of the vehicle terminal 1b receives the updated map information transmitted from the server 2 via the communication unit 13 (step S13). The control unit 11 displays the received map information on the display unit 15 (step S14) and ends the process.

[0058] 10 is a flowchart showing the procedure for the dangerous spot warning process. For example, the vehicle terminal 1 executes the following process in parallel with the dangerous event detection process described with reference to FIG.

[0059] The control unit 11 of the vehicle terminal 1 acquires map information indicating dangerous locations where dangerous events are likely to occur from the map DB 251 of the server 2 via the communication unit 13 (step S101). The control unit 11 acquires current location information via the GPS module 18 (step S102).

[0060] The control unit 11 determines whether or not the danger spot overlaps with a first area set within a first distance from the vehicle based on the current position information and the position information of the danger spot indicated by the map information (step S103). If the control unit 11 determines that the danger spot does not overlap with the first area (NO in step S103), the process returns to step S102. If the control unit 11 determines that the danger spot overlaps with the first area (YES in step S103), the control unit 11 generates a command to output a first warning and outputs the first warning via the speaker 19 (step S104).

[0061] The control unit 11 determines whether the dangerous location overlaps with a second area set within a second distance shorter than the first area, based on the current position information and the position information of the dangerous location indicated by the map information (step S105). If the control unit 11 determines that the dangerous location does not overlap with the second area (NO in step S105), the process returns to step S105. If the control unit 11 determines that the dangerous location overlaps with the second area (YES in step S105), the control unit 11 erases the output command for the first warning that is being output (step S106). The control unit 11 enlarges the region of interest of the captured image that is to be used to detect a dangerous event (step S107).

[0062] The control unit 11 determines whether the dangerous location has left the second area based on the current location information and the location information of the dangerous location indicated by the map information (step S108). If the control unit 11 determines that the dangerous location has left the second area (YES in step S108), it returns the area of ​​interest in the enlarged captured image to the area of ​​interest before enlargement (step S109) and returns to the processing of step S101. If the control unit 11 determines that the dangerous location has not left the second area (NO in step S108), it returns to the processing of step S108.

[0063] According to this embodiment, a danger warning is output based on a dangerous event occurring in the vehicle or a dangerous location where a dangerous event is likely to occur, thereby making it possible to prevent accidents before they occur.

[0064] According to this embodiment, when a dangerous spot overlaps the second region, it is possible to expand the region of interest in the captured image that is the target of detecting a dangerous event.

[0065] According to this embodiment, when a dangerous spot overlaps with the second area, the threshold for detecting a dangerous event is changed, thereby making it possible to increase the detection sensitivity of the vehicle for the dangerous event.

[0066] According to this embodiment, by displaying both dangerous locations and dangerous events on a map, it becomes possible to comprehensively check information related to the occurrence of an accident.

[0067] In this embodiment, for convenience, map information generated based on detection information from a vehicle is described as an example, but the map information according to this embodiment is not limited to this. For example, the map information may reflect traffic information based on disaster information distributed in real time.

[0068] (Embodiment 2) The second embodiment relates to an embodiment in which the first area is enlarged in accordance with the traveling speed of the vehicle. Note that a description of the contents that overlap with the first embodiment will be omitted.

[0069] The traveling speed of a vehicle affects the time it takes for the vehicle to reach a dangerous location. As the traveling speed increases, the time it takes for the vehicle to reach a dangerous location decreases, which may result in missing the timing to output a danger warning to the user. Taking this into consideration, when the traveling speed is high, the first area is expanded, thereby enabling the danger warning to be output to the user earlier.

[0070] Fig. 11 is a flowchart showing the processing procedure when enlarging the first area in accordance with the vehicle's traveling speed. The same reference numerals are used to designate the same parts as in Fig. 10, and the description thereof will be omitted. After executing the process of step S102, the control unit 11 of the vehicle terminal 1 acquires the vehicle's traveling speed, for example, from a speed measurement sensor mounted on the vehicle (step S111). The control unit 11 determines whether the acquired traveling speed is equal to or greater than a predetermined reference speed (step S112).

[0071] When the control unit 11 determines that the acquired traveling speed is equal to or greater than the reference speed (YES in step S112), it expands the first region (step S113) and executes the processing of step S103. For example, the control unit 11 expands the radius of the large circle of the first region set in a sector shape in accordance with the magnitude of the traveling speed. For example, when the acquired traveling speed is 1.2 times the reference speed, the control unit 11 expands the radius of the concentric circle of the first region by 1.2 times. When the control unit 11 determines that the acquired traveling speed is less than the reference speed (NO in step S112), it proceeds to the processing of step S103.

[0072] According to this embodiment, by enlarging the first area in accordance with the traveling speed of the vehicle, it is possible to output a danger warning to the user at an appropriate timing.

[0073] (Embodiment 3) The third embodiment relates to an embodiment in which the distance from the vehicle to the third area is changed depending on the attributes of the user (driver) driving the vehicle. In the third embodiment, the second area and the third area are distinguished from each other. Note that the description of the contents overlapping with the first and second embodiments will be omitted.

[0074] User attributes include the user's age, etc. For example, elderly drivers may be more likely to have traffic accidents due to issues such as driving below the legal speed limit, braking late, or slow reactions. Taking these factors into consideration, it is necessary to change the third distance from the vehicle according to the user's age. For elderly drivers, the third distance from the vehicle is lengthened according to a predetermined rule. For example, for elderly drivers in their 70s, the third distance from the vehicle may be lengthened by 1.5 times. User attributes may also include driving skills or years of driving experience, etc.

[0075] Fig. 12 is a block diagram showing an example of the configuration of the server 2 according to the second embodiment. Note that the same reference numerals are used to designate the same components as those in Fig. 3, and the description thereof will be omitted. A user DB 253 is stored in the mass storage unit 25. The user DB 253 stores user information including user attributes.

[0076] 13 is an explanatory diagram showing an example of a record layout of the user DB 253. The user DB 253 includes a user ID column, a gender column, and an age column. The user ID column stores a unique user ID to identify each user. The gender column stores the user's gender. The age column stores the user's age.

[0077] 14 is a flowchart showing the processing procedure for changing the third distance depending on the user's age. The control unit 11 of the vehicle terminal 1 acquires the user's age from the user DB 253 of the server 2 based on the user ID (step S121). The control unit 11 determines whether the user is an elderly driver based on the acquired user's age (step S122). For example, if the user's age is 70 or older, the control unit 11 may determine that the user is an elderly driver.

[0078] If the control unit 11 determines that the user is an elderly driver (YES in step S122), it sets the third distance from the vehicle longer than that for drivers other than elderly drivers (step S123) and ends the process. For example, it sets the third distance from the vehicle to be 1.2 times longer. If the control unit 11 determines that the user is not an elderly driver (NO in step S122), it ends the process.

[0079] In the above process, the third distance is changed based on the user's age, but the present invention is not limited to this. The third distance may be changed based on the user's driving skill or years of driving experience, in addition to the user's age.

[0080] According to this embodiment, by changing the third area distance from the vehicle in accordance with the attributes of the user, it becomes possible to output a danger warning to the user in advance at an appropriate timing. In this embodiment, the second region and the third region are distinguished from each other, but the second region and the third region may be the same region.

[0081] In this embodiment, not only the third distance but also the first distance may be changed. For example, by increasing the first distance in the case of an elderly driver, the elderly driver can recognize the detection of a dangerous spot more quickly. This can prevent the elderly driver from having to respond in a panic to a dangerous event when the hazard map is updated in real time.

[0082] The embodiments disclosed herein are to be considered in all respects as illustrative and not restrictive. The scope of the present invention is defined by the claims, not by the above meaning, and is intended to include all modifications within the meaning and scope of the claims. [Explanation of symbols]

[0083] 1. Information processing terminal (vehicle terminal) 11 Control section 12 Storage section 13 Communications Department 14 Input section 15 Display section 16 Photography Department 17 Auxiliary storage 18 GPS module 19 Speaker 1P control program 2. Information processing device (server, map information provider) 21 Control section 22 Memory section 23 Communications Department 24 Reading unit 25 Mass storage 251 Map DB 252 Detection Information DB 253 User DB 2a Portable storage media 2b Semiconductor memory 2P control program

Claims

1. determining whether the dangerous area overlaps with a first area set within a first distance from the vehicle and a second area set within a second distance from the vehicle that is shorter than the first distance, based on map information indicating dangerous areas where dangerous events are likely to occur and position information of the vehicle; generating a command to output a first warning when it is determined that the dangerous spot overlaps with the first area; When it is determined that the dangerous spot overlaps with the second area, the output command of the first warning is deleted; Acquire an image of the surroundings of the vehicle; Detecting a dangerous event of the vehicle from the image; outputting a second warning when the dangerous event is detected; Detecting the hazardous event from a region of interest within the image; When it is determined that the dangerous spot overlaps with a third area set within a third distance from the vehicle that is shorter than the first distance, the area of ​​interest is expanded. A program that causes a computer to perform a process.

2. When it is determined that the dangerous location overlaps with the third area, a threshold value used as a reference for detecting the dangerous event from the image is changed. The program according to claim 1, which executes processing.

3. The third distance from the vehicle is changed according to an attribute of a user who drives the vehicle.

3. The program according to claim 1, which executes processing.

4. The first area is expanded in accordance with the traveling speed of the vehicle.

4. The program according to claim 1, which executes processing.

5. When a dangerous event for the vehicle is detected, detection information including a detection time and location information is transmitted to a map information providing device that provides the map information; The map information updated in accordance with the detection information is acquired from the map information providing device.

5. The program according to claim 1, which executes processing.

6. determining whether the dangerous area overlaps with a first area set within a first distance from the vehicle and a second area set within a second distance from the vehicle that is shorter than the first distance, based on map information indicating dangerous areas where dangerous events are likely to occur and position information of the vehicle; generating a command to output a first warning when it is determined that the dangerous spot overlaps with the first area; When it is determined that the dangerous spot overlaps with the second area, the output command of the first warning is deleted; Acquire an image of the surroundings of the vehicle; Detecting a dangerous event of the vehicle from the image; outputting a second warning when the dangerous event is detected; Detecting the hazardous event from a region of interest within the image; When it is determined that the dangerous spot overlaps with a third area set within a third distance from the vehicle that is shorter than the first distance, the area of ​​interest is expanded. An information processing method that causes a computer to execute a process.

Images