Information processing device, information processing method, and information processing program

Abstract

To provide an information processing device or the like capable of reliably starting recording of an image or the like obtained by imaging another vehicle under dangerous driving without an operation or the like of a driver.SOLUTION: In an on-vehicle device T, vehicle identification information of another vehicle moving in the circumference is extracted from a circumferential image obtained by imaging the circumference of one vehicle. When vehicle identification information of a specific vehicle identified to be under dangerous driving in the past coincides with the extracted vehicle identification information, preservation of the circumferential image obtained by imaging the other vehicle on which the coincident vehicle identification information has been extracted is started.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] This application belongs to the technical field of information processing apparatuses, information processing methods, and information processing programs. More specifically, it belongs to the technical field of an information processing apparatus and an information processing method for performing information processing on a surrounding image obtained by imaging the surroundings of a moving object, and an information processing program executed in the information processing apparatus.

Background Art

[0002] In recent years, nuisance driving or dangerous driving such as so-called tailgating has often been in the news. In the following description, the above-mentioned dangerous driving or nuisance driving is collectively referred to as "dangerous driving". Here, when encountering a situation where dangerous driving by another vehicle affects the driving of the host vehicle, for example, it is desirable to record an image or the like showing the situation of the other vehicle using a so-called drive recorder or the like. As a prior art document disclosing the prior art related to the recording of such an image or the like, the following Patent Document 1 can be cited.

[0003] In the prior art described in this Patent Document 1, a camera is provided on the host vehicle to image the surroundings, and when another vehicle performs dangerous driving near the host vehicle, an image capturing the situation is saved as one piece of data together with its position, date and time, and the vehicle registration number of the other vehicle, etc., and this is transmitted to an external server.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, when the host vehicle encounters a dangerous situation as described above, in the prior art disclosed in Patent Document 1, the driver himself / herself is required to operate a button installed in the vehicle to start imaging by the above camera. And with such a configuration, the imaging is not performed (in other words, the corresponding data is not saved) unless the driver operates the button. However, in a dangerous situation as described above, it may be too harsh to require the driver to calmly operate the above button.

[0006] Therefore, the present application is made in view of the above problems, and an example of the problem is to provide an information processing apparatus, an information processing method, and an information processing program executed in the information processing apparatus that can surely start recording an image or the like of another vehicle performing dangerous driving without an operation by the driver or the like.

Means for Solving the Problems

[0007] In order to solve the above problems, the invention according to claim 1 includes: an identification information extraction means for extracting moving body identification information of another moving body moving around from surrounding image information corresponding to a surrounding image obtained by imaging the surroundings of the moving body; moving body identification information of a specific moving body that is a moving body specified based on a past dangerous driving history; and when the extracted moving body identification information matches the moving body identification information of the specific moving body, a recording control means for starting recording of the surrounding image information obtained by imaging the other moving body for which the matching moving body identification information has been extracted.

[0008] In order to solve the above problems, the invention according to claim 9 is an information processing method executed in an information processing apparatus including an extraction unit and a recording control unit, the method including: an identification information extraction step of extracting, by the extraction unit, moving object identification information of another moving object moving around from surrounding image information corresponding to a surrounding image obtained by imaging the surroundings of a moving object; and a recording control step of starting, by the recording control unit, recording of the surrounding image information obtained by imaging the other moving object for which the moving object identification information has been extracted when the moving object identification information of a specific moving object, which is a moving object specified based on a past dangerous driving history, matches the extracted moving object identification information.

[0009] In order to solve the above problems, the invention according to claim 10 causes a computer included in an information processing apparatus to function as an identification information extraction unit that extracts moving object identification information of another moving object moving around from surrounding image information corresponding to a surrounding image obtained by imaging the surroundings of a moving object, and a recording control unit that starts recording of the surrounding image information obtained by imaging the other moving object for which the moving object identification information has been extracted when the moving object identification information of a specific moving object, which is a moving object specified based on a past dangerous driving history, matches the extracted moving object identification information.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Embodiments for Carrying Out the Invention

[0011] Next, a mode for carrying out the present application will be described with reference to FIG. 1. Note that FIG. 1 is a block diagram showing the schematic configuration of the information processing apparatus according to the embodiment.

[0012] As shown in FIG. 1, the information processing apparatus T according to the embodiment includes an identification information extraction unit 11b and a recording control unit 11a.

[0013] In this configuration, the identification information extraction unit 11b extracts moving object identification information of another moving object moving around the moving object from the surrounding image information corresponding to the surrounding image obtained by imaging the surroundings of the moving object.

[0014] Then, when the moving object identification information of a specific moving object specified based on the past dangerous driving history matches the moving object identification information extracted by the identification information extraction unit 11b, the recording control unit 11a starts recording the surrounding image information obtained by imaging the other moving object from which the matching moving object identification information has been extracted.

[0015] As described above, according to the configuration of the information processing apparatus T of the embodiment, when the moving object identification information extracted from the surrounding image information matches the moving object identification information of the specific moving object, the recording of the surrounding image information obtained by imaging the other moving object from which the matching moving object identification information has been extracted is started. Therefore, the recording of the surrounding image information can be surely started without an operation by the user or the like.

Example

[0016] Next, specific examples corresponding to the above-described embodiment will be described with reference to FIGS. 2 to 4. Note that the examples described below are examples in the case where the present application is applied to an information providing system that provides information regarding the vehicle performing the dangerous driving from a server apparatus connected via a network such as the Internet to in-vehicle apparatuses respectively mounted on the respective vehicles.

[0017] FIG. 2 is a block diagram showing the schematic configuration of the information providing system according to the embodiment, FIG. 3 is a block diagram showing the schematic configuration of an in-vehicle device or the like constituting the information providing system, and FIG. 4 is a flowchart showing the information providing process according to the embodiment. At this time, in FIGS. 2 and 3, for each component of the embodiment corresponding to each component of the information processing apparatus T in the embodiment shown in FIG. 1, the same component numbers as those of the components in the information processing apparatus T are used.

[0018] As shown in FIG. 2, the information providing system S according to the embodiment includes in-vehicle devices T1, T2,..., Tn (n is a natural number), each of which is mounted on a vehicle, for example, and an information providing server SV, which are connected to each other via a network NW composed of the Internet or a dedicated line or the like so that information or data can be exchanged therebetween. These in-vehicle devices T1, T2,..., Tn are specifically realized as, for example, a drive recorder. In the following description, when describing common matters regarding the in-vehicle devices T1, T2,..., Tn (n is a natural number), these are collectively referred to as "in-vehicle device T". Also, the vehicle on which the in-vehicle device T being described is mounted is hereinafter referred to as the "own vehicle". At this time, the in-vehicle device T corresponds to an example of the information processing apparatus T of the embodiment.

[0019] In the above configuration, the information providing server SV associates vehicle identification information for identifying a vehicle that is supposed to have driven dangerously in the past (specifically, the vehicle registration number of the vehicle (the vehicle number described on the so-called license plate)), the risk score of the embodiment, and the risk flag of the embodiment with each other, and records them non-volatilely as a dangerous driving history. At this time, the above risk score is a score that quantitatively indicates the degree of danger of the vehicle regarding dangerous driving. Also, the above risk flag is a flag indicating whether or not the vehicle habitually performs dangerous driving based on the risk score. In the following description, a vehicle that habitually performs dangerous driving is referred to as a "habitual dangerous driving vehicle".

[0020] Then, in response to the inquiry request of the embodiment transmitted from each in-vehicle device T via the network NW, the information providing server SV transmits, via the network NW, a response indicating whether or not another vehicle that is the target of the inquiry request is a habitual dangerous driving vehicle to the in-vehicle device T that has transmitted the inquiry request. As a result, the in-vehicle device T that has transmitted the inquiry request recognizes whether or not another vehicle (any one of the other vehicles other than the own vehicle) that is the target of the inquiry request is a habitual dangerous driving vehicle. And when the other vehicle that is the target of the inquiry request is a habitual dangerous driving vehicle, for example, even when there is no instruction operation by the driver of the own vehicle or the like, the in-vehicle device T records (saves) the image information of the habitual dangerous driving vehicle captured by the in-vehicle device on the SD (Super Density or Secure Digital) card of the embodiment. In the following description, the recording on the SD card of the embodiment is simply referred to as "saving to the SD card".

[0021] On the other hand, each in-vehicle device T transmits, via the network NW, the dangerous driving vehicle information of the embodiment in which evaluation information indicating the degree of the dangerous driving (including evaluation information indicating that there was no dangerous driving) and the vehicle identification information of the other vehicle that has performed the dangerous driving are associated with respect to the dangerous driving by another vehicle (regardless of whether it is a habitual dangerous driving vehicle or not) other than the own vehicle to the information providing server SV. And the information providing server SV that has received the dangerous driving vehicle information updates the danger score and the danger flag for the vehicle based on the evaluation information and the vehicle identification information included in the received dangerous driving vehicle information. At this time, when the degree of the dangerous driving indicated by the evaluation information is high, it is updated so that the danger score increases, and when there is no dangerous driving, it is updated so that the danger score decreases.

[0022] Also, in each in-vehicle device T, according to the occurrence situation of the dangerous driving, the image information of the vehicle that has performed the dangerous driving and has been saved to the SD card due to the occurrence of the dangerous driving is deleted from the SD card.

[0023] Next, the configurations and operations of the in-vehicle device T and the information providing server SV that constitute the information providing system S of the embodiment will be described more specifically.

[0024] First, as shown in FIG. 3(a), the in-vehicle device T of the embodiment includes an interface 10, a processing unit 11 composed of a CPU, a RAM (Random Access Memory), a ROM (Read Only Memory), etc., a reader / writer 12, a memory 13, an operation unit 14 composed of operation buttons or a touch panel, etc., a camera 15 composed of a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) image sensor, etc., a sensor unit 16 composed of a GNSS (Global Navigation Satellite System) receiver or an acceleration sensor, etc., and a display 17 composed of a liquid crystal display, etc. Further, the processing unit 11 is composed of a recording / erasing control unit 11a of the embodiment, an extraction unit 11b of the embodiment, and a determination unit 11c of the embodiment. At this time, the recording / erasing control unit 11a, the extraction unit 11b, and the determination unit 11c may be realized by a hardware logic circuit composed of the CPU, etc. of the processing unit 11, or may be realized software-wise by the CPU reading and executing a program corresponding to the information providing process of the embodiment described later. Further, the extraction unit 11b corresponds to an example of the identification information extraction means 11b of the embodiment and an example of the "feature extraction means" of the present application, the recording / erasing control unit 11a corresponds to an example of the recording control means 11a of the embodiment, an example of the "erasing means" of the present application, and an example of the "erasing control means" of the present application, respectively, and the determination unit 11c corresponds to an example of the "determination means" of the present application.

[0025] In the above configuration, the interface 10 controls the exchange of data with the information providing server SV via the network NW under the control of the processing unit 11. The camera 15, for example, has the front and rear of the host vehicle as its imaging range, and outputs image information as a result of imaging the imaging range to the processing unit 11 under the control of the processing unit 11. Note that the imaging range of the camera 15 may be, for example, the entire circumference of the host vehicle. The memory 13 temporarily records the image information under the control of the processing unit 11. The sensor unit 16 outputs, for example, position data indicating the position of the host vehicle to the control unit 11 based on the reception result of the navigation radio wave by the GNSS receiver and the like. The operation unit 14 generates an operation signal corresponding to an operation by, for example, the driver of the host vehicle and outputs it to the processing unit 11. At this time, the operation unit 14 includes a save instruction unit used when the driver or the like instructs to save the image information to the SD card CD. On the other hand, the recording / erasing control unit 11a of the processing unit 11 controls the saving, reading, and erasing of data with respect to the SD card CD via the reader / writer 12. The extraction unit 11b of the processing unit 11 extracts the vehicle identification information of another vehicle shown in the image corresponding to the image information output from the camera 15 and the feature amount indicating the features of the other vehicle by the same method as in the prior art. At this time, the feature amount includes, for example, the feature amounts of the outer shape and color of the other vehicle. The determination unit 11c of the processing unit 11 determines whether or not another vehicle is performing dangerous driving based on the image information and the feature amounts of the image corresponding thereto. In addition to these, the processing unit 11 executes other processes desired as the in-vehicle device T using the operation signal from the operation unit 14 and the position data and the like from the sensor unit 16.

[0026] On the one hand, as shown in FIG. 3(b), the information providing server SV of the embodiment includes an interface 1, a processing unit 2 composed of a CPU, a RAM, a ROM, etc., a display 3 composed of a liquid crystal display, etc., an operation unit 4 composed of a keyboard, a mouse, etc., and a recording unit 5 composed of an HDD (Hard Disc Drive) or an SSD (Solid State Drive), etc. Further, the processing unit 2 includes an update unit 2a of the embodiment and a determination unit 2b of the embodiment. At this time, the update unit 2a and the determination unit 2b may be realized by a hardware logic circuit composed of the CPU, etc. of the processing unit 2, or may be realized software-wise by the CPU reading out and executing a program corresponding to the information providing process of the embodiment described later.

[0027] In the above configuration, in the recording unit 5, response data 50 of an embodiment in which the vehicle identification information for identifying a vehicle that is supposed to have performed the above dangerous driving in the past, the above risk score, and the above risk flag are associated is non-volatilely recorded as a database of dangerous driving history. On the other hand, the interface 1 controls the exchange of data with each in-vehicle device T via the network NW under the control of the processing unit 2. The operation unit 4 generates an operation signal in response to an operation by, for example, an administrator or the like of the information providing server SV, and outputs it to the processing unit 2. On the other hand, the update unit 2a of the processing unit 2 updates the above risk score for the vehicle with the above vehicle identification information based on the above evaluation information and the above vehicle identification information included in the above dangerous driving vehicle information received from each in-vehicle device T. The mode of updating the risk score by the update unit 2a will be described in detail later with reference to FIG. 4. Next, the determination unit 2b of the processing unit 2 compares each risk score with a preset risk threshold for each corresponding vehicle identification information, and determines whether the vehicle with the above vehicle identification information is the above habitual dangerous driving vehicle. Then, the determination unit 2b updates the above risk flag based on the determination result. Specifically, when the risk score at that time is equal to or higher than the above risk threshold, the determination unit 2b determines that the vehicle with the above vehicle identification information is a habitual dangerous driving vehicle, and turns on the risk flag associated with the above vehicle identification information. On the contrary, when the risk score at that time is less than the above risk threshold, the determination unit 2b determines that the vehicle with the above vehicle identification information is not a habitual dangerous driving vehicle, and turns off the risk flag associated with the above vehicle identification information. In addition to these, the processing unit 2 executes other processes desired as the information providing server SV based on the above operation signal and the like from the operation unit 4.

[0028] Next, the information providing process of the embodiment, which is executed mainly by the processing unit 11 of the in-vehicle device T and the processing unit 2 of the information providing server SV having the above-described configuration, will be collectively described with reference to FIGS. 3 and 4.

[0029] As shown in the corresponding flowcharts in FIG. 4 respectively, the information providing process of the embodiment includes a dangerous driving vehicle image recording process of the embodiment (see the upper left of FIG. 4) and a dangerous driving vehicle information transmission process of the embodiment (see the lower left of FIG. 4) executed centering around the processing unit 11 of the in-vehicle device T, and a dangerous driving vehicle inquiry process of the embodiment (see the upper right of FIG. 4) and a dangerous driving information reception process of the embodiment (see the lower right of FIG. 4) executed centering around the processing unit 2 of the information providing server SV.

[0030] Then, the dangerous driving vehicle image recording process of the embodiment shown in the upper left of FIG. 4 is started, for example, at preset timings after the timing when the power of the in-vehicle device T is turned on. As shown in the upper left of FIG. 4, when the dangerous driving vehicle image recording process of the embodiment is started, the processing unit 11 of the in-vehicle device T controls the camera 15 to image the surroundings of the own vehicle, acquires image information as the imaging result, and records it in the memory 13 in association with time information indicating the imaged time (step S1). In the image corresponding to this image information, for example, other vehicles, pedestrians, etc. existing around the own vehicle are reflected. Next, the extraction unit 11b of the processing unit 11 extracts the vehicle identification information of the other vehicle from the image (step S2). Thereafter, the processing unit 11 includes the vehicle identification information extracted by the extraction unit 11b and the device ID for identifying the in-vehicle device T from other in-vehicle devices T, and transmits the inquiry request of the above embodiment for inquiring whether the vehicle with the vehicle identification information is a habitual dangerous driving vehicle to the information providing server SV via the interface 10 and the network NW (step S3).

[0031] Next, the dangerous driving vehicle inquiry process of the embodiment shown in the upper right of FIG. 4 starts in parallel with the dangerous driving information reception process of the embodiment shown in the lower right of FIG. 4, for example, at the timing when the service of the information providing server SV is started. As shown in the upper right of FIG. 4, when the dangerous driving information reception process of the embodiment starts, the processing unit 2 of the information providing server SV monitors the transmission of the above inquiry request from any in-vehicle device T (step S20, step S20: NO. Refer to step S3 above). In the monitoring of step S20, when the above inquiry request is transmitted from any in-vehicle device T (step S20: YES), the processing unit 2 then determines whether the danger flag associated with the vehicle identification information included in the received inquiry request is "ON" in the response data 50 (step S21). In the determination of step S21, when the danger flag associated with the vehicle identification information is not "ON" (step S21: NO), the processing unit 2 transmits to the in-vehicle terminal T that transmitted the inquiry request received in step S20, via the interface 1 and the network NW, a response indicating that the vehicle with the vehicle identification information included in the inquiry request is not a habitual dangerous driving vehicle (step S23). Then the processing unit 2 proceeds to other processes as the information providing server SV. On the other hand, in the determination of step S21, when the danger flag associated with the vehicle identification information is "ON" (step S21: YES), the processing unit 2 transmits to the in-vehicle terminal T that transmitted the inquiry request received in step S20, via the interface 1 and the network NW, a response indicating that the vehicle with the vehicle identification information included in the inquiry request is a habitual dangerous driving vehicle (step S22). Note that the response in step S22 or step S23 is returned based on the device ID included in the above inquiry request. Then the processing unit 2 proceeds to other processes as the information providing server SV.

[0032] On the other hand, the processing unit 11 of the in-vehicle device T that transmitted the inquiry request in step S3 receives the response transmitted from the information providing server SV in step S22 or step S23 (step S4). Next, based on the received response, the processing unit 11 determines whether the vehicle with the vehicle identification information included in the inquiry request transmitted in step S3 is a habitual dangerous driving vehicle (step S5). In the determination of step S5, if the vehicle with the vehicle identification information is not a habitual dangerous driving vehicle (step S5: NO; see step S23 above), the processing unit 11 returns to step S1 as it is and repeats the above-described processing. On the other hand, in the determination of step S5, if the vehicle with the vehicle identification information is a habitual dangerous driving vehicle (step S5: YES; see step S22 above), the recording / deletion unit 11a then reads out the image information of the image in which the vehicle (habitual dangerous driving vehicle) with the vehicle identification information appears from the memory 13, and starts saving it to the SD card CD via the reader / writer 12 (step S6). Thereby, the saving of the image information showing the habitual dangerous driving vehicle to the SD card CD is started.

[0033] Next, the processing unit 11 and the extraction unit 11b extract the feature amounts of the habitual dangerous driving vehicle, and based on the extracted feature amounts, track the image of the habitual dangerous driving vehicle in the continuously captured image information, and continue to save the image information including it (step S6). The tracking in this step S6 is performed based on either one or both of the outer shape and color of the habitual dangerous driving vehicle as the feature amounts. The tracking method itself is the same as the conventional image feature amount extraction method and tracking method.

[0034] Next, when the recording / deletion control unit 11a of the processing unit 11 determines that the risk driving habitual vehicle from which the image information was saved in step S6 has left the host vehicle and thus the following is no longer possible, or when the time during which the following becomes impossible for other reasons than the vehicle leaving continues for a predetermined time, the recording / deletion control unit 11a stops the saving of the image information on the SD card CD performed in step S6 (step S7). After that, the recording / deletion control unit 11a determines whether to delete the image information for which the saving has been stopped from the SD card CD (step S8). Specifically, as the determination in step S8, for example, regarding the risk driving habitual vehicle corresponding to the image information for which the saving was stopped in step S7, when the transmission of the risk driving vehicle information associating the evaluation information indicating that the risk driving habitual vehicle has performed a risk driving (that is, that there has been a risk driving) and the vehicle identification information of the risk driving habitual vehicle is performed during the saving of the image information of the risk driving habitual vehicle in step S6, or when the saving instruction unit of the operation unit 14 is operated for the vehicle (step S8: retain), the deletion of the image information is not performed (deletion is prohibited). On the other hand, for the vehicle corresponding to the image information for which the saving was stopped in step S7, when, for example, the transmission of the risk driving vehicle information including the evaluation information such as the evaluation information indicating that the risk driving has been performed is not performed during the saving of the image information of the risk driving habitual vehicle in step S6, and the saving instruction unit has not been operated either (step S8: delete), the recording / deletion control unit 11a deletes the image information from the SD card CD (step S9). Then, the processing unit 11 transmits the risk driving vehicle information associating the evaluation information indicating that the risk driving habitual vehicle has not actually performed a risk driving (that is, "no risk driving") and the vehicle identification information of the risk driving habitual vehicle to the information providing server SV via the interface 10 and the network NW (step S10). After that, the processing unit 11 proceeds to other processes as the in-vehicle device T.

[0035] On the other hand, the dangerous driving vehicle information transmission process of the embodiment shown in the lower left of FIG. 4 starts at preset timings after, for example, the timing when the power of the in-vehicle device T is turned on, in parallel with the dangerous driving vehicle image recording process of the embodiment shown in the upper left of FIG. 4. As shown in the lower left of FIG. 4, when the dangerous driving vehicle information transmission process of the embodiment is started, similar to the above step S1, the processing unit 11 of the in-vehicle device T controls the camera 15 to image the surroundings of the host vehicle, acquires image information as the imaging result, and records it in the memory 13 in association with the time information indicating the imaged time (step S15). Next, the extraction unit 11b of the processing unit 11 extracts the vehicle identification information of the other vehicle from the image in the same manner as in step S2 above (step S16). Next, the processing unit 11 and the determination unit 11c determine whether dangerous driving has been detected in the other vehicle in which the vehicle identification information was extracted in step S16 (step S17). In the determination of this step S17, the determination unit 11c determines whether, for example, sudden lane change, tailgating from behind, sudden braking or route obstruction in the front, etc. have been performed based on the image of the other vehicle, thereby detecting the presence or absence of the above dangerous driving. In the determination of step S17, when dangerous driving is detected in the other vehicle (step S17: YES), the processing unit 11 transmits the dangerous driving vehicle information associating the evaluation information indicating that the other vehicle has performed dangerous driving (that is, that there has been dangerous driving) and the vehicle identification information extracted in step S16 above for the other vehicle to the information providing server SV via the interface 10 and the network NW (step S18). At this time, as the evaluation information indicating that the dangerous driving has been performed, for example, three-level evaluation information of "serious dangerous driving", "moderate dangerous driving" or "minor dangerous driving" may be included in the dangerous driving vehicle information according to the detection content in step S7 based on a preset standard. In addition, in the detection of step S17 above, in addition to the automatic determination by the determination unit 11c, the driver or passenger of the host vehicle may operate a predetermined button or the like of the operation unit 14 to select the above evaluation information and include it in the dangerous driving vehicle information. Thereafter, the processing unit 11 proceeds to other processes as the in-vehicle device T.

[0036] Next, the dangerous driving vehicle information reception process of the embodiment shown in the lower right of FIG. 4 starts in parallel with the dangerous driving vehicle inquiry process of the embodiment shown in the upper right of FIG. 4, for example, at the timing when the service of the information providing server SV is started. As shown in the lower right of FIG. 4, when the dangerous driving vehicle information reception process of the embodiment starts, the processing unit 2 of the information providing server SV monitors the transmission of the dangerous driving vehicle information from any in-vehicle device T (step S30, step S30: NO. Refer to step S12 or step S18 above). In the monitoring of step S30, when the dangerous driving vehicle information is transmitted from any in-vehicle device T (step S30: YES), the processing unit 2 then checks whether the response data 50 including the vehicle identification information associated with the received dangerous driving vehicle information (that is, the response data 50 of the vehicle corresponding to the received dangerous driving vehicle information) has already been recorded in the recording unit 5 (step S31). In the determination of step S31, when the response data 50 including the vehicle identification information associated with the received dangerous driving vehicle information has not yet been recorded (step S31: NO), the processing unit 2 newly records the response data 50 including the vehicle identification information in the recording unit 5 (step S32) and proceeds to step S33 described later. When the response data 50 is newly recorded in step S32, the risk score included therein is set to "0" and the risk flag is set to "off".

[0037] On the other hand, in the determination of step S31, if the response data 50 including the vehicle identification information associated with the received dangerous driving vehicle information has already been recorded (step S31: YES), the update unit 2a of the processing unit 2 updates the risk score for the vehicle with the vehicle identification information based on the evaluation information and the vehicle identification information included in the dangerous driving vehicle information received in step S30 (step S33). Here, specifically in step S33, for example, if the evaluation information included in the dangerous driving vehicle information received in step S30 is at the "malicious dangerous driving" stage (see step S18 above), the update unit 2a adds, for example, 1,000 points to the risk score. Also, if the evaluation information is at the "moderate dangerous driving" stage (see step S18 above), the update unit 2a adds, for example, 750 points to the risk score. Further, if the evaluation information is at the "minor dangerous driving" stage (see step S18 above), the update unit 2a adds, for example, 500 points to the risk score. Finally, if the evaluation information is at the "no dangerous driving" stage (see step S12 above), the update unit 2a subtracts 1 point from the risk score.

[0038] Next, the determination unit 2b of the processing unit 2 determines whether the risk score updated according to the stage of the evaluation information in step S33 is greater than or equal to the risk threshold (step S34). Here, as the risk threshold corresponding to the point used as the update point in step S33, for example, 600 points may be set in advance (so that the vehicle is not identified as a habitual dangerous driving vehicle just by adding 500 points, which is the additional score when the evaluation information is at the "minor dangerous driving" stage, only once). When the risk score updated according to the stage of the evaluation information is greater than or equal to the risk threshold (step S34: YES), the determination unit 2b determines that the vehicle with the vehicle identification information associated with the risk score at that time is a habitual dangerous driving vehicle, and sets the risk flag associated with the vehicle identification information to "ON" (step S35). Note that the update of the risk flag in step S35 includes the case where it continues to be "ON". On the other hand, when the risk score updated according to the stage of the evaluation information is less than the risk threshold (step S34: NO), the determination unit 2b determines that the vehicle with the vehicle identification information associated with the risk score at that time is not a habitual dangerous driving vehicle or has ceased to be a habitual dangerous driving vehicle, and sets the risk flag associated with the vehicle identification information to "OFF" (step S36). Thereafter, the processing unit 2 proceeds to other processes as the information providing server SV.

[0039] As described above, according to the information providing process of the embodiment, the evaluation information for evaluating the risk level of other vehicles and the vehicle identification information of other vehicles are acquired from the in-vehicle device T, and the risk score associated with each vehicle identification information is updated according to the evaluation information (see step S33 in FIG. 4). At this time, when the evaluation information indicates that another vehicle has performed dangerous driving, the risk score is increased, and when the evaluation information indicates that another vehicle has not performed dangerous driving, the risk score is decreased. Therefore, the risk score can be appropriately updated according to the occurrence status of dangerous driving in other vehicles.

[0040] Here, according to the point allocation of the risk level in the evaluation information as in the embodiment, for example, even if the risk score is increased by 750 points assuming that there has been a moderately dangerous driving once, the risk threshold is 600 points, and the fact that there has been no dangerous driving (the risk score decreases by only 1) is then transmitted as the above-mentioned dangerous driving vehicle information from a total of 150 in-vehicle devices T, it will not be identified as a habitual dangerous driving vehicle. Thus, it is possible to prevent a vehicle that is not actually a habitual dangerous driving vehicle from being permanently identified as a habitual dangerous driving vehicle even if it accidentally performs dangerous driving. Note that the above point allocation is preferably reviewed according to the popularity of the information providing system S of the present application. This is because it is considered that as the information providing system becomes more popular, the number of in-vehicle devices T that transmit the dangerous driving vehicle information indicating that there has been no dangerous driving will increase.

[0041] Also, when the evaluation information indicates that another vehicle has performed dangerous driving (i.e., in any of the above "malicious dangerous driving", "dangerous driving", or "minor dangerous driving" cases), the increase width of the risk score is larger than the decrease width of the risk score when the evaluation information indicates that another vehicle has not performed dangerous driving (i.e., in the above "no dangerous driving" case). Therefore, the risk score can be appropriately updated with more evaluation information in the case where dangerous driving has been performed and the case where it has not been performed.

[0042] Furthermore, a vehicle whose associated risk score exceeds a predetermined risk threshold is determined as a habitual dangerous driving vehicle (step S35 in FIG. 4), and in response to an inquiry request from the in-vehicle device T, this fact is transmitted to the in-vehicle device T (see step S22 in FIG. 4). Therefore, in the in-vehicle device T, it is possible to easily recognize a habitual dangerous driving vehicle.

[0043] Furthermore, when the vehicle identification information extracted from the image information obtained by the camera 15 matches the vehicle identification information of a habitual dangerous driving vehicle, the saving of the image information of other vehicles that have captured the vehicle with the matching vehicle identification information to the SD card CD is started (see step S6 in FIG. 4). Therefore, the saving of the image information can be surely started without an operation by the driver of the own vehicle or the like. As a result, it becomes possible to start recording images around the own vehicle before the habitual dangerous driving vehicle actually performs dangerous driving, and it also becomes possible to verify later the presence or absence of an event that has triggered the dangerous driving of the habitual dangerous driving vehicle.

[0044] In addition, the external features of the habitual dangerous driving vehicle shown in the image information to be saved are extracted, and based on the extracted features, the following vehicle of the habitual dangerous driving vehicle and the saving of the image information are continued (see step S6 in FIG. 4). Therefore, it is possible to surely continue the saving of the image information of other vehicles with vehicle identification information that matches the vehicle identification information of the habitual dangerous driving vehicle.

[0045] Furthermore, as the external features used for the following vehicle in step S6, the external features or color features of the other vehicle are extracted, so that the saving of the necessary image information can be more surely continued.

[0046] At this time, the in-vehicle device T may be provided with, for example, a LiDAR (Light Detection and Ranging) sensor or the like that optically detects, for example, the height of a vehicle as the external feature as a means for extracting the external feature. In this case, since the external feature is optically detected, the external feature can be extracted more accurately. At this time, the LiDAR (Light Detection and Ranging) sensor or the like corresponds to an example of the "optical feature detection means" of the present application.

[0047] Furthermore, when the above-described appearance features can no longer be extracted and it is necessary to stop saving the image information of the other vehicle (see step S10 in FIG. 4), by stopping the saving when it becomes unnecessary, for example, the recording area of the SD card CD for recording the image information can be effectively utilized.

[0048] Also, when it is determined that there is dangerous driving in the other vehicle or when there is an operation to save the image information (see step S11 in FIG. 4), deleting the saved image information from the SD card CD is prohibited, so that the necessary image information can be reliably saved.

[0049] Furthermore, in the determination of step S11 in FIG. 4 above, when it is not determined that there is dangerous driving and there is no operation for the above-described save instruction (see deletion in step S11 in FIG. 4), the image information is deleted from the SD card CD, so that, for example, the recording area of the SD card CD for saving the image information can be effectively utilized.

[0050] In the above-described embodiment, all responses are transmitted to the in-vehicle device T that has sent a query request (see step S22 or step S23 in FIG. 4). However, in addition to this, for example, from the perspective of privacy protection, a response may be transmitted only in response to a query request from an in-vehicle device T that satisfies a preset condition. In this case, from the perspective of privacy protection and the like, the transmission destination of the response regarding the habitual dangerous driving vehicle can be limited.

[0051] Also, in the above-described embodiment, the risk score is updated using all the evaluation information transmitted in the past. However, in addition to this, the risk score may be updated using only the evaluation information transmitted between the current date and time and a preset past time point. In this case, it is possible to prevent the risk score from being updated based on extremely old evaluation information.

[0052] Furthermore, time information may be included in the evaluation information from the in-vehicle device T, and the risk score may be updated by being classified in advance for each preset day of the week or time zone based on the time information. In this case, based on the risk score corresponding to the day of the week or time zone when the introduction request from the in-vehicle device T is received, the result of determining whether the vehicle to be queried is a habitual dangerous driving vehicle can be transmitted to the in-vehicle device T. Thereby, it is possible to identify a vehicle that tends to perform dangerous driving on a specific day of the week or time zone.

[0053] Furthermore, type information indicating the type of the road on which the host vehicle was traveling at the time when the evaluation information was transmitted may be included in the evaluation information from the in-vehicle device T, and the risk score may be updated by being classified for each type of road during driving based on the type information. In this case, when the in-vehicle device T receives an introduction request including the type of the road on which the host vehicle is currently traveling, based on the risk score corresponding to the type of the road, the result of determining whether the vehicle to be queried is a habitual dangerous driving vehicle can be transmitted to the in-vehicle device T. Thereby, for example, it is possible to identify a vehicle that tends to perform dangerous driving on a specific road such as a highway.

[0054] Also, in the above-described embodiment, when the feature of the vehicle with the vehicle identification information that matches the vehicle identification information of the habitual dangerous driving vehicle can no longer be extracted, the saving of the image information to the SD card CD is stopped. However, in addition to this, after the time when the feature can no longer be extracted, the saving of the image information with the matching vehicle identification information may be configured to continue for a preset time. In this case, the reason why the above feature can no longer be extracted is, for example, that the habitual dangerous driving vehicle has hidden behind the pillar of the host vehicle or behind another vehicle and cannot be seen. Even if the feature can be extracted again later, the necessary image information can be saved continuously.

[0055] Furthermore, a program corresponding to each flowchart shown in FIG. 4 is recorded on a recording medium such as an optical disk or a hard disk, or acquired via a network such as the Internet, and read and executed by a general-purpose microcomputer or the like, whereby the microcomputer or the like can be caused to function as the processing unit 2 or the processing unit 11 in the embodiment. Description of Signs

[0056] 11a Recording control means (recording / deletion control unit) 11b Identification information extraction means (extraction unit) T Information processing apparatus (in-vehicle apparatus) T1, T2, Tn In-vehicle apparatus S Information providing system

Claims

【Claim 1】 Identification information extraction means for extracting moving body identification information of another moving body moving around from surrounding image information corresponding to a surrounding image obtained by imaging the surroundings of a moving body; After starting recording of the surrounding image information based on the moving body identification information of a specific moving body that is a moving body identified based on a past dangerous driving history and the extracted moving body identification information, when tracking of the specific moving body using the surrounding image information becomes impossible, recording control means for stopping the recording of the surrounding image information; An information processing apparatus comprising the same.

Images