Information processing device, information processing method, and program
An information processing device uses image analysis to assess the safety of overtaking a first vehicle by monitoring the movement of a second vehicle, improving the accuracy of passability assessments and reducing the risk of accidents.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-03-16
- Publication Date
- 2026-04-01
AI Technical Summary
Existing methods for evaluating the starting possibility of a stopped vehicle during overtaking are unreliable, especially when the target vehicle lacks communication capabilities, and relying solely on visual cues can lead to misjudgment.
An information processing device that uses image analysis from a camera to detect and identify the movement of a second vehicle relative to a first vehicle on the roadside, calculates a score indicating the safety of overtaking based on overtaking behavior, and outputs this information to assist other vehicles in determining the passability of the first vehicle.
Accurately provides information to other vehicles about the passability of a first vehicle on the road, enhancing safety by reducing the likelihood of reckless overtaking and potential accidents.
Smart Images

Figure 0007838706000001 
Figure 0007838706000002 
Figure 0007838706000003
Abstract
Description
Technical Field
[0001] The present invention relates to an information processing apparatus, an information processing method, and program relates to.
Background Art
[0002] Patent Document 1 discloses a vehicle control device that sets a speed limit value distribution that defines an upper limit value of the relative speed between the host vehicle and a stopped vehicle according to the starting possibility of the stopped vehicle when overtaking or passing the stopped vehicle. Specifically, the vehicle control device described in the same document sets a large value as the speed limit value, which is the upper limit value of the relative speed of the target vehicle, when the starting possibility is low. Conversely, when the starting possibility is high, the speed limit value is set to a small value, and when overtaking a vehicle with a high starting possibility, it is controlled to pass at a low speed. According to the same document, the starting possibility is described as being evaluated based on communication with the target vehicle, the position of the driving range, the operation of the brake, the wiper, the presence or absence of passengers, the open / closed state of the door, etc.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] As one method of accurately evaluating the starting possibility, as in Patent Document 1, it is conceivable to communicate with the target vehicle and acquire the state of the vehicle, but there is a problem that it does not function if the target vehicle is not equipped with a communication function. Further, if the starting possibility is evaluated only from the appearance state of the target vehicle, such as the lighting state of the brake lamp, the wiper, the presence or absence of passengers, the open / closed state of the door, etc., without depending on communication with the target vehicle, there is a possibility of misjudgment.
[0005] This disclosure relates to an information processing device, an information processing method, and an information processing device that can accurately provide information to other vehicles, etc., indicating whether a vehicle on the road is passable. program The purpose is to provide. [Means for solving the problem]
[0006] From a first perspective, an information processing device is provided, comprising: detection means for detecting a first vehicle on a road; identification means for identifying the movement of a second vehicle coming from behind the first vehicle from an image taken by a camera capable of photographing the road; calculation means for calculating the degree to which the first vehicle can be safely overtaken based on whether or not the second vehicle has overtaken the first vehicle; and output means for outputting information indicating the degree to which the first vehicle can be safely overtaken to a predetermined output destination.
[0007] From a second perspective, an information processing method is provided which detects a first vehicle on a road, identifies the movement of a second vehicle coming from behind the first vehicle from an image taken with a camera capable of photographing the road, calculates the degree to which the first vehicle can be safely overtaken based on whether or not the second vehicle has overtaken the first vehicle, and outputs information indicating the degree to which the first vehicle can be safely overtaken to a predetermined output destination.
[0008] From a third perspective, a recording medium is provided that records a program that performs the following: a process for detecting a first vehicle on a road; a process for identifying the movement of a second vehicle coming from behind the first vehicle from an image taken by a camera capable of photographing the road; a process for calculating the degree to which the first vehicle can be safely overtaken based on whether or not the second vehicle has overtaken the first vehicle; and a process for outputting information indicating the degree to which the first vehicle can be safely overtaken to a predetermined output destination. [Effects of the Invention]
[0009] According to this disclosure, it will be possible to accurately provide information to other vehicles, etc., indicating whether a vehicle on the road is passable. [Brief explanation of the drawing]
[0010] [Figure 1] This figure shows the configuration of one embodiment of the present disclosure. [Figure 2] This is a flowchart illustrating the operation of one embodiment of the present disclosure. [Figure 3] This is a diagram illustrating the operation of one embodiment of the present disclosure. [Figure 4] This is a diagram illustrating the operation of one embodiment of the present disclosure. [Figure 5] This is a diagram illustrating the operation of one embodiment of the present disclosure. [Figure 6] This figure shows the configuration of the first embodiment of the present disclosure. [Figure 7] This figure shows an example of a table held by the information processing device of the first embodiment of this disclosure. [Figure 8] This is a flowchart illustrating the operation of the first embodiment of this disclosure. [Figure 9] This is a diagram illustrating the operation of the first embodiment of this disclosure. [Figure 10] This figure shows the configuration of the second embodiment of the present disclosure. [Figure 11] This is a flowchart illustrating the operation of the second embodiment of the present disclosure. [Figure 12] This is a diagram illustrating the operation of a second embodiment of the present disclosure. [Figure 13] This is another figure illustrating the operation of the second embodiment of the present disclosure. [Figure 14] This is another figure illustrating the operation of the second embodiment of the present disclosure. [Figure 15] This is another figure illustrating the operation of the second embodiment of the present disclosure. [Figure 16] This figure shows the configuration of the third embodiment of the present disclosure. [Figure 17] This is a flowchart illustrating the operation of the third embodiment of this disclosure. [Figure 18] This is a diagram illustrating the operation of the third embodiment of the present disclosure. [Figure 19] It is a diagram showing the configuration of a computer constituting the information processing apparatus of the present disclosure.
Embodiments for Carrying Out the Invention
[0011] First, an outline of an embodiment of the present disclosure will be described with reference to the drawings. Note that the reference numerals in the drawings appended to this outline are for convenience of each element as an example to assist understanding, and are not intended to limit the present disclosure to the illustrated mode. Also, the connection lines between blocks in the drawings and the like referred to in the following description include both bidirectional and unidirectional ones. The one-way arrow schematically shows the flow of the main signal (data), and does not exclude bidirectionality. The program is executed via a computer device, and the computer device includes, for example, a processor, a storage device, an input device, a communication interface, and a display device as necessary. Further, this computer device is configured to be communicable with devices inside or outside the device (including computers) via the communication interface, whether wired or wireless. Also, ports or interfaces are provided at the input / output connection points of each block in the figure, but the illustration thereof is omitted.
[0012] In one embodiment of the present disclosure, as shown in FIG. 1, it can be realized by an information processing apparatus 10 including a detection means 11, a specifying means 12, a calculating means 13, and an output means 14.
[0013] More specifically, the detection means 11 detects a first vehicle on the road, for example, a first vehicle located on the roadside. The identification means 12 identifies the movement of a second vehicle coming from behind the first vehicle from an image captured by a camera capable of photographing the road. The calculation means 13 calculates the degree to which the first vehicle can be safely overtaken. The output means 14 then outputs information indicating the degree to which the first vehicle can be safely overtaken to a predetermined output destination. For example, the output means 14 can indicate the degree to which the first vehicle can be safely overtaken by outputting the information to a predetermined output destination on the network 20. The calculation means 13 may also calculate the possibility that the first vehicle is a "stopped vehicle" as an example of the degree to which the first vehicle can be safely overtaken. In this case, a "stopped vehicle" refers to a state in which the first vehicle is stopped in the same place for a certain period of time, and includes stopping states shorter than "parking" under the Road Traffic Act.
[0014] The information processing device 10 configured as described above operates as follows. First, the information processing device 10 detects a first vehicle located on the roadside (step S01 in Figure 2). Located on the roadside means that the center line of the vehicle's direction of travel is closer to the edge than the center of the lane, and the vehicle does not necessarily have to be stopped.
[0015] Next, the information processing device 10 monitors the second vehicle approaching from behind the first vehicle using the camera C and identifies its movement (step S02 in Figure 2). At this time, the information processing device 10 can be configured to identify the movement of the second vehicle approaching from behind the first vehicle by referring to an image taken later in time than the image taken when the first vehicle was detected.
[0016] Next, the information processing device 10 calculates the degree to which the second vehicle can safely overtake the first vehicle, based on whether or not the second vehicle has overtaken the first vehicle (step S03 in Figure 2).
[0017] Finally, the information processing device 10 outputs information indicating the degree to which the first vehicle can be safely overtaken to a predetermined output destination (step S04 in Figure 2).
[0018] Figures 3 to 5 are diagrams illustrating the operation of one embodiment of the present disclosure. In the example in Figure 3, vehicle V11 is located on the roadside. This vehicle V11 is referred to as the "first vehicle." Vehicles V12 and V13 are assumed to be following behind it.
[0019] Here, as shown in Figure 4, let's assume that vehicle V12 has overtaken vehicle V11. In this case, the information processing device 10 identifies that the second vehicle V12, coming from behind the first vehicle V11, has overtaken the first vehicle V11, and based on this, calculates the degree to which the first vehicle V11 can be safely overtaken. Specifically, since the second vehicle V12 has overtaken the first vehicle V11, the information processing device 10 calculates a high degree to which the first vehicle V11 can be safely overtaken. The information processing device 10 then outputs this calculation result to a predetermined output destination. For example, by notifying vehicle V13 of this calculation result, vehicle V13 can recognize that the degree to which it can safely overtake vehicle V11 is high and prepare for the overtaking operation.
[0020] On the other hand, as shown in Figure 5, suppose that vehicle V12 slows down and stops before vehicle V11. In this case, the information processing device 10 identifies that the second vehicle V12, coming from behind the first vehicle V11, is not attempting to overtake the first vehicle V11, and based on this, calculates the degree to which it can safely overtake the first vehicle V11. Specifically, since the second vehicle V12 is not overtaking the first vehicle V11, the information processing device 10 calculates a low degree to which it can safely overtake the first vehicle V11. The information processing device 10 then outputs this calculation result to a predetermined output destination. For example, by notifying vehicle V13 of this calculation result, vehicle V13 recognizes that it can safely overtake the first vehicle V11, and can perform the same deceleration as the second vehicle V12.
[0021] As described above, according to this embodiment, it is possible to notify other vehicles that the first vehicle V11 on the road may be a stationary vehicle.
[0022] [First Embodiment] Next, a first embodiment that assists route buses in safely overtaking vehicles ahead will be described in detail with reference to the drawings. Figure 6 is a diagram showing the configuration of the first embodiment of this disclosure. Referring to Figure 6, an information processing device 100 is shown that is connected to a control center 200 and assists the operation of route bus V2 by providing appropriate guidance to vehicle V1, etc.
[0023] The information processing device 100 includes a detection unit 101, a identification unit 102, a calculation unit 103, and a transmission unit 104.
[0024] The detection unit 101 detects a first vehicle (for example, vehicle V11 in Figure 3) located on the roadside. In addition to using the image from camera C to recognize the vehicle as an object, the detection unit 101 can also detect obstacles such as vehicles by installing infrared or laser transceivers on the roadside. Furthermore, it can also detect vehicles located on the roadside from information acquired by radar, LiDAR, or a detector embedded in the road surface. Criteria for being located on the roadside can include, for example, the distance between the roadside and the vehicle body being within a predetermined threshold, or the vehicle body being located on the road shoulder. This detection unit 101 corresponds to the detection means 11 described above.
[0025] The identification unit 102 monitors following vehicles approaching from behind the first vehicle using images captured by a camera C capable of photographing the road, and identifies their movements. The images captured by this camera C are taken chronologically after the time the first vehicle was detected. Note that the camera C in this disclosure is not limited to a visible-image camera. For example, a LiDAR or infrared image camera can also be used. This identification unit 102 corresponds to the identification means 12 described above. Furthermore, the identification unit 102 may continue monitoring following vehicles for a predetermined period of time, and there may be multiple following vehicles.
[0026] The calculation unit 103 calculates a value indicating the degree to which the following vehicle (the second vehicle, for example, vehicle V12 in Figures 4 and 5) can safely overtake the first vehicle, based on whether or not the following vehicle has overtaken the first vehicle. In this embodiment, the calculation unit 103 calculates a score indicating the degree to which the first vehicle can safely overtake. This calculation unit 103 corresponds to the calculation means 13 described above. The calculation unit 103 may also calculate the score such that the score increases according to the number of second vehicles that have overtaken the first vehicle V11.
[0027] Figure 7 shows an example of a table held by the information processing device 100 of the first embodiment of this disclosure. The information processing device 100 of this embodiment adds to the score when it detects the occurrence of a certain event. For example, when a second vehicle (for example, vehicle V12 in Figures 4 and 5) overtakes a first vehicle (for example, vehicle V11 in Figures 4 and 5), the information processing device 100 adds 50 points to the score. Also, for example, if a certain amount of time has elapsed since the detection of the first vehicle (for example, vehicle V11 in Figures 4 and 5), or if a predetermined amount of time has elapsed since the first vehicle came to a standstill, the information processing device 100 performs a correction by adding 30 points to the score.
[0028] Furthermore, the information processing device 100 subtracts from the score when it detects the occurrence of a certain event. In the example in Figure 7, if the second vehicle (for example, vehicle V12 in Figures 4 and 5) accelerates in the latter half of the overtaking process, the information processing device 100 performs a correction by subtracting 30 points from the score. Also, if the second vehicle (for example, vehicle V12 in Figures 4 and 5) decelerates and stops before the first vehicle (for example, vehicle V11 in Figures 4 and 5), the information processing device 100 performs a correction by subtracting 50 points from the score. In this way, the information processing device 100 calculates a score indicating the degree to which the first vehicle can be safely overtaken.
[0029] In the example in Figure 7, only the behavior of the second vehicle (for example, vehicle V12 in Figures 4 and 5) is shown, but the score may be added to or subtracted using information obtained from the image of the first vehicle. For example, if it is known that the first vehicle has its hazard lights on, that passengers are getting in or out with the doors open, or that the driver's seat is empty, the score may be added. Conversely, if it is known that the first vehicle has its brake lights on, that its turn signals are on, or that there is someone in the driver's seat, the score may be subtracted. In the above example, the score is calculated by addition or subtraction, but a method of calculating the score by multiplying by a correction rate depending on the type of event can also be adopted. Of course, it is also possible to calculate the score using an evaluation formula that combines both methods.
[0030] The transmitting unit 104 transmits the calculation result to the control center 200.
[0031] The control center 200 uses the score received from the information processing device 100 to provide operational support for the route bus V2. Various forms of this operational support are possible. For example, the control center 200 transmits a score to the route bus V2 approaching the first vehicle from behind, indicating the degree to which it can safely overtake the vehicle in front (the first vehicle). The route bus V2 can display this score on an in-vehicle terminal. Furthermore, if the route bus V2 is an autonomous vehicle, it can use this score to decide whether to overtake the first vehicle, or to adjust the speed during the overtake and the distance between the two vehicles.
[0032] If the control center 200 has the function to directly control the route bus V2, it may use this score to directly operate (remotely operate) the route bus V2. For example, when the control center 200 remotely operates the route bus V2, it uses this score to drive it. As described above, this transmission unit 104 corresponds to the output means 14 described above.
[0033] Next, the operation of this embodiment will be described in detail with reference to the drawings. Figure 8 is a flowchart showing the operation of the first embodiment. Referring to Figure 8, first, the information processing device 100 detects a vehicle (first vehicle) located on the roadside (step S001).
[0034] Next, the information processing device 100 starts monitoring the second vehicle that follows (step S002).
[0035] Next, the information processing device 100 calculates a score indicating the degree to which the first vehicle can be safely overtaken, using the movement of the second vehicle coming from behind the first vehicle (step S003).
[0036] Next, the information processing device 100 transmits the calculated score to the control center 200 (step S004).
[0037] Upon receiving the score, the control center 200 creates information to be transmitted to the route bus V2 based on the score and transmits it to the route bus V2 (the third vehicle) as shown in Figure 9. For example, in the example in Figure 9, the control center 200 notifies the route bus V2 that there is a stopped vehicle 500m ahead and that caution should be exercised when overtaking it. The driver of the route bus V2 drives while referring to this information. For example, in the example in Figure 9, since it has been determined that caution is required when overtaking the vehicle ahead (the first vehicle), the driver of the route bus V2 does not attempt to overtake and instead slows down. In this way, it is possible to prevent accidents caused by reckless overtaking.
[0038] In the example described above, the information processing device 100 was described as transmitting scores and information to the route bus V2 (third vehicle) via the control center 200, but the information processing device 100 may also transmit information directly to the route bus V2 (third vehicle).
[0039] [Second Embodiment] Next, a second embodiment will be described in which the information processing device calculates a score indicating the degree to which the first vehicle can be safely overtaken, by referring to map information in addition to the image from camera C. Figure 10 is a diagram showing the configuration of the second embodiment. The difference from the first embodiment shown in Figure 6 is that the information processing device 100a is equipped with a map information storage unit 105, and consequently, the operation of the calculation unit 103a is different. The other configurations are the same as in the first embodiment, so the following will focus on explaining the differences.
[0040] The map information storage unit 105 stores map information of the vicinity of the road. This map information may be, for example, map information used for route guidance services or road management, but it is desirable that it includes information on surrounding facilities. The map information storage unit 105 may also be located outside the information processing device 100a. In this case, the information processing device 100a will access the external map information storage unit 105 to obtain the map information.
[0041] The calculation unit 103a calculates a score indicating the degree to which the second vehicle can safely overtake the first vehicle V1, based on the movement of the second vehicle and the map information. The calculation unit 103a also functions as a means for acquiring map information.
[0042] Next, the operation of this embodiment will be described in detail with reference to the drawings. Figure 11 is a flowchart showing the operation of the second embodiment. The only difference from Figure 8, which shows the operation of the first embodiment, is step S103. The other steps are the same as in the first embodiment, so the differences will be explained below.
[0043] In step S103, the information processing device 100a calculates a score indicating the degree to which the second vehicle can safely overtake the first vehicle V1, based on the movement of the second vehicle and map information.
[0044] Figures 12 to 15 illustrate examples of score calculation using map information by the information processing device 100a. In the example in Figure 12, the first vehicle V11 is located on the roadside. However, referring to the map information, this location corresponds to the installation location of a parking meter PM. In this case, regardless of the movement of the second vehicle V12, the information processing device 100a assigns a high score indicating the degree to which the first vehicle V11 can be safely overtaken. It should be noted that, not limited to parking meters PM, there may also be stores or other structures directly next to the parking position of the first vehicle V11. In this case as well, the information processing device 100a assigns a high score indicating the degree to which the first vehicle V11 can be safely overtaken. By using map information in this way, the accuracy of the score calculation by the information processing device 100a can be improved. By providing the score calculated in this way to the route bus (third vehicle) V13, it becomes possible to inform the route bus (third vehicle) V13 that there is a high probability that the first vehicle V11 is a stationary vehicle.
[0045] In the example shown in Figure 13, the first vehicle V11 is located on the edge of the road, and vehicle V12 is slowing down and stopped in front of vehicle V11. Furthermore, referring to the map information, it is found that the road width w is wider than that of a typical road. Thus, despite the wide road width w, the fact that vehicle V12 is stopped suggests that there is a high probability that the first vehicle V11 will start moving. For example, vehicle V11 may have its turn signal on, but it is often not visible to the route bus (third vehicle) V13 behind it. In such a case, since there is a high probability that the first vehicle V11 will start moving in the near future, the information processing device 100a sets a low score indicating the degree to which it is safe to overtake the first vehicle V11. By providing the route bus (third vehicle) V13 with a score using map information in this way, it is possible to warn the route bus (third vehicle) V13 not to make a reckless overtake.
[0046] In the example in Figure 14, the first vehicle V11 is located on the edge of the road, and the second vehicle V12 has overtaken the first vehicle V11. Furthermore, referring to the map information, it is determined that the road width w1 is narrower than that of a typical road. Thus, despite the narrow road width w1, the fact that the second vehicle V12 has overtaken vehicle V11 indicates that the first vehicle V11 appears unlikely to move, or that there are no vehicles approaching from the opposite lane. In this case as well, the information processing device 100a assigns a high score to the degree to which the first vehicle V11 can be safely overtaken. By providing this map-based score to the route bus (third vehicle) V13, it becomes possible to inform the route bus (third vehicle) V13 that it can safely overtake.
[0047] In the example in Figure 15, the first vehicle V11 is located on the roadside, and multiple vehicles V14 and V12 have overtaken the first vehicle V11. The fact that two vehicles have overtaken it consecutively indicates that the first vehicle V11 does not appear to be moving, or that there are no vehicles coming in the oncoming lane. In this case as well, the information processing device 100a sets a high score indicating the degree to which the first vehicle V11 can be safely overtaken. By providing the route bus (third vehicle) V13 with a score using map information in this way, it is possible to inform the route bus (third vehicle) V13 that it can be safely overtaken.
[0048] As described above, according to this embodiment, by using map information in combination, it is possible to calculate a score indicating the degree to which the first vehicle V11 can be safely overtaken with higher accuracy than in the first embodiment.
[0049] [Third Embodiment] Next, a third embodiment will be described in which the information processing device calculates a score indicating the degree to which the first vehicle can be safely overtaken, by referring to the traffic signal information near the road in addition to the image from camera C. Figure 16 is a diagram showing the configuration of the third embodiment. The difference from the first embodiment shown in Figure 6 is that the information processing device 100b is equipped with a traffic signal information acquisition unit 106, and consequently, the operation of the calculation unit 103b is different. The other configurations are the same as in the first embodiment, so the following will focus on explaining those differences.
[0050] The signal light information acquisition unit 106 acquires light status information indicating the lighting status of the signal light S located in front of the first vehicle. This light status information can be acquired from the signal light S, or from a signal control device that controls the signal light S. If the control center 200 is equipped with a function to control the signal light S, the light status information may also be acquired from the control center 200.
[0051] The calculation unit 103b calculates a score indicating the degree to which the first vehicle V1 can be safely overtaken, based on the movement of the second vehicle and the lighting status information.
[0052] Next, the operation of this embodiment will be described in detail with reference to the drawings. Figure 17 is a flowchart showing the operation of the third embodiment. The only difference from Figure 8, which shows the operation of the first embodiment, is step S203. The other steps are the same as in the first embodiment, so the differences will be explained below.
[0053] In step S203, the information processing device 100b calculates a score indicating the degree to which the second vehicle can safely overtake the first vehicle V1, based on the movement of the second vehicle and the lighting status information.
[0054] Figure 18 illustrates an example of score calculation using lighting status information by the information processing device 100b. In the example in Figure 18, the first vehicle V21 is located on the roadside. However, referring to the lighting status information, the traffic light S in front of the first vehicle V21 is red. In this case, regardless of the movement of the second vehicle V22, the information processing device 100b assigns a high score indicating the degree to which the first vehicle V21 can be safely overtaken. The reason for this is that while the traffic light S in front is red, the possibility of the first vehicle V21 starting to move is low.
[0055] On the other hand, if the information on the light status indicates that the light status of traffic light S will change from red to green, the information processing device 100b will set a low score indicating the degree to which the first vehicle V21 can be safely overtaken, regardless of the movement of the second vehicle V22. This is because the first vehicle will start moving once the light status of the traffic light S ahead changes to green.
[0056] As explained above, according to this embodiment, by using lighting status information in combination, it is possible to calculate a score indicating the degree to which the first vehicle V21 can be safely overtaken with higher accuracy than in the first embodiment. Then, by sending the score and associated images to the route bus (third vehicle) V13 via the control center 200, it is possible to improve the safety of the operation of the route bus (third vehicle) V13.
[0057] While the embodiments of this disclosure have been described above, this disclosure is not limited to the embodiments described above, and further modifications, substitutions, and adjustments can be made without departing from the basic technical concept of this disclosure. For example, the network configurations, element configurations, and data representations shown in the drawings are examples to aid in understanding this disclosure and are not limited to the configurations shown in these drawings.
[0058] (Regarding hardware configuration) In each embodiment of this disclosure, each component of each device represents a functional unit block. Some or all of each component of each device is realized by any combination of an information processing device 900 and a program, for example, as shown in Figure 19. Figure 19 is a block diagram showing an example of the hardware configuration of the information processing device 900 that realizes each component of each device. The information processing device 900 includes, as an example, the following configuration. ·CPU(Central Processing Unit)901 • ROM (Read Only Memory) 902 ·RAM(Random Access Memory)903 Program 904 is loaded into RAM903. • Storage device 905 for storing program 904 • Drive device 907 for reading and writing recording medium 906 • Communication interface 908 connected to communication network 909 • Input / output interface 910 for data input and output. • Bus 911 connecting each component
[0059] Each component of each device in each embodiment is realized by the CPU 901 acquiring and executing a program 904 that realizes these functions. That is, the CPU 901 in Figure 19 executes a vehicle detection program and a second vehicle monitoring program, and performs update processing of each calculation parameter held in RAM 903, storage device 905, etc. The program 904 that realizes the functions of each component of each device is, for example, stored in storage device 905 or ROM 902 in advance and read by the CPU 901 as needed. The program 904 may be supplied to the CPU 901 via a communication network 909, or it may be stored in a recording medium 906 in advance, and the drive device 907 may read the program and supply it to the CPU 901.
[0060] There are various variations in how each device is implemented. For example, each device may be implemented by any combination of a separate information processing device 900 and a program for each component. Alternatively, multiple components of each device may be implemented by any combination of a single information processing device 900 and a program. That is, each part (processing means, function) of the information processing device shown in the first to third embodiments described above can be implemented by a computer program that causes a processor mounted on the device to execute the above-described processing using its hardware.
[0061] Furthermore, some or all of the components of each device are realized by other general-purpose or dedicated circuits, processors, etc., or combinations thereof. These may be made up of a single chip or multiple chips connected via a bus.
[0062] Some or all of the components of each device may be realized by a combination of the circuits and programs described above.
[0063] When some or all of the components of each device are implemented by multiple information processing devices or circuits, these multiple information processing devices or circuits may be centrally located or distributed. For example, the information processing devices or circuits may be implemented in a form in which each is connected via a communication network, such as a client-and-server system or a cloud computing system.
[0064] The embodiments described above are preferred embodiments of this disclosure and do not limit the scope of this disclosure to these embodiments alone. That is, a person skilled in the art can modify or substitute the embodiments described above to construct various modified forms without departing from the gist of this disclosure.
[0065] For example, in the first to third embodiments described above, an example was given in which the control center 200 assists in the operation of a route bus, but the scope of application of this disclosure is not limited to this. For example, it is also possible to provide a score calculated by the information processing devices 100 to 100b for a specific vehicle or vehicle type. Furthermore, the score indicating the degree to which the first vehicle V11 can be safely overtaken can also be described in a different way. For example, instead of a score indicating the degree to which the first vehicle V11 can be safely overtaken, a score indicating the likelihood that the first vehicle V11 is a stationary vehicle can be used.
[0066] Furthermore, the contents of the table shown in Figure 7 are merely an example, and other actions not shown in Figure 7 may be identified and reflected in the score. For example, if the second vehicle overtakes the first vehicle and leaves a large lateral gap between them, the score indicating the degree to which the second vehicle can safely overtake the first vehicle may be reduced. This is because if a large lateral gap is left between the second vehicle and the first vehicle, the driver of the second vehicle may be anticipating that the first vehicle will start moving in the near future. By using such various movements of the second vehicle to adjust the score, it becomes possible to accurately estimate the degree to which the first vehicle can safely overtake.
[0067] Furthermore, the second embodiment and the third embodiment described above can be combined and implemented. In this case, the information processing device will calculate a score indicating the degree to which the first vehicle can be safely overtaken, based on the movement of the second vehicle, map information, and lighting status information.
[0068] Some or all of the above embodiments may also be described as follows, but are not limited to these.
[0069] [Note 1] A detection means for detecting a first vehicle on the road, A means for identifying the movement of a second vehicle coming from behind the first vehicle from an image taken with a camera capable of photographing the aforementioned road, A calculation means for calculating the degree to which the first vehicle can be safely overtaken based on whether or not the second vehicle has overtaken the first vehicle, An output means that outputs information indicating the degree to which the first vehicle can be safely overtaken to a predetermined output destination, An information processing device equipped with the following features. [Note 2] The identification means of the information processing device described above can be configured to identify the movement of the second vehicle coming from behind the first vehicle from an image taken after the time the first vehicle was detected. [Note 3] The output means of the information processing device described above can be configured to transmit information to a third vehicle approaching the first vehicle from behind the first vehicle, indicating the degree to which it can safely overtake the first vehicle. [Note 4] The output means of the information processing device described above can be configured to transmit information to a control device that controls a third vehicle approaching the first vehicle from behind the first vehicle, indicating the degree to which the first vehicle can be safely overtaken. [Note 5] The calculation means of the information processing device described above can further be configured to calculate the degree to which the first vehicle can be safely overtaken based on whether or not a predetermined amount of time has elapsed since the first vehicle came to a standstill. [Note 6] The calculation means of the information processing device described above can further be configured to calculate the degree to which the first vehicle can be safely overtaken, based on whether or not the second vehicle accelerated while overtaking. [Note 7] The information processing device described above further, The system includes means for acquiring map information of the vicinity of the aforementioned road, The calculation means can be configured to calculate the degree to which the first vehicle can be safely overtaken based on the movement of the second vehicle and the map information. [Note 8] The information processing device described above further, The system includes means for acquiring lighting status information indicating the lighting status of a traffic signal located in front of the first vehicle, The calculation means can be configured to calculate the degree to which the first vehicle can be safely overtaken based on the movement of the second vehicle and the lighting status information. [Note 9] The calculation means of the information processing device described above can be configured to calculate the degree to which a plurality of vehicles, including the second vehicle, can safely overtake the first vehicle, based on whether or not they have overtaken the first vehicle. [Note 10] The first vehicle on the road is detected, From images captured by a camera capable of photographing the aforementioned road, the movement of the second vehicle approaching from behind the first vehicle is identified. Based on whether or not the second vehicle has overtaken the first vehicle, the degree to which the first vehicle can be safely overtaken is calculated. Information indicating the degree to which the first vehicle can be safely overtaken is output to a predetermined output destination. Information processing methods. [Note 11] The process of detecting the first vehicle on the road, The process involves identifying the movement of a second vehicle approaching from behind the first vehicle based on an image taken with a camera capable of photographing the aforementioned road, A process for calculating the degree to which the second vehicle can safely overtake the first vehicle, based on whether or not the second vehicle has overtaken the first vehicle, A process that outputs information indicating the degree to which the first vehicle can be safely overtaken to a predetermined output destination, A recording medium that contains a program to execute [something]. Furthermore, the forms described in each of the above appendices can be combined with each other after making the necessary modifications. For example, a configuration that combines the contents described in appendice 2 and the contents described in appendice 3 is also included within the scope of disclosure of this specification. Furthermore, the forms described in appendices 10 to 11 above can be expanded into the forms described in appendices 2 to 9, similar to appendice 1.
[0070] Furthermore, each disclosure in the above-mentioned patent documents is incorporated into this document by reference and may be used as the basis or part of this disclosure as necessary. Within the framework of this disclosure (including the claims), further modifications and adjustments to the embodiments or examples are possible based on their fundamental technical ideas. Also, within the framework of this disclosure, various combinations or selections (including partial deletions) of various disclosure elements (including each element of each claim, each element of each embodiment or example, each element of each drawing, etc.) are possible. In other words, this disclosure naturally includes the entire disclosure, including the claims, and various modifications and alterations that a person skilled in the art could make in accordance with the technical idea. In particular, with respect to the numerical ranges described in this document, any numerical value or sub-range included within that range should be interpreted as being specifically described, even if not otherwise stated. Furthermore, each disclosure item of the above-mentioned cited documents may, as necessary, be used in part or in whole as part of this disclosure, in accordance with the spirit of this disclosure, and this is also considered to be included in the disclosure items of this application. [Explanation of Symbols]
[0071] 10, 100, 100a, 100b Information Processing Device 11. Detection methods 12 Specific means 13 Calculation method 14 Output means 101 Detection unit 102 Specific part 103 Calculation section 104 Transmitter 105 Map Information Storage Unit 106 Signal light information acquisition section 200 Control Center 900 Information Processing Equipment 901 CPU(Central Processing Unit) 902 ROM (Read Only Memory) 903 RAM (Random Access Memory) 904 Program 905 Storage device 906 Recording media 907 Drive unit 908 Communication Interface 909 Communication Network 910 Input / Output Interface 911 Bus C Camera PM Parking Meter S traffic light V1, V11, V12 vehicles V2, V13 vehicles (route buses) w, w1 Road width
Claims
1. A detection means for detecting a first vehicle on the road, A means for identifying the movement of a second vehicle coming from behind the first vehicle from an image taken with a camera capable of photographing the aforementioned road, A calculation means for calculating the degree to which the first vehicle can be safely overtaken based on whether or not the second vehicle has overtaken the first vehicle, An output means that outputs information indicating the degree to which the first vehicle can be safely overtaken to a predetermined output destination, An information processing device equipped with the following features.
2. The information processing device according to claim 1, wherein the identifying means identifies the movement of the second vehicle coming from behind the first vehicle from an image taken at a time later than the time the first vehicle was detected.
3. The output means transmits information to a third vehicle approaching the first vehicle from behind the first vehicle indicating the degree to which it can safely overtake the first vehicle. The information processing apparatus according to claim 1.
4. The output means transmits information to a control device that controls a third vehicle approaching the first vehicle from behind the first vehicle, indicating the degree to which the first vehicle can be safely overtaken. The information processing apparatus according to claim 1.
5. The calculation means further calculates the degree to which the first vehicle can be safely overtaken, based on whether or not a predetermined amount of time has elapsed since the first vehicle came to a standstill. The information processing apparatus according to claim 1.
6. The calculation means further calculates the degree to which the first vehicle can be safely overtaken, based on whether or not the second vehicle accelerated while overtaking. The information processing apparatus according to claim 1.
7. moreover, The system includes means for acquiring map information of the vicinity of the aforementioned road, The calculation means calculates the degree to which the first vehicle can be safely overtaken based on the movement of the second vehicle and the map information. The information processing apparatus according to claim 1.
8. moreover, The system includes means for acquiring lighting status information indicating the lighting status of a traffic signal located in front of the first vehicle, The calculation means calculates the degree to which the first vehicle can be safely overtaken based on the movement of the second vehicle and the lighting status information. An information processing device according to any one of claims 1 to 7.
9. The information processing device is The first vehicle on the road is detected, From images captured by a camera capable of photographing the aforementioned road, the movement of the second vehicle approaching from behind the first vehicle is identified. Based on whether or not the second vehicle has overtaken the first vehicle, the degree to which the first vehicle can be safely overtaken is calculated. An information processing method that outputs information indicating the degree to which the first vehicle can be safely overtaken to a predetermined output destination.
10. A process for detecting the first vehicle on the road, The process involves identifying the movement of a second vehicle approaching from behind the first vehicle based on an image taken with a camera capable of photographing the aforementioned road, A process for calculating the degree to which the first vehicle can be safely overtaken based on whether or not the second vehicle has overtaken the first vehicle, A process that outputs information indicating the degree to which the first vehicle can be safely overtaken to a predetermined output destination, A program that executes the command.
Citation Information
Patent Citations
A vehicle control system and method for providing information to support an overtaking maneuver
EP3923259A1
Driving support apparatus and program
JP2010287162A
Vehicular control device
JP2019142428A
Control system and control method for moving body
JP2019144971A
System, method and computer readable storage medium for traffic intersection navigation
JP2020109656A