Warning timing adjustment device and program

Abstract

To provide a warning timing adjustment device capable of outputting a warning at the appropriate timing corresponding to conditions of one more occupants in a vehicle.SOLUTION: A warning timing adjustment device adjusts timing at which warning output device outputs a warning. The warning output device detects a situation where the warning needs to be output, and calculates a reference timing for outputting a warning (reference warning output timing) based on the detection result. The warning timing adjustment device includes: a determination unit that determines whether or not a timing at which the warning output device actually outputs a warning (actual warning output timing) needs to be changed from the reference warning output timing; and a warning output timing change unit that changes the actual warning output timing from the reference warning output timing when it needs to be changed. The determination unit determines whether the actual warning output timing needs to be changed from the reference warning output timing based on at least one of positions of occupants in a vehicle, body postures of the occupants, the number of occupants, ages of the occupants, and specific marks on personal items of the occupants.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a warning timing adjustment device and a program.

Background Art

[0002] Patent Document 1 describes a technique for outputting an alarm for passengers. In the technique described in Patent Document 1, it is described that the alarm timing is advanced when an elderly person or a child is included in the passengers. By the way, even when an elderly person or a child is riding in the vehicle, if the elderly person or the child is safely seated, it is considered that there is no need to advance the alarm timing. However, in the technique described in Patent Document 1, it is not determined whether or not it is necessary to advance the alarm timing. Therefore, depending on the technique described in Patent Document 1, there is a possibility that an alarm may not be output at an appropriate timing.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In view of the above problems, an object of the present invention is to provide a warning timing adjustment device and a program that can output a warning at an appropriate timing according to the state of passengers in a vehicle.

Means for Solving the Problems

[0005] One aspect of the present invention is a warning timing adjustment device for adjusting the timing at which a warning output device mounted on a vehicle outputs a warning, wherein the warning output device comprises a detection unit for detecting a situation in which a warning output is necessary, and a warning output timing calculation unit for calculating a reference warning output timing, which is a reference for the timing at which a warning is output, based on the detection result of the detection unit, and the warning timing adjustment device comprises a determination unit for determining whether or not it is necessary to change the actual warning output timing, which is the timing at which the warning output device actually outputs a warning, from the reference warning output timing calculated by the warning output timing calculation unit, and a warning output timing change unit for changing the actual warning output timing from the reference warning output timing when the determination unit determines that it is necessary to change the actual warning output timing from the reference warning output timing, wherein the determination unit determines whether or not it is necessary to change the actual warning output timing from the reference warning output timing based on at least one of the position of the occupants in the vehicle, the posture of the occupants, the number of occupants, the age of the occupants, and a specific mark attached to the occupants' belongings.

[0006] One aspect of the present invention is a program for causing a computer to perform a warning timing adjustment step to adjust the timing at which a warning output device mounted on a vehicle outputs a warning, wherein the warning output device comprises a detection unit that detects a situation in which a warning output is necessary, and a warning output timing calculation unit that calculates a reference warning output timing, which is a reference for the timing at which a warning is output, based on the detection result of the detection unit, and the warning timing adjustment step includes a determination step of determining whether or not it is necessary to change the actual warning output timing, which is the timing at which the warning output device actually outputs a warning, from the reference warning output timing calculated by the warning output timing calculation unit, and a warning output timing change step of changing the actual warning output timing from the reference warning output timing if it is determined in the determination step that it is necessary to change the actual warning output timing from the reference warning output timing, wherein the determination step determines whether or not it is necessary to change the actual warning output timing from the reference warning output timing based on at least one of the position of the occupants in the vehicle, the posture of the occupants, the number of occupants, the age of the occupants, and a specific mark attached to the occupants' belongings, and is a program. [Effects of the Invention]

[0007] According to the present invention, it is possible to provide a warning timing adjustment device and program that can output a warning at an appropriate timing according to the state of the occupants in the vehicle. [Brief explanation of the drawing]

[0008] [Figure 1] This figure shows an example of a vehicle to which the warning timing adjustment device of the first embodiment is applied. [Figure 2] This is a flowchart illustrating an example of the process performed in the warning timing adjustment device of the first embodiment. [Figure 3] This figure shows an example of a vehicle to which the warning timing adjustment device of the third embodiment is applied. [Modes for carrying out the invention]

[0009] Hereinafter, embodiments of the warning timing adjustment device and program of the present invention will be described with reference to the attached drawings.

[0010] <First Embodiment> Figure 1 shows an example of a vehicle V to which the warning timing adjustment device 1 of the first embodiment is applied. In the example shown in Figure 1, the warning output device A and the warning timing adjustment device 1 are installed in vehicle V. Vehicle V is a vehicle that can carry multiple passengers, such as a bus, and where standing and seated passengers may be present. In the example shown in Figure 1, the warning output device A and the warning timing adjustment device 1 are provided separately. However, in other examples, the warning timing adjustment device 1 may be included in the warning output device A (i.e., the warning timing adjustment device 1 may be part of the warning output device A). Furthermore, the warning output device A, which includes the warning timing adjustment device 1, may be part of, for example, a drive recorder.

[0011] In the example shown in Figure 1, warning output device A outputs a warning to the occupants of vehicle V. Warning output device A is a forward collision warning device that performs forward collision warning (FCW), which is one of the ADAS (Advanced Driver-Assistance Systems) functions. Warning output device A (forward collision warning device) comprises a detection unit A1, a warning output timing calculation unit A2, an acquisition unit A3, and a warning output unit A4. Detection unit A1 detects situations that require a warning to be issued. Detection unit A1 includes at least one of the following: an ADAS camera, an ADAS radar, and an ADAS LiDAR (Light Detection and Ranging) for detecting objects that may collide with the vehicle ahead (e.g., a vehicle in front). The warning output timing calculation unit A2 calculates a reference timing (reference warning output timing) for when the warning output unit A4 outputs a warning, based on the detection result of the detection unit A1. The warning output timing calculation unit A2 calculates the timing at which the distance between the vehicle V and the object to be hit in front is estimated to fall below a threshold, which is used as the reference warning output timing. The acquisition unit A3 acquires the output from the warning timing adjustment device 1 (the result of determining whether or not it is necessary to change the timing at which the warning output unit A4 actually outputs a warning (actual warning output timing) from the reference warning output timing, and the amount by which the actual warning output timing is advanced if it is necessary to change the actual warning output timing from the reference warning output timing).

[0012] The warning output unit A4 outputs a warning to the occupants of vehicle V based on the reference warning output timing calculated by the warning output timing calculation unit A2 and the output from the warning timing adjustment device 1 acquired by the acquisition unit A3 (the result of determining whether or not it is necessary to change the actual warning output timing from the reference warning output timing, and the amount by which the actual warning output timing should be advanced if it is necessary to change the actual warning output timing from the reference warning output timing). The warning output unit A4 provides warnings to the occupants of vehicle V, for example, by outputting an audio warning (in-vehicle announcement) or a display warning. In another example, the warning output unit A4 may output a warning to the driver of vehicle V via voice, display, etc., and the driver of vehicle V may then issue a warning to the occupants of vehicle V via voice (in-vehicle announcement), display, etc. By the warning output unit A4 outputting a warning to the driver of vehicle V, the driver of vehicle V can perform braking operations on vehicle V more gently, thereby suppressing the shaking of vehicle V and improving the safety of the occupants inside vehicle V.

[0013] In the example shown in Figure 1, the warning timing adjustment device 1 adjusts the timing at which the warning output unit A4 of the warning output device A (forward collision warning device) outputs a warning (actual warning output timing). The warning timing adjustment device 1 comprises an imaging unit 11, a determination unit 12, a warning output timing changing unit 13, and an output unit 14. The imaging unit 11 captures images of the occupants inside the vehicle V. The imaging unit 11 may be equipped with only one camera or with multiple cameras. The determination unit 12 determines, based on the images of occupants inside the vehicle V captured by the imaging unit 11, whether or not it is necessary to change the timing at which the warning output unit A4 of the warning output device A (forward collision warning device) actually outputs a warning (actual warning output timing) from the standard warning output timing calculated by the warning output timing calculation unit A2. More specifically, the determination unit 12 determines whether or not it is necessary to change the actual warning output timing from the standard warning output timing based on at least one of the occupants' positions inside the vehicle V, their posture, the number of occupants, their ages, and specific marks attached to the occupants' belongings.

[0014] For example, the determination unit 12 determines that if an occupant is in a position other than a seat in the vehicle V (i.e., if there is an occupant standing), the actual warning output timing needs to be earlier than if there is no occupant in a position other than a seat (i.e., if there is no occupant standing) (i.e., it determines that the actual warning output timing needs to be changed from the reference warning output timing). In this example, the determination unit 12 has the function of estimating the occupant's position based on an image of the occupant in the vehicle V captured by the imaging unit 11. For example, the determination unit 12 has the function of estimating the occupant's position by performing training using a pair of an image of the occupant in the vehicle V and the correct position of that occupant as training data. For example, the determination unit 12 determines that if there are occupants in a position other than seated in the vehicle V (i.e., if there are standing occupants), the actual warning output timing needs to be earlier than if only seated occupants were present in the vehicle V (i.e., the determination unit 12 determines that the actual warning output timing needs to be changed from the standard warning output timing). In this example, the determination unit 12 has the function of estimating the occupants' positions based on images of occupants in the vehicle V captured by the imaging unit 11. For example, the determination unit 12 has the function of estimating the occupants' positions by performing training using pairs of images of occupants in the vehicle V and the correct occupant positions as training data. For example, the determination unit 12 determines that if the number of occupants in vehicle V is greater than the number of seats (i.e., there are standing occupants), the actual warning output timing needs to be earlier than if the number of occupants in vehicle V is less than or equal to the number of seats (i.e., there is a high probability that there are no standing occupants) (i.e., it determines that the actual warning output timing needs to be changed from the reference warning output timing). In this example, the determination unit 12 has the function of estimating the number of occupants based on images of occupants in vehicle V captured by the imaging unit 11. For example, the determination unit 12 has the function of estimating the number of occupants in vehicle V by performing training using pairs of images of occupants in vehicle V and the correct number of occupants in vehicle V as training data. Alternatively, the number of people recognized by image recognition may be used as the number of occupants by using known techniques such as those shown in the URL below. https: / / www.elix-inc.com / cases / computer-vision / 938 / https: / / viso.ai / applications / people-counting-system / https: / / sightcorp.com / people-counting-software /

[0015] For example, when an occupant (e.g., an elderly person in the later stage) whose age is equal to or greater than the first threshold value (e.g., 75 years old) is present in the vehicle V, the determination unit 12 determines that it is necessary to advance the actual warning output timing compared to the case where an occupant whose age is equal to or greater than the first threshold value is not present in the vehicle V (that is, determines that it is necessary to change the actual warning output timing from the reference warning output timing). Further, when an occupant (e.g., a preschool child) whose age is equal to or less than the second threshold value (e.g., 6 years old) is present in the vehicle V, the determination unit 12 determines that it is necessary to advance the actual warning output timing compared to the case where an occupant whose age is equal to or less than the second threshold value is not present in the vehicle V (that is, determines that it is necessary to change the actual warning output timing from the reference warning output timing). In this example, the determination unit 12 has a function of estimating the age of the occupant based on the image of the occupant in the vehicle V captured by the imaging unit 11. For example, the determination unit 12 has a function of estimating the age of the occupant by performing learning using, as teacher data, a set of an image of the occupant in the vehicle V and the correct age of the occupant. For example, when there is an occupant carrying an item with a specific mark (e.g., "maternity mark", "stop sign for the disabled", "international symbol mark for the disabled", "international symbol mark for the blind", "physical disability mark", "help mark", etc.), the determination unit 12 determines that it is necessary to advance the actual warning output timing compared to the case where there is no occupant carrying an item with a specific mark (that is, determines that it is necessary to change the actual warning output timing from the reference warning output timing). In this example, the determination unit 12 has a function of identifying the mark attached to the item of the occupant based on the image of the occupant in the vehicle V captured by the imaging unit 11. For example, the determination unit 12 has a function of identifying the mark attached to the item of the occupant by performing learning using, as teacher data, a set of an image of the occupant in the vehicle V and the correct mark attached to the item of the occupant.

[0016] In the example shown in FIG. 1, when the determination unit 12 determines that it is necessary to change the actual warning output timing from the reference warning output timing, the warning output timing change unit 13 changes the actual warning output timing from the reference warning output timing (accelerates the actual warning output timing). Specifically, the warning output timing change unit 13 calculates the amount (change amount) to accelerate the actual warning output timing. On the other hand, when the determination unit 12 determines that it is not necessary to change the actual warning output timing from the reference warning output timing, the warning output timing change unit 13 does not change the actual warning output timing from the reference warning output timing (does not accelerate the actual warning output timing). That is, the warning output timing change unit 13 substantially calculates zero as the amount (change amount) to accelerate the actual warning output timing. The output unit 14 outputs to the warning output device A (front collision warning device) the determination result as to whether it is necessary to change the actual warning output timing from the reference warning output timing (the result of the determination by the determination unit 12), and the amount to accelerate the actual warning output timing when it is necessary to change the actual warning output timing from the reference warning output timing (the change amount calculated by the warning output timing change unit 13).

[0017] That is, in the example shown in FIG. 1, the warning timing adjustment device 1 basically adjusts the actual warning output timing by accelerating the actual warning output timing according to the state of the occupants in the vehicle V for safety. Therefore, the warning output device A (front collision warning device) can output a warning at an appropriate timing according to the state of the occupants in the vehicle V.

[0018] In the example shown in Figure 1, if all occupants are seated, and there are no occupants in vehicle V whose age is above the first threshold, and there are no occupants in vehicle V whose age is below the second threshold, and there are no occupants carrying personal items with a specific mark, the warning output timing change unit 13 does not advance the actual warning timing (i.e., the warning output unit A4 of warning output device A (forward collision warning device) outputs a warning at the standard warning output timing). However, in other examples, if all occupants are seated, and there are no occupants in vehicle V whose age is above the first threshold, and there are no occupants in vehicle V whose age is below the second threshold, and there are no occupants carrying personal items with a specific mark, the warning output unit A4 of warning output device A (forward collision warning device) does not have to output a warning. This is because it is considered that there is no inconvenience to any of the occupants. Also, regardless of conditions such as age or marks, the warning output unit A4 does not have to output a warning if all occupants are seated.

[0019] Figure 2 is a flowchart illustrating an example of the process performed in the warning timing adjustment device 1 of the first embodiment. In the example shown in Figure 2, in step S11, the imaging unit 11 captures images of the occupants inside the vehicle V. In step S12, the determination unit 12 determines, based on the images of the occupants inside the vehicle V captured in step S11, whether or not it is necessary to change the timing at which the warning output unit A4 of the warning output device A actually outputs a warning (actual warning output timing) from the reference warning output timing calculated by the warning output timing calculation unit A2. More specifically, in step S12, the determination unit 12 determines, based on at least one of the occupants' positions inside the vehicle V, their posture, the number of occupants, their ages, and any specific marks on the occupants' belongings, whether or not it is necessary to change the actual warning output timing from the reference warning output timing. In step S13, the warning output timing change unit 13 changes the actual warning output timing from the reference warning output timing (advances the actual warning output timing) if it was determined in step S12 that it is necessary to change the actual warning output timing from the reference warning output timing. Furthermore, if the warning output timing modification unit 13 determines in step S12 that it is not necessary to change the actual warning output timing from the reference warning output timing, it calculates zero as the amount to advance the actual warning output timing (amount of change). In step S14, the output unit 14 outputs to the warning output device A the result of the determination in step S12 as to whether or not it is necessary to change the actual warning output timing from the reference warning output timing, and the amount by which the actual warning output timing should be advanced if it is necessary to change the actual warning output timing from the reference warning output timing (the amount of change calculated in step S13). In other words, in the process shown in Figure 2, the warning timing adjustment device 1 adjusts the timing at which the warning output device A mounted on the vehicle V outputs a warning.

[0020] <Second Embodiment> A second embodiment of the warning timing adjustment device and program of the present invention will be described below. The warning timing adjustment device 1 of the second embodiment is configured in the same way as the warning timing adjustment device 1 of the first embodiment described above, except for the points described later. Therefore, the warning timing adjustment device 1 of the second embodiment can achieve the same effects as the warning timing adjustment device 1 of the first embodiment described above, except for the points described later.

[0021] Vehicle V to which the warning timing adjustment device 1 of the second embodiment is applied is configured in substantially the same manner as vehicle V shown in Figure 1. The warning output device A installed in vehicle V to which the warning timing adjustment device 1 of the second embodiment is applied is a forward collision warning device, similar to the example shown in Figure 1. In a vehicle V to which the warning timing adjustment device 1 of the second embodiment is applied, a wheelchair user is considered as a target occupant for which the warning output device A (forward collision warning device) outputs a warning. This is because a wheelchair user may have difficulty maintaining their posture even when seated, such as when the vehicle V is braking.

[0022] In an example of a vehicle V to which the warning timing adjustment device 1 of the second embodiment is applied, the determination unit 12 not only determines whether the occupants in the vehicle V are standing or seated based on the images of the occupants in the vehicle V captured by the imaging unit 11, but also determines whether the seated occupants are seated in a seat in the vehicle V or in a wheelchair. In detail, the determination unit 12 determines that even if an occupant is seated in the vehicle V, if that occupant is in a wheelchair, the actual warning output timing needs to be changed (advanced) from the standard warning output timing. In this example, the determination unit 12 has the function of identifying whether an occupant is seated in a seat in the vehicle V or in a wheelchair, based on an image of the occupant in the vehicle V captured by the imaging unit 11. For example, the determination unit 12 has the function of identifying whether an occupant is seated in a seat in the vehicle V or in a wheelchair by performing training using pairs of images of occupants in the vehicle V and the correct answer of whether the occupant is seated in a seat in the vehicle V or in a wheelchair as training data.

[0023] In an example of a vehicle V to which the warning timing adjustment device 1 of the second embodiment is applied, if the determination unit 12 determines that an occupant is standing inside the vehicle V, the warning output timing change unit 13 makes the actual warning output timing earlier than the reference warning output timing. In the first example, the warning output timing modification unit 13, for example, when the determination unit 12 determines that an elderly occupant (i.e., an occupant whose age is above the first threshold) is standing, advances the actual warning output timing compared to when the determination unit 12 determines that only occupants whose age is below the first threshold are standing. In the second example, the warning output timing modification unit 13 advances the actual warning output timing when the determination unit 12 determines that a crew member is standing who is carrying an item with a specific mark, compared to when the determination unit 12 determines that only crew members who are not carrying an item with a specific mark are standing. In the third example, the warning output timing change unit 13 advances the actual warning output timing when the determination unit 12 determines that an occupant with mobility difficulties is standing, compared to when the determination unit 12 determines that only occupants without mobility difficulties are standing. In this example, the determination unit 12 has the function of determining whether an occupant has mobility difficulties by learning using training data consisting of images of occupants in the vehicle V and the correct answer of whether or not the occupant has mobility difficulties.

[0024] In the fourth example, the warning output timing change unit 13 advances the actual warning output timing when the determination unit 12 determines that an occupant is standing with luggage of a predetermined size or larger than that, compared to when the determination unit 12 determines that only occupants without luggage of a predetermined size or larger are standing. In this example, the determination unit 12 has the function of estimating the size of luggage held by an occupant by learning using training data consisting of images of occupants in the vehicle V and the correct size of the luggage held by that occupant. In the fifth example, the determination unit 12 determines that there is an occupant standing in vehicle V, although this does not correspond to the first to fourth examples. In this case, the warning output timing change unit 13 sets the actual warning output timing earlier than when the determination unit 12 determines that there is no standing occupant in vehicle V. The warning output timing change unit 13 may also set the actual warning output timing earlier than when the determination unit 12 determines that there is a standing occupant in vehicle V who is holding onto a handrail, if the determination unit 12 determines that there is no standing occupant in vehicle V who is holding onto a handrail. In this example, the determination unit 12 has the function of determining whether there is a standing occupant in vehicle V who is holding onto a handrail by learning using a pair of images of occupants in vehicle V and the correct answer of whether or not there is a standing occupant in vehicle V who is holding onto a handrail as training data.

[0025] In the sixth example, if the determination unit 12 determines that an occupant in vehicle V is in a wheelchair, the warning output timing change unit 13 adjusts the actual warning output timing to be earlier than the reference warning output timing. In detail, the warning output timing modification unit 13 advances the actual warning output timing when the determination unit 12 determines that there is an occupant in a wheelchair, compared to when the determination unit 12 determines that there is no occupant in a wheelchair.

[0026] <Third Embodiment> A third embodiment of the warning timing adjustment device and program of the present invention will be described below. The warning timing adjustment device 1 of the third embodiment is configured in the same way as the warning timing adjustment device 1 of the second embodiment described above, except for the points described later. Therefore, the warning timing adjustment device 1 of the third embodiment can achieve the same effects as the warning timing adjustment device 1 of the second embodiment described above, except for the points described later.

[0027] Figure 3 shows an example of a vehicle V to which the warning timing adjustment device 1 of the third embodiment is applied. In the example shown in Figure 3, a warning output device A and a warning timing adjustment device 1 are installed in vehicle V. Warning output device A is configured in the same way as warning output device A shown in Figure 1. In other words, warning output device A shown in Figure 3 is a forward collision warning device, just like warning output device A shown in Figure 1.

[0028] The warning timing adjustment device 1 comprises an imaging unit 11, a determination unit 12, a warning output timing changing unit 13, and an output unit 14. The imaging unit 11 is configured similarly to the imaging unit 11 shown in Figure 1. The determination unit 12 is configured similarly to the determination unit 12 shown in Figure 1. The warning output timing change unit 13 includes an occupant number estimation unit 13A, a total score calculation unit 13B, and a change amount calculation unit 13C. The occupant number estimation unit 13A estimates the number of first-class occupants, who are elderly (e.g., late-stage elderly) occupants standing in the vehicle V, the number of second-class occupants, who are standing in the vehicle V and carrying belongings with a specific mark, the number of third-class occupants, who are standing in the vehicle V and have difficulty walking, the number of fourth-class occupants, who are standing in the vehicle V and carrying luggage of a certain size or larger, the number of fifth-class occupants, who are standing in the vehicle V excluding first-class, second-class, third-class, and fourth-class occupants, and the number of sixth-class occupants, who are in wheelchairs in the vehicle V, based on images of occupants in the vehicle V captured by the imaging unit 11.

[0029] For example, the passenger count estimation unit 13A has the function of estimating the number of Type 1 passengers (elderly passengers standing) in vehicle V by training with training data consisting of pairs of images of passengers in vehicle V and the correct number of Type 1 passengers in vehicle V. For example, the passenger count estimation unit 13A has the function of estimating the number of Type 2 passengers (passengers standing and holding belongings with a specific mark) in vehicle V by training with training data consisting of pairs of images of passengers in vehicle V and the correct number of Type 2 passengers in vehicle V. For example, the passenger count estimation unit 13A has the function of estimating the number of Type 3 passengers (passengers standing and with mobility difficulties) in vehicle V by training with training data consisting of pairs of images of passengers in vehicle V and the correct number of Type 3 passengers in vehicle V. For example, the passenger count estimation unit 13A has the function of estimating the number of Type 4 passengers (passengers standing with luggage of a certain size or larger) in vehicle V by training with training data consisting of pairs of images of passengers in vehicle V and the correct number of Type 4 passengers in vehicle V. For example, the passenger count estimation unit 13A has the function of estimating the number of Type 5 passengers (passengers standing, excluding Type 1, Type 2, Type 3, and Type 4 passengers) in vehicle V by training with training data consisting of pairs of images of passengers in vehicle V and the correct number of Type 5 passengers in vehicle V. For example, the passenger count estimation unit 13A has the function of estimating the number of Type 6 passengers (passengers in wheelchairs) in vehicle V by training with training data consisting of pairs of images of passengers in vehicle V and the correct number of Type 6 passengers in vehicle V.

[0030] The total score calculation unit 13B calculates a total score which is the sum of the following: the Type 1 score, which is the product of the number of Type 1 crew members and Type 1 weights estimated by the crew number estimation unit 13A; the Type 2 score, which is the product of the number of Type 2 crew members and Type 2 weights estimated by the crew number estimation unit 13A; the Type 3 score, which is the product of the number of Type 3 crew members and Type 3 weights estimated by the crew number estimation unit 13A; the Type 4 score, which is the product of the number of Type 4 crew members and Type 4 weights estimated by the crew number estimation unit 13A; the Type 5 score, which is the product of the number of Type 5 crew members and Type 5 weights estimated by the crew number estimation unit 13A; and the Type 6 score, which is the product of the number of Type 6 crew members and Type 6 weights estimated by the crew number estimation unit 13A. The change amount calculation unit 13C calculates the amount by which the actual warning output timing is advanced compared to the reference warning output timing (change amount) based on the total score calculated by the total score calculation unit 13B. Specifically, the change amount calculation unit 13C increases the amount by which the actual warning output timing is advanced (change amount) the higher the total score calculated by the total score calculation unit 13B.

[0031] In other words, in the example shown in Figure 3, the more elderly occupants (Category 1 occupants) standing in vehicle V, the higher the total score and the greater the amount by which the actual warning output timing is advanced. Also, the more occupants (Category 2 occupants) standing in vehicle V with belongings bearing a specific mark, the higher the total score and the greater the amount by which the actual warning output timing is advanced. Furthermore, the more occupants (Category 3 occupants) standing in vehicle V with mobility impairments, the higher the total score and the greater the amount by which the actual warning output timing is advanced. Furthermore, the more occupants (Category 4 occupants) standing in vehicle V with luggage exceeding a certain size, the higher the total score and the greater the amount by which the actual warning output timing is advanced. Also, the more occupants (Category 5 occupants) standing in vehicle V excluding Category 1, Category 2, Category 3, and Category 4 occupants, the higher the total score and the greater the amount by which the actual warning output timing is advanced. Furthermore, the more occupants (Category 6 occupants) in vehicle V who are in wheelchairs, the higher the total score and the greater the amount by which the actual warning output timing is advanced. The output unit 14 is configured in the same way as the output unit 14 shown in Figure 1.

[0032] If vehicle V is, for example, a route bus and is running behind schedule, the upper limit of the change amount calculation unit 13C can calculate (i.e., the limit of the amount by which the actual warning output timing can be advanced) may be set in advance. This is to suppress an increase in the delay of vehicle V.

[0033] <Fourth Embodiment> A fourth embodiment of the warning timing adjustment device and program of the present invention will be described below. The warning timing adjustment device 1 of the fourth embodiment is configured in the same way as the warning timing adjustment device 1 of the first embodiment described above, except for the points described later. Therefore, the warning timing adjustment device 1 of the fourth embodiment can achieve the same effects as the warning timing adjustment device 1 of the first embodiment described above, except for the points described later.

[0034] Vehicle V to which the warning timing adjustment device 1 of the fourth embodiment is applied is configured in substantially the same manner as vehicle V shown in Figure 1. The warning output device A installed in vehicle V to which the warning timing adjustment device 1 of the fourth embodiment is applied is a car navigation system. In one example of a vehicle V to which the warning timing adjustment device 1 of the fourth embodiment is applied, the warning output device A (car navigation device) and the warning timing adjustment device 1 are provided separately. However, in other examples, the warning timing adjustment device 1 may be included in the warning output device A (car navigation device) (that is, the warning timing adjustment device 1 may be part of the warning output device A (car navigation device)).

[0035] In an example of a vehicle V to which the warning timing adjustment device 1 of the fourth embodiment is applied, the warning output device A (car navigation device) includes a detection unit A1, a warning output timing calculation unit A2, an acquisition unit A3, and a warning output unit A4, similar to the warning output device A shown in Figure 1. Detection unit A1 detects situations that require the output of a warning. Detection unit A1 includes a vehicle position measurement unit (not shown) that measures the vehicle's position based on GPS (Global Positioning System) signals, and a storage unit (not shown) that stores map information including location information for sharp curves. The warning output timing calculation unit A2 calculates a reference timing (reference warning output timing) for when the warning output unit A4 outputs a warning, based on the detection result of the detection unit A1. The warning output timing calculation unit A2 calculates the timing at which the distance between the vehicle V and the entrance to the sharp curve is estimated to fall below a threshold, which is used as the reference warning output timing. The acquisition unit A3 acquires the output from the warning timing adjustment device 1 (the result of determining whether or not it is necessary to change the timing at which the warning output unit A4 actually outputs a warning (actual warning output timing) from the reference warning output timing, and the amount by which the actual warning output timing is advanced if it is necessary to change the actual warning output timing from the reference warning output timing).

[0036] The warning output unit A4 outputs a warning to the occupants of vehicle V based on the reference warning output timing calculated by the warning output timing calculation unit A2 and the output from the warning timing adjustment device 1 acquired by the acquisition unit A3 (the result of determining whether or not it is necessary to change the actual warning output timing from the reference warning output timing, and the amount by which the actual warning output timing should be advanced if it is necessary to change the actual warning output timing from the reference warning output timing). The warning output unit A4 provides the occupants of vehicle V with warnings such as voice warnings and display warnings. In another example, the warning output unit A4 may output a warning to the driver of vehicle V via voice, display, etc., and the driver of vehicle V may then issue a warning to the occupants of vehicle V via voice, display, etc. By the warning output unit A4 outputting a warning to the driver of vehicle V, the driver of vehicle V can perform braking operations on vehicle V more gently, thereby suppressing the shaking of vehicle V and improving the safety of the occupants inside vehicle V.

[0037] In an example of a vehicle V to which the warning timing adjustment device 1 of the fourth embodiment is applied, the warning timing adjustment device 1 adjusts the timing at which the warning output unit A4 of the warning output device A (car navigation device) outputs a warning (actual warning output timing). The warning timing adjustment device 1 includes an imaging unit 11, a determination unit 12, a warning output timing changing unit 13, and an output unit 14, similar to the warning timing adjustment device 1 shown in Figure 1. The imaging unit 11, etc., is the same as the imaging unit 11, etc., shown in Figure 1. The determination unit 12 determines, based on the image of the occupants inside the vehicle V captured by the imaging unit 11, whether or not it is necessary to change the timing at which the warning output unit A4 of the warning output device A (car navigation device) actually outputs a warning (actual warning output timing) from the standard warning output timing calculated by the warning output timing calculation unit A2. The output unit 14 outputs to the warning output device A (car navigation device) the result of the determination of whether or not it is necessary to change the actual warning output timing from the reference warning output timing (the result of the determination by the determination unit 12), and the amount by which the actual warning output timing should be advanced if it is necessary to change the actual warning output timing from the reference warning output timing (the amount of change calculated by the warning output timing change unit 13).

[0038] In other words, in an example of a vehicle V to which the warning timing adjustment device 1 of the fourth embodiment is applied, the warning output device A (car navigation device) can output a warning at an appropriate timing according to the state of the occupants in the vehicle V.

[0039] In another example of a vehicle V to which the warning timing adjustment device 1 of the fourth embodiment is applied, the warning output unit A4 of the warning output device A (car navigation device) does not need to output a warning if all occupants are seated, if there are no occupants in the vehicle V whose age is above the first threshold, if there are no occupants in the vehicle V whose age is below the second threshold, and if there are no occupants who possess personal items marked with a specific symbol. This is because it is considered that there will be no inconvenience to any of the occupants.

[0040] <Fifth Embodiment> A fifth embodiment of the warning timing adjustment device and program of the present invention will be described below. The warning timing adjustment device 1 of the fifth embodiment is configured in the same way as the warning timing adjustment devices 1 of the second and fourth embodiments described above, except for the points described later. Therefore, the warning timing adjustment device 1 of the fifth embodiment can achieve the same effects as the warning timing adjustment devices 1 of the second and fourth embodiments described above, except for the points described later.

[0041] A vehicle V to which the warning timing adjustment device 1 of the fifth embodiment is applied is configured in substantially the same way as a vehicle V to which the warning timing adjustment device 1 of the fourth embodiment is applied. The warning output device A installed in the vehicle V to which the warning timing adjustment device 1 of the fifth embodiment is applied is a car navigation system. In a vehicle V to which the warning timing adjustment device 1 of the fifth embodiment is applied, a wheelchair user is considered as an occupant to whom the warning output device A (car navigation device) outputs a warning.

[0042] In an example of a vehicle V to which the warning timing adjustment device 1 of the fifth embodiment is applied, the determination unit 12, similar to the determination unit 12 of the second embodiment, not only determines whether the occupants in the vehicle V are standing or seated based on images of the occupants in the vehicle V captured by the imaging unit 11, but also determines whether the seated occupants are seated in a seat in the vehicle V or in a wheelchair.

[0043] <Sixth Embodiment> A sixth embodiment of the warning timing adjustment device and program of the present invention will be described below. The warning timing adjustment device 1 of the sixth embodiment is configured in the same way as the warning timing adjustment devices 1 of the third and fifth embodiments described above, except for the points described later. Therefore, the warning timing adjustment device 1 of the sixth embodiment can achieve the same effects as the warning timing adjustment devices 1 of the third and fifth embodiments described above, except for the points described later.

[0044] Vehicle V to which the warning timing adjustment device 1 of the sixth embodiment is applied is configured in substantially the same manner as vehicle V shown in Figure 3. The warning output device A installed in vehicle V to which the warning timing adjustment device 1 of the sixth embodiment is applied is a car navigation system.

[0045] The warning timing adjustment device 1 of the sixth embodiment is the same as the warning timing adjustment device 1 shown in Figure 3.

[0046] Although embodiments for carrying out the present invention have been described above using examples, the present invention is not limited in any way to these embodiments, and various modifications and substitutions can be made without departing from the spirit of the invention. The configurations described in each of the embodiments and examples above may be combined as appropriate.

[0047] Furthermore, the functions of all or part of the components of the warning timing adjustment device 1 in the above-described embodiment may also be realized by recording a program for realizing these functions on a computer-readable recording medium, having a computer system read the program recorded on this recording medium, and executing it. The term "computer system" here includes hardware such as the operating system and peripheral devices. Furthermore, "computer-readable recording media" refers to portable media such as flexible disks, magneto-optical disks, ROMs, and CD-ROMs, as well as storage units such as hard disks built into computer systems. In addition, "computer-readable recording media" may also include those that dynamically hold programs for a short period of time, such as communication lines used when transmitting programs over networks such as the Internet or communication lines such as telephone lines, and those that hold programs for a certain period of time, such as volatile memory inside computer systems that act as servers or clients in such cases. Moreover, the above-mentioned programs may be for the purpose of realizing some of the functions described above, and may also be programs that can realize the aforementioned functions in combination with programs already recorded in the computer system. [Explanation of symbols]

[0048] V...Vehicle, A...Warning output device, A1...Detection unit, A2...Warning output timing calculation unit, A3...Acquisition unit, A4...Warning output unit, 1...Warning timing adjustment device, 11...Imaging unit, 12...Determination unit, 13...Warning output timing change unit, 13A...Occupant number estimation unit, 13B...Total score calculation unit, 13C...Change amount calculation unit, 14...Output unit

Claims

1. A warning timing adjustment device that calculates the timing at which a warning output device installed in a vehicle outputs a warning, A determination unit determines, based on images of occupants inside the vehicle, whether or not it is necessary to change the timing at which the warning output device outputs a warning. The system includes a warning output timing modification unit that calculates an amount to change the timing of outputting the warning when the determination unit determines that it is necessary, The determination unit determines whether it is necessary to change the timing of outputting a warning based on at least one of the following: the position of the occupants, the posture of the occupants, the number of occupants, the age of the occupants, and a specific mark attached to the occupants' belongings, all of which are estimated from images of the occupants inside the vehicle. The warning output timing modification unit calculates a score based on the estimated number of occupants of each type in the vehicle, estimated based on images of occupants inside the vehicle, and a weighting corresponding to each occupant type. The larger the calculated score, the greater the amount by which the timing of outputting the warning is advanced. Warning timing adjustment device.

2. If the determination unit determines that an occupant in the vehicle is standing or in a wheelchair, the warning output timing change unit calculates an amount to advance the timing of outputting the warning. The warning timing adjustment device according to claim 1.

3. The warning output timing change unit comprises an occupant number estimation unit, a total score calculation unit, and a change amount calculation unit. The passenger count estimation unit estimates the number of Class 1 passengers, who are elderly passengers standing in the vehicle; the number of Class 2 passengers, who are standing in the vehicle and carrying personal belongings with a specific mark; the number of Class 3 passengers, who are persons with mobility impairments standing in the vehicle; the number of Class 4 passengers, who are standing in the vehicle and carrying luggage of a certain size or larger; the number of Class 5 passengers, who are standing in the vehicle excluding the Class 1, Class 2, Class 3, and Class 4 passengers; and the number of Class 6 passengers, who are passengers in wheelchairs in the vehicle. The total score calculation unit calculates a total score which is the sum of the following: the first score, which is the product of the number of first-class crew members and the first-class weight estimated by the crew number estimation unit; the second score, which is the product of the number of second-class crew members and the second-class weight estimated by the crew number estimation unit; the third score, which is the product of the number of third-class crew members and the third-class weight estimated by the crew number estimation unit; the fourth score, which is the product of the number of fourth-class crew members and the fourth-class weight estimated by the crew number estimation unit; the fifth score, which is the product of the number of fifth-class crew members and the fifth-class weight estimated by the crew number estimation unit; and the sixth score, which is the product of the number of sixth-class crew members and the sixth-class weight estimated by the crew number estimation unit. The change amount calculation unit calculates the amount of change that will advance the timing of outputting the warning, based on the total score calculated by the total score calculation unit. The warning timing adjustment device according to claim 1 or 2.

4. A detection unit that detects objects to be hit in front, A warning output timing calculation unit calculates the time at which the distance between the vehicle detected by the detection unit and the object to be hit in front is estimated to fall below a predetermined threshold, and sets the calculated time as the reference warning output timing. An acquisition unit that acquires from the warning timing adjustment device described in claim 1 the amount by which the timing of actually outputting a warning is advanced relative to the reference warning output timing, A warning output unit that outputs a warning to the vehicle occupant based on the aforementioned standard warning output timing and the amount of change that advances the timing of outputting the warning, A warning output device equipped with the following features.

5. A program that causes a computer to perform a warning timing adjustment step to calculate the timing at which a warning output device installed in a vehicle outputs a warning, The warning timing adjustment step includes: A determination step of determining whether it is necessary to change the timing at which the warning output device outputs a warning, based on an image of an occupant inside the vehicle, If it is determined by the determination step that it is necessary, the warning output timing change step includes calculating the amount of change to advance the timing at which the warning is output, In the determination step, it is determined whether or not the timing of outputting the warning needs to be changed based on at least one of the following: the position of the occupants, the posture of the occupants, the number of occupants, the age of the occupants, and a specific mark attached to the occupants' belongings, all of which are estimated from images of the occupants inside the vehicle. In the warning output timing change step, a score is calculated based on the number of occupants of each type in the vehicle estimated based on images of occupants in the vehicle, and a weighting corresponding to each occupant type. The larger the calculated score, the greater the amount by which the timing of outputting the warning is advanced. program.

Images