Information notification device, information notification method, program, and recording medium

Abstract

The present invention provides an information notification device that can inform the vehicle driver of the shaking or tilting of cargo in an intuitive and easy-to-understand manner. [Solution] The system includes a sound output unit that outputs sound so that the sound image is localized either inside or around the vehicle interior, a state information acquisition unit that acquires cargo state information indicating the behavior or posture of one or more cargoes, and a control unit that controls the sound output unit to move the position of the sound image by a distance corresponding to the behavior or posture of one or more cargoes.

Description

Technical Field

[0001] The present invention relates to an information notification device, an information notification method, a program, and a recording medium, and for example, relates to an information notification device, an information notification method, a program, and a recording medium for notifying information to an occupant of a vehicle. Background Art

[0002] It is difficult for a driver of a vehicle such as a truck to grasp the shaking and inclination of a cargo loaded on a cargo bed in real time.

[0003] Accordingly, a cargo information collection system has been proposed that detects the load and inclination of cargo to determine the degree of danger in small vehicles such as taxis, and notifies the vehicle driver of the determination result via display on a display unit, an alarm sound from a speaker, or the like (see, for example, Patent Document 1). Prior Art Documents Patent Documents

[0004] Patent Document 1 Japanese Unexamined Patent Application Publication No. 2021-117077 Summary of the Invention Problems to be Solved by the Invention

[0005] In the system of the above-mentioned conventional technology, since there is only a uniform notification method for the state of cargo, it is difficult for the vehicle driver to grasp the inclination and shaking of the cargo in detail in real time, and there is a problem that the driver cannot appropriately recognize the state of the cargo. In addition, since the same notification is performed both when the cargo is at risk of falling and when the cargo is shaking violently, there is a problem that it is difficult to take an appropriate response according to the situation.

[0006] The present invention has been made in view of the above points, and one of the objects thereof is to provide an information notification device capable of notifying a vehicle driver of the shaking and inclination of cargo in an intuitively easy-to-understand manner. Means for Solving the Problems

[0007] The invention described in claim 1 is characterized by comprising: a sound output unit that outputs sound so as to localize a sound image at any location inside or around the vehicle interior; a state information acquisition unit that acquires cargo state information indicating the behavior or posture of one or more cargoes; and a control unit that controls the sound output unit to move the position of the sound image by a distance corresponding to the behavior or posture of the one or more cargoes.

[0008] The invention described in claim 8 is an information notification method performed by an information notification device having a sound output unit that outputs sound so that a sound image is localized in or around the interior of a vehicle, and is characterized by comprising: a state information acquisition step of acquiring cargo state information indicating the behavior or posture state of one or more cargoes; and a control step of controlling the sound output unit to move the position of the sound image by a distance corresponding to the behavior or posture of the one or more cargoes.

[0009] The invention described in claim 9 is a program that causes a computer provided in an information notification device having a sound output unit that outputs sound so that a sound image is localized in or around the interior of a vehicle to execute a state information acquisition step of acquiring cargo state information indicating the behavior or posture state of one or more cargoes, and a control step of controlling the sound output unit to move the position of the sound image by a distance corresponding to the behavior or posture of the one or more cargoes.

[0010] The invention described in claim 10 is characterized in that a recording medium has a recording device that has a sound output unit that outputs sound so that a sound image is localized in or around the interior of a vehicle, and a computer provided in the device records a program that causes the computer to execute a state information acquisition step that acquires cargo state information indicating the behavior or posture state of one or more cargoes, and a control step that controls the sound output unit to move the position of the sound image by a distance corresponding to the behavior or posture of the one or more cargoes. [Brief explanation of the drawing]

[0011] [Figure 1] This figure schematically shows the front seat portion of a vehicle according to Embodiment 1 of the present invention. [Figure 2] This is a block diagram showing the configuration of an information notification device according to Embodiment 1 of the present invention. [Figure 3] This graph shows an example of the relationship between the time-dependent change in risk level and the threshold. [Figure 4A] This diagram schematically illustrates an example of sound image localization when the cargo is shaking. [Figure 4B] This diagram schematically illustrates an example of sound image localization when the cargo is shaking significantly. [Figure 5A] This diagram schematically illustrates an example of sound image localization when the cargo is tilted. [Figure 5B] This diagram schematically illustrates another example of sound image localization when the cargo is tilted. [Figure 5C] This diagram schematically illustrates another example of sound image localization when the cargo is shaking. [Figure 6] This diagram schematically illustrates an example of sound image localization when multiple cargoes are present. [Figure 7] This diagram schematically illustrates another example of sound image localization when multiple cargoes are present. [Figure 8] This diagram schematically illustrates another example of sound image localization when multiple cargoes are present. [Figure 9] This is a block diagram showing the configuration of an information notification device according to Embodiment 2 of the present invention. [Figure 10] This graph shows an example of the relationship between the time-dependent change in overall risk and the threshold. [Figure 11] This is a block diagram showing the configuration of an information notification device according to Embodiment 3 of the present invention. [Figure 12] This diagram shows the threshold adjustment performed by the threshold adjustment unit. [Figure 13] This is a block diagram showing the configuration of an information notification device according to Embodiment 4 of the present invention. [Figure 14] This figure shows examples of sticker designs used to identify important cargo. [Figure 15] It is a diagram showing a mode of outputting a notification sound according to the importance of an important cargo. [Figure 16] It is a diagram showing a mode of outputting a notification sound in a modified example. [Figure 17] It is a diagram showing a mode of outputting a notification sound in a modified example. [Figure 18] It is a diagram showing a mode of outputting a notification sound in a modified example. [Figure 19] It is a diagram showing an example of risk degree determination in a modified example. [Figure 20] It is a diagram showing an example of risk degree determination in a modified example. [Figure 21] It is a diagram showing an adjustment example of a reproduction time of a notification sound in a modified example. DETAILED DESCRIPTION OF THE INVENTION

[0012] Preferred embodiments of the present invention will be described in detail below. In the following description of each embodiment and the accompanying drawings, substantially identical or equivalent parts are denoted by the same reference numerals. EXAMPLE

[0013] The information notification device according to the present embodiment is a device that is provided in a vehicle serving as a moving object and notifies the driver of the vehicle in real time of the status of cargo loaded on the vehicle, such as shaking or inclination.

[0014] FIG. 1 is a schematic diagram showing a view from above of a front seat portion FP of a vehicle M equipped with the information notification device 100 according to the present embodiment. The information notification device 100 is disposed, for example, at a central portion of a dashboard DB in a vehicle cabin of the vehicle M.

[0015] The front seat portion FP of the vehicle M is provided with speakers SP1 to SP4 which are sound output units that output sound toward the vehicle cabin. The speaker SP1 is provided at a position on the right side when viewed from a direction directly facing a steering wheel HL of a driver's seat DS. The speaker SP2 is provided at a position on the left side of a passenger seat PS. The speakers SP3 and SP4 are provided at left and right positions of a rear seat BS, respectively.

[0016] Figure 2 is a block diagram showing the configuration of the information notification device 100 according to this embodiment. The information notification device 100 includes a cargo recognition unit 11, a status information acquisition unit 12, a risk determination unit 13, a threshold comparison unit 14, a sound output unit 15, and a notification control unit 16.

[0017] The cargo recognition unit 11 recognizes the cargo loaded on the cargo bed or rear seats (hereinafter referred to as the cargo bed, etc.) of the vehicle M based on images captured by cameras installed on the cargo bed or rear seats (hereinafter referred to as the cargo bed, etc.) of the vehicle M. In this embodiment, it is assumed that one or more cargo items are loaded on the cargo bed, etc. of the vehicle M, and the cargo recognition unit 11 recognizes each of the one or more cargo items.

[0018] The status information acquisition unit 12 acquires information indicating the behavior of the cargo, such as swaying, and the posture of the cargo, such as its tilt, as cargo status information, based on sensor information obtained from load sensors, tilt sensors, etc., installed on the cargo bed of the vehicle M. If multiple loads are loaded on the cargo bed of the vehicle M, the status information acquisition unit 12 acquires cargo status information for each of the multiple loads.

[0019] The risk determination unit 13 determines the degree of risk of a significant impact that could cause the cargo to tip over or be damaged, based on the cargo condition information acquired by the condition information acquisition unit 12, as the "risk level". The risk determination unit 13 determines the risk level, for example, by comparing the degree of tilt of the cargo with a standard value. The risk determination unit 13 also determines the risk level, for example, by comparing the degree of sway of the cargo with a standard value.

[0020] If there are multiple loads, the risk determination unit 13 determines the risk level based on the number of loads whose shaking or tilting exceeds a standard value, or the proportion of loads whose shaking or tilting exceeds a standard value to the total load.

[0021] The threshold comparison unit 14 compares the risk level determined by the risk level determination unit 13 with a predetermined threshold. In this embodiment, a first threshold Th1 and a second threshold Th2 are set, and the threshold comparison unit 14 compares the risk level with both thresholds.

[0022] The sound output unit 15 includes the speakers SP1 to SP4 described above and outputs sound so that the sound image is localized at a location either inside or around the vehicle M using three-dimensional sound. In this embodiment, the sound output unit 15 outputs a sound (hereinafter referred to as a notification sound) to notify the status of the cargo, localizing the sound image at a location corresponding to the direction of the swaying or tilting occurring in the cargo, in accordance with the control of the notification control unit 16.

[0023] In this embodiment, the sound source for the notification sound is not particularly limited, and the sound output unit 15 outputs the notification sound using a pre-set sound source that is easy for the driver to hear, such as a beep, sound effect, or music.

[0024] The notification control unit 16 controls the sound output by the sound output unit 15 based on the risk level determination result by the risk level determination unit 13 and the result of the comparison with the threshold by the threshold comparison unit 14. Specifically, the notification control unit 16 controls the sound output unit 15 to output a notification sound when the risk level exceeds the first threshold Th1. Furthermore, after the start of notification sound output, if the risk level falls below the second threshold Th2, the notification control unit 16 controls the sound output unit 15 to stop the notification sound output.

[0025] Figure 3 is a graph showing an example of the relationship between the change in risk over time and the first threshold Th1 and the second threshold Th2.

[0026] The notification control unit 16 starts outputting a notification sound from the sound output unit 15 at time t1 when the risk level exceeds the first threshold Th1. Subsequently, the notification control unit 16 continues outputting the notification sound until the risk level falls below the second threshold Th2 at time t2, and then stops outputting the notification sound after time t2.

[0027] Next, we will explain the localization of the sound image when the sound output unit 15 outputs a notification sound.

[0028] Figure 4A schematically shows an example of sound image localization when the cargo is shaking (i.e., when shaking occurs that results in a danger level of Th1 or higher). For example, when the cargo is shaking (vibrating) in the left-right direction, the notification control unit 16 controls the sound output unit 15 to output a notification sound so that the sound image travels back and forth between position L1, which is located to the left of the driver Dr's seat (i.e., the driver's seat DS), and position R1, which is located to the right.

[0029] Figure 4B schematically shows an example of sound image localization when there is significant shaking (vibration) in the cargo. The notification control unit 16 controls the sound output unit 15 to output a notification sound with an intensity corresponding to the magnitude of the shaking, for example, with a large sound pressure when the shaking is large, so that the sound image moves back and forth in the left-right direction. Alternatively, instead of increasing the sound pressure, the distance the sound image moves (i.e., the back-and-forth distance) may be increased according to the magnitude of the shaking.

[0030] Figure 5A schematically shows an example of sound image localization when the cargo is tilted (i.e., when the tilt is such that the degree of danger is greater than or equal to threshold Th1). For example, if the cargo is tilted to the right, the notification control unit 16 controls the sound output unit 15 to output a notification sound so that the sound image moves from position L1, which is to the left of the position where the driver Dr is sitting (i.e., the position of the driver's seat DS), to position R1, which is to the right. In this case, the notification control unit 16 outputs the notification sound so that the distance the sound image moves increases in proportion to the magnitude of the tilt.

[0031] Figure 5B schematically shows another example of sound image localization when the cargo is tilted. For example, if the cargo is tilted to the right, the notification control unit 16 controls the sound output unit 15 to output a notification sound so that the sound image is localized to position R1, which is located to the right from the position where the driver Dr is sitting. In this case, the notification control unit 16 outputs the notification sound with an intensity corresponding to the degree of tilt, for example, a sound pressure corresponding to the degree of tilt.

[0032] Figure 5C schematically shows another example of sound image localization when the cargo is tilted. For example, if the cargo is tilted to the right, the notification control unit 16 controls the sound output unit 15 to shift the center position to the right, which is the direction of the tilt, and moves the sound image back and forth in the left-right direction with respect to that center position. At that time, the notification control unit 16 outputs a notification sound such that the distance the sound image moves increases in proportion to the magnitude of the tilt.

[0033] In this way, by localizing or moving the sound image in response to the shaking or tilting of the cargo, the driver of vehicle M can intuitively perceive the condition of the cargo.

[0034] Figure 6 shows an example of sound image localization when multiple cargoes are present. Here, the example shows four cargoes, C1 to C4, loaded on the cargo bed CB of vehicle M. Sensors SR1 to SR4 are also placed on the cargo bed CB to detect shaking or tilting for each of the cargoes C1 to C4.

[0035] If cargo C4 is shaking or tilting, and the degree of danger to cargo C4 due to that shaking or tilting is greater than or equal to threshold Th1, the notification control unit 16 controls the sound output unit 15 to output a notification sound so that the sound image is localized to the position corresponding to cargo C4. Then, as explained with reference to Figures 4A, 4B and 5A-5C, the notification control unit 16 changes the position of the sound image relative to the position of cargo C4 according to the type, direction, and degree of shaking or tilting occurring in cargo C4. In this way, the driver of vehicle M is notified that cargo C4 is shaking or tilting.

[0036] Figure 7 shows another example of sound image localization when multiple cargoes are present. Here, similar to Figure 6, it shows a case where, among cargoes C1 to C4, cargo C4 is shaking or tilting, and the risk level of cargo C4 due to that shaking or tilting is above the threshold Th1.

[0037] The notification control unit 16 controls the sound output unit 15 to output notification sounds so that the sound image is alternately localized at a reference position RP located near the center of the four cargoes C1 to C4 and at the position corresponding to cargo C4. When localizing the sound image to the position corresponding to cargo C4, the position of the sound image is changed according to whether it is shaking or tilting, its direction and degree. This notifies the driver of the vehicle M that cargo C4 is shaking or tilting. At this time, different sound sources may be used for the notification sound localized at the reference position RP and for the notification sound localized at the position of cargo C4 to notify the driver of the shaking or tilting of cargo C4.

[0038] Figure 8 shows another example of sound image localization when multiple cargoes are present. Here, as with Figures 6 and 7, it shows a case where, among cargoes C1 to C4, cargo C4 is shaking or tilting, and the risk level of cargo C4 due to that shaking or tilting is above the threshold Th1.

[0039] The notification control unit 16 controls the sound output unit 15 to localize a sound image to a position corresponding to each of the cargo C1 to C3 that is not shaking or tilting, and outputs a notification sound based on sound source A. The notification control unit 16 also controls the sound output unit 15 to localize a sound image to a position corresponding to the cargo C4 that is shaking or tilting, and outputs a notification sound based on sound source B, which is different from sound source A. For example, sound source A uses a sound that does not cause stress to the driver, and sound source B uses a warning sound that attracts attention, such as a beep or sound effect. The position of the sound image is then changed based on the position of cargo C4, according to the type, direction, and degree of shaking or tilting occurring in cargo C4. This notifies the driver of vehicle M that cargo C4 is shaking or tilting.

[0040] As described above, the information notification device 100 of this embodiment detects the behavior of the cargo, such as shaking, or its posture, such as tilting, and outputs a notification sound while changing the position of the sound image according to the detected behavior or posture.

[0041] According to the information notification device 100 of this embodiment, it is possible to notify the vehicle driver of the shaking or tilting of the cargo in an intuitive and easy-to-understand manner. [Examples]

[0042] Next, Example 2 of the present invention will be described.

[0043] Figure 9 is a block diagram showing the configuration of an information notification device 200 according to Embodiment 2 of the present invention. The information notification device 200 includes a cargo recognition unit 11, a state information acquisition unit 12, a first risk level determination unit 13A, a threshold comparison unit 14, a sound output unit 15, a notification control unit 16, a vehicle behavior information acquisition unit 17, a driver state information acquisition unit 18, a second risk level determination unit 13B, and an overall risk level determination unit 19.

[0044] The first risk determination unit 13A, similar to the risk determination unit 13 in Embodiment 1, determines the degree of risk to the cargo as the "first risk level" based on the cargo condition information acquired by the condition information acquisition unit 12.

[0045] The vehicle behavior information acquisition unit 17 acquires vehicle behavior information, including the vehicle speed, the frequency of acceleration and deceleration, and the frequency of sudden braking, based on the speed and acceleration information of the vehicle M acquired by the speed sensor and acceleration sensor (not shown) mounted on the vehicle M.

[0046] The driver status information acquisition unit 18 acquires information about the driver's state, such as the driver's level of concentration, as driver status information, based on the driver's facial image captured by an in-vehicle camera (not shown) mounted on the vehicle M. The driver status information acquisition unit 18 includes, for example, an image recognition device and acquires driver status information by detecting the driver's gaze based on the facial image.

[0047] The second risk determination unit 13B determines the degree of risk to the cargo as "second risk level" based on the vehicle behavior information acquired by the vehicle behavior information acquisition unit 17 and the driver status information acquired by the driver status information acquisition unit 18.

[0048] The overall risk assessment unit 19 determines the overall risk level, which indicates the degree of risk to the cargo, based on the first risk level determined by the first risk assessment unit 13A and the second risk level determined by the second risk assessment unit 13B. The overall risk assessment unit 19 calculates the overall risk level, for example, by adding the first risk level and the second risk level together.

[0049] The threshold comparison unit 14 compares the overall risk level determined by the overall risk level determination unit 19 with the first threshold Th1 and the second threshold Th2.

[0050] The notification control unit 16 controls the sound output unit 15 to output a notification sound when the overall risk level exceeds the first threshold Th1. Furthermore, after the notification sound has started to output, the sound output unit 15 controls the sound output unit 15 to stop the notification sound output when the overall risk level falls below the second threshold Th2.

[0051] Figure 10 is a graph showing an example of the relationship between the change in overall risk over time and the first threshold Th1 and the second threshold Th2.

[0052] The notification control unit 16 starts outputting a notification sound from the sound output unit 15 at time t3 when the overall risk level exceeds the first threshold Th1. Subsequently, the notification control unit 16 continues outputting the notification sound until the overall risk level exceeds the second threshold Th2 at time t4, and then stops outputting the notification sound after time t4.

[0053] As described above, the information notification device 200 of this embodiment outputs a notification sound based on an overall risk level determined by adding a second risk level determined based on vehicle behavior information and driver status information to a first risk level determined based on cargo status information.

[0054] According to the information notification device 200 of this embodiment, by determining the risk based on the vehicle behavior and the driver's condition, it is possible to output a notification sound to encourage the driver to drive safely, for example, when there is a possibility that the cargo may be endangered even though the shaking or tilting of the cargo appears to be small. [Examples]

[0055] Next, Example 3 of the present invention will be described.

[0056] Figure 11 is a block diagram showing the configuration of an information notification device 300 according to Embodiment 3 of the present invention. The information notification device 300 includes a cargo recognition unit 11, a status information acquisition unit 12, a risk determination unit 13, a threshold comparison unit 14, a sound output unit 15, a notification control unit 16, a vehicle position acquisition unit 21, a high-risk location information acquisition unit 22, and a threshold adjustment unit 23.

[0057] The vehicle position acquisition unit 21 is composed of, for example, a GPS (Global Positioning System) receiver, and acquires the position information of the vehicle M by receiving radio waves transmitted from GPS satellites and calculating the distance from the GPS satellites based on the received radio waves.

[0058] The high-risk location information acquisition unit 22 acquires map information from the car navigation system (not shown) installed in the vehicle M, and identifies locations where there is a high probability that the cargo will experience shaking or tilting above a predetermined standard as high-risk locations based on the acquired map information. For example, locations such as sharp curves, slopes, unpaved roads, bridges that are strongly affected by gusts of wind or crosswinds, coastal roads, and near-miss locations based on past data are identified as high-risk locations. The high-risk location information acquisition unit 22 acquires the location information of the identified high-risk locations as high-risk location information.

[0059] The threshold adjustment unit 23 adjusts the thresholds used by the threshold comparison unit 14 for comparing the degree of risk, based on the location information of vehicle M and high-risk location information. Specifically, if vehicle M is located in a high-risk location, the first threshold Th1 and the second threshold Th2 are adjusted to be lower than normal.

[0060] Figure 12 shows the threshold adjustment by the threshold adjustment unit 23. The threshold adjustment unit 23 adjusts the first threshold at high-risk locations to a threshold Th1A that is a predetermined level lower than the first threshold Th1, which is the first threshold at locations other than high-risk locations. The threshold adjustment unit 23 also adjusts the second threshold at high-risk locations to a threshold Th2A that is a predetermined level lower than the second threshold Th2, which is the second threshold at locations other than high-risk locations.

[0061] If vehicle M is located at a high-risk location, the threshold comparison unit 14 compares the risk level with the thresholds using the adjusted thresholds, a first threshold Th1A and a second threshold Th2A. If the risk level exceeds the first threshold Th1A, the notification control unit 16 controls the sound output unit 15 to output a notification sound. After the notification sound has started to output, if the risk level falls below the second threshold Th2A, the sound output unit 15 controls the sound output unit 15 to stop the notification sound output.

[0062] As described above, in the information notification device 300 of this embodiment, the first threshold and the second threshold at high-risk locations are adjusted to be lower than normal. When vehicle M is located at a high-risk location, the device compares the risk level with the thresholds based on the adjusted thresholds, the first threshold Th1A and the second threshold Th2A, and outputs a notification sound from when the risk level exceeds the first threshold Th1A until it falls below the second threshold Th2A.

[0063] In high-risk locations, that is, locations prone to significant shaking or tilting that could lead to cargo tipping or damage, drivers may not have enough time to respond unless notifications are given earlier than usual. According to the information notification device 300 of this embodiment, by setting a lower threshold for high-risk locations and providing notifications earlier, drivers can take action to prevent danger with ample time. [Examples]

[0064] Next, Example 4 of the present invention will be described.

[0065] Figure 13 is a block diagram showing the configuration of an information notification device 400 according to Embodiment 4 of the present invention. The information notification device 400 includes a cargo recognition unit 11, a status information acquisition unit 12, a risk level determination unit 13, a threshold comparison unit 14, a sound output unit 15, a notification control unit 16, a critical cargo identification unit 24, and a ratio determination unit 25.

[0066] The critical cargo identification unit 24 identifies one or more cargo items from the large amount of cargo loaded on the cargo bed of vehicle M as critical cargo, which are subject to detection of shaking or tilting and assessment of risk. The critical cargo identification unit 24 identifies cargo items as critical cargo based on images taken by a camera (not shown) installed on the cargo bed of vehicle M, for example, by attaching a sticker or marker as a distinguishing mark.

[0067] Furthermore, important cargo is assigned an importance level, and the important cargo identification unit 24 determines the importance level of the important cargo with the seal or marker based on the design of the seal or marker. For example, important cargo that is "strictly not to be impacted" is assigned an importance level of "3," important cargo that should "avoid major impacts" is assigned an importance level of "2," and important cargo that can withstand minor impacts as long as it doesn't tip over is assigned an importance level of "1." Cargo with a low risk of damage is not assigned a seal or marker and is treated as having an importance level of "0" (i.e., not important cargo).

[0068] Figure 14 shows examples of sticker designs used to identify important cargo. The important cargo identification unit 24 identifies cargo with a sticker featuring vertical double lines, as shown in the upper part of the figure, as important cargo of importance level "1". The important cargo identification unit 24 also identifies cargo with a sticker featuring a checkerboard pattern, as shown in the middle part of the figure, as important cargo of importance level "2". Furthermore, the important cargo identification unit 24 identifies cargo with a sticker featuring a cross pattern, as shown in the lower part of the figure, as important cargo of importance level "3".

[0069] Furthermore, the markings used to identify important cargo are not limited to these; for example, stickers such as "Perishable" or "This Side Up," which are conventionally used in cargo transport, may be used as markings to identify important cargo. In addition, stickers coated with fluorescent paint or reflective film may be used as markings to make them easier to detect in dimly lit spaces.

[0070] The status information acquisition unit 12 acquires cargo status information indicating the behavior such as shaking and the attitude such as tilting for important cargo identified by the important cargo identification unit 24. In this embodiment, as described above, a marker is attached to the important cargo, so the shaking of the cargo may be detected using the shaking of the marker as a marker.

[0071] The risk determination unit 13 determines the risk level of the critical cargo based on the cargo status information acquired by the status information acquisition unit 12. The threshold comparison unit 14 compares the determined risk level of the critical cargo with a first threshold Th1 and a second threshold Th2.

[0072] The notification control unit 16 controls the sound output unit 15 to output a notification sound when the determined risk level for important cargo exceeds the first threshold Th1. At that time, the notification control unit 16 switches the mode of output of the notification sound according to the importance level set for the important cargo.

[0073] Figure 15 shows the output patterns of notification sounds according to the importance level of critical cargo. For critical cargo with an importance level of "3," i.e., cargo that must not be struck, a notification sound is output at a notification intensity of 3 when the danger level exceeds the first threshold Th1. For example, the notification sound is output with a higher volume and a longer sound image travel distance. In addition, a notification sound is output using a sound source that strongly conveys a sense of alarm, such as a siren.

[0074] Furthermore, for critical cargo with a severity level of "2," meaning cargo that should be avoided if it experiences a major impact, a notification sound will be output at a notification intensity of 2 if the level of danger exceeds the first threshold Th1. For example, a notification sound will be output at a moderate volume with a moderate round-trip distance of the sound image. In addition, a notification sound will be output using a sound source that provides a moderate level of alertness, such as a horn.

[0075] Furthermore, for critical cargo with an importance level of "1," meaning that minor impacts are acceptable as long as it doesn't fall over, a notification sound will be output with a notification intensity of 1 if the risk level exceeds the first threshold Th1. For example, the notification sound will be output with a low volume and a short round-trip distance of the sound image. In addition, a notification sound will be output using a sound source that creates a relatively weak sense of alarm, such as a beep.

[0076] Furthermore, cargo with an importance rating of "0," meaning a low risk of damage, is not considered important cargo and is therefore not subject to hazard assessment, and no notification sound is emitted.

[0077] As described above, the information notification device 400 of this embodiment determines the degree of danger for important cargo among the multiple cargoes loaded on the cargo bed of the vehicle M, and outputs a notification sound based on the comparison result between the degree of danger and a threshold. Furthermore, the mode of output of the notification sound is switched based on the importance level set for the important cargo.

[0078] According to the information notification device 400 of this embodiment, when there is a large amount of cargo on the truck bed and notifying the driver about all of the cargo would be bothersome, the device focuses on determining the level of danger and notifying the driver about the cargo of high importance. This allows the driver to be aware of the shaking and tilting of important cargo without feeling bothered.

[0079] It should be noted that the present invention is not limited to those shown in the above embodiments. For example, Embodiment 4 described a case where a large amount of cargo is loaded onto the cargo bed of a vehicle M, and the swaying or tilting of important cargo is detected, the degree of danger is determined, and notification is given. However, instead of this, notification may be given based on the proportion of cargo that is swaying.

[0080] Figure 16 shows an example of how notification sounds are output in such modified cases. For example, the degree of shaking of the cargo, which is located on the outer edges of the cargo bed of vehicle M and can be captured by a camera installed on the cargo bed of vehicle M, is determined as a whole. If the entire cargo on the outer edges is shaking, a notification sound is output at a notification intensity of 3. If about half of the cargo on the outer edges is shaking, a notification sound is output at a notification intensity of 2. If only a small portion of the cargo on the outer edges is shaking, a notification sound is output at a notification intensity of 1.

[0081] This makes it possible to provide notifications without causing inconvenience, even when a large amount of cargo is loaded, similar to Example 4.

[0082] Furthermore, notifications based on the overall degree of shaking may be used in combination with notifications using the critical cargo as in Example 4.

[0083] Figure 17 shows an example of the output mode of the notification sound in such modified cases. For example, if the entire important cargo is shaking and the entire cargo placed on the outside is shaking, a notification sound is output at a notification intensity of 3. If the entire important cargo is shaking and about half or a very small part of the cargo placed on the outside is shaking, a notification sound is output at a notification intensity of 2. If about half of the important cargo is shaking and the entire cargo placed on the outside or about half of it is shaking, a notification sound is output at a notification intensity of 2. If about half of the important cargo is shaking and a very small part of the cargo placed on the outside is shaking, a notification sound is output at a notification intensity of 1. If a very small part of the important cargo is shaking and the entire cargo placed on the outside is shaking, a notification sound is output at a notification intensity of 2. If a very small part of the important cargo is shaking and about half of the cargo placed on the outside is shaking, a notification sound is output at a notification intensity of 1. If a very small part of the important cargo is shaking and a very small part of the cargo placed on the outside is shaking, no notification sound is output.

[0084] Furthermore, the notification method may be changed based on the proportion of the swaying cargo by altering the duty cycle of the sound output time, rather than by changing the volume or sound source.

[0085] Figure 18 shows the output modes of the notification sound in such modified cases. For example, if the entire cargo placed on the outside is shaking, the notification sound is output in such a way that the duty cycle is large (i.e., the output time is long). If about half of the cargo placed on the outside is shaking, the notification sound is output in such a way that the duty cycle is medium (i.e., the output time is medium). If about half of the cargo placed on the outside is shaking, the notification sound is output in such a way that the duty cycle is small (i.e., the output time is short).

[0086] Furthermore, in the above-described embodiment 2, the case in which the total risk level is calculated by adding the first risk level and the second risk level, and the total risk level is compared with the first threshold Th1 and the second threshold Th2 to output a notification sound was explained as an example. However, the first risk level and the second risk level may also be compared with thresholds separately to output a notification sound. For example, notification sounds corresponding to the first risk level and the second risk level may be prepared, and one of the notification sounds may be output depending on which risk level is greater.

[0087] Figure 19 shows a comparison of the first and second risk levels and the first threshold Th1 in this modified example. The vertical axis represents the first risk level, and the horizontal axis represents the second risk level.

[0088] A notification sound is output when both the first and second risk levels exceed the first threshold Th1. In this case, the sound source of the notification sound is switched depending on which risk level is greater. For example, region A1 shown in the figure is a region where the proportion of the first risk level is greater than that of the second risk level. Therefore, a notification sound based on the first sound source corresponding to the first risk level is output. On the other hand, region A2 shown in the figure is a region where the proportion of the second risk level is greater than that of the first risk level. Therefore, a notification sound based on the second sound source corresponding to the second risk level is output.

[0089] Furthermore, in addition to the first and second risk levels, a third risk level may be set, and the sound source of the notification tone may be switched depending on which risk level has the highest proportion after comparing each level with a threshold. For example, in the above embodiment 2, the risk level based on vehicle behavior and driver condition was set as the second risk level, but these may be separated and set as the second risk level determined based on vehicle behavior and the third risk level based on driver condition, and a comparison with a threshold may be performed for each.

[0090] Figure 20 shows a comparison of the first, second, and third risk levels with the first threshold Th1 in a modified example where three risk levels are set as described above. Region A1 in the figure is the region with the largest proportion of the first risk level, so it outputs a notification sound based on the first sound source corresponding to the first risk level. Region A2 is the region with the largest proportion of the second risk level, so it outputs a notification sound based on the second sound source corresponding to the second risk level. Region A3 is the region with the largest proportion of the third risk level, so it outputs a notification sound based on the third sound source corresponding to the third risk level.

[0091] Additionally, if the overall risk level exceeds a threshold, a notification sound may be output, and the playback time (output time) of the notification sound corresponding to the first risk level and the second risk level may be adjusted accordingly.

[0092] Figure 21 shows an example of adjusting the playback time of notification sounds in such a modified example. For example, if the proportion of the first level of danger is 70% and the proportion of the second level of danger is 30%, a notification sound based on a first sound source corresponding to the first level of danger and a notification sound based on a second sound source corresponding to the second level of danger are played sequentially with output times of 7:3. This allows the driver to recognize which level of danger is dominant based on the type of sound source of the notification sound.

[0093] Furthermore, the series of processes described in each of the above embodiments can be carried out by computer processing according to a program stored on a recording medium such as ROM (Read Only Memory). [Explanation of symbols]

[0094] 100 Information notification device 11. Cargo Recognition Unit 12 Status Information Acquisition Unit 13. Risk Assessment Unit 13A First Risk Assessment Unit 13B Second Risk Assessment Unit 14. Threshold comparison section 15. Sound output section 16 Notification Control Unit 17. Vehicle behavior information acquisition unit 18. Driver Status Information Acquisition Unit 19. Comprehensive Risk Assessment Department 21 Vehicle position acquisition unit 22 High-Risk Location Information Acquisition Unit 23 Threshold adjustment section 24. Important Cargo Identification Section 25 Percentage determination unit

Claims

1. A sound output unit that outputs sound so that the sound image is localized at any location inside or around the vehicle's interior, A status information acquisition unit that acquires cargo status information indicating the behavior or posture state of one or more cargoes, A control unit controls the sound output unit to move the position of the sound image by a distance corresponding to the behavior or posture of the one or more of the aforementioned cargoes. An information notification device characterized by having the following features.

2. The system includes a risk determination unit that determines the degree of risk, which is the degree of risk that may arise for one or more cargoes, based on the cargo condition information. The control unit, The sound output unit is controlled to output sound so that the sound image is localized at the first position. When the risk level changes from a state below a first threshold to a state above a first threshold, the position of the sound image is moved from the first position by a distance corresponding to the risk level. The information notification device according to feature 1.

3. The comparison unit compares the risk level with a second threshold that is lower than the first threshold. The control unit controls the sound output unit to stop the sound output when the risk level, after it has exceeded the first threshold, falls below a second threshold that is lower than the first threshold. The information notification device according to feature 2.

4. A location information acquisition unit that acquires location information of the aforementioned vehicle, A high-risk location information acquisition unit acquires information on high-risk locations, which are locations with a high degree of risk to the one or more cargoes, based on map information. A threshold adjustment unit adjusts the first threshold and the second threshold based on the vehicle's location information and the high-risk location information. The information notification device according to claim 3, characterized by having the following features.

5. The system includes a critical cargo identification unit that identifies, among the one or more cargoes mentioned above, cargoes with a high importance for risk assessment as critical cargoes. The information notification device according to claim 2, characterized in that the control unit controls the output of sound by the sound output unit based on the result of comparing the degree of risk of the important cargo with the first threshold.

6. The system includes a vehicle behavior information acquisition unit that acquires vehicle behavior information indicating the behavior of the vehicle, The information notification device according to claim 2, characterized in that the risk determination unit determines the risk level based on the cargo status information and the vehicle behavior information.

7. The vehicle has a driver status information acquisition unit that acquires driver status information indicating the status of the driver of the vehicle, The information notification device according to claim 2, characterized in that the risk determination unit determines the risk level based on the cargo status information and the driver status information.

8. An information notification method performed by an information notification device having a sound output unit that outputs sound so that the sound image is localized at any location inside or around the vehicle interior, A status information acquisition step involves acquiring cargo status information that indicates the behavior or posture state of one or more cargoes, A control step of controlling the sound output unit to move the position of the sound image by a distance corresponding to the behavior or posture of the one or more of the aforementioned cargoes, A method for notifying information, characterized by including the following:

9. A computer provided in an information notification device having a sound output unit that outputs sound so that the sound image is localized at any location inside or around the vehicle interior, A status information acquisition step involves acquiring cargo status information that indicates the behavior or posture state of one or more cargoes, A control step of controlling the sound output unit to move the position of the sound image by a distance corresponding to the behavior or posture of the one or more of the aforementioned cargoes, A program characterized by causing the execution of a program.

10. A computer provided in an information notification device having a sound output unit that outputs sound so that the sound image is localized at any location inside or around the vehicle interior, A status information acquisition step involves acquiring cargo status information that indicates the behavior or posture state of one or more cargoes, A control step of controlling the sound output unit to move the position of the sound image by a distance corresponding to the behavior or posture of the one or more of the aforementioned cargoes, A recording medium that stores a program that executes a program.

Images