Control device, control method, and program
The control device adjusts vehicle notifications based on passenger presence using sensors, improving in-vehicle comfort by tailoring notifications to the driver, reducing passenger discomfort.
Patent Information
- Application Number
- PCT/JP2024/018009
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-24
- Filing Date
- 2024-05-15
- Publication Date
- 2024-11-28
AI Technical Summary
Existing vehicle notification systems do not account for passengers, leading to discomfort in the in-vehicle environment due to notifications intended for drivers.
A control device and method that utilize in-vehicle and external sensors to adjust notification settings and outputs based on the presence of passengers, using sensors like cameras, weight sensors, and seatbelt sensors to determine passenger presence and adjust notification intensity, type, and timing.
This approach ensures that notifications are tailored to the driver, reducing passenger discomfort by adjusting notification intensity and relevance, thereby enhancing the overall in-vehicle comfort.
Smart Images

Figure JP2024018009_28112024_PF_FP_ABST
Abstract
Description
Control device, control method, and program
[0001] The present invention relates to a control device, a control method, and a program.
[0002] There is a technology that uses various sensors mounted on a vehicle to detect the situation around the vehicle and notify people inside the vehicle according to the detected situation around the vehicle.
[0003] For example, Patent Document 1 discloses a technology for controlling in-vehicle notifications such as signal sounds and messages based on an index indicating the mental state of the driver (mental workload).Furthermore, Patent Document 2 discloses a technology for controlling provision of information to a user while driving in accordance with workload values estimated for each of multiple workloads resulting from the user's actions while driving (driving operations, device operations while driving, auditory operations, visual operations) and psychological state.
[0004] JP 2022-141011 A JP 2010-033549 A
[0005] The technologies of the above-mentioned Patent Documents 1 and 2 do not take into consideration the case where there are passengers in the vehicle, for example. In this case, there is a possibility that the comfort of the in-vehicle environment will be reduced, such as the passengers being annoyed by the in-vehicle notification given to the driver.
[0006] One example of a problem that the present invention aims to solve is to provide a technology for creating a comfortable in-vehicle environment.
[0007] A first invention in the present disclosure is a control device comprising: a setting unit that sets rules for outputting notification information according to the situation around the vehicle based on the output of an in-vehicle sensor that detects the internal state of the vehicle; and a notification output unit that executes output processing of the notification information based on the output of an outside-vehicle sensor that detects the situation around the vehicle and the rules.
[0008] A second invention in the present disclosure is a control method including a computer setting a rule for outputting notification information according to the situation around the vehicle based on the output of an in-vehicle sensor that detects the internal state of the vehicle, and executing an output process of the notification information based on the output of an outside-vehicle sensor that detects the situation around the vehicle and the rule.
[0009] A third invention in the present disclosure is a program for causing a computer to execute: a setting procedure for setting a rule for outputting notification information according to the situation around the vehicle based on the output of an in-vehicle sensor that detects the internal state of the vehicle; and a notification output procedure for executing an output process of the notification information based on the output of an outside-vehicle sensor that detects the situation around the vehicle and the rule.
[0010] FIG. 1 is a block diagram illustrating a first functional configuration of a control device according to the present disclosure; FIG. 2 is a diagram illustrating a first hardware configuration of a computer that realizes the control device according to the present disclosure; FIG. 3 is a flowchart illustrating a first operation of the control device according to the present disclosure; FIG. 4 is a block diagram illustrating a second functional configuration of the control device according to the present disclosure; FIG. 5 is a diagram illustrating a second hardware configuration of a computer that realizes the control device according to the present disclosure; and FIG. 6 is a flowchart illustrating a second operation of the control device according to the present disclosure.
[0011] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. In all drawings, similar components are denoted by similar reference numerals, and descriptions thereof will be omitted as appropriate. In the following disclosure, the drawings may relate to one or more embodiments.
[0012] In the following description, each component of each device represents a functional block rather than a hardware configuration. Each component of each device is realized by any combination of hardware and software, centered around the CPU of any computer, memory, a program loaded into the memory, a storage medium such as a hard disk that stores the program, and a network connection interface. There are many variations in the realization method and device.
[0013] Furthermore, when elements such as blocks in a diagram are linked by arrows, the direction of the arrows is merely to make the flow of information easier to understand. In this case, the direction of the arrows does not limit the direction of communication (one-way communication / two-way communication) unless otherwise specified.
[0014] First Embodiment Fig. 1 is a block diagram illustrating a first functional configuration of a control device 10 according to the present disclosure. The control device 10 is mounted on a vehicle 1 (an automobile in the example of Fig. 1). The control device 10 may be a device built into the vehicle 1, or may be a device that is later attached to the vehicle 1. The control device 10 illustrated in Fig. 1 includes a setting unit 110 and a notification output unit 120.
[0015] The setting unit 110 sets a rule for outputting notification information according to the situation around the vehicle 1 based on the output of the in-vehicle sensor 20 .
[0016] Here, the "in-vehicle sensor 20" includes any sensor capable of detecting the state inside the vehicle 1. For example, the in-vehicle sensor 20 may be an image sensor (camera) installed so as to be able to capture images of the interior of the vehicle 1. Furthermore, for example, the in-vehicle sensor 20 may be a weight sensor or a seat belt fastening sensor provided on each seat of the vehicle 1. Furthermore, for example, the in-vehicle sensor 20 may be a combination of two or more of the image sensor, weight sensor, and seat belt fastening sensor described above.
[0017] The "rules" relate to at least one of the manner in which notification information is output and the conditions under which notification information is output. Specific examples of the rule setting operation by the setting unit 110 will be described later.
[0018] The notification output unit 120 executes a process of outputting notification information within the vehicle 1 based on the output of the outside sensor 30 provided in the vehicle 1 and the rules set by the setting unit 110 .
[0019] Here, the "external sensor 30" includes any sensor capable of detecting the state of the periphery of the vehicle 1. For example, the external sensor 30 may be an image sensor (camera) installed so as to capture images of at least one of the front and rear of the vehicle 1 or in all directions of the vehicle 1. Furthermore, for example, the external sensor 30 may be various sensors (millimeter-wave radar, ultrasonic sensor, Light Detection and Ranging (LiDAR), etc.) that detect objects located in the periphery of the vehicle 1. Furthermore, for example, the internal sensor 20 may be a combination of the image sensor and various sensors described above.
[0020] When the notification output unit 120 executes the notification information output process, it generates a control signal for the output source 40 based on the output of the external sensor 30 and transmits the control signal to the output source 40. The output source 40 then executes an operation in response to the control signal from the notification output unit 120. As a result, notification information according to the situation around the vehicle 1 is output to people inside the vehicle 1, including the driver of the vehicle 1. Here, the "output source 40" includes any device capable of notifying at least the driver of the situation around the vehicle 1. For example, the output source 40 may be a speaker device that notifies the driver of the situation around the vehicle 1 by using sound as notification information. Alternatively, for example, the output source 40 may be a lighting device that notifies the driver of the situation around the vehicle 1 by using light as notification information. Alternatively, for example, the output source 40 may be a seat vibration device that notifies the driver of the situation around the vehicle 1 by using vibration of the seat (driver's seat) as notification information. The notification output unit 120 executes the output process using at least one of sound, light, and seat vibration as notification information using such an output source 40. A specific example of the notification information output process performed by the notification output unit 120 will be described later.
[0021] FIG. 2 is a diagram illustrating a first hardware configuration of a computer 1000 that realizes the control device 10 according to the present disclosure.
[0022] The computer 1000 includes a bus 1010 , a processor 1020 , a memory 1030 , a storage device 1040 , an input / output interface 1050 , and a network interface 1060 .
[0023] The bus 1010 is a data transmission path for transmitting and receiving data among the processor 1020, memory 1030, storage device 1040, input / output interface 1050, and network interface 1060. However, the method of connecting the processor 1020 and the like to each other is not limited to bus connection.
[0024] The processor 1020 is implemented as a central processing unit (CPU) or a graphics processing unit (GPU).
[0025] The memory 1030 is a main storage device realized by a random access memory (RAM) or the like.
[0026] The storage device 1040 is an auxiliary storage device realized by removable media such as a hard disk drive (HDD), a solid state drive (SSD), a memory card, or a read only memory (ROM), etc. The storage device 1040 stores at least program modules that realize the functions of the control device 10 described above (the setting unit 110 and the notification output unit 120).
[0027] The processor 1020 loads a program module read from the storage device 1040 onto the memory 1030 and executes the program module, thereby realizing a function corresponding to the program module. For example, the processor 1020 reads a program module corresponding to the setting unit 110 onto the memory 1030 and executes the program module, thereby realizing the function of the setting unit 110 described in the present disclosure. Similarly, the processor 1020 reads a program module corresponding to the notification output unit 120 onto the memory 1030 and executes the program module, thereby realizing the function of the notification output unit 120 described in the present disclosure. The operation of the processor 1020 is common to each embodiment included in the present disclosure.
[0028] The above-described program modules may be recorded on a recording medium other than the storage device 1040. The recording medium on which the program modules are recorded includes any non-transitory, tangible medium usable by the computer 1000. The recording medium on which the program modules are recorded may have embedded therein program code that is readable by the computer 1000 (processor 1020).
[0029] The input / output interface 1050 is an interface for connecting the computer 1000 (control device 10) to various input / output devices.
[0030] The network interface 1060 is an interface for connecting the computer 1000 (control device 10) to a network. This network is, for example, a Controller Area Network (CAN) of the vehicle 1. The network may also be, for example, a Local Area Network (LAN) or a Wide Area Network (WAN). The network interface 1060 may be connected to the network via a wireless connection or a wired connection.
[0031] The computer 1000 (control device 10) is connected to various devices (not shown) via an input / output interface 1050 or a network interface 1060. The "various devices" here include at least the above-mentioned in-vehicle sensor 20, the outside-vehicle sensor 30, and the output source 40 (at least one of a speaker device, a lighting device, and a seat vibration device). Furthermore, although not limited thereto, the "various devices" include input devices such as operation buttons, a keyboard, a touch panel, and a microphone, and output devices such as a display.
[0032] An example of the operation of the control device 10 will be described below with reference to Fig. 3. Fig. 3 is a flowchart illustrating a first operation of the control device 10 in the present disclosure.
[0033] First, the setting unit 110 acquires the output of the interior sensor 20 mounted on the vehicle 1 (step S102). Then, the setting unit 110 detects the interior state of the vehicle 1 based on the acquired output of the interior sensor 20 (step S104). Then, the setting unit 110 sets a rule regarding the output of notification information inside the vehicle 1 based on the detection result of the interior state of the vehicle 1 (step S106).
[0034] The notification output unit 120 sequentially acquires the output of the external sensor 30, and executes the output process of notification information regarding the situation around the vehicle 1 based on the output of the external sensor 30 and the regulations set in the processing of step S106 (step S108).
[0035] In the present embodiment, the setting unit 110 sets a rule for outputting notification information (information corresponding to the situation around the vehicle) based on the output of the interior sensor 20 that detects the interior state of the vehicle 1. As described above, the "rule" in the present disclosure relates to at least one of the method for outputting the notification information and the output conditions for the notification information. That is, the setting unit 110 sets the method for outputting the notification information and the output conditions for the notification information within the vehicle 1 in accordance with the interior state of the vehicle 1. Then, the notification output unit 120 executes the output process for the notification information within the vehicle 1 based on the output of the exterior sensor 30 and the rule set by the setting unit 110. In this way, in the present embodiment, the output of notification information within the vehicle 1 is controlled in accordance with the interior state of the vehicle 1. This is expected to have the effect of suppressing a decrease in the comfort of the in-vehicle environment when providing notification information to people within the vehicle 1.
[0036] The operation of the control device 10 according to the first embodiment will be described in more detail below using some specific examples.
[0037] <First specific example of the first embodiment> As one specific example, the operation of the control device 10 will be described in a case where, when an object (such as a person or another vehicle) around the vehicle 1 is detected based on the output of the external sensor 30, a warning sound (including a warning voice) according to the distance between the object and the vehicle 1 is output as notification information.
[0038] In this case, first, in step S102, the setting unit 110 acquires the output of the interior sensor 20 via the input / output interface 1050 or the network interface 1060. For example, if the interior sensor 20 is an image sensor, the setting unit 110 acquires image data from the image sensor. Alternatively, for example, if the interior sensor 20 is a weight sensor provided in each seat, the setting unit 110 acquires output data of the weight sensor that changes in accordance with the force applied to each seat. Alternatively, for example, if the interior sensor 20 is a seat belt fastening sensor, the setting unit 110 outputs output data from the seat belt fastening sensor indicating whether the seat belt of each seat is fastened or not fastened in the buckle.
[0039] Next, in step S104, the setting unit 110 detects the interior situation of the vehicle 1, specifically, the presence or absence of a passenger, based on the output of the interior sensor 20. Here, it is assumed that the interior sensor 20 includes an image sensor. In this case, the setting unit 110 can determine whether a person is present in each seat of the vehicle 1 except the driver's seat, i.e., whether a passenger is present, based on the output (image data) from the image sensor. The setting unit 110 can use a known image processing algorithm as a technique for detecting a person from image data. For example, it is assumed that the interior sensor 20 includes a weight sensor provided in each seat. In this case, the setting unit 110 determines whether a person is present in each seat of the vehicle 1 except the driver's seat, i.e., whether a passenger is present, based on the output value of the weight sensor, which changes depending on the force applied to each seat. For example, it is assumed that the interior sensor 20 includes a seat belt fastening sensor. In this case, the setting unit 110 determines whether a person is present in each seat of the vehicle 1 except the driver's seat, i.e., whether a passenger is present, based on the output data of the seat belt fastening sensor corresponding to each seat of the vehicle 1 except the driver's seat. The setting unit 110 can detect the presence or absence of a passenger using the outputs of multiple types of in-vehicle sensors 20 (at least two of an image sensor, a weight sensor, and a seat belt fastening sensor). The setting unit 110 may be configured to identify the seat position of the passenger in addition to the presence or absence of a passenger. The setting unit 110 can identify the seat position of the passenger based on the detected position of the person on the image data output from the image sensor, or the position (seat position) of the weight sensor or seat belt fastening sensor that indicates that a person has been detected.
[0040] If no passenger is detected, i.e., if only the driver is in the vehicle 1, the setting unit 110 reads out default rules for outputting a warning sound (notification information) in step S106. Note that data indicating the default rules is stored in advance in a storage area accessible to the setting unit 110, such as the memory 1030 or the storage device 1040. Note that the "default rules" are arbitrary. In this specific example, for example, data indicating the default intensity of the warning sound output from the speaker device, the default output state of the warning sound corresponding to the distance to the detected object (default output time and default output interval), and default criteria for outputting the warning sound are stored in advance in the above-mentioned storage area. Note that the "default criteria" here can also be referred to as the "default warning sensitivity (notification output sensitivity)" for the output of the vehicle exterior sensor 30. If no passenger is detected, the notification output unit 120 compares the output of the vehicle exterior sensor 30 with the default rules and outputs a warning in accordance with the default rules.
[0041] On the other hand, if a passenger is detected, in step S106, the setting unit 110 sets a rule for outputting a warning sound (notification information) that is at least partially different from the default rule. Then, in step S108, the notification output unit 120 compares the output of the outside sensor 30 with the rule set by the setting unit 110 and outputs a warning in accordance with the rule.
[0042] As an example, the setting unit 110 may be configured to change the output intensity (volume) of the warning sound. Specifically, the setting unit 110 sets a standard that sets the output intensity (volume) of the warning sound to be lower than the default output intensity. Here, the warning sound (notification information) according to the situation around the vehicle 1 is basically information intended for the driver and is not particularly relevant to passengers. By lowering the intensity (volume) of the warning sound output from the speaker device, it is possible to reduce the possibility that passengers will feel uncomfortable due to unnecessary information.
[0043] As another example, the setting unit 110 may be configured to change the criteria for determining whether or not to output a warning sound (the warning sensitivity for the external sensor 30). Specifically, if the default criteria for outputting a warning sound is "a distance of 1 m to an object," the setting unit 110 may set, for example, a criterion for "a distance of 70 cm to an object" as the default. That is, the setting unit 110 changes the default criteria for outputting a warning sound when an object is present within 1 m of the vehicle 1 to a criterion for not outputting a warning sound unless an object is present within 70 cm of the vehicle 1. This reduces the likelihood of notifications (warnings) based on the output of the external sensor 30. As described above, warning sounds (notification information) based on the situation around the vehicle 1 are basically intended for the driver and are not particularly relevant to passengers. By changing the criteria for determining whether or not to output a warning sound (the warning sensitivity for the external sensor 30) as illustrated, the frequency with which passengers are notified of unnecessary information is reduced, thereby reducing the likelihood of passengers feeling uncomfortable.
[0044] Note that, if the setting unit 110 can identify the seat position of the passenger, it may be configured to set a rule based on the seat position of the passenger. For example, if a passenger is detected in the rear seat, the setting unit 110 sets a rule that is at least partially different from the default rule described above. Children generally often sit in the rear seat. It is also possible that children may fall asleep inside the vehicle. In such a case, if the notification output unit 120 outputs a warning (notification information) according to the default rule, it may startle the sleeping child. Therefore, by executing the processing described above by the setting unit 110 when a passenger is detected in the rear seat, it is possible to reduce the possibility of discomforting passengers (especially children).
[0045] Furthermore, when the vehicle 1 is equipped with a plurality of types of output sources 40 (e.g., a speaker device, a lighting device, and a seat vibration device), the setting unit 110 may switch the output source 40 that executes the output process based on the output of the in-vehicle sensor 20. For example, in this specific example, when a passenger is detected, the setting unit 110 may switch the output source 40 of the notification information to an output device other than a speaker device (e.g., a lighting device and / or a seat vibration device provided for the driver of the vehicle 1). In this way, unnecessary notification information is less likely to be perceived by the passenger, thereby reducing the possibility that the passenger will feel uncomfortable.
[0046] <Second specific example of the first embodiment> As one specific example, the operation of the control device 10 will be described in a case where, when an object (such as a person or another vehicle) around the vehicle 1 is detected based on the output of the external sensor 30, a warning sound (including a warning voice) and a warning vibration of the seat are output as notification information according to the distance between the object and the vehicle 1.
[0047] The operation of the setting unit 110 in step S102 and the operation of the setting unit 110 in step S104 are the same as those in the first specific example described above.
[0048] If no passenger is detected, i.e., if only the driver is in the vehicle 1, the setting unit 110 reads out default rules for outputting the warning sound and warning vibration (notification information) in step S106. Note that data indicating the default rules is stored in advance in a storage area accessible to the setting unit 110, such as the memory 1030 or the storage device 1040. Note that the "default rules" are arbitrary. In this specific example, for example, data indicating the default intensity of the warning sound output from the speaker device and the warning vibration output from the seat vibration device, the default output state of the warning sound and warning vibration corresponding to the distance to the detected object (default output time and default output interval), and default criteria for outputting the warning sound and warning vibration are stored in advance in the above-mentioned storage area. Note that the "default criteria" here can also be referred to as the "default warning sensitivity (notification output sensitivity)" for the output of the vehicle exterior sensor 30. If no passenger is detected, the notification output unit 120 compares the output of the vehicle exterior sensor 30 with the default rules and outputs a warning in accordance with the default rules.
[0049] On the other hand, if a passenger is detected, in step S106, the setting unit 110 sets rules for outputting the warning sound and warning vibration (notification information) that are at least partially different from the default rules. Then, in step S108, the notification output unit 120 compares the output of the outside sensor 30 with the rules set by the setting unit 110 and outputs a warning in accordance with the rules.
[0050] As an example, the setting unit 110 may be configured to change the output intensity (volume) of the warning sound. Specifically, the setting unit 110 sets a standard that sets the output intensity (volume) of the warning sound to be lower than the default output intensity. Here, the warning sound and warning vibration (notification information) according to the situation around the vehicle 1 are basically information intended for the driver and are not particularly relevant to passengers. By lowering the intensity (volume) of the warning sound output from the speaker device, it is possible to reduce the possibility that passengers will feel uncomfortable due to unnecessary information.
[0051] As another example, the setting unit 110 may be configured to change the output intensity (volume and vibration magnitude) of each of the warning sound and the warning vibration. Specifically, the setting unit 110 sets a rule that the output intensity (volume) of the warning sound is lower than the default output intensity and the output intensity (vibration magnitude) of the warning vibration is higher than the default output intensity. Here, the warning sound and warning vibration (notification information) according to the situation around the vehicle 1 are basically information intended for the driver and are not particularly relevant to passengers. By lowering the intensity (volume) of the warning sound output from the speaker device, the possibility that passengers will feel uncomfortable due to unnecessary information can be reduced. Furthermore, because the warning vibration is generated by a seat vibration device installed in the driver's seat, it is difficult for passengers to perceive it. Therefore, even if the intensity of the warning vibration is increased, the possibility that passengers will feel uncomfortable is low. Furthermore, by increasing the intensity of the warning vibration, the driver can more easily perceive the seat vibration, thereby reducing the possibility that the driver will miss the warning if the warning sound is reduced.
[0052] As another example, the setting unit 110 may be configured to change the criterion (warning sensitivity for the vehicle exterior sensor 30) for determining whether to output a warning sound and a warning vibration. For example, the setting unit 110 lowers the criterion (warning sensitivity) for the warning sound and maintains the criterion (warning sensitivity) for the warning vibration. Specifically, if the default criterion for outputting a warning sound is "a distance of 1 m to an object," the setting unit 110 sets, for example, a criterion for "a distance of 70 cm to an object" as the default. That is, the setting unit 110 changes the default criterion for outputting a warning sound when an object is present within 1 m from the vehicle 1 to a criterion for not outputting a warning sound unless an object is present within 70 cm from the vehicle 1. Alternatively, the setting unit 110 may set, as the default criterion, a criterion for not outputting a warning sound at all, regardless of the distance from the vehicle 1 to an object. On the other hand, if the default criterion for outputting a warning vibration is "a distance of 1 m to an object," the setting unit 110 maintains the criterion as is. As a result, the warning sound based on the output of the external sensor 30 is less likely to be generated, but the warning vibration based on the output of the external sensor 30 is generated as usual. As described above, the warning sound and warning vibration (notification information) corresponding to the situation around the vehicle 1 are basically information intended for the driver and are not particularly relevant to passengers. By changing the criteria for determining whether to output a warning sound (the warning sensitivity for the external sensor 30) as shown in the example, the frequency with which passengers are notified of unnecessary information is reduced, thereby reducing the likelihood of passengers feeling uncomfortable. Furthermore, by setting the criteria for determining whether to output a warning vibration (the warning sensitivity for the external sensor 30) as shown in the example, the likelihood of passengers feeling uncomfortable is reduced while also reducing the likelihood of the driver overlooking the warning. In this case, the setting unit 110 may set a rule that increases the output intensity of the warning vibration above the default intensity. Increasing the intensity of the warning vibration makes it easier for the driver to perceive the seat vibration, further reducing the likelihood that the driver will overlook the warning when the warning sound is reduced.
[0053] Note that, if the setting unit 110 can identify the seat position of the passenger, it may be configured to set a rule based on the seat position of the passenger. For example, if a passenger is detected in the rear seat, the setting unit 110 sets a rule that is at least partially different from the default rule described above. Children generally often sit in the rear seat. It is also possible that children may fall asleep inside the vehicle. In such a case, if the notification output unit 120 outputs a warning (notification information) according to the default rule, the sleeping child may be startled. Therefore, by executing the processing described above by the setting unit 110 when a passenger is detected in the rear seat, the possibility of discomforting the passenger (especially the child) can be reduced.
[0054] Furthermore, when the vehicle 1 is equipped with a plurality of types of output sources 40 (e.g., a speaker device, a lighting device, and a seat vibration device), the setting unit 110 may switch the output source 40 that executes the output process based on the output of the in-vehicle sensor 20. For example, in this specific example, when a passenger is detected, the setting unit 110 may switch the output source 40 of the notification information to an output device other than a speaker device (e.g., a lighting device and a seat vibration device provided for the driver of the vehicle 1). In this way, unnecessary notification information is less likely to be perceived by the passenger, thereby reducing the possibility that the passenger will feel uncomfortable.
[0055] <Third specific example of the first embodiment> As one specific example, the operation of the control device 10 will be described in a case where, when an object (such as a person or another vehicle) around the vehicle 1 is detected based on the output of the external sensor 30, a warning sound (including a warning voice) and a warning light are output as notification information according to the distance between the object and the vehicle 1.
[0056] The operation of the setting unit 110 in step S102 and the operation of the setting unit 110 in step S104 are the same as those in the first specific example described above.
[0057] If no passenger is detected, i.e., if only the driver is in the vehicle 1, the setting unit 110 reads out default rules for outputting the warning sound and warning light (notification information) in step S106. Note that data indicating the default rules is stored in advance in a storage area accessible to the setting unit 110, such as the memory 1030 or the storage device 1040. Note that the "default rules" are arbitrary. In this specific example, for example, data indicating the default intensity of the warning sound output from the speaker device and the warning light output from the lighting device, the default output state of the warning sound and warning light corresponding to the distance to the detected object (default output time and default output interval), and default standards for outputting the warning sound and warning light are stored in advance in the above-mentioned storage area. Note that the "default standards" here can also be referred to as the "default warning sensitivity (notification output sensitivity)" for the output of the external sensor 30. If no passenger is detected, the notification output unit 120 compares the output of the external sensor 30 with the default rules in step S108 and outputs a warning in accordance with the default rules.
[0058] On the other hand, if a passenger is detected, in step S106, the setting unit 110 sets rules for outputting the warning sound and warning light (notification information) that are at least partially different from the default rules. Then, in step S108, the notification output unit 120 compares the output of the vehicle exterior sensor 30 with the rules set by the setting unit 110 and outputs a warning in accordance with the rules.
[0059] As an example, the setting unit 110 may be configured to change the output intensity (volume) of the warning sound. Specifically, the setting unit 110 sets a standard that sets the output intensity (volume) of the warning sound to be lower than the default output intensity. Here, the warning sound and warning vibration (notification information) according to the situation around the vehicle 1 are basically information intended for the driver and are not particularly relevant to passengers. By lowering the intensity (volume) of the warning sound output from the speaker device, it is possible to reduce the possibility that passengers will feel uncomfortable due to unnecessary information.
[0060] As another example, the setting unit 110 may be configured to change the output intensity (brightness) of the warning light. Specifically, the setting unit 110 sets a rule that reduces the output intensity (brightness) of the warning light compared to the default output intensity. Here, the warning sound and warning vibration (notification information) corresponding to the situation around the vehicle 1 are basically information intended for the driver and are not particularly relevant to passengers. By lowering the intensity (brightness) of the warning light output from the warning light, passengers are less likely to perceive the warning light, thereby reducing the likelihood that the passengers will feel uncomfortable. Alternatively, the setting unit 110 may set a rule that increases the output intensity (brightness) of the warning light compared to the default output intensity. Because the lighting device is set for the driver, even if the intensity of the warning light is increased, it is unlikely that the passengers will feel uncomfortable. Increasing the intensity of the warning light also makes it easier for the driver to perceive the warning light.
[0061] As another example, the setting unit 110 may be configured to change the output state of the warning illumination. Here, the "output state of the warning illumination" includes, for example, the contrast of the illumination and the frequency of change in the color of the illumination. Specifically, the setting unit 110 may set a rule that reduces the contrast value of the warning illumination compared to a default contrast value. The setting unit 110 may also set a rule that reduces the frequency of change in the color of the warning illumination (i.e., a rule that gradually changes the color of the warning illumination). This reduces the likelihood that passengers will find the warning illumination unpleasant. The setting unit 110 may also set a rule that increases the contrast or color change frequency of the warning illumination compared to the default contrast or color change frequency. Because the lighting device is set for the driver, increasing the contrast or color change frequency of the warning illumination has little impact on the passenger's vision. Therefore, increasing the contrast or color change frequency of the warning illumination is unlikely to cause discomfort to the passenger. Increasing the contrast or color change frequency of the warning illumination makes the warning illumination more easily perceptible to the driver.
[0062] As another example, the setting unit 110 may change the criterion for determining whether to output a warning sound and a warning vibration (the warning sensitivity for the vehicle exterior sensor 30). For example, the setting unit 110 lowers the criterion (warning sensitivity) for the warning sound and maintains the criterion (warning sensitivity) for the warning light. Specifically, if the default criterion for outputting a warning sound is "a distance of 1 m to an object," the setting unit 110 sets, for example, a criterion for "a distance of 70 cm to an object" as the default. That is, the setting unit 110 changes the default criterion for outputting a warning sound when an object is present within 1 m from the vehicle 1 to a criterion for not outputting a warning sound unless an object is present within 70 cm from the vehicle 1. Alternatively, the setting unit 110 may set, as the default criterion, a criterion for not outputting a warning sound at all, regardless of the distance from the vehicle 1 to an object. On the other hand, if the default criterion for outputting a warning light is "a distance of 1 m to an object," the setting unit 110 maintains the criterion. As a result, the warning sound based on the output of the vehicle exterior sensor 30 is less likely to be emitted, but the warning light based on the output of the vehicle exterior sensor 30 is still emitted as usual. As described above, the warning sound and warning light (notification information) according to the conditions around the vehicle 1 are basically information intended for the driver and are not particularly relevant to passengers. By changing the criteria for determining whether to output the warning sound (the warning sensitivity for the vehicle exterior sensor 30) as shown in the example, the frequency with which passengers are notified of unnecessary information is reduced, thereby reducing the likelihood of passengers feeling uncomfortable. Furthermore, by setting the criteria for determining whether to output the warning light (the warning sensitivity for the vehicle exterior sensor 30) as shown in the example, the likelihood of passengers feeling uncomfortable is reduced while also reducing the likelihood of the driver overlooking the warning. In this case, the setting unit 110 may also set a standard that increases the output intensity of the warning light above the default intensity. Increasing the intensity of the warning light makes it easier for the driver to perceive seat vibrations, further reducing the likelihood that the driver will overlook the warning when the warning sound is reduced.
[0063] Note that, if the setting unit 110 can identify the seat position of the passenger, it may be configured to set a rule based on the seat position of the passenger. For example, if a passenger is detected in the rear seat, the setting unit 110 sets a rule that is at least partially different from the default rule described above. Children generally often sit in the rear seat. It is also possible that children may fall asleep inside the vehicle. In such a case, if the notification output unit 120 outputs a warning (notification information) according to the default rule, it may startle the sleeping child. Therefore, by executing the processing described above by the setting unit 110 when a passenger is detected in the rear seat, it is possible to reduce the possibility of discomforting passengers (especially children).
[0064] Furthermore, when the vehicle 1 is equipped with a plurality of types of output sources 40 (e.g., a speaker device, a lighting device, and a seat vibration device), the setting unit 110 may switch the output source 40 that executes the output process based on the output of the in-vehicle sensor 20. For example, in this specific example, when a passenger is detected, the setting unit 110 may switch the output source 40 of the notification information to an output device other than a speaker device (e.g., a lighting device and a seat vibration device provided for the driver of the vehicle 1). In this way, unnecessary notification information is less likely to be perceived by the passenger, thereby reducing the possibility that the passenger will feel uncomfortable.
[0065] The operation of the control device 10 is not limited to the three specific examples described above. For example, the control device 10 can perform the same operations as those described in the three specific examples described above for each of the multiple output sources 40 (speaker devices, lighting devices, seat vibration devices, etc.) in the vehicle 1 or various combinations thereof.
[0066] Second Embodiment Fig. 4 is a block diagram illustrating a second functional configuration of the control device 10 according to the present disclosure. The control device 10 is mounted on a vehicle 1 (an automobile in the example of Fig. 4). The control device 10 may be a device built into the vehicle 1, or may be a device that is later attached to the vehicle 1. The control device 10 illustrated in Fig. 4 includes a setting unit 110 and a notification output unit 120.
[0067] The setting unit 110 acquires detailed information corresponding to the position information of the vehicle 1 from the map information. The setting unit 110 can acquire the position information of the vehicle 1 using, for example, a Global Positioning System (GPS) module 60 or a known self-position estimation algorithm based on sensing results from the external sensor 30. Here, the "external sensor 30" includes any sensor capable of detecting the state around the vehicle 1, as in the first embodiment. The setting unit 110 can acquire detailed information about the position corresponding to the position information of the vehicle 1 by referring to the map information stored in the map information storage unit 50. The setting unit 110 then sets a rule for outputting notification information according to the state around the vehicle 1 based on the acquired detailed information.
[0068] The "rules" relate to at least one of the manner in which notification information is output and the conditions under which notification information is output. This is the same as in the first embodiment. Specific examples of the rule setting operation by the setting unit 110 will be described later.
[0069] As in the first embodiment described above, the notification output unit 120 executes the process of outputting notification information within the vehicle 1 based on the output of the vehicle exterior sensor 30 provided in the vehicle 1 and the rules set by the setting unit 110. When executing the process of outputting notification information, the notification output unit 120 generates a control signal for the output source 40 based on the output of the vehicle exterior sensor 30 and transmits the control signal to the output source 40. Then, the output source 40 executes an operation according to the control signal from the notification output unit 120.
[0070] FIG. 5 is a diagram illustrating a second hardware configuration of a computer 1000 that realizes the control device 10 according to the present disclosure.
[0071] The computer 1000 includes a bus 1010, a processor 1020, a memory 1030, a storage device 1040, an input / output interface 1050, and a network interface 1060, similar to the first embodiment described above.
[0072] The bus 1010 is a data transmission path for transmitting and receiving data among the processor 1020, memory 1030, storage device 1040, input / output interface 1050, and network interface 1060. However, the method of connecting the processor 1020 and the like to each other is not limited to bus connection.
[0073] The processor 1020 is implemented as a central processing unit (CPU) or a graphics processing unit (GPU).
[0074] The memory 1030 is a main storage device realized by a random access memory (RAM) or the like.
[0075] The storage device 1040 is an auxiliary storage device realized by removable media such as a hard disk drive (HDD), a solid state drive (SSD), a memory card, or a read only memory (ROM). The storage device 1040 stores at least program modules that realize the above-described functions of the control device 10 (the setting unit 110 and the notification output unit 120). In this embodiment, the storage device 1040 may also function as a map information storage unit 50 that stores map information.
[0076] The processor 1020 loads a program module read from the storage device 1040 onto the memory 1030 and executes the program module, thereby realizing a function corresponding to the program module. For example, the processor 1020 reads a program module corresponding to the setting unit 110 onto the memory 1030 and executes the program module, thereby realizing the function of the setting unit 110 described in the present disclosure. Similarly, the processor 1020 reads a program module corresponding to the notification output unit 120 onto the memory 1030 and executes the program module, thereby realizing the function of the notification output unit 120 described in the present disclosure. The operation of the processor 1020 is common to each embodiment included in the present disclosure.
[0077] The above-described program modules may be recorded on a recording medium other than the storage device 1040. The recording medium on which the program modules are recorded includes any non-transitory, tangible medium usable by the computer 1000. The recording medium on which the program modules are recorded may have embedded therein program code that is readable by the computer 1000 (processor 1020).
[0078] The input / output interface 1050 is an interface for connecting the computer 1000 (control device 10) to various input / output devices.
[0079] The network interface 1060 is an interface for connecting the computer 1000 (control device 10) to a network. This network is, for example, a Controller Area Network (CAN) of the vehicle 1. The network may also be, for example, a Local Area Network (LAN) or a Wide Area Network (WAN). The network interface 1060 may be connected to the network via a wireless connection or a wired connection.
[0080] The computer 1000 (control device 10) is connected to various devices (not shown) via an input / output interface 1050 or a network interface 1060. The "various devices" here include at least the above-mentioned external sensor 30, output source 40 (at least one of a speaker device, a lighting device, and a seat vibration device), and GPS module 60. Furthermore, although not particularly limited, the "various devices" include input devices such as operation buttons, a keyboard, a touch panel, and a microphone, and output devices such as a display. Furthermore, the computer 1000 (control device 10) may be connected via the network interface 1060 to another computer 2000 that has the function of the map information storage unit 50.
[0081] An example of the operation of the control device 10 will be described below with reference to Fig. 6. Fig. 6 is a flowchart illustrating a second operation of the control device 10 in the present disclosure.
[0082] First, the setting unit 110 acquires location information of the vehicle 1 (step S202). Then, the setting unit 110 uses the acquired location information of the vehicle 1 to acquire detailed information from the map information stored in the map information storage unit 50 (step S204). This detailed information is information related to the location corresponding to the location information of the vehicle 1 acquired in the processing of step S202. Then, the setting unit 110 sets rules for outputting notification information within the vehicle 1 based on the detailed information acquired based on the location information of the vehicle 1 (step S206).
[0083] The notification output unit 120 sequentially acquires the output of the external sensor 30, and executes the output process of notification information regarding the situation around the vehicle 1 based on the output of the external sensor 30 and the regulations set in the processing of step S206 (step S208).
[0084] In this embodiment, the setting unit 110 sets a rule for outputting notification information (information corresponding to the situation around the vehicle) based on detailed information obtained from map information based on the position information of the vehicle 1. As described above, the "rule" in this disclosure relates to at least one of the method for outputting the notification information and the output conditions for the notification information. Furthermore, the detailed information derived from the position information of the vehicle 1 and the map information can be used as an index for determining the appropriateness of outputting the notification information to the driver, as will be shown in a specific example below. The notification output unit 120 then executes output processing of the notification information within the vehicle 1 based on the output of the external sensor 30 and the rule set by the setting unit 110. In this way, in this embodiment, the output of notification information within the vehicle 1 is controlled to suit the driver based on the detailed information derived from the position information of the vehicle 1 and the map information. This is expected to have the effect of reducing discomfort to the driver when providing notification information to the driver of the vehicle 1.
[0085] The operation of the control device 10 according to the second embodiment will be described in more detail below using some specific examples.
[0086] <First specific example of the second embodiment> As one specific example, the operation of the control device 10 will be described in a case where "road characteristics corresponding to the position information of vehicle 1" are obtained as detailed information from map information, and a warning sound (including a warning voice) according to the distance between an object (a person or another vehicle) located on vehicle 1 and vehicle 1 is output as notification information based on the road characteristics.
[0087] In this case, first, in step S202, the setting unit 110 acquires the position information of the vehicle 1 from the GPS module 60 connected via the input / output interface 1050 or the network interface 1060. The setting unit 110 may also execute a self-position estimation process for the vehicle 1 based on the output of the external sensor 30, and estimate (acquire) the position information of the vehicle 1.
[0088] Next, in step S204, the setting unit 110 uses the position information of the vehicle 1 to refer to the map information stored in the map information storage unit 50. Then, the setting unit 110 acquires, as detailed information, information indicating the characteristics of the road at the position corresponding to the position information of the vehicle 1 from the map information. Here, "road characteristics" includes, for example, "school route" and "road width." Then, in step S206, the setting unit 110 sets rules for outputting notification information according to the situation around the vehicle 1 based on the road characteristics acquired as detailed information. Then, in step S208, the notification output unit 120 compares the output of the external sensor 30 with the rules set by the setting unit 110 and outputs a warning in accordance with the rules.
[0089] As an example, "school routes" are often frequented by children, so it is preferable to increase the sensitivity of the warning. Therefore, when detailed information about a road indicating a "school route" is acquired, the setting unit 110 may be configured to set a higher standard (the "default" described in the first embodiment) for the criterion for determining whether to output a warning sound (the warning sensitivity for the external sensor 30). Specifically, if the default criterion for outputting a warning sound is "a distance to an object of 1.0 m," the setting unit 110 may set the standard to, for example, "a distance to an object of 1.5 m." By extending the criterion for outputting a warning sound by 0.5 m from the default, notifications (warnings) based on the output of the external sensor 30 are more likely to be issued. Areas near school routes are often frequented by children whose movements are difficult to predict, which can be stressful for drivers. By changing the criterion for determining whether to output a warning sound (the warning sensitivity for the external sensor 30) as shown in the example, the driver can be notified of a warning with a certain degree of leeway. This reduces the possibility that the driver will feel uncomfortable due to the output of a warning (notification information) inside the vehicle 1.
[0090] As another example, the "road width" can be considered a factor that affects the driver's psychological state (comfort level) when passing an oncoming vehicle. Therefore, when a road characteristic indicating the "road width" is acquired as detailed information, the setting unit 110 may be configured to set a standard for determining whether to output a warning sound (the warning sensitivity for the external sensor 30) based on the value of the "road width." For example, a first concept is that when the "road width" is narrow, the driver is required to operate the vehicle more delicately when passing an oncoming vehicle. In other words, it can be said that it is preferable for the driver to have a warning sound output when the driver has sufficient composure. According to this concept, the setting unit 110 is preferably configured to set the standard for determining whether to output a warning sound (the warning sensitivity for the external sensor 30) higher than usual, based on the "road width." In this case, the setting unit 110 operates as described in the previous example. A second concept is that it is natural that two vehicles will approach each other when passing an oncoming vehicle. In other words, it can be said that it is preferable for the driver not to output a warning sound more than necessary when passing each other. According to this concept, the setting unit 110 is preferably configured to set the criterion for determining whether or not to output a warning sound (the warning sensitivity for the external sensor 30) lower than normal. In this case, specifically, if the default criterion for outputting a warning sound is "a distance to an object of 1.0 m," the setting unit 110 sets the criterion as, for example, "a distance to an object of 60 cm." By setting a criterion for outputting a warning sound in this manner, the output of warnings (notification information) that are bothersome to the driver is reduced. In other words, the possibility that the driver will feel uncomfortable due to the output of warnings (notification information) within the vehicle 1 can be reduced.
[0091] Furthermore, when setting the rule regarding the output of notification information, the setting unit 110 may further acquire information indicating characteristics of the vehicle 1. For example, the information indicating the characteristics of the vehicle 1 includes information such as the length and width of the vehicle 1. Then, the setting unit 110 sets the rule regarding the output of notification information based on the information indicating the characteristics of the vehicle 1 and the information indicating the characteristics of the road. Here, according to the first concept described above, the setting unit 110 may be configured to set a higher criterion for determining whether or not to output a warning sound (the warning sensitivity for the vehicle exterior sensor 30) as the numerical value of the width of the vehicle 1 increases. Furthermore, according to the second concept described above, the setting unit 110 may be configured to set a lower criterion for determining whether or not to output a warning sound (the warning sensitivity for the vehicle exterior sensor 30) as the numerical value of the width of the vehicle 1 increases.
[0092] As another example, the setting unit 110 may further acquire information regarding the characteristics of the oncoming vehicle when setting the rule regarding the output of notification information. In this case, the setting unit 110 may acquire information such as the width and overall length of the oncoming vehicle by, for example, analyzing an image of the oncoming vehicle captured by a camera (not shown) or through vehicle-to-vehicle communication with the oncoming vehicle. The setting unit 110 then sets the rule regarding the output of notification information by further using the acquired characteristics of the oncoming vehicle. Here, according to the first concept described above, the setting unit 110 may be configured to set a higher criterion for determining whether to output a warning sound (the warning sensitivity of the external sensor 30) as the numerical value of the width of the oncoming vehicle increases. Furthermore, according to the second concept described above, the setting unit 110 may be configured to set a lower criterion for determining whether to output a warning sound (the warning sensitivity of the external sensor 30) as the numerical value of the width of the oncoming vehicle increases.
[0093] As another example, the setting unit 110 may further acquire data indicating the driver's driving skill when setting the regulations regarding the output of notification information. In this case, the data indicating the driver's driving skill is stored in a database (not shown) connected via the network interface 1060. The setting unit 110 can acquire data indicating the driver's driving skill by, for example, analyzing images generated by a camera capable of capturing the interior of the vehicle 1 to identify the driver and accessing the database based on the identification results. A first consideration regarding driving skill is that a driver with higher driving skill is able to pass oncoming vehicles with more ease. In this case, outputting a warning notification when passing a vehicle may annoy the driver. According to this consideration, the setting unit 110 is preferably configured to set a lower criterion for determining whether to output a warning sound (warning sensitivity for the external sensor 30) the higher the driver's driving skill. A second consideration regarding driving skill is that a driver with higher driving skill is more likely to become complacent during driving operations. In this case, it is preferable for the driver to be more comfortable outputting a warning when passing a vehicle. According to this idea, the setting unit 110 is preferably configured to set the criterion for determining whether or not to output a warning sound (warning sensitivity to the outside sensor 30) higher as the driver's driving skill improves.
[0094] In the previous example, the setting unit 110 may be configured to further acquire data regarding the driver of the oncoming vehicle and set rules regarding the output of notification information. In this case, the setting unit 110 may, for example, analyze an image captured by a camera capable of capturing images of the exterior of the vehicle 1 to identify the driver of the oncoming vehicle, and access the above-mentioned database based on the identification result to acquire data indicating the driving skill of the driver of the vehicle 1. Alternatively, the setting unit 110 may acquire information indicating the driver of the oncoming vehicle stored on the oncoming vehicle through vehicle-to-vehicle communication with the oncoming vehicle. In this case, the setting unit 110 may acquire data indicating the driving skill of the driver of the oncoming vehicle by accessing the above-mentioned database based on information acquired from the oncoming vehicle through vehicle-to-vehicle communication. Here, according to the first concept described in the previous example, the setting unit 110 may be configured to set a lower criterion for determining whether to output a warning sound (the warning sensitivity for the external sensor 30) as the driving skill of the driver of the oncoming vehicle increases. Furthermore, according to the second idea shown in the previous example, the setting unit 110 may be configured to set the criterion for determining whether or not to output a warning sound (warning sensitivity for the external sensor 30) higher the higher the driving skill of the driver of the oncoming vehicle.
[0095] The setting unit 110 may be configured to set a rule regarding the content of the warning (notification information) based on the road characteristics acquired from the vehicle 1's location information and map information. For example, if the road characteristics acquired based on the vehicle 1's location information indicate a "school route," the setting unit 110 sets a rule to use stricter wording for the warning audio content (e.g., "You will be hit at the rear right, 30 cm behind."). In this way, a more thorough warning is output in an environment where the driver needs to pay more attention. Such a warning is beneficial to the driver and is unlikely to annoy the driver.
[0096] The setting unit 110 may also be configured to set a rule for the warning (notification information) output source 40 based on the location information of the vehicle 1 and information about facilities acquired from map information. For example, when the road characteristics acquired based on the location information of the vehicle 1 indicate a "school route," the setting unit 110 may be configured to set a rule to use a lighting device (a warning light output source) and / or a seat vibration device (a warning vibration output source) in addition to a speaker device (a warning sound output source). In this way, a more thorough warning is output in an environment where the driver needs to pay more attention. Such a warning is beneficial to the driver and is unlikely to annoy the driver.
[0097] <Specific example 2 of the second embodiment> As one specific example, the operation of the control device 10 will be described in a case where "information on facilities corresponding to the location information of vehicle 1" is obtained as detailed information from map information, and a warning sound (including warning voice) according to the distance between an object (a person or another vehicle) located on vehicle 1 and vehicle 1 is output as notification information based on the information on the facilities.
[0098] The operation of the setting unit 110 in step S202 is the same as in the first specific example described above.
[0099] In step S204, the setting unit 110 uses the location information of the vehicle 1 to refer to the map information stored in the map information storage unit 50. Then, the setting unit 110 acquires, as detailed information, information about facilities located at positions corresponding to the location information of the vehicle 1 from the map information. Here, "information about the facilities" includes, for example, information indicating characteristics of the facilities, such as "home" or "store parking lot." Then, in step S206, the setting unit 110 sets rules for outputting notification information according to the situation around the vehicle 1 based on the information about the facilities acquired as detailed information. Then, in step S208, the notification output unit 120 compares the output of the external sensor 30 with the rules set by the setting unit 110 and outputs a warning in accordance with the rules.
[0100] As an example, since a driver is accustomed to driving near "home," excessive warnings may annoy the driver. Therefore, when the facility information acquired based on the location information of the vehicle 1 indicates "home," the criterion for determining whether to output a warning sound (the warning sensitivity for the external sensor 30) may be set to a lower standard than normal (the "default" described in the first embodiment). As another example, when the facility information acquired based on the location information of the vehicle 1 indicates "home," many vehicles owned by other people are located near a "store parking lot," which is a place where the driver needs to be more careful. Therefore, when the facility information acquired based on the location information of the vehicle 1 indicates "store parking lot," the criterion for determining whether to output a warning sound (the warning sensitivity for the external sensor 30) may be set to a higher standard than normal (the "default" described in the first embodiment). This allows a warning appropriate for the driver to be output.
[0101] The setting unit 110 may be configured to set a rule regarding the content of the warning (notification information) based on information regarding facilities acquired from the location information of the vehicle 1 and map information. For example, if the facility information acquired based on the location information of the vehicle 1 indicates "home," the setting unit 110 sets a rule to make the voice content regarding the warning vague (e.g., "Rear right, you will be hit in a short distance."). Alternatively, if the facility information acquired based on the location information of the vehicle 1 indicates "store parking lot," the setting unit 110 sets a rule to make the voice content regarding the warning more precise (e.g., "Rear right, you will be hit in 30 cm."). This allows a more thorough warning to be output in places where the driver is not familiar with driving and is likely to feel uneasy. This prevents the driver from being annoyed by the output of the warning (notification information) within the vehicle 1.
[0102] The setting unit 110 may also be configured to set a rule for the output source 40 of the warning (notification information) based on the location information of the vehicle 1 and information about facilities acquired from map information. For example, the setting unit 110 may set a rule not to select the output source 40 (not to output a warning sound) when the facility information acquired based on the location information of the vehicle 1 indicates "home." In this way, a warning will not be issued in places where the driver frequently drives and would not feel uneasy even without a warning. This makes it possible to prevent the driver from being annoyed by the output of a warning (notification information) within the vehicle 1.
[0103] <Specific example 3 of the second embodiment> As one specific example, the operation of the control device 10 will be described in a case where "accident occurrence history corresponding to the location information of vehicle 1" is obtained as detailed information from map information, and a warning sound (including warning voice) according to the distance between an object (a person or another vehicle) located on vehicle 1 and vehicle 1 based on the accident occurrence history is output as notification information.
[0104] The operation of the setting unit 110 in step S202 is the same as in the first specific example described above.
[0105] In step S204, the setting unit 110 refers to the map information stored in the map information storage unit 50 using the location information of the vehicle 1. The setting unit 110 then acquires, as detailed information, information indicating the history of accidents occurring at locations corresponding to the location information of the vehicle 1 from the map information. In this specific example, the map information includes information regarding the history of accidents at each location. In step S206, the setting unit 110 sets a rule regarding the output of notification information according to the situation around the vehicle 1 based on the information indicating the history of accidents acquired as detailed information. For example, the setting unit 110 compiles the history of accidents over a certain period (e.g., the past six months) and calculates an index regarding the frequency of accidents. The setting unit 110 then sets a rule regarding the output of notification information according to the situation around the vehicle 1 based on the calculated index. For example, the setting unit 110 sets a higher standard for determining whether to output a warning sound (the warning sensitivity for the external sensor 30) as the frequency of accidents indicated by the calculated index increases. Then, in step S208, the notification output unit 120 compares the output of the outside sensor 30 with the regulations set by the setting unit 110 and outputs a warning in accordance with the regulations. This makes it possible to issue an appropriate warning in places where accidents are likely to occur.
[0106] The setting unit 110 may be configured to set a rule regarding the output content of the warning (notification information). For example, if the frequency of accidents indicated by the indicator is high, the setting unit 110 sets a rule to make the audio content of the warning more precise (for example, "You will be hit at the rear right, 30 cm behind."). By doing so, a more thorough warning is output in locations where accidents are likely to occur. Such a notification is also beneficial to the driver and is unlikely to cause discomfort to the driver.
[0107] The setting unit 110 may be configured to set a rule for the output source 40 of the warning (notification information). For example, if the frequency of accidents indicated by the indicator is high, the setting unit 110 may be configured to set a rule to use a lighting device (an output source of warning light) and / or a seat vibration device (an output source of warning vibration) in addition to a speaker device (an output source of warning sound). In this way, a more thorough warning is output in high-risk locations. Such a notification is also beneficial to the driver and is unlikely to cause discomfort to the driver.
[0108] <Specific example 4 of the second embodiment> As one specific example, the operation of the control device 10 will be described in a case where "traffic volume corresponding to the position information of vehicle 1" is obtained as detailed information from map information, and a warning sound (including warning voice) according to the distance between an object (person or other vehicle) located on vehicle 1 and vehicle 1 is output as notification information based on the traffic volume information.
[0109] The operation of the setting unit 110 in step S202 is the same as in the first specific example described above.
[0110] In step S204, the setting unit 110 refers to the map information stored in the map information storage unit 50 using the location information of the vehicle 1. The setting unit 110 then acquires, as detailed information, information indicating traffic volume at a location corresponding to the location information of the vehicle 1 from the map information. In this specific example, the map information includes information regarding traffic volume at each location. In step S206, the setting unit 110 sets a rule regarding the output of notification information according to the situation around the vehicle 1 based on the information indicating traffic volume acquired as detailed information. For example, the setting unit 110 calculates the average traffic volume over a certain period (e.g., the most recent six months) as an index. The setting unit 110 then sets a rule regarding the output of notification information according to the situation around the vehicle 1 based on the calculated index. For example, the setting unit 110 sets a criterion for determining whether to output a warning sound (the warning sensitivity for the external sensor 30) higher as the average traffic volume indicated by the calculated index increases. Then, in step S208, the notification output unit 120 compares the output of the outside sensor 30 with the rules set by the setting unit 110 and outputs a warning in accordance with the rules. This makes it possible to issue an appropriate warning in places where traffic volume is heavy, i.e., where the driver needs to pay more attention.
[0111] The setting unit 110 may be configured to set a rule regarding the output content of the warning (notification information). For example, when the average traffic volume indicated by the indicator is high, the setting unit 110 sets a rule to make the voice content of the warning more precise (for example, "You will be hit in front of you on the right, 30 cm behind you."). By doing so, a more thorough warning is output in a place where the driver needs to be more careful. Such a notification is also beneficial to the driver and is unlikely to cause discomfort to the driver.
[0112] The setting unit 110 may be configured to set a rule regarding the output source 40 of the warning (notification information). For example, when the average traffic volume indicated by the indicator is high, the setting unit 110 may be configured to set a rule to use a lighting device (an output source of warning light) and / or a seat vibration device (an output source of warning vibration) in addition to a speaker device (an output source of warning sound). In this way, a more thorough warning is output in a place where the driver needs to be more careful. Such a notification is also beneficial to the driver and is unlikely to cause discomfort to the driver.
[0113] Although the embodiments have been described above with reference to the drawings, these are merely examples of the present invention, and various other configurations can also be adopted.
[0114] For example, while the three specific examples of the first embodiment illustrate cases in which warning information based on the situation around the vehicle 1 is output, the operation of the control device 10 according to the present disclosure is not limited thereto. For example, the control device 10 may perform the operation described above in the first embodiment when outputting advertising information based on the identification result of facilities (e.g., stores) around the vehicle 1. For example, the control device 10 identifies the type and name of stores located around the vehicle 1 (e.g., in the direction of travel) based on the output of an external sensor 30 (e.g., an image sensor). The control device 10 then acquires advertising information linked to the identification result of the store type and store name via an advertising server (not shown). Note that the control device 10 can communicate with an advertising server on the Internet by connecting to the Internet, for example, via the network interface 1060. When outputting advertising information acquired from the advertising server, the control device 10 performs the operation described in the above specific example. This prevents a decrease in the comfort of the in-vehicle environment even when advertising information is output inside the vehicle 1.
[0115] Furthermore, if the driver's line of sight can be detected using a camera or the like installed inside the vehicle, the setting unit 110 may set a rule by further using the detection result of the driver's line of sight. For example, in the second embodiment, the setting unit 110 sets a rule based on detailed information acquired from the position information and map information of the vehicle 1. In this case, the setting unit 110 corrects the set rule by using the detection result of the driver's line of sight. Specifically, the setting unit 110 uses the detection result of the driver's line of sight to identify a direction that the driver cannot see. Then, the setting unit 110 corrects the rule to increase the warning sensitivity for the identified direction. In this way, it is possible to output a warning tailored to the driver's situation.
[0116] Furthermore, in the second embodiment, the setting unit 110 may set a rule using a sensor (external sensor 30) that detects conditions outside the vehicle. For example, the setting unit 110 may set a rule based on detailed information acquired from the position information of the vehicle 1 and map information. At this time, the setting unit 110 may further identify the number of people in the vicinity based on the output of the external sensor 30. In this case, the setting unit 110 may further identify attributes of the people (e.g., children) from the sensing results. Then, the setting unit 110 corrects the set rule based on the results of identifying the number of people and the person attributes. Specifically, the setting unit 110 corrects the rule to increase warning sensitivity when, for example, a predetermined number of children or more are detected in a parking lot. This makes it possible to output a warning (notification information) tailored to the surrounding conditions.
[0117] The control device 10 may further include a function for acquiring driver feedback information regarding notification information output specifications and learning a driver-appropriate setting value based on the feedback information. For example, the driver inputs positive information indicating that the notification information output specifications are appropriate, or negative information indicating that the notification information output specifications are inappropriate (e.g., the notification is too loud), using an input device connected via the input / output interface 1050 or the network interface 1060. The setting unit 110 acquires the input information as feedback information and constructs a setting method (algorithm) for the specifications appropriate for the driver. For example, the setting unit 110 may set a specification for outputting voice notification information using strict expressions (e.g., "The vehicle will contact the vehicle in the rear right, 30 cm behind."), and the notification output unit 120 performs notification processing in accordance with the specification. Then, the driver may input negative feedback information in response to the notification processing in accordance with the specification. In this case, the setting unit 110 adjusts the algorithm to more actively adopt a specification for outputting voice notification information using ambiguous expressions (e.g., "The vehicle will contact the vehicle in the rear right, a short distance away."). This enables notification information to be output tailored to the driver.
[0118] Examples of reference forms are given below. 1. A control device comprising: a setting unit that sets a rule for outputting notification information according to the situation around the vehicle, based on the output of an interior sensor that detects the state inside the vehicle; and a notification output unit that executes output processing of the notification information, based on the output of an exterior sensor that detects the situation around the vehicle and the rule. 2. The control device described in 1., in which the setting unit detects the presence or absence of a passenger based on the output of the interior sensor, and changes the rule depending on the presence or absence of the passenger. 3. The control device described in 2., in which the setting unit changes the rule based on the seat position of the passenger. 4. The control device described in any one of 1. to 3., in which the notification output unit executes the output processing using at least one of sound, light, and seat vibration as the notification information. 5. The control device described in 4., in which the setting unit sets a rule regarding the output intensity or output state of at least one of sound, light, and seat vibration depending on the output of the interior sensor. 6. The control device according to 4., wherein the setting unit sets a rule regarding a standard for determining whether or not to output the notification information according to the output of the in-vehicle sensor. 7. The control device according to any one of 1. to 3., wherein the notification output unit has a plurality of output sources, and the setting unit switches the output source for executing the output process based on the output of the in-vehicle sensor. 8. A control method including a computer setting a rule for outputting notification information according to the situation around the vehicle based on the output of an in-vehicle sensor that detects the internal state of the vehicle, and executing output processing of the notification information based on the output of an outside sensor that detects the situation around the vehicle and the rule. 9. The control method according to 8., wherein the computer detects the presence or absence of a passenger based on the output of the in-vehicle sensor, and changes the rule according to the presence or absence of the passenger. 10. The control method according to 9., wherein the computer changes the rule based on the seat position of the passenger. 11. A control method according to 8., wherein the computer executes the output process using at least one of sound, light, and seat vibration as the notification information. 10. The control method according to any one of 10. to 10.12. The control method recited in 11., including the computer setting a rule regarding the output intensity or output state of at least one of the sound, light, and seat vibration according to the output of the in-vehicle sensor. 13. The control method recited in 11., including the computer setting a rule regarding a criterion for determining whether or not to output the notification information according to the output of the in-vehicle sensor. 14. The control method recited in any one of 8. to 13., including a plurality of output sources, and the computer switching the output source that executes the output processing based on the output of the in-vehicle sensor. 15. A program causing a computer to execute: a setting procedure for setting a rule for outputting notification information according to the situation around the vehicle based on the output of an in-vehicle sensor that detects the state inside the vehicle; and a notification output procedure for executing output processing of the notification information based on the output of an outside sensor that detects the situation around the vehicle and the rule. 16. The program recited in 15., the setting procedure including detecting the presence or absence of a passenger based on the output of the in-vehicle sensor, and changing the rule according to the presence or absence of the passenger. 17. The program described in 16., wherein the setting procedure includes changing the rule based on the seat position of the passenger. 18. The program described in any one of 15. to 17., wherein the notification output procedure includes executing the output processing using at least one of sound, light, and seat vibration as the notification information. 19. The program described in 18., wherein the setting procedure includes setting a rule regarding the output intensity or output state of at least one of sound, light, and seat vibration according to the output of the in-vehicle sensor. 20. The program described in 18., wherein the setting procedure includes setting a rule regarding a criterion for determining whether or not to output the notification information according to the output of the in-vehicle sensor. 21. The program described in any one of 15. to 20., wherein there are a plurality of output sources, and the setting procedure includes switching the output source that executes the output processing based on the output of the in-vehicle sensor.
[0119] This application claims priority based on Japanese Patent Application No. 2023-085770, filed May 24, 2023, the disclosure of which is incorporated herein by reference in its entirety.
[0120] REFERENCE SIGNS LIST 1 Vehicle 10 Control device 110 Setting unit 120 Notification output unit 1000 Computer 1010 Bus 1020 Processor 1030 Memory 1040 Storage device 1050 Input / output interface 1060 Network interface 20 In-vehicle sensor 30 Out-vehicle sensor 40 Output source 50 Map information storage unit 60 GPS module
Claims
1. A control device comprising: a setting unit that sets a rule for outputting notification information according to the situation around the vehicle based on the output of an in-vehicle sensor that detects the internal condition of the vehicle; and a notification output unit that executes output processing of the notification information based on the output of an outside-vehicle sensor that detects the situation around the vehicle and the rule.
2. The control device according to claim 1, wherein the setting unit detects the presence or absence of a passenger based on an output from the in-vehicle sensor, and changes the regulation depending on the presence or absence of the passenger.
3. The control device according to claim 2, wherein the setting unit changes the rule based on a seat position of the passenger.
4. The control device according to any one of claims 1 to 3, wherein the notification output unit executes the output process using at least one of sound, light, and seat vibration as the notification information.
5. The control device according to claim 4, wherein the setting unit sets a regulation relating to an output intensity or an output state of at least one of the sound, light and seat vibration in accordance with an output of the in-vehicle sensor.
6. The control device according to claim 4, wherein the setting unit sets a provision regarding a criterion for determining whether or not to output the notification information in accordance with an output of the in-vehicle sensor.
7. The control device according to any one of claims 1 to 3, wherein the notification output unit has a plurality of output sources, and the setting unit switches the output source that executes the output process based on an output from the in-vehicle sensor.
8. A control method including: a computer sets a rule for outputting notification information according to the situation around the vehicle based on the output of an in-vehicle sensor that detects the internal condition of the vehicle; and executes output processing of the notification information based on the output of an outside-vehicle sensor that detects the situation around the vehicle and the rule.
9. A program for causing a computer to execute: a setting procedure for setting regulations for outputting notification information according to the situation around the vehicle based on the output of an in-vehicle sensor that detects the internal condition of the vehicle; and a notification output procedure for executing output processing of the notification information based on the output of an outside-vehicle sensor that detects the situation around the vehicle and the regulations.
Citation Information
Patent Citations
Drive assist system
JP2006214945A
Navigation system for car
JP2006220435A
Spatial sonification of accelerating objects
JP2016020203A
