Control device, control method, and program

The control device adjusts notification output based on vehicle sensors to enhance passenger comfort by modifying notification intensity and source, addressing the discomfort caused by driver-focused notifications in the presence of passengers.

JP7948731B2Active Publication Date: 2026-11-11PIONEER IP
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2025522349
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2023-05-24
Filing Date
2024-05-15
Publication Date
2026-11-11
Estimated Expiration
2044-05-15

AI Technical Summary

Technical Problem

Existing vehicle notification technologies do not account for the presence of fellow passengers, potentially leading to an uncomfortable in-vehicle environment due to notifications directed at the driver.

Method used

A control device that adjusts notification output based on the internal state of the vehicle, using in-vehicle and external sensors to set rules for notification information, ensuring the comfort of both the driver and passengers by modifying the intensity, criteria, and output source of notifications.

Benefits of technology

The solution effectively reduces passenger discomfort by tailoring notification settings according to the vehicle's internal state and surrounding conditions, ensuring relevant information is directed at the driver while minimizing disturbance to passengers.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007948731000001
    Figure 0007948731000001
  • Figure 0007948731000002
    Figure 0007948731000002
  • Figure 0007948731000003
    Figure 0007948731000003
Patent Text Reader

Abstract

A control device (10) includes a setting unit (110) and a notification output unit (120). The setting unit (110) sets, on the basis of an output of a vehicle interior sensor (20) that detects an internal state of a vehicle (1), a rule for outputting notification information corresponding to the situation around the vehicle (1). The notification output unit (120) executes output processing of the notification information on the basis of an output of a vehicle exterior sensor (30) that detects the situation around the vehicle (1) and the rule set by the setting unit (110).
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present invention relates to a control device, a control method, and a program.

BACKGROUND ART

[0002] There is a technology that detects the situation around a vehicle using various sensors mounted on the vehicle, and notifies a person inside the vehicle according to the detected surrounding situation.

[0003] For example, Cited Document 1 discloses a technology for controlling in-vehicle notifications such as notification sounds and messages based on an index indicating the driver's mental state (mental workload). Further, for example, Cited Document 2 discloses a technology for controlling information provision to a user during driving according to workload values estimated for each of a plurality of workloads caused by the user's actions during driving (driving operations, device operations during driving, auditory actions, visual actions) and psychological states.

PRIOR ART DOCUMENTS

PATENT DOCUMENTS

[0004]

PATENT DOCUMENT 1

PATENT DOCUMENT 2

SUMMARY OF THE INVENTION

PROBLEMS TO BE SOLVED BY THE INVENTION

[0005] The technologies of the above-mentioned Cited Document 1 and Cited Document 2 do not take into account cases where, for example, there is a fellow passenger in the vehicle. In this case, there is a possibility that the comfort of the in-vehicle environment may deteriorate, such as the in-vehicle notifications provided to the driver making the fellow passenger feel uncomfortable.

[0006] An example of the problem to be solved by the present invention is to provide a technology for creating a comfortable in-vehicle environment.

MEANS FOR SOLVING THE PROBLEMS

[0007] The first invention in this disclosure is, A setting unit sets a rule for outputting notification information according to the surrounding conditions of the vehicle based on the output of an in-vehicle sensor that detects the internal state of the vehicle, The output of the external sensor that detects the conditions around the vehicle and the regulations Based on this, a notification output unit executes the output processing of the notification information, This is a control device equipped with [a specific feature / feature].

[0008] The second invention in this disclosure is, Computers Based on the output of an in-vehicle sensor that detects the internal state of the vehicle, a provision is set to output notification information corresponding to the surrounding conditions of the vehicle. Based on the output of the external sensor that detects the surrounding conditions of the vehicle and the aforementioned regulations, the process for outputting the notification information is executed. This is a control method that includes the provision of such a feature.

[0009] The third invention in this disclosure is, On the computer, A setting procedure for setting a rule to output notification information corresponding to the surrounding conditions of the vehicle based on the output of an in-vehicle sensor that detects the internal state of the vehicle. A notification output procedure that performs the output processing of the notification information based on the output of an external sensor that detects the surrounding conditions of the vehicle and the aforementioned regulations. This is a program to execute [the command / action]. [Brief explanation of the drawing]

[0010] [Figure 1] This is a block diagram illustrating the first functional configuration of the control device relating to this disclosure. [Figure 2] This figure illustrates a first hardware configuration of a computer that implements the control device related to this disclosure. [Figure 3] This is a flowchart illustrating the first operation of the control device in this disclosure. [Figure 4] This is a block diagram illustrating a second functional configuration of the control device relating to this disclosure. [Figure 5] This figure illustrates a second hardware configuration of a computer that implements the control device related to this disclosure. [Figure 6] This flowchart illustrates a second operation of the control device in this disclosure. [Modes for carrying out the invention]

[0011] Hereinafter, embodiments of the invention described in this disclosure will be explained with reference to the drawings. In all drawings, similar components are denoted by the same reference numerals, and descriptions are omitted where appropriate. Furthermore, in the following disclosure, the drawings may be associated with one or more embodiments.

[0012] Furthermore, in the following description, each component of each device refers to a functional block, not a hardware-level configuration. Each component of each device is realized by any combination of hardware and software, centered around the CPU, memory, programs loaded into memory, storage media such as a hard disk that stores those programs, and a network connection interface of any computer. There are various variations in the implementation method and the device itself.

[0013] Furthermore, when elements such as blocks in a diagram are linked by arrows, the direction of the arrows is merely to make the flow of information easier to understand. In this case, unless otherwise specified, the direction of the arrows does not limit the direction of communication (one-way communication / two-way communication).

[0014] • First Embodiment Figure 1 is a block diagram illustrating a first functional configuration of the control device 10 according to this disclosure. The control device 10 is mounted on a vehicle 1 (an automobile in the example of Figure 1). The control device 10 may be a device built into the vehicle 1, or it may be a device that is later attached to the vehicle 1. The control device 10 illustrated in Figure 1 has a setting unit 110 and a notification output unit 120.

[0015] The setting unit 110 sets a rule for outputting notification information corresponding to the surrounding situation of the vehicle 1, based on the output of the in-vehicle sensor 20.

[0016] Here, the "in-vehicle sensor 20" includes any sensor capable of detecting the internal state of the vehicle 1. For example, the in-vehicle sensor 20 may be an image sensor (camera) installed to be capable of capturing the inside of the vehicle 1. Further for example, the in-vehicle sensor 20 may be a weight sensor or a seatbelt wearing sensor provided at each seat of the vehicle 1. Further for example, the in-vehicle sensor 20 may be a combination of two or more of the above-described image sensor, weight sensor, and seatbelt wearing sensor.

[0017] Further, the "rule" relates to at least one of the output method of the notification information and the output condition of the notification information. Note that a specific example of the rule setting operation by the setting unit 110 will be described later.

[0018] The notification output unit 120 executes output processing of the notification information inside the vehicle 1, based on the output of the external sensor 30 provided in the vehicle 1 and the rule set by the setting unit 110.

[0019] Here, the "external sensor 30" includes any sensor capable of detecting the state of the surroundings of the vehicle 1. For example, the external sensor 30 may be an image sensor (camera) installed to be capable of capturing at least one of the front or rear of the vehicle 1, or all directions of the vehicle 1. Further for example, the external sensor 30 may be various sensors (millimeter wave radar, ultrasonic sensor, Light Detection and Ranging (LiDAR), etc.) that detect objects located around the vehicle 1. Further for example, the vehicle outside sensor 3 0 may be a combination of the above-described image sensor and various sensors.

[0020] When the notification output unit 120 performs notification information output processing, it generates a control signal for the output source 40 based on the output of the external sensor 30 and transmits the control signal to the output source 40. The output source 40 then performs an operation in accordance with the control signal from the notification output unit 120. As a result, notification information corresponding to the surrounding conditions of vehicle 1 is output to people inside vehicle 1, including the driver of vehicle 1. Here, "output source 40" includes at least any device capable of notifying the driver of vehicle 1 of the surrounding conditions of vehicle 1. For example, output source 40 may be a speaker device that notifies the driver of the surrounding conditions of vehicle 1 by using sound as notification information. Alternatively, output source 40 may be a lighting device that notifies the driver of the surrounding conditions of vehicle 1 by using light as notification information. Alternatively, output source 40 may be a seat vibration device that notifies the driver of the surrounding conditions of vehicle 1 by using vibration of the seat (driver's seat) as notification information. The notification output unit 120 uses such an output source 40 to perform output processing using at least one of sound, light, and seat vibration as notification information. A specific example of the notification information output processing performed by the notification output unit 120 will be described later.

[0021] Figure 2 is a diagram illustrating a first hardware configuration of a computer 1000 that implements the control device 10 according to this disclosure.

[0022] Computer 1000 has a bus 1010, a processor 1020, memory 1030, a storage device 1040, an input / output interface 1050, and a network interface 1060.

[0023] Bus 1010 is a data transmission path for the processor 1020, memory 1030, storage device 1040, input / output interface 1050, and network interface 1060 to send and receive data to and from each other. However, the method of connecting the processor 1020 and the other components to each other is not limited to bus connection.

[0024] The 1020 processor is a processor implemented in the Central Processing Unit (CPU) and Graphics Processing Unit (GPU), among others.

[0025] Memory 1030 is a type of main memory implemented using Random Access Memory (RAM), etc.

[0026] The storage device 1040 is an auxiliary storage device implemented as a Hard Disk Drive (HDD), Solid State Drive (SSD), removable media such as a memory card, or Read Only Memory (ROM). The storage device 1040 stores at least program modules that implement each of the functions of the control device 10 described above (setting unit 110 and notification output unit 120).

[0027] The processor 1020 implements the functions corresponding to the program modules read from the storage device 1040 by loading them into the memory 1030 and executing them. For example, the processor 1020 implements the functions of the setting unit 110 as described in this disclosure by reading the program module corresponding to the setting unit 110 into the memory 1030 and executing it. Similarly, the processor 1020 implements the functions of the notification output unit 120 as described in this disclosure by reading the program module corresponding to the notification output unit 120 into the memory 1030 and executing it. This operation of the processor 1020 is common to all embodiments included in this disclosure.

[0028] The program module described above may be recorded on a recording medium other than the storage device 1040. The recording medium on which the program module is recorded includes any medium usable by a non-temporary, tangible computer 1000. The recording medium on which the program module is recorded may have program code embedded in it that can be read by the computer 1000 (processor 1020).

[0029] The input / output interface 1050 is an interface for connecting the computer 1000 (control device 10) with various input / output devices.

[0030] The network interface 1060 is an interface for connecting the computer 1000 (control unit 10) to a network. This network is, for example, the Controller Area Network (CAN) of vehicle 1. Alternatively, the network may be, for example, a Local Area Network (LAN) or a Wide Area Network (WAN). The method by which the network interface 1060 connects to the network may be wireless or wired.

[0031] The computer 1000 (control device 10) is connected to various devices (not shown) via an input / output interface 1050 or a network interface 1060. "Various devices" here refers to at least the in-vehicle sensor 20, the external sensor 30, and the output source 40 (at least one of the speaker device, lighting device, and seat vibration device). Furthermore, "various devices" are not particularly limited to, but may include, for example, input devices such as operation buttons, keyboards, touch panels, and microphones, and output devices such as displays.

[0032] An example of the operation of the control device 10 will be explained below using Figure 3. Figure 3 is a flowchart illustrating the first operation of the control device 10 in this disclosure.

[0033] First, the setting unit 110 acquires the output of the in-vehicle sensor 20 installed in the vehicle 1 (step S102). Then, the setting unit 110 detects the internal state of the vehicle 1 based on the acquired output of the in-vehicle sensor 20 (step S104). Then, based on the detection result of the internal state of the vehicle 1, the setting unit 110 sets the rules regarding the output of notification information inside the vehicle 1 (step S106).

[0034] The notification output unit 120 sequentially acquires the output of the external sensor 30, and based on the output of the external sensor 30 and the rules set in the process of step S106, it performs the output processing of notification information regarding the surrounding conditions of the vehicle 1 (step S108).

[0035] In this embodiment, the setting unit 110 sets a rule for outputting notification information (information corresponding to the surrounding conditions of the vehicle) based on the output of the in-vehicle sensor 20 that detects the internal state of the vehicle 1. Here, as described above, the "rule" in this disclosure relates to at least one of the method of outputting the notification information and the output conditions for the notification information. That is, the setting unit 110 sets the method of outputting notification information within the vehicle 1 and the output conditions according to the internal state of the vehicle 1. Then, the notification output unit 120 executes the notification information output processing within the vehicle 1 based on the output of the external sensor 30 and the rule set by the setting unit 110. In this way, in this embodiment, the output of notification information within the vehicle 1 is controlled according to the internal state of the vehicle 1. This is expected to have the effect of suppressing a decrease in the comfort of the in-vehicle environment when providing notification information to a person inside the vehicle 1.

[0036] The operation of the control device 10 according to the first embodiment will be explained in more detail by giving some specific examples below.

[0037] <Specific Example 1 of the First Embodiment> As one specific example, we will explain the operation of the control device 10 when it detects an object (such as a person or another vehicle) around the vehicle 1 based on the output of the external sensor 30, and outputs a warning sound (including a warning voice) as notification information corresponding to the distance between the object and the vehicle 1.

[0038] In this case, first, in step S102, the setting unit 110 acquires the output of the in-vehicle sensor 20 via the input / output interface 1050 or the network interface 1060. For example, if the in-vehicle sensor 20 is an image sensor, the setting unit 110 acquires image data from the image sensor. Also, for example, if the in-vehicle sensor 20 is a weight sensor provided on each seat, the setting unit 110 acquires output data from the weight sensor that changes according to the force applied to each seat. Also, for example, if the in-vehicle sensor 20 is a seat belt wearing sensor, the setting unit 110 acquires output data from the seat belt wearing sensor indicating whether the seat belt of each seat is inserted into the buckle or not. acquisition do.

[0039] Next, in step S104, the setting unit 110 detects the conditions inside the vehicle 1, specifically whether or not there are passengers, based on the output of the in-vehicle sensor 20. Here, let's assume that the in-vehicle sensor 20 includes an image sensor. In this case, the setting unit 110 can determine whether or not there are people in each seat of the vehicle 1 excluding the driver's seat, i.e., whether or not there are passengers, based on the output (image data) from the image sensor. The setting unit 110 can use known image processing algorithms as a technique for detecting people from image data. For example, let's assume that the in-vehicle sensor 20 includes weight sensors provided at each seat. In this case, the setting unit 110 determines whether or not there are people in each seat of the vehicle 1 excluding the driver's seat, i.e., whether or not there are passengers, based on the output value of the weight sensor which changes according to the force applied to each seat. For example, let's assume that the in-vehicle sensor 20 includes a seat belt wearing sensor. In this case, the setting unit 110 determines whether or not there are people in each seat of the vehicle 1 excluding the driver's seat, i.e., whether or not there are passengers, based on the output data of the seat belt wearing sensor corresponding to each seat of the vehicle 1 excluding the driver's seat. The setting unit 110 can detect the presence or absence of passengers using the outputs of multiple types of in-vehicle sensors 20 (at least two of which are image sensors, weight sensors, and seat belt sensors). The setting unit 110 may also be configured to identify the seat position of any passengers. The setting unit 110 can identify the seat position of a passenger based on the detected location of a person in the image data output from the image sensor, or the location (seat position) of the weight sensor or seat belt sensor indicating that a person has been detected.

[0040] If no passenger is detected, that is, if only the driver is in vehicle 1, the setting unit 110 reads the default setting for outputting a warning sound (notification information) in step S106. The data indicating the default setting is pre-stored in a memory area accessible by the setting unit 110, such as memory 1030 or storage device 1040. The "default setting" is arbitrary. In this specific example, for example, the default intensity of the warning sound output from the speaker device, the default output state of the warning sound corresponding to the distance to the detected object (default output time and default output interval), and data indicating the default criteria for outputting the warning sound are pre-stored in the aforementioned memory area. The "default criteria" here can also be called the "default warning sensitivity (notification output sensitivity)" for the output of the external sensor 30. If no passenger is detected, the notification output unit 120 compares the output of the external sensor 30 with the default setting and outputs a warning in accordance with the default setting.

[0041] On the other hand, if a passenger is detected, in step S106, the setting unit 110 sets a provision regarding the output of a warning sound (notification information) that differs in at least part from the default provision. Then, in step S108, the notification output unit 120 compares the output of the external sensor 30 with the provision set by the setting unit 110 and outputs a warning in accordance with that provision.

[0042] For example, the setting unit 110 may be configured to change the output intensity (volume) of the warning sound. Specifically, the setting unit 110 sets a setting that reduces the output intensity (volume) of the warning sound to a level lower than the default output intensity. Here, the warning sound (notification information) corresponding to the surrounding conditions of the vehicle 1 is basically information directed at the driver and is not very relevant to passengers. By lowering the intensity (volume) of the warning sound output from the speaker device, the possibility of passengers feeling uncomfortable due to unnecessary information can be reduced.

[0043] As another example, the setting unit 110 may be configured to change the criteria for determining whether or not to output a warning sound (warning sensitivity to the external sensor 30). Specifically, if the default criterion for outputting a warning sound is "distance to the object is 1m", the setting unit 110 can set a new criterion, for example, "distance to the object is 70cm". In other words, the setting unit 110 changes the default criterion from outputting a warning sound when an object is within 1m of the vehicle 1 to setting a new criterion where no warning sound is output unless an object is within 70cm of the vehicle 1. This allows for notifications (warnings) based on the output of the external sensor 30. but This reduces the likelihood of the problem occurring. As mentioned above, the warning sounds (notification information) that correspond to the surrounding conditions of vehicle 1 are basically information directed at the driver and are not very relevant to passengers. By changing the criteria for determining whether or not to output a warning sound (warning sensitivity to the external sensor 30) as exemplified, the frequency of passengers being notified of information that is unnecessary for them is reduced, thus reducing the possibility of passengers feeling uncomfortable.

[0044] Furthermore, the setting unit 110 may be configured to set rules based on the seat position of a passenger if it can identify the passenger's seat position. For example, if a passenger is detected in the rear seat, the setting unit 110 sets rules that differ in some respects from the default rules described above. Children often sit in the rear seat. Also, children often fall asleep in the vehicle. In such cases, if the notification output unit 120 outputs a warning (notification information) according to the default rules, it may startle a sleeping child. Therefore, by executing the processing by the setting unit 110 as described above when a passenger is detected in the rear seat, the possibility of causing discomfort to the passenger (especially a child) can be reduced.

[0045] Furthermore, if the vehicle 1 is equipped with multiple types of output sources 40 (for example, a speaker device, a lighting device, and a seat vibration device), the setting unit 110 may switch the output source 40 that performs output processing based on the output of the in-vehicle sensor 20. For example, in this specific example, when a passenger is detected, the setting unit 110 may switch the output source 40 for notification information to an output device other than the speaker device (for example, a lighting device and / or seat vibration device provided for the driver of the vehicle 1). By doing so, unnecessary notification information for passengers is less likely to be perceived by passengers, thus reducing the possibility of passengers feeling uncomfortable.

[0046] <Specific example of the first embodiment, part 2> As one specific example, we will explain the operation of the control device 10 when it detects an object (such as a person or another vehicle) around the vehicle 1 based on the output of the external sensor 30, and outputs a warning sound (including a warning voice) and seat warning vibration as notification information corresponding to the distance between the object and the vehicle 1.

[0047] The operation of the setting unit 110 in step S102 and the operation of the setting unit 110 in step S104 are the same as in the first specific example described above.

[0048] If no passenger is detected, that is, if only the driver is in vehicle 1, the setting unit 110 reads out the default settings for the output of warning sounds and warning vibrations (notification information) in step S106. The data indicating the default settings is pre-stored in a memory area accessible by the setting unit 110, such as memory 1030 or storage device 1040. The "default settings" are arbitrary. In this specific example, for example, the default intensity of the warning sound output from the speaker device and the warning vibration output from the seat vibration device, the default output state of the warning sound and warning vibration corresponding to the distance to the detected object (default output time and default output interval), and data indicating the default criteria for outputting warning sounds and warning vibrations are pre-stored in the aforementioned memory area. The "default criteria" here can also be called the "default warning sensitivity (notification output sensitivity)" for the output of the external sensor 30. If no passenger is detected, the notification output unit 120 compares the output of the external sensor 30 with the default settings and outputs a warning in accordance with those default settings.

[0049] On the other hand, if a passenger is detected, in step S106, the setting unit 110 sets a set of rules for outputting a warning sound and warning vibration (notification information) that differs in at least part from the default rules. Then, in step S108, the notification output unit 120 compares the output of the external sensor 30 with the rules set by the setting unit 110 and outputs a warning in accordance with those rules.

[0050] For example, the setting unit 110 may be configured to change the output intensity (volume) of the warning sound. Specifically, the setting unit 110 sets a regulation that lowers the output intensity (volume) of the warning sound compared to the default output intensity. Here, the warning sound and warning vibration (notification information) that correspond to the surrounding conditions of the vehicle 1 are basically information directed at the driver and not very relevant to passengers. By lowering the intensity (volume) of the warning sound output from the speaker device, the possibility of passengers feeling uncomfortable due to unnecessary information can be reduced.

[0051] As another example, the setting unit 110 may be configured to change the output intensity (volume and vibration magnitude) of the warning sound and warning vibration, respectively. Specifically, the setting unit 110 sets a specification that lowers the output intensity (volume) of the warning sound compared to the default output intensity, and increases the output intensity (vibration magnitude) of the warning vibration compared to the default output intensity. Here, the warning sound and warning vibration (notification information) according to the surrounding conditions of the vehicle 1 are basically information directed at the driver and not very relevant to passengers. By lowering the intensity (volume) of the warning sound output from the speaker device, the possibility of passengers feeling uncomfortable due to unnecessary information can be reduced. Also, since the warning vibration is generated by a seat vibration device installed in the driver's seat, it is difficult for passengers to perceive. Therefore, even if the intensity of the warning vibration is increased, the possibility of passengers feeling uncomfortable is low. Furthermore, by increasing the intensity of the warning vibration, the driver becomes more perceptible to the seat vibration, thus reducing the possibility of the driver missing the warning if the warning sound is low.

[0052] As another example, the setting unit 110 may be configured to change the criteria (warning sensitivity to the external sensor 30) for determining whether or not to output a warning sound and warning vibration. For example, the setting unit 110 may lower the criteria (warning sensitivity) for the warning sound and maintain the criteria (warning sensitivity) for the warning vibration as is. Specifically, if the default criterion for outputting a warning sound is "distance to the object is 1m", the setting unit 110 may set a new criterion, for example, "distance to the object is 70cm". In other words, the setting unit 110 changes the default setting, which outputs a warning sound when an object is within 1m of the vehicle 1, to a setting where no warning sound is output unless an object is within 70cm of the vehicle 1. Alternatively, the setting unit 110 may set a setting where no warning sound is output at all, regardless of the distance from the vehicle 1 to the object. On the other hand, if the default criterion for outputting a warning vibration is "distance to the object is 1m", the setting unit 110 maintains that criterion as is. As a result, warning sounds based on the output of the external sensor 30 are less likely to occur, but warning vibrations based on the output of the external sensor 30 will occur as usual. As mentioned above, the warning sounds and vibrations (notification information) that correspond to the surrounding conditions of the vehicle 1 are basically information directed at the driver and are not very relevant to passengers. By changing the criteria for determining whether or not to output a warning sound (warning sensitivity to the external sensor 30) as exemplified, the frequency of passengers being notified of information that is unnecessary for them is reduced, thus reducing the possibility that passengers may feel uncomfortable. Also, by setting the criteria for determining whether or not to output a warning vibration (warning sensitivity to the external sensor 30) as exemplified, it is possible to reduce the possibility that passengers may feel uncomfortable while also reducing the possibility that the driver may miss a warning. In this case, the setting unit 110 may also set a provision that increases the output intensity for warning vibrations compared to the default intensity. By increasing the intensity of warning vibrations, the driver will be more likely to perceive the vibrations in the seat, thus further reducing the possibility that the driver may miss a warning if the warning sound is reduced.

[0053] Furthermore, the setting unit 110 may be configured to set rules based on the seat position of a passenger if it can identify the passenger's seat position. For example, if a passenger is detected in the rear seat, the setting unit 110 sets rules that differ in some respects from the default rules described above. Children often sit in the rear seat. Also, children often fall asleep in the vehicle. In such cases, if the notification output unit 120 outputs a warning (notification information) according to the default rules, it may startle a sleeping child. Therefore, by executing the processing by the setting unit 110 as described above when a passenger is detected in the rear seat, the possibility of causing discomfort to the passenger (especially a child) can be reduced.

[0054] Furthermore, if the vehicle 1 is equipped with multiple types of output sources 40 (for example, a speaker device, a lighting device, and a seat vibration device), the setting unit 110 may switch the output source 40 that performs output processing based on the output of the in-vehicle sensor 20. For example, in this specific example, when a passenger is detected, the setting unit 110 may switch the output source 40 for notification information to an output device other than the speaker device (for example, a lighting device and a seat vibration device provided for the driver of the vehicle 1). By doing so, unnecessary notification information for passengers is less likely to be perceived by passengers, thus reducing the possibility of passengers feeling uncomfortable.

[0055] <Specific example of the first embodiment, part 3> As one specific example, we will explain the operation of the control device 10 when it detects an object (such as a person or another vehicle) around the vehicle 1 based on the output of the external sensor 30, and outputs a warning sound (including a warning voice) and warning lighting as notification information corresponding to the distance between the object and the vehicle 1.

[0056] The operation of the setting unit 110 in step S102 and the operation of the setting unit 110 in step S104 are the same as in the first specific example described above.

[0057] If no passenger is detected, that is, if only the driver is in vehicle 1, the setting unit 110 reads out the default settings for the output of warning sounds and warning lights (notification information) in step S106. The data indicating the default settings is pre-stored in a storage area accessible to the setting unit 110, such as memory 1030 or storage device 1040. The "default settings" are arbitrary. In this specific example, for example, the default intensity of the warning sound output from the speaker device and the warning light output from the lighting device, the default output state of the warning sound and warning light corresponding to the distance to the detected object (default output time and default output interval), and data indicating the default criteria for outputting warning sounds and warning lights are pre-stored in the aforementioned storage area. The "default criteria" here can also be called the "default warning sensitivity (notification output sensitivity)" for the output of the external sensor 30. If no passenger is detected, the notification output unit 120 compares the output of the external sensor 30 with the default settings in step S108 and outputs a warning in accordance with the default settings.

[0058] On the other hand, if a passenger is detected, in step S106, the setting unit 110 sets a set of rules regarding the output of a warning sound and warning light (notification information) that differs in at least part from the default rules. Then, in step S108, the notification output unit 120 compares the output of the external sensor 30 with the rules set by the setting unit 110 and outputs a warning in accordance with those rules.

[0059] For example, the setting unit 110 may be configured to change the output intensity (volume) of the warning sound. Specifically, the setting unit 110 sets a regulation that lowers the output intensity (volume) of the warning sound compared to the default output intensity. Here, the warning sound and warning vibration (notification information) that correspond to the surrounding conditions of the vehicle 1 are basically information directed at the driver and not very relevant to passengers. By lowering the intensity (volume) of the warning sound output from the speaker device, the possibility of passengers feeling uncomfortable due to unnecessary information can be reduced.

[0060] As another example, the setting unit 110 may be configured to change the output intensity (brightness) of the warning lights. Specifically, the setting unit 110 sets a value that lowers the output intensity (brightness) of the warning lights compared to the default output intensity. Here, the warning sound and vibration (notification information) that correspond to the surrounding conditions of the vehicle 1 are basically information directed at the driver and not very relevant to passengers. By lowering the intensity (brightness) of the warning lights output from the warning lights, it becomes more difficult for passengers to perceive the warning lights, thus reducing the possibility of passengers feeling uncomfortable. Alternatively, the setting unit 110 may set a value that increases the output intensity (brightness) of the warning lights compared to the default output intensity. As a premise, the lighting device is set for the driver, so even if the intensity of the warning lights is increased, it is unlikely to be perceived by passengers. Therefore, even if the intensity of the warning lights is increased, the possibility of passengers feeling uncomfortable is low. In addition, increasing the intensity of the warning lights makes it easier for the driver to perceive the warning lights.

[0061] As another example, the setting unit 110 may be configured to change the output state of the warning lights. Here, "output state of warning lights" includes, for example, the contrast of the lights and the frequency of the color change of the lights. Specifically, the setting unit 110 may set a setting that reduces the contrast value of the warning lights to a value lower than the default contrast value. The setting unit 110 may also set a setting that reduces the frequency of the color change of the warning lights (i.e., a setting that causes the color of the warning lights to change gradually). This reduces the possibility that passengers may find the warning lights unpleasant. The setting unit 110 may also set a setting that increases the contrast and color change frequency of the warning lights to a value higher than the default contrast and change frequency. As a premise, the lighting device is set for the driver, so even if the contrast and color change frequency of the warning lights are increased, the impact on the passengers' vision is small. Therefore, even if the contrast and color change frequency of the warning lights are increased, the possibility of passengers finding them unpleasant is low. In addition, increasing the contrast and color change frequency of the warning lights makes the warning lights easier for the driver to perceive.

[0062] As another example, the setting unit 110 may change the criteria (warning sensitivity to the external sensor 30) for determining whether or not to output a warning sound and warning vibration. For example, the setting unit 110 may lower the criteria (warning sensitivity) for the warning sound and maintain the criteria (warning sensitivity) for the warning light as is. Specifically, if the default criterion for outputting a warning sound is "distance to the object is 1m", the setting unit 110 may set a new criterion, for example, "distance to the object is 70cm". In other words, the setting unit 110 changes the default setting, which outputs a warning sound when an object is within 1m of the vehicle 1, to a setting where no warning sound is output unless an object is within 70cm of the vehicle 1. Alternatively, the setting unit 110 may set a setting where no warning sound is output at all, regardless of the distance from the vehicle 1 to the object. On the other hand, if the default criterion for outputting a warning light is "distance to the object is 1m", the setting unit 110 maintains that criterion as is. As a result, warning sounds based on the output of the external sensor 30 are less likely to occur, but warning lights based on the output of the external sensor 30 will occur as usual. As mentioned above, the warning sounds and warning lights (notification information) that correspond to the surrounding conditions of the vehicle 1 are basically information directed at the driver and are not very relevant to passengers. By changing the criteria for determining whether or not to output a warning sound (warning sensitivity to the external sensor 30) as exemplified, the frequency of passengers being notified of information that is unnecessary for them is reduced, thus reducing the possibility that passengers may feel uncomfortable. Also, by setting the criteria for determining whether or not to output a warning light (warning sensitivity to the external sensor 30) as exemplified, it is possible to reduce the possibility that passengers may feel uncomfortable while also reducing the possibility that the driver may miss a warning. In this case, the setting unit 110 may also set a provision that increases the output intensity for the warning light from the default intensity. By increasing the intensity of the warning light, the driver will be more likely to perceive seat vibrations, thus further reducing the possibility that the driver may miss a warning if the warning sound is reduced.

[0063] Furthermore, the setting unit 110 may be configured to set rules based on the seat position of a passenger if it can identify the passenger's seat position. For example, if a passenger is detected in the rear seat, the setting unit 110 sets rules that differ in some respects from the default rules described above. Children often sit in the rear seat. Also, children often fall asleep in the vehicle. In such cases, if the notification output unit 120 outputs a warning (notification information) according to the default rules, it may startle a sleeping child. Therefore, by executing the processing by the setting unit 110 as described above when a passenger is detected in the rear seat, the possibility of causing discomfort to the passenger (especially a child) can be reduced.

[0064] Furthermore, if the vehicle 1 is equipped with multiple types of output sources 40 (for example, a speaker device, a lighting device, and a seat vibration device), the setting unit 110 may switch the output source 40 that performs output processing based on the output of the in-vehicle sensor 20. For example, in this specific example, when a passenger is detected, the setting unit 110 may switch the output source 40 for notification information to an output device other than the speaker device (for example, a lighting device and a seat vibration device provided for the driver of the vehicle 1). By doing so, unnecessary notification information for passengers is less likely to be perceived by passengers, thus reducing the possibility of passengers feeling uncomfortable.

[0065] It should be noted that the operation of the control device 10 is not limited to the three specific examples described above. For example, the control device 10 can perform operations similar to those described in the three specific examples above for each or various combinations of the multiple output sources 40 (speaker device, lighting device, seat vibration device, etc.) within the vehicle 1.

[0066] • Second embodiment Figure 4 is a block diagram illustrating a second functional configuration of the control device 10 according to this disclosure. The control device 10 is mounted on a vehicle 1 (an automobile in the example of Figure 4). The control device 10 may be a device built into the vehicle 1, or it may be a device that is later attached to the vehicle 1. The control device 10 illustrated in Figure 4 has a setting unit 110 and a notification output unit 120.

[0067] The setting unit 110 obtains detailed information corresponding to the location information of vehicle 1 from the map information. The setting unit 110 can obtain the location information of vehicle 1 using, for example, a Global Positioning System (GPS) module 60 or a known self-position estimation algorithm based on sensing results from the external sensor 30. Here, the "external sensor 30" includes any sensor capable of detecting the surrounding conditions of vehicle 1, as in the first embodiment described above. The setting unit 110 can then obtain detailed information regarding the location corresponding to the location information of vehicle 1 by referring to the map information stored in the map information storage unit 50. Based on the obtained detailed information, the setting unit 110 sets a rule for outputting notification information according to the surrounding conditions of vehicle 1.

[0068] The "regulations" relate to at least one of the method of outputting notification information and the conditions for outputting notification information. This is the same as in the first embodiment described above. Specific examples of the setting operation of the regulation by the setting unit 110 will be described later.

[0069] The notification output unit 120, similar to the first embodiment described above, performs notification information output processing within the vehicle 1 based on the output of the external sensor 30 provided in the vehicle 1 and the rules set by the setting unit 110. When the notification output unit 120 performs notification information output processing, it generates a control signal for the output source 40 based on the output of the external sensor 30 and transmits the control signal to the output source 40. The output source 40 then performs an operation in accordance with the control signal from the notification output unit 120.

[0070] Figure 5 is a diagram illustrating a second hardware configuration of a computer 1000 that implements the control device 10 according to this disclosure.

[0071] The computer 1000, similar to the first embodiment described above, includes a bus 1010, a processor 1020, a memory 1030, a storage device 1040, an input / output interface 1050, and a network interface 1060.

[0072] Bus 1010 is a data transmission path for the processor 1020, memory 1030, storage device 1040, input / output interface 1050, and network interface 1060 to send and receive data to and from each other. However, the method of connecting the processor 1020 and the other components to each other is not limited to bus connection.

[0073] The 1020 processor is a processor implemented in the Central Processing Unit (CPU) and Graphics Processing Unit (GPU), among others.

[0074] Memory 1030 is a type of main memory implemented using Random Access Memory (RAM), etc.

[0075] The storage device 1040 is an auxiliary storage device implemented as a removable media such as a Hard Disk Drive (HDD), Solid State Drive (SSD), or memory card, or as Read Only Memory (ROM). The storage device 1040 stores at least program modules that implement each of the functions of the control device 10 described above (setting unit 110 and notification output unit 120). In this embodiment, the storage device 1040 may also function as a map information storage unit 50 that stores map information.

[0076] The processor 1020 implements the functions corresponding to the program modules read from the storage device 1040 by loading them into the memory 1030 and executing them. For example, the processor 1020 implements the functions of the setting unit 110 as described in this disclosure by reading the program module corresponding to the setting unit 110 into the memory 1030 and executing it. Similarly, the processor 1020 implements the functions of the notification output unit 120 as described in this disclosure by reading the program module corresponding to the notification output unit 120 into the memory 1030 and executing it. This operation of the processor 1020 is common to all embodiments included in this disclosure.

[0077] The program module described above may be recorded on a recording medium other than the storage device 1040. The recording medium on which the program module is recorded includes any medium usable by a non-temporary, tangible computer 1000. The recording medium on which the program module is recorded may have program code embedded in it that can be read by the computer 1000 (processor 1020).

[0078] The input / output interface 1050 is an interface for connecting the computer 1000 (control device 10) with various input / output devices.

[0079] The network interface 1060 is an interface for connecting the computer 1000 (control unit 10) to a network. This network is, for example, the Controller Area Network (CAN) of vehicle 1. Alternatively, the network may be, for example, a Local Area Network (LAN) or a Wide Area Network (WAN). The method by which the network interface 1060 connects to the network may be wireless or wired.

[0080] The computer 1000 (control unit 10) is connected to various devices (not shown) via an input / output interface 1050 or a network interface 1060. These "various devices" include at least the external sensor 30, output source 40 (at least one of a speaker device, lighting device, and seat vibration device), and GPS module 60. While not particularly limited, these "various devices" also include, for example, input devices such as operation buttons, keyboards, touch panels, and microphones, and output devices such as displays. Furthermore, the computer 1000 (control unit 10) may be connected via the network interface 1060 to another computer 2000 that provides the functions of the map information storage unit 50.

[0081] An example of the operation of the control device 10 will be explained below using Figure 6. Figure 6 is a flowchart illustrating a second operation of the control device 10 in this disclosure.

[0082] First, the setting unit 110 acquires location information for vehicle 1 (step S202). Then, the setting unit 110 uses the acquired location information for vehicle 1 to obtain detailed information from the map information stored in the map information storage unit 50 (step S204). This detailed information is information related to the location corresponding to the location information for vehicle 1 acquired in step S202. Then, the setting unit 110 sets the rules for outputting notification information within vehicle 1 based on the detailed information acquired based on the location information for vehicle 1 (step S206).

[0083] The notification output unit 120 sequentially acquires the output of the external sensor 30, and based on the output of the external sensor 30 and the rules set in the process of step S206, it performs output processing of notification information regarding the surrounding conditions of the vehicle 1 (step S208).

[0084] In this embodiment, the setting unit 110 sets a rule for outputting notification information (information corresponding to the surrounding conditions of the vehicle) based on detailed information obtained from map information based on the location information of the vehicle 1. Here, as described above, the "rule" in this disclosure relates to at least one of the method of outputting the notification information and the conditions for outputting the notification information. Furthermore, the detailed information derived from the location information and map information of the vehicle 1 can be used as an indicator to determine whether the output processing of notification information to the driver is appropriate, as shown in the specific example described later. The notification output unit 120 then executes the output processing of notification information within the vehicle 1 based on the output of the external sensor 30 and the rule set by the setting unit 110. In this way, in this embodiment, the output of notification information within the vehicle 1 is controlled according to the driver based on detailed information derived from the location information and map information of the vehicle 1. As a result, it is expected that the effect of providing notification information to the driver of the vehicle 1 will be suppressed from causing discomfort to the driver.

[0085] The operation of the control device 10 according to the second embodiment will be explained in more detail by giving some specific examples below.

[0086] <Specific example 1 of the second embodiment> As one specific example, we will explain the operation of the control device 10 when it obtains "road characteristics corresponding to the location information of vehicle 1" as detailed information from map information, and outputs a warning sound (including a warning voice) as notification information corresponding to the distance between vehicle 1 and an object (person or other vehicle) located at vehicle 1 based on those road characteristics.

[0087] In this case, first, in step S202, the setting unit 110 acquires the location information of the vehicle 1 from the GPS module 60 connected via the input / output interface 1050 or the network interface 1060. Alternatively, the setting unit 110 may perform a self-position estimation process of the vehicle 1 based on the output of the external sensor 30 to estimate (acquire) the location information of the vehicle 1.

[0088] Next, in step S204, the setting unit 110 uses the location information of the vehicle 1 to refer to the map information stored in the map information storage unit 50. The setting unit 110 then obtains detailed information from the map information indicating the characteristics of the road at the location corresponding to the location information of the vehicle 1. Here, "road characteristics" include, for example, "school route" and "road width". Then, in step S206, the setting unit 110 sets rules for outputting notification information appropriate to the situation around the vehicle 1 based on the road characteristics obtained as detailed information. Then, in step S208, the notification output unit 120 compares the output of the external sensor 30 with the rules set by the setting unit 110 and outputs a warning in accordance with those rules.

[0089] For example, on a "school route," there is a lot of traffic of children, so it is preferable to increase the sensitivity of the warning. Therefore, when the characteristics of a road indicating a "school route" are acquired as detailed information, the setting unit 110 may be configured to set a higher standard than the normal standard (the "default" described in the first embodiment) for determining whether or not to output a warning sound (warning sensitivity to the external sensor 30). Specifically, if the default standard for outputting a warning sound is "distance to the object is 1.0m", the setting unit 110 may set a standard of, for example, "distance to the object is 1.5m". By extending the standard for outputting a warning sound by 0.5m from the default standard, notifications (warnings) based on the output of the external sensor 30 are increased. but This makes it more likely to occur. Areas near school routes are high-tension locations for drivers because of the frequent movement of children, whose movements are difficult to predict. By changing the criteria for determining whether or not to output a warning sound (warning sensitivity to the external sensor 30) as exemplified, drivers can be warned with a certain degree of leeway. but Notifications will be sent. This reduces the likelihood that the driver may feel uncomfortable due to the output of warnings (notification information) inside the vehicle.

[0090] As another example, "road width" can be said to be a factor that affects the driver's psychological state (peace of mind) when passing an oncoming vehicle. Therefore, when the setting unit 110 acquires road characteristics indicating "road width" as detailed information, it may be configured to set a provision regarding the criteria for determining whether or not to output a warning sound (warning sensitivity to the external sensor 30) based on the numerical value of "road width". For example, if the "road width" is narrow, the first consideration is that the driver will be required to perform more delicate vehicle operations when passing an oncoming vehicle. In other words, it can be said that it is preferable for the driver to have a warning sound output when they have peace of mind. According to this consideration, the setting unit 110 is preferably configured to set the criteria for determining whether or not to output a warning sound (warning sensitivity to the external sensor 30) higher than usual based on the "road width". In this case, the setting unit 110 operates as explained in the previous example. Furthermore, the second consideration is that when passing an oncoming vehicle, it is natural for two vehicles to be close together. In other words, it can be said that it is preferable for the driver not to output a warning sound more than necessary when passing another vehicle. According to this idea, the setting unit 110 is preferably configured to set the criterion for determining whether or not to output a warning sound (warning sensitivity to the external sensor 30) lower than the normal setting. Specifically, in this case, if the default criterion for outputting a warning sound is "distance to the object is 1.0m", the setting unit 110 sets a standard criterion such as "distance to the object is 60cm". By setting a standard for the output of warning sounds in this way, the output of warnings (notification information) that are bothersome to the driver is reduced. In other words, the possibility that the driver will feel uncomfortable due to the output of warnings (notification information) inside the vehicle 1 can be reduced.

[0091] Furthermore, when setting the rules regarding the output of notification information, the setting unit 110 may acquire further information indicating the characteristics of the vehicle 1. For example, information indicating the characteristics of the vehicle 1 may include information such as the length and width of the vehicle 1. The setting unit 110 then sets the rules regarding the output of notification information based on the information indicating the characteristics of the vehicle 1 and the information indicating the characteristics of the road. Here, according to the first idea described above, the setting unit 110 may be configured to set a higher criterion for determining whether or not to output a warning sound (warning sensitivity to the external sensor 30) as the numerical value of the width of the vehicle 1 increases. Also, according to the second idea described above, the setting unit 110 may be configured to set a lower criterion for determining whether or not to output a warning sound (warning sensitivity to the external sensor 30) as the numerical value of the width of the vehicle 1 increases.

[0092] As another example, the setting unit 110 may acquire further information regarding the characteristics of the oncoming vehicle when setting the rules for outputting notification information. In this case, the setting unit 110 can acquire information such as the width and overall length of the oncoming vehicle by, for example, analyzing an image of the oncoming vehicle taken by a camera (not shown), or by vehicle-to-vehicle communication with the oncoming vehicle. The setting unit 110 then uses the acquired characteristics of the oncoming vehicle to set the rules for outputting notification information. Here, according to the first idea described above, the setting unit 110 may be configured to set a higher criterion for determining whether or not to output a warning sound (warning sensitivity to the external sensor 30) the larger the numerical value of the width of the oncoming vehicle. Also, according to the second idea described above, the setting unit 110 may be configured to set a lower criterion for determining whether or not to output a warning sound (warning sensitivity to the external sensor 30) the larger the numerical value of the width of the oncoming vehicle.

[0093] As another example, the setting unit 110 may acquire further data indicating the driver's driving skills when setting the rules regarding the output of notification information. In this case, the data indicating the driver's driving skills is stored in a database (not shown) connected via the network interface 1060. The setting unit 110 can acquire data indicating the driver's driving skills of vehicle 1 by, for example, analyzing images generated by a camera capable of taking pictures inside vehicle 1 to identify the driver, and accessing the database based on the identification result. One consideration regarding driving skills is that drivers with higher driving skills can pass oncoming vehicles with more margin. In this case, a notification output warning when passing another vehicle may cause discomfort to the driver. According to this consideration, the setting unit 110 is preferably configured to set the criterion for determining whether or not to output a warning sound (warning sensitivity to the external sensor 30) lower the higher the driver's driving skills. Another consideration regarding driving skills is that drivers with higher driving skills are more likely to become overconfident while driving. In this case, it is preferable for the driver to be more likely to output a warning when passing another vehicle. According to this idea, the setting unit 110 is preferably configured to set a higher criterion (warning sensitivity to the external sensor 30) for determining whether or not to output a warning sound, as the driver's driving skills are higher.

[0094] In the previous example, the setting unit 110 may also be configured to acquire further data regarding the driver of the oncoming vehicle and to set the rules for outputting notification information. In this case, the setting unit 110 can identify the driver of the oncoming vehicle by analyzing images taken by a camera capable of taking pictures of the outside of vehicle 1, and by accessing the database mentioned above based on the identification result, it can acquire data indicating the driving skills of the driver of vehicle 1. Alternatively, the setting unit 110 may acquire information indicating the driver of the oncoming vehicle held by the oncoming vehicle through vehicle-to-vehicle communication with the oncoming vehicle. In this case, the setting unit 110 may acquire data indicating the driving skills of the driver of the oncoming vehicle by accessing the database mentioned above based on the information acquired from the oncoming vehicle through vehicle-to-vehicle communication. Here, according to the first idea shown in the previous example, the setting unit 110 may be configured to set the criterion for determining whether or not to output a warning sound (warning sensitivity to the external sensor 30) lower the higher the driving skills of the driver of the oncoming vehicle. Furthermore, according to the second idea shown in the previous example, the setting unit 110 may be configured to set a higher criterion (warning sensitivity to the external sensor 30) for determining whether or not to output a warning sound, the higher the driving skill of the driver of the oncoming vehicle.

[0095] The setting unit 110 acquires the location information and map information of the vehicle 1. It will be done The system may be configured to set regulations regarding the content of warnings (notification information) based on the characteristics of the road. For example, if the road characteristics acquired based on the location information of vehicle 1 indicate a "school route," the setting unit 110 sets a regulation to use stricter wording for the voice content of the warning (for example, "Right rear, contact will occur in 30 cm"). In this way, more thorough warnings are output in environments where drivers should pay more attention. Such warnings are beneficial to drivers and do not cause them discomfort. to The likelihood of that happening is low.

[0096] Furthermore, the setting unit 110 may be configured to set provisions regarding the warning (notification information) output source 40 based on information about the equipment obtained from the location information and map information of the vehicle 1. For example, if the road characteristics obtained based on the location information of the vehicle 1 indicate a "school route," the setting unit 110 may be configured to set provisions for using a lighting device (warning light output source) and / or a seat vibration device (warning vibration output source) in addition to a speaker device (warning sound output source). In this way, more thorough warnings are output in environments where the driver should pay more attention. Such warnings are beneficial to the driver and do not cause discomfort to the driver. to The likelihood of that happening is low.

[0097] <Specific example of the second embodiment, part 2> As one specific example, we will explain the operation of the control device 10 when it obtains "information regarding equipment corresponding to the location information of vehicle 1" as detailed information from map information, and outputs a warning sound (including a warning voice) as notification information corresponding to the distance between vehicle 1 and an object (person or other vehicle) located at vehicle 1 based on the information regarding said equipment.

[0098] The operation of the setting unit 110 in step S202 is the same as in the first specific example described above.

[0099] In step S204, the setting unit 110 uses the location information of the vehicle 1 to refer to the map information stored in the map information storage unit 50. The setting unit 110 then obtains detailed information from the map information regarding facilities located at the location corresponding to the location information of the vehicle 1. Here, "information regarding facilities" includes information indicating the characteristics of facilities, such as "home" or "store parking lot." Then, in step S206, the setting unit 110 sets rules for outputting notification information in the vicinity of the vehicle 1 according to the situation, based on the facility information obtained as detailed information. Then, in step S208, the notification output unit 120 compares the output of the external sensor 30 with the rules set by the setting unit 110 and outputs a warning in accordance with those rules.

[0100] For example, near the driver's "home," excessive warnings may be offensive because the driver is accustomed to driving in that area. Therefore, when the information of the equipment acquired based on the location information of vehicle 1 indicates "home," the criterion for determining whether or not to output a warning sound (warning sensitivity to the external sensor 30) may be configured to be set lower than the normal setting (the "default" described in the first embodiment). As another example, near a "store parking lot," there are many vehicles owned by other people, making it a place where drivers need to be more careful. Therefore, when the information of the equipment acquired based on the location information of vehicle 1 indicates "store parking lot," the criterion for determining whether or not to output a warning sound (warning sensitivity to the external sensor 30) may be configured to be set higher than the normal setting (the "default" described in the first embodiment). In this way, a warning appropriate to the driver can be output.

[0101] The setting unit 110 may be configured to set rules regarding the content of warnings (notification information) based on information about the equipment obtained from the location information and map information of the vehicle 1. For example, if the information about the equipment obtained based on the location information of the vehicle 1 indicates "home," the setting unit 110 sets a rule to make the voice content of the warning ambiguous (for example, "Right rear, you will make contact very soon."). Also, for example, if the information about the equipment obtained based on the location information of the vehicle 1 indicates "store parking lot," the setting unit 110 sets a rule to make the voice content of the warning more precise (for example, "Right rear, you will make contact in 30 cm."). In this way, more thorough warnings are output in places where the driver is not very familiar with driving and is likely to feel anxious. This makes it possible to avoid making the driver uncomfortable by outputting warnings (notification information) inside the vehicle 1. to It can be prevented from happening.

[0102] Furthermore, the setting unit 110 may be configured to set a provision regarding the output source 40 of the warning (notification information) based on information about the equipment obtained from the location information and map information of the vehicle 1. For example, the setting unit 110 may set a provision not to select the output source 40 (not to output a warning sound) when the information about the equipment obtained based on the location information of the vehicle 1 indicates "home". In this way, warnings will not be generated in places where the driver frequently drives and is unlikely to feel anxious even without a warning. This will prevent the driver from feeling uncomfortable due to the output of warning (notification information) inside the vehicle 1. to It can be prevented from happening.

[0103] <Specific example of the second embodiment, part 3> As one specific example, we will explain the operation of the control device 10 when it obtains "accident occurrence history corresponding to the location information of vehicle 1" as detailed information from map information, and outputs a warning sound (including a warning voice) as notification information corresponding to the distance between vehicle 1 and an object (person or other vehicle) located at vehicle 1 based on the accident occurrence history.

[0104] The operation of the setting unit 110 in step S202 is the same as in the first specific example described above.

[0105] In step S204, the setting unit 110 uses the location information of the vehicle 1 to refer to the map information stored in the map information storage unit 50. The setting unit 110 then obtains information from the map information indicating the accident history at the location corresponding to the location information of the vehicle 1 as detailed information. In this specific example, the map information includes information on the accident history at each location. Then, in step S206, the setting unit 110 sets rules regarding the output of situation-appropriate notification information around the vehicle 1 based on the information indicating the accident history obtained as detailed information. For example, the setting unit 110 aggregates the accident history over a certain period (for example, the most recent six months) and calculates an index related to the frequency of accidents. Then, the setting unit 110 sets rules regarding the output of situation-appropriate notification information around the vehicle 1 based on the calculated index. For example, the setting unit 110 sets a higher criterion for determining whether or not to output a warning sound (warning sensitivity to the external sensor 30) the higher the accident frequency indicated by the calculated index. Then, in step S208, the notification output unit 120 compares the output of the external sensor 30 with the regulations set by the setting unit 110 and outputs a warning in accordance with those regulations. This makes it possible to provide appropriate warnings in places where accidents are likely to occur.

[0106] The setting unit 110 may also be configured to set regulations regarding the content of the warning (notification information) output. For example, if the frequency of accidents indicated by the indicator is high, the setting unit 110 can set regulations to make the voice content of the warning more precise (for example, "Right rear, contact will occur in 30 cm behind"). In this way, more detailed warnings are output in places where accidents are likely to occur. Such notifications are also beneficial to the driver and are unlikely to cause discomfort to the driver.

[0107] Furthermore, the setting unit 110 may be configured to set provisions regarding the output source 40 for warnings (notification information). For example, if the frequency of accidents indicated by the indicator is high, it may be configured to set provisions for using a lighting device (output source for warning lights) and / or a seat vibration device (output source for warning vibrations) in addition to a speaker device (output source for warning sounds). In this way, more thorough warnings are output in high-risk locations. Such notifications are also beneficial to the driver and are unlikely to cause discomfort to the driver.

[0108] <Specific example of the second embodiment, part 4> As one specific example, we will explain the operation of the control device 10 when it obtains "traffic volume corresponding to the location information of vehicle 1" as detailed information from map information, and outputs a warning sound (including a warning voice) as notification information corresponding to the distance between vehicle 1 and an object (person or other vehicle) located at vehicle 1 based on said traffic volume information.

[0109] The operation of the setting unit 110 in step S202 is the same as in the first specific example described above.

[0110] In step S204, the setting unit 110 uses the location information of the vehicle 1 to refer to the map information stored in the map information storage unit 50. The setting unit 110 then obtains information indicating the traffic volume at the location corresponding to the location information of the vehicle 1 as detailed information from the map information. In this specific example, the map information includes information on the traffic volume at each location. Then, in step S206, the setting unit 110 sets rules regarding the output of situation-appropriate notification information around the vehicle 1 based on the traffic volume information obtained as detailed information. For example, the setting unit 110 calculates the average traffic volume over a certain period (for example, the most recent six months) as an indicator. Then, the setting unit 110 sets rules regarding the output of situation-appropriate notification information around the vehicle 1 based on the calculated indicator. For example, the setting unit 110 sets a higher criterion (warning sensitivity to the external sensor 30) for determining whether or not to output a warning sound, the higher the average traffic volume indicated by the calculated indicator. Then, in step S208, the notification output unit 120 compares the output of the external sensor 30 with the regulations set by the setting unit 110 and outputs a warning in accordance with those regulations. This makes it possible to provide appropriate warnings in places with heavy traffic, i.e., places where the driver should pay more attention.

[0111] The setting unit 110 may also be configured to set regulations regarding the content of the warning (notification information) output. For example, if the average traffic volume indicated by the indicator is high, the setting unit 110 can set regulations to make the voice content of the warning more precise (for example, "Contact is 30 cm behind you, to the right front"). In this way, more detailed warnings are output in places where the driver should pay more attention. Such notifications are also beneficial to the driver and are unlikely to cause discomfort to the driver.

[0112] The setting unit 110 may also be configured to set provisions regarding the output source 40 for warnings (notification information). For example, if the average traffic volume indicated by the indicator is high, it may be configured to set provisions for using a lighting device (output source for warning lights) and / or a seat vibration device (output source for warning vibrations) in addition to a speaker device (output source for warning sounds). In this way, more thorough warnings are output in places where the driver should pay more attention. Such notifications are also beneficial to the driver and are unlikely to cause discomfort to the driver.

[0113] The embodiments described above with reference to the drawings are examples of the present invention, and various other configurations can also be adopted.

[0114] For example, the three specific examples of the first embodiment illustrate a case in which warning information is output based on the surrounding conditions of the vehicle 1, but the operation of the control device 10 according to this disclosure is not limited to this. For example, the control device 10 may perform the operation described above in the first embodiment when outputting advertising information according to the identification result of facilities (e.g., stores) around the vehicle 1. For example, the control device 10 identifies the type and name of stores located around the vehicle 1 (e.g., in the direction of travel) based on the output of the external sensor 30 (e.g., an image sensor). The control device 10 then acquires advertising information linked to the identification result of the type and name of stores via an advertising server (not shown). The control device 10 can communicate with an advertising server on the internet by connecting to the internet via, for example, the network interface 1060. When outputting advertising information acquired from the advertising server, the control device 10 performs the operation shown in the specific examples above. This makes it possible to suppress a decrease in the comfort of the in-vehicle environment even when advertising information is output inside the vehicle 1.

[0115] Furthermore, if the driver's gaze can be detected using a camera or the like installed inside the vehicle, the setting unit 110 may further use the detection result of the driver's gaze to set the rules. For example, in the second embodiment, suppose the setting unit 110 sets a rule based on detailed information obtained from the location information and map information of the vehicle 1. In this case, the setting unit 110 corrects the set rule using the detection result of the driver's gaze. Specifically, the setting unit 110 uses the detection result of the driver's gaze to identify directions that the driver cannot see. Then, the setting unit 110 corrects the rule to increase the warning sensitivity for the identified directions. In this way, it becomes possible to output warnings that are tailored to the driver's situation.

[0116] In the second embodiment, the setting unit 110 may further use a sensor (external sensor 30) that detects the situation outside the vehicle to set the rules. For example, suppose the setting unit 110 sets a rule based on detailed information obtained from the location information and map information of the vehicle 1. At this time, the setting unit 110 further identifies the number of people in the surroundings based on the output of the external sensor 30. In this case, the setting unit 110 may further identify the attributes of the people (for example, children) from the sensing results. Then, the setting unit 110 corrects the set rule based on the identification results of the number of people and the attributes of the people. Specifically, if a predetermined number of children or more are detected in a parking lot, for example, the rule is corrected to increase the warning sensitivity. In this way, it becomes possible to output a warning (notification information) that is appropriate to the surrounding situation.

[0117] Furthermore, the control device 10 acquires driver feedback information regarding the specifications for outputting notification information, and learns appropriate setting values ​​for the driver based on said feedback information. NohIt may further include the following. For example, the driver inputs positive information indicating that the notification information output regulations are appropriate, or negative information indicating that the notification information output is inappropriate (e.g., the notification is too noisy), using an input device connected via the input / output interface 1050 or network interface 1060. The setting unit 110 acquires the input information as feedback information and constructs a method (algorithm) for setting regulations that is suitable for the driver. For example, suppose the setting unit 110 sets a regulation to output voice notification information using precise language (e.g., "Right rear, contact in 30cm"), and the notification output unit 120 performs notification processing in accordance with that regulation. Then, suppose the driver inputs negative feedback information in response to the notification processing in accordance with that regulation. In this case, the setting unit 110 adjusts its algorithm to more actively adopt a regulation that outputs voice notification information using ambiguous language (e.g., "Right rear, contact in a little while"). This makes it possible to output notification information that is tailored to the driver.

[0118] Examples of reference formats are provided below. 1. A setting unit sets a rule for outputting notification information according to the surrounding conditions of the vehicle based on the output of an in-vehicle sensor that detects the internal state of the vehicle, A notification output unit that performs the output processing of the notification information based on the output of an external sensor that detects the conditions around the vehicle and the aforementioned regulations, A control device equipped with the following features. 2. The aforementioned setting unit is, Based on the output of the in-vehicle sensor, the presence or absence of a passenger is detected. Depending on whether or not there is a passenger, the above provision shall be modified. The control device described in 1. 3. The setting unit modifies the provisions based on the seat position of the passenger. The control device described in 2. 4. The notification output unit performs the output processing using at least one of sound, light, and seat vibration as the notification information. A control device as described in any one of items 1 to 3. 5. The setting unit sets a specification regarding the output intensity or output state of at least one of the sound, light, and seat vibrations according to the output of the in-vehicle sensor. The control device described in 4. 6. The setting unit sets the criteria for determining whether or not to output the notification information according to the output of the in-vehicle sensor. The control device described in 4. 7. The notification output unit has multiple output sources, The setting unit switches the output source that performs the output processing based on the output of the in-vehicle sensor. A control device as described in any one of items 1 to 3. 8. Computers Based on the output of an in-vehicle sensor that detects the internal state of the vehicle, a provision is set to output notification information corresponding to the surrounding conditions of the vehicle. Based on the output of the external sensor that detects the surrounding conditions of the vehicle and the aforementioned regulations, the process for outputting the notification information is executed. A control method that includes the following. 9. The aforementioned computer, Based on the output of the in-vehicle sensor, the presence or absence of a passenger is detected. Depending on whether or not there is a passenger, the above provision shall be modified. The control method described in 8., including the above. 10. The aforementioned computer, The provisions are modified based on the seating position of the aforementioned passenger. The control method described in 9, including the above. 11. The aforementioned computer, The output processing is performed using at least one of sound, light, and seat vibration as the notification information. A control method described in any one of 8 to 10, including the above. 12. The aforementioned computer, The definitions relating to the output intensity or output state of at least one of the aforementioned sound, light, and seat vibrations are set according to the output of the in-vehicle sensor. The control method described in 11, which includes the following. 13. The aforementioned computer, The criteria for determining whether or not the aforementioned notification information needs to be output are set according to the output of the in-vehicle sensor. The control method described in 11, which includes the following. 14. There are multiple output sources, The aforementioned computer, Based on the output of the in-vehicle sensor, the output source that performs the output processing is switched. A control method described in any one of items 8 through 13. 15. On the computer, A setting procedure for setting a rule to output notification information corresponding to the surrounding conditions of the vehicle based on the output of an in-vehicle sensor that detects the internal state of the vehicle. A notification output procedure that performs the output processing of the notification information based on the output of an external sensor that detects the surrounding conditions of the vehicle and the aforementioned regulations. A program to execute. 16. The above setup procedure is: Based on the output of the in-vehicle sensor, the presence or absence of a passenger is detected. Depending on whether or not there is a passenger, the above provision shall be modified. The program described in section 15, including the following. 17. The setting procedure modifies the provisions based on the seat position of the passenger. The program described in section 16, including the above. 18. The notification output procedure performs the output processing using at least one of sound, light, and seat vibration as the notification information. A program that includes any one of items 15 to 17. 19. The setting procedure involves setting a specification for at least one output intensity or output state of sound, light, and seat vibration according to the output of the in-vehicle sensor. The program described in section 18, including the following. 20. The above setting procedure sets the criteria for determining whether or not to output the notification information according to the output of the in-vehicle sensor. The program described in section 18, including the following. twenty one. There are multiple output sources, The setting procedure involves switching the output source that performs the output processing based on the output of the in-vehicle sensor. A program that includes any one of items 15 to 20.

[0119] This application claims priority based on Japanese Patent Application No. 2023-085770, filed on 24 May 2023, and incorporates all of its disclosures herein. [Explanation of Symbols]

[0120] 1 vehicle 10 Control device 110 Setting section 120 Notification output section 1000 computers 1010 Bus 1020 Processor 1030 memory 1040 Storage Devices 1050 Input / Output Interface 1060 Network Interfaces 20 In-car sensors 30 External vehicle sensors 40 Output sources 50 Map Information Storage Unit 60 GPS modules

Claims

1. A setting unit sets a rule for outputting notification information according to the surrounding conditions of the vehicle based on the output of an in-vehicle sensor that detects the internal state of the vehicle, A notification output unit that performs the output processing of the notification information based on the output of an external sensor that detects the conditions around the vehicle and the aforementioned regulations, Equipped with, The vehicle is provided with at least two types of output sources, including a speaker device that outputs sound and a non-sound output device that outputs light or seat vibrations to the driver of the vehicle. The setting unit switches the output source of the notification information from the speaker device to the non-sound output device based on the output of the in-vehicle sensor. Control device.

2. The aforementioned setting unit is, Based on the output of the in-vehicle sensor, the presence or absence of a passenger is detected. Depending on whether or not there is a passenger, the above provision shall be modified. The control device according to claim 1.

3. The setting unit modifies the provisions based on the seat position of the passenger. The control device according to claim 2.

4. The notification output unit performs the output processing using at least one of sound, light, and seat vibration as the notification information. The control device according to any one of claims 1 to 3.

5. The setting unit sets a specification regarding the output intensity or output state of at least one of the sound, light, and seat vibrations according to the output of the in-vehicle sensor. The control device according to claim 4.

6. The setting unit sets the criteria for determining whether or not to output the notification information according to the output of the in-vehicle sensor. The control device according to claim 4.

7. Computers Based on the output of an in-vehicle sensor that detects the internal state of the vehicle, a provision is set to output notification information corresponding to the surrounding conditions of the vehicle. Based on the output of the external sensor that detects the surrounding conditions of the vehicle and the aforementioned regulations, the process for outputting the notification information is executed. This includes, The vehicle is provided with at least two types of output sources, including a speaker device that outputs sound and a non-sound output device that outputs light or seat vibrations to the driver of the vehicle. The computer includes switching the output source of the notification information from the speaker device to the non-sound output device based on the output of the in-vehicle sensor, Control method.

8. On the computer, A setting procedure for setting a rule to output notification information corresponding to the surrounding conditions of the vehicle based on the output of an in-vehicle sensor that detects the internal state of the vehicle. A notification output procedure that performs the output processing of the notification information based on the output of an external sensor that detects the surrounding conditions of the vehicle and the aforementioned regulations. Perform an action that includes this, The vehicle is provided with at least two types of output sources, including a speaker device that outputs sound and a non-sound output device that outputs light or seat vibrations to the driver of the vehicle. The operation described above includes, in the notification output procedure, switching the output source of the notification information from the speaker device to the non-sound output device based on the output of the in-vehicle sensor. program.

Citation Information

Patent Citations

  • Drive assist system

    JP2006214945A

  • Navigation system for car

    JP2006220435A

  • Notification device for vehicle and notification method

    JP2008065551A

  • Information provision device, information provision method, program and information provision system

    JP2010033549A

  • Communication apparatus, information notification method, information notification program and recording medium

    JP2013196411A