In-vehicle device and method for controlling in-vehicle device
Patent Information
- Application Number
- JP2021087205
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-05-24
- Publication Date
- 2025-04-25
- Estimated Expiration
- 2041-05-24
AI Technical Summary
The challenge of effectively controlling the output of external sounds in a vehicle environment, where improved sound insulation makes it difficult to hear important external sounds like a child's voice or an approaching vehicle, while unnecessary or undesirable sounds may also be output.
An in-vehicle device that uses microphones and cameras to collect external sounds and images, combined with GPS and user terminal data, to determine the location and conditions of potential sound output, controlling the output through a processor based on meta information and policies to ensure relevant sounds are heard while minimizing noise.
The system appropriately controls the output of external sounds in the vehicle, ensuring important sounds are heard while avoiding unnecessary noise, enhancing safety and user experience.
Smart Images
Figure 00000010_0000 
Figure 00000011_0000 
Figure 00000012_0000
Abstract
Description
Technical Field
[0001] The present invention generally relates to the control of outputting outside vehicle sounds into the vehicle interior.
Background Art
[0002] With the improvement of the sound insulation performance of vehicles (for example, passenger cars), outside vehicle sounds are becoming less audible inside the vehicle. Outside vehicle sounds include sounds related to situations where attention is required for driving, such as the voices of children and the approach of speeding vehicles.
[0003] Therefore, a technology for outputting outside vehicle sounds collected by a microphone provided in a vehicle into the vehicle interior is known. As this type of technology, for example, the technology disclosed in Patent Document 1 is known. According to the technology disclosed in Patent Document 1, even when listening to music inside the vehicle, dangerous sounds as outside vehicle sounds can be optimally heard.
Prior Art Documents
Patent Documents
[0004]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0005] If outside vehicle sounds are always output into the vehicle interior, when a dangerous sound is collected, that dangerous sound is immediately output into the vehicle interior. However, the state of always outputting outside vehicle sounds into the vehicle interior is equivalent to the vehicle having no sound insulation performance.
[0006] On the other hand, when the output of outside vehicle sounds into the vehicle interior is appropriately controlled, it may happen that outside vehicle sounds are not output into the vehicle interior even in a situation where it is desirable to output them, or that outside vehicle sounds are output into the vehicle interior even in a situation where it is not desirable to output them. [Means for solving the problem]
[0007] An in-vehicle device, which is communicatively connected to a microphone that inputs external vehicle sounds and a speaker that outputs sound inside the vehicle, identifies a location that falls within a predetermined range from the vehicle's current location, which is determined based on GPS (Global Positioning System) signals, using location management information that includes information representing each of one or more locations and metadata for that location. The in-vehicle device controls whether or not to output external vehicle sounds input via the microphone through the speaker, based on whether or not the metadata for that location meets the conditions for external vehicle sound output or non-external vehicle sound output. [Effects of the Invention]
[0008] According to the present invention, whether or not external sounds are output into the vehicle cabin is appropriately controlled. [Brief explanation of the drawing]
[0009] [Figure 1] This shows an example of the overall system configuration related to one embodiment of the present invention. [Figure 2] This shows an example of the functional configuration of an in-vehicle device. [Figure 3] An example of the monitoring unit's processing flow is shown below. [Figure 4] An example of the processing flow of the output control unit is shown. [Modes for carrying out the invention]
[0010] In the following explanation, "interface device" may refer to one or more interface devices (typically communication interface devices).
[0011] Furthermore, in the following explanation, "memory" refers to one or more memory devices, which may be volatile memory devices or non-volatile memory devices.
[0012] Furthermore, in the following explanation, "persistent storage device" can refer to one or more non-volatile storage devices (e.g., HDD (Hard Disk Drive), SSD (Solid State Drive)).
[0013] Furthermore, in the following explanation, "storage device" may refer to at least memory, including both memory and persistent storage.
[0014] Furthermore, in the following description, the "control device" may include one or more processor devices. At least one processor device is typically a microprocessor device such as a CPU (Central Processing Unit), but may also be other types of processor devices such as a GPU (Graphics Processing Unit). The control device may also include hardware circuits (e.g., FPGA (Field-Programmable Gate Array), CPLD (Complex Programmable Logic Device), or ASIC (Application Specific Integrated Circuit)) that perform some or all of the processing.
[0015] Furthermore, in the following explanation, functions may be described using the expression "yyy section," but a function may be implemented by one or more computer programs executed by a processor, by one or more hardware circuits (e.g., FPGA or ASIC), or by a combination thereof. A process described with a function as the subject may also be a process performed by a processor or a device having such a processor. Multiple functions may be combined into one function, or one function may be divided into multiple functions.
[0016] Furthermore, in the following explanation, when describing similar elements without distinction, a common reference code will be used, and when describing similar elements with distinction, a reference code will be used. For example, when describing speakers without particular distinction, "speaker 103" will be written, while when describing individual speakers with distinction, they may be written as "speaker 103FR" or "speaker 103RR".
[0017] Figure 1 shows an example of the overall system configuration according to one embodiment of the present invention.
[0018] The vehicle 150 is equipped with multiple (or one) microphones 101, multiple (or one) cameras 102, and multiple (or one) speakers 103, and is also equipped with an in-vehicle device 100 that is communicatively connected (for example, by wired or wireless connection) to the microphones 101, cameras 102, and speakers 103.
[0019] Each of the multiple microphones 101 is equipped to receive external sounds from the vehicle 150. Examples of the multiple microphones 101 include a left front microphone 101FL, a right front microphone 101FR, a left center microphone 101CL, a right center microphone 101CR, a left rear microphone 101RL, and a right rear microphone 101RR. These microphones 101 collect external sounds and output analog signals as external sound signals. The analog signals output by each microphone 101 are input to the in-vehicle device 100 as digital signals via an A / D converter (not shown). The in-vehicle device 100 outputs a digital signal based on these digital signals. The output digital signal is output as an analog signal via a D / A converter (not shown) and output as external sound from at least one speaker 103. The aforementioned A / D converter and D / A converter may be located inside or outside the in-vehicle device 100.
[0020] Each of the plurality of cameras 102 is provided for photographing the interior or exterior of the vehicle. As the plurality of cameras 102, for example, there are a front camera 102F, a left center camera 102CL, a right center camera 102CR, and a rear camera 102R. Images (moving images or still images) photographed by these cameras 102 are input into the in-vehicle device 100. The in-vehicle device 100 analyzes the input images and, based on the results of the analysis, performs at least one of whether to output an external sound and selection of a speaker 103 that outputs an external sound.
[0021] Each of the plurality of speakers 103 is provided for outputting sound inside the vehicle 150. As the plurality of speakers 103, for example, there are a left front speaker 103FL, a right front speaker 103FR, a left rear speaker 103RL, and a right rear speaker 103RR. These speakers 103 output sound according to an analog signal output from the in-vehicle device 100.
[0022] FIG. 2 shows an example of the functional configuration of the in-vehicle device 100.
[0023] The in-vehicle device 100 includes an I / F device (interface device) 201, a UI (User Interface) device 20, a storage device 203, and a control device 204.
[0024] The microphone 101, the camera 102, the speaker 103, the UI device 202, the GPS (Global Positioning System) sensor 250, and the user terminal 180 are communicably connected (for example, by wire or wirelessly) to the I / F device 201. Through the I / F device 201, it may be a device capable of communicating via a wide area network such as the Internet or a WAN (Wide Area Network), or it may be a device incapable of such communication. In the latter case, the I / F device 201 may be communicable with a device capable of communicating via a wide area network, such as the user terminal 180.
[0025] The GPS sensor 250 may be located inside or outside the in-vehicle device 100. Based on GPS signals, the GPS sensor 250 determines the current location of the vehicle 150 in which it is installed. Information representing the determined local location is input to the in-vehicle device 100 via the I / F device 201 and stored in the storage device 203.
[0026] The user terminal 180 is a user information processing terminal located inside the vehicle 150, and is, for example, a smartphone (or a tablet or laptop computer). The user terminal 180 may have a target application that recognizes information representing an evaluation and information representing the location associated with that evaluation for each of one or more evaluations, each of which is associated with location information. The target application may be, for example, a map application or an SNS (Social Networking Service) application. The information representing the evaluation may be information representing an evaluation of the location to which the evaluation is associated (for example, in particular an evaluation related to external noise at that location). Note that, for example, the user terminal 180 may not be necessary.
[0027] The UI device 202 is an input / output device, and may be, for example, a touch panel type display device. The UI device 202 may also include warning lights. The UI device 202 may also include buttons such as a power button. The UI device 202 may also include a microphone for voice input and a speaker for sound output. The speaker in the UI device 202 may be all or some of the speakers that output external sounds.
[0028] The storage device 203 stores information such as location management information 270, control policy 280, and external sound flag 290. The control device 204 implements functions such as the monitoring unit 241 and output control unit 242 by, for example, executing a computer program.
[0029] Location management information 270 is information that includes information representing each of one or more locations and metadata for that location. For each location, the metadata for that location may include at least one of the following (A) to (C). (A) Information representing at least one of the topography, intersection, road, facility, or land type and condition to which the location belongs (for example, information representing the location of one's home, information representing a high crime rate, or information representing road signs). (B) Information indicating the importance of the location in question. (C) Information associated with the location in question, representing an evaluation of external noise at that location.
[0030] For example, the information in (A) may be included in map information representing a map (for example, information including road network information with intersections as nodes and roads between intersections as links), or it may be manually entered information, or it may be POI (Point of Interest) information entered according to IVI (In-Vehicle Infotainment) technology.
[0031] Furthermore, for example, the information in (B) may be manually entered information, POI (Point of Interest) information entered according to IVI (In-Vehicle Infotainment) technology, or emergency alert information (for example, information representing an earthquake early warning, tsunami warning, or volcanic eruption warning). If such information is included in the metadata and this is specified as a condition for outputting external sounds, sounds such as ground rumbling, tsunami sounds, fire department guidance voices, and the voices of people evacuating can be picked up into the vehicle cabin, facilitating the understanding of the real-time situation that is changing moment by moment at the scene.
[0032] Furthermore, for example, the information in (C) may be manually entered information or information entered in accordance with IVI technology (e.g., POI information), but in this embodiment, it may be information received from the target application of the user terminal 180. The information in (C) may include, for example, information such as a score representing an evaluation of external sounds (e.g., the number of "likes" on a comment in an SNS application) or text. The information in (C) may include, for example, text representing positive words related to sound, such as "The sound of the flowing river is lovely" or "The chirping of birds is soothing." If such information is included in the metadata and this is specified as an external sound output condition, the sound can be automatically brought into the vehicle cabin (or, the external sound flag can be suggested to be turned "ON" via the display device or by voice).
[0033] By including at least one of (A) to (C) in the metadata for each location, it is possible to appropriately control whether or not to output external sound into the interior of the vehicle 150 according to the current location of the vehicle 150.
[0034] Furthermore, as information (C), the information received from the target application on the user terminal 180 (information including location information and information indicating an evaluation of external noise at that location) may contain information indicating the latest status at that location. As described later, by using such information to determine whether or not to output external noise, it is expected that the output of external noise into the interior of the vehicle 150 will be controlled more appropriately according to the current location of the vehicle 150. In addition, since the information received from the user terminal 180 inside the vehicle can be used as metadata (location metadata) included in the location management information 270, even if the in-vehicle device 100 is a device that cannot communicate via a wide-area network such as the internet, it is expected that the latest metadata about the location can be obtained.
[0035] The control policy 280 is information representing the policy for controlling the output of external sounds (for example, a policy that includes the conditions for external sound output). The external sound flag 290 is a flag that indicates whether or not external sounds are output into the vehicle cabin.
[0036] The control device 204 is communicatively connected to the I / F device 201 and the storage device 203. The control device 204 identifies a location within a predetermined range from the current location (the current location of the vehicle 150) identified by the GPS sensor 250, from among one or more locations represented by the location management information 270. Based on whether the metadata of the location conforms to the conditions for external sound output or external sound non-output (for example, conditions defined as at least part of the control policy 280), the control device 204 controls whether to output external sound input via one or more of the multiple (or one) microphones 101 through one or more of the multiple (or one) speakers 103. Specifically, for example, the monitoring unit 241 monitors the relationship between the metadata of the location within a predetermined range from the current location of the vehicle 150 and the control policy 280, and updates the value of the external sound flag 290 ("ON" or "OFF"). "ON" means external sound output. "OFF" means external sound non-output. The monitoring unit 241 analyzes the images captured by the camera 102 to identify the surrounding conditions of the vehicle 150, and in addition to position metadata, it may update the value of the external sound flag 290 based on whether the identified surrounding conditions meet the conditions for external sound output or external sound non-output. Here, "surrounding conditions" may refer to at least one of the conditions in front of, to the left of, to the right of, and behind the vehicle 150. The output control unit 242 controls whether or not to output external sound through the speaker 103 according to the value of the external sound flag 290.
[0037] Figure 3 shows an example of the processing flow of the monitoring unit 241.
[0038] The monitoring unit 241 determines whether the external sound flag 290 is "ON" or not (S301).
[0039] If the result of S301 is false (S301: NO), the monitoring unit 241 determines whether or not an event has occurred that changes the current external sound flag 290 (S302). The event may be, for example, any of the following: (a1) Manual modification operation via UI device 202 (modification of external sound flag). (a2) Metadata of the target location, which is a location within a predetermined range from the current location of the vehicle 150, is identified from the location management information 270, and it is determined whether the identified metadata satisfies the conditions for external sound output (conditions represented by the control policy 280), and the result of that determination is true.
[0040] The "target location" may be the location to which the current location belongs, a location at a predetermined distance from the current location along the vehicle 150's route (for example, a route determined by the control device 204 based on map information) (or each of one or more locations up to the predetermined distance), or a location at a predetermined distance from the current location along the vehicle 150's route (for example, a route determined by the control device 204 based on map information) (or each of one or more locations up to the predetermined distance). Furthermore, the "current location" may be a location expressed in terms of latitude and longitude, and the "target location" may be a location expressed in terms of latitude and longitude, or a location as a range (geographical area) expressed in a different way in place of or in addition to latitude and longitude.
[0041] An example of satisfying the "conditions for external sound output" is that the metadata of the target location (and the surrounding conditions identified based on the analysis results of the images captured by camera 102) must satisfy at least one of the following conditions. • The location in question must be within the vicinity of a building where many children reside, such as a kindergarten, nursery school, or elementary school. • The target location must be an intersection that meets the definition of an intersection with poor visibility. • The location must be within an area defined as a place where natural sounds can be enjoyed, such as an area inhabited by birds and insects, or an area with many trees and plants.
[0042] If the result of the S302 judgment is true (S302:YES), the monitoring unit 241 changes the value of the external sound flag 290 from "OFF" to "ON" (S304). If monitoring is completed (for example, if the power to the in-vehicle device 100 is turned off) (S305:YES), the process ends. If monitoring continues (S305:NO), the process returns to S301.
[0043] If the result of S302 is false (S302: NO), the process proceeds to S305.
[0044] If the result of S301 is true (S301:YES), the monitoring unit 241 determines whether an event has occurred that changes the current external vehicle sound flag 290 (S303). The event may be, for example, one of the following: (b1) Manual modification operation via UI device 202 (modification of external sound flag). (b2) Metadata of the target location, which is a location within a predetermined range from the current location of the vehicle 150, is identified from the location management information 270, and it is determined whether the identified metadata satisfies the condition for no external sound output (the condition represented by the control policy 280), and the result of that determination is true.
[0045] An example of satisfying the "condition for no external noise output" is that the metadata of the target location (and the surrounding conditions identified based on the analysis results of the images captured by camera 102) must satisfy at least one of the following conditions. This is expected to ensure privacy and prevent loud noises from entering the cabin. • The location in question must belong to a location defined as one where privacy is a priority. • The location in question must be in an area that has been assessed as having high noise levels.
[0046] If the result of the S303 judgment is true (S303:YES), the monitoring unit 241 changes the value of the external sound flag 290 from "ON" to "OFF" (S304). Then the process proceeds to S305. On the other hand, if the result of the S303 judgment is false (S303:NO), the process proceeds to S305.
[0047] In addition, according to the flow shown in Figure 3, the value of the external sound flag 290 is changed automatically. However, if S302 or S303:YES, the monitoring unit 241 may, via the display device, display information indicating the change in the value of the external sound flag 290 (i.e., ON or OFF of external sound intake into the cabin), and if the value of the external sound flag 290 is changed in response to this display, S304 may be performed. In other words, the external sound flag 290 may be changed manually.
[0048] Figure 4 shows an example of the processing flow of the output control unit 242.
[0049] The output control unit 242 determines whether the external sound flag 290 is "ON" or not (S401).
[0050] If the result of the judgment in S401 is true (S401:YES), the output control unit 242 performs external sound output control, outputting the external sound from the speaker 103 if external sound is input from the microphone 101 (S402:YES) (S403). If the control is finished (for example, if the power to the in-vehicle device 100 is turned off) (S406:YES), the process ends. If the control continues (S406:NO), the process returns to S401.
[0051] If the result of the determination in S401 is false (S401: NO), the output control unit 242 outputs a warning via at least one of the display device and warning light of the UI device 202 if external sound is input from the microphone 101 and the external sound meets predetermined conditions (S404: YES). The process then proceeds to S406. The "predetermined conditions" referred to in this paragraph may be conditions for sounds (including voices) that are considered to be dangerous. This allows the user inside the vehicle to be notified (warned) that such a sound has been detected, even if the external sound flag 290 is "OFF," if a sound that is considered to be a dangerous factor is input from the microphone 101. The display device may also display information indicating the direction of the sound source from the position of the microphone that received the strongest sound (i.e., the direction of the microphone).
[0052] According to this embodiment, the monitoring unit 241 identifies a target location that is within a predetermined range from the vehicle's current position, which is determined based on the GPS signal. The monitoring unit 241 updates the value of the external sound flag 290 based on whether the metadata of the target location meets the conditions for external sound output or external sound non-output. The output control unit 242 controls whether or not to output external sound input via the microphone 101 via the speaker 103 based on the value of the external sound flag 290. This makes it possible to appropriately control whether or not external sound is output into the vehicle cabin. For example, if the condition for external sound output is that the metadata of the target location represents a beach, mountain road, or city, then even if it is difficult to open the windows due to pollen or infectious diseases (in other words, even in a car cabin with the windows closed), external sounds such as the sound of waves, birdsong, or the sounds of a city hustle and bustle can be brought into the cabin. Furthermore, if the target location is set to a location a predetermined distance away from the vehicle's current position along the vehicle's route (for example, a guided route determined by the navigation function), the system will begin taking in external sounds into the cabin in advance. Thus, external sounds can be expected to serve as preventative sounds for identifying potential hazards beforehand.
[0053] In this embodiment, for example, in S403 in Figure 4, at least one of the following (X) to (Z) may be performed. Fade-in is expected to avoid startling the user (passenger) due to sudden external sound input, and fade-out is expected to inform the user that they are moving away from the location where external sound input is necessary. (X) If the metadata of the target location meets the predetermined conditions for external sound output (for example, conditions that mean high importance), and the vehicle 150 is approaching the target location, the monitoring unit 241 may set the external sound flag 290 "ON" and execute the fade-in. If the output control unit 242 detects the external sound flag 290 "ON" and the setting for the fade-in, it may start the fade-in of the external sound from the speaker 103. (Y) If the metadata of the target location meets the predetermined conditions for no external sound output, and the vehicle 150 is approaching the target location, the monitoring unit 241 may set the external sound flag 290 to "OFF" and execute fade-out. If the output control unit 242 detects the external sound flag 290 to "OFF" and the setting for fade-out, it may start fading out the external sound from the speaker 103. (Z) If the metadata of the target location conforms to the above predetermined conditions for external sound output, and the vehicle 150 is moving away from the target location, the monitoring unit 241 may set the external sound flag 290 "ON" and execute fade-out. If the output control unit 242 detects the external sound flag 290 "ON" and the setting for fade-out, it may start fading out the external sound from the speaker 103.
[0054] The output control unit 242 may output external sound at (X) or (Y) from at least one of speakers 103FL and 103FR, and output external sound at (Z) from at least one of speakers 103RL and 103FR. This allows the user to be more accurately informed of approaching or moving away from the target location.
[0055] Furthermore, the output control unit 242 may select one of several sound output modes and output sound from the speaker 103 according to the selected sound output mode. The control policy 280 may also include information representing the relationship between the position metadata and the sound output mode. Specifically, for example, if the external sound flag 290 is "ON" and one of the multiple sound output modes is associated with the metadata of the target position, the output control unit 242 may, for example, in S403 of Figure 4, output the external sound input via the microphone 101 through the speaker 103 in the associated sound output mode. This allows external sounds output according to the position to be output more appropriately into the vehicle cabin. Note that the multiple sound output modes may include sound output modes for sound image localization and sound output modes for sound field reproduction. Specifically, for example, they are as follows. The sound output mode for sound image localization may be associated with a location defined as suitable for avoiding danger (e.g., a nursery school, an intersection with poor visibility, a home parking lot, etc.). According to this sound output mode, the output control unit 242 mainly focuses on grasping the sound image localization in the two-dimensional axes of front, back, left, and right, and may emphasize sounds that are judged to be dangerous as needed (e.g., by emphasizing volume, sound quality, etc.). The sound output mode for sound field reproduction may be associated with a position defined as primarily needing to provide entertainment value, for example, in the case of simulated reproduction of the external environment. According to this sound output mode, the output control unit 242 may perform sound field reproduction that emphasizes sound spread by using a simulated 360° sound field generation algorithm using HRTF (Head Related Transfer Function), etc. (and further using effects such as reverberation).
[0056] Furthermore, as mentioned above, a condition for not outputting external noise may be that the target location belongs to a location defined as one where privacy is important. For example, a residential area may be used as such a location, and in residential areas, the external noise flag 290 may be set to "OFF" by default. For example, in cases where it is desirable to output external noise into the vehicle interior in a privacy-important location such as a residential area (for example, if the monitoring unit 241 is configured to analyze external noise input from the microphone 101 and identifies risk factors as a result of the analysis), the monitoring unit 241 may display a dialog such as "Please give due consideration to privacy" on the screen of the display device of the in-vehicle device 100, and then the monitoring unit 241 may change the external noise flag 290 to "ON". Also, if the metadata of the target location is POI information received from the target application or POI information acquired by the in-vehicle device 100 via a wide-area network, and the POI information includes information indicating a "privacy protection area", the monitoring unit 241 may automatically set the external noise flag 290 to "OFF".
[0057] Furthermore, the monitoring unit 241 may change the value of the external sound flag 290 based on weather information input to the in-vehicle device 100 as POI information or other information, in addition to metadata of the target location (for example, information representing weather by time and area, or information representing weather identified by the monitoring unit 241 based on information input from the microphone 101 and / or camera 102). For example, if the weather identified for the target location by the monitoring unit 241 is a relatively dangerous weather condition such as lightning or hail, the external sound flag 290 may be automatically set to "ON". This is expected to prompt the user to evacuate by allowing them to hear thunder inside the vehicle and grasp the interval and magnitude of the flash and thunder. Also, if the weather is hail, it is expected that the sound of hail hitting the ground and vehicle will be heard inside the vehicle, prompting the user to evacuate. Furthermore, in the case of rain, the sounds of rain outside the vehicle can be heard inside the car as ambient sounds that enhance entertainment, allowing users to enjoy the sound of rain.
[0058] Although one embodiment has been described above, this is merely an example for the purpose of explaining the present invention, and is not intended to limit the scope of the present invention to this embodiment alone. The present invention can be carried out in various other forms. [Explanation of symbols]
[0059] 100...In-vehicle device
Claims
1. an interface device communicably connected to a microphone that inputs sounds from outside the vehicle, a speaker that outputs sounds to the interior of the vehicle, and a GPS (Global Positioning System) sensor that identifies the current position of the vehicle based on a GPS signal; a storage device that stores location management information, which is information including information representing one or more locations and meta information of the locations; a control device that is communicably connected to the interface device and the storage device, that identifies a location that is within a predetermined range from the identified current location among one or more locations represented by the location management information, and that controls whether or not to output the vehicle exterior sound input via the microphone via the speaker based on whether or not meta information of the location satisfies a condition for outputting or not outputting the vehicle exterior sound; An in-vehicle device comprising:
2. The control device performs at least one of the following (X) to (Z): (X) When meta information of a position within a predetermined range from the identified current position satisfies a predetermined condition for outputting external vehicle sound and the vehicle is approaching the position, the fading-in of external vehicle sound from the speaker is started. (Y) When the meta information of a position within a predetermined range from the identified current position satisfies a predetermined condition for non-output of vehicle exterior sound and the vehicle is approaching the position, the fading out of the vehicle exterior sound from the speaker is started. (Z) when meta information of a position within a predetermined range from the identified current position satisfies the predetermined condition for vehicle exterior sound output and the vehicle is moving away from the position, starting to fade out the vehicle exterior sound from the speaker; The in-vehicle device according to claim 1 .
3. The vehicle is provided with speakers at both the front and rear sides, The control device (X) or (Y) external sound output is performed from a speaker on the front side of the vehicle, (Z) The external sound output is performed from a speaker at the rear of the vehicle. The in-vehicle device according to claim 2 .
4. For each location, the meta information for that location includes at least one of the following: (A) information representing at least one of the type and condition of the terrain, intersection, road, facility, or land to which the location belongs; and (B) information indicating the importance of the location; (C) information associated with the location and representing an evaluation of the vehicle exterior noise at the location; The in-vehicle device according to claim 1 .
5. the interface device is communicably connected to a user terminal that is an information processing terminal of a user in a cabin of the vehicle, the user terminal has an application that recognizes, for each of one or more ratings each associated with information representing a location, information representing the rating and information representing a location associated with the rating; The information (C) is information received by the control device from the user terminal via the interface device. The in-vehicle device according to claim 4.
6. When meta information of a position within a predetermined range from the identified current position conforms to the conditions for vehicle exterior sound output and the meta information is associated with any one of a plurality of sound output modes including a sound output mode for sound image localization and a sound output mode for sound field reproduction, the control device outputs the vehicle exterior sound input via the microphone via the speaker in the associated sound output mode. The in-vehicle device according to claim 1 .
7. The vehicle is provided with at least one display device selected from a display device and a warning light, When the control device is in a state where the vehicle exterior sound input via the microphone is not output via the speaker, but the vehicle exterior sound satisfies a predetermined condition, the control device outputs a warning via at least one of the display device and the warning light. The in-vehicle device according to claim 1 .
8. A control method performed by an in-vehicle device communicably connected to a microphone that inputs sounds outside a vehicle and a speaker that outputs sounds into the interior of the vehicle, comprising: Identifying a location within a predetermined range from the vehicle current location identified based on a GPS (Global Positioning System) signal from location management information, which is information including information representing each of one or more locations and meta information of the location; and controlling whether or not to output the vehicle exterior sound input via the microphone via the speaker based on whether or not the meta information of the position conforms to the conditions for outputting the vehicle exterior sound or for not outputting the vehicle exterior sound. Control method.