Electronic device for vehicle, and operating method thereof

Abstract

Disclosed is an operating method of an electronic device for a vehicle, the operating method including: obtaining at least one ambient sound through a microphone; identifying a group including the at least one ambient sound from among a plurality of preset groups on the basis of at least one of type information and volume information of the at least one ambient sound; and transmitting the at least one ambient sound to a mobile device on the basis of at least one of driving information of a vehicle and ambient environment information of the vehicle and transmission conditions corresponding to the identified group.

Description

Automotive electronic device and its operating method

[0001] The present disclosure relates to a vehicle electronic device and an operating method thereof, and more particularly, to a vehicle electronic device and an operating method thereof for providing a user with ambient sounds acquired by the vehicle electronic device.

[0002] As the prevalence of wearable devices increases, many people are increasingly wearing them while driving.

[0003] However, when wearing a wearable device and driving a vehicle while watching media, there is a problem in that the sounds around the vehicle cannot be heard clearly due to the media.

[0004] There are also issues with not being able to clearly hear surrounding sounds due to the noise-canceling function of the wearable device, the noise-blocking function of the vehicle itself, and the user's safety devices (helmet, etc.).

[0005] Therefore, there is an emerging need to provide ambient sounds to drivers wearing wearable devices based on the vehicle's driving environment and surroundings.

[0006] An electronic device for a vehicle according to one embodiment of the present disclosure may include at least one microphone, a memory storing at least one command, a communication unit performing communication with a mobile device, and at least one processor executing at least one command stored in the memory.

[0007] The at least one processor can acquire at least one ambient sound through the at least one microphone by executing the at least one instruction.

[0008] The at least one processor can identify a group including the at least one ambient sound among a plurality of preset groups based on at least one of type information and size information of the at least one ambient sound by executing the at least one command.

[0009] The at least one processor can control the communication unit to transmit the at least one ambient sound to the mobile device based on at least one of driving information of the vehicle and surrounding environment information of the vehicle and a transmission condition corresponding to the identified group by executing the at least one command.

[0010] A mobile device according to one embodiment of the present disclosure may include a communication unit that performs communication with a vehicle electronic device and a wearable device, a memory that stores at least one command, and at least one processor that executes at least one command stored in the memory.

[0011] The at least one processor can control the communication unit to receive at least one ambient sound or information on the occurrence of the at least one ambient sound from the vehicle electronic device by executing the at least one command.

[0012] The at least one processor can synthesize the generated sound corresponding to the at least one ambient sound or the occurrence information of the at least one ambient sound with the audio data being played by executing the at least one command.

[0013] The at least one processor can control the communication unit to transmit the synthesized sound to the wearable device by executing the at least one command.

[0014] A method of operating a vehicle electronic device according to one embodiment of the present disclosure may include a step of acquiring at least one ambient sound through at least one microphone.

[0015] A method of operating a vehicle electronic device according to one embodiment of the present disclosure may include a step of identifying a group including at least one ambient sound among a plurality of preset groups based on at least one of type information and size information of the at least one ambient sound.

[0016] A method of operating a vehicle electronic device according to one embodiment of the present disclosure may include a step of transmitting at least one ambient sound to the mobile device based on at least one of driving information of the vehicle and surrounding environment information of the vehicle and a transmission condition corresponding to the identified group.

[0017] A method of operating a mobile device according to one embodiment of the present disclosure may include a step of receiving at least one ambient sound or information on the occurrence of the at least one ambient sound from a vehicle electronic device.

[0018] A method of operating a mobile device according to one embodiment of the present disclosure may include a step of synthesizing a generated sound corresponding to at least one ambient sound or occurrence information of the at least one ambient sound with audio data being played.

[0019] A method of operating a mobile device according to one embodiment of the present disclosure may include a step of transmitting the synthesized sound to a wearable device.

[0020] Figure 1a is a drawing illustrating an example of sound occurring around a moving vehicle.

[0021] FIG. 1b is a diagram for explaining a connection relationship between a vehicle electronic device according to one embodiment of the present disclosure, a mobile device according to one embodiment of the present disclosure, and a wearable device.

[0022] FIG. 2 is a block diagram illustrating components of a vehicle electronic device according to one embodiment of the present disclosure.

[0023] Figure 3 is a drawing for explaining a plurality of preset groups.

[0024] FIG. 4 is a drawing for explaining an operation performed using artificial intelligence technology in one embodiment of the present disclosure.

[0025] FIG. 5 is a diagram illustrating an in-vehicle electronic device according to one embodiment of the present disclosure that operates in conjunction with a server.

[0026] Figure 6 is a drawing for explaining Figure 5 in detail.

[0027] FIG. 7 is a diagram illustrating an embodiment of transmitting ambient sound from a vehicle electronic device according to an embodiment of the present disclosure to a mobile device according to an embodiment of the present disclosure.

[0028] FIG. 8 is a diagram for explaining an operation corresponding to a vehicle electronic device transmitting mixing information to a mobile device according to one embodiment of the present disclosure.

[0029] FIG. 9 is a block diagram illustrating components of a mobile device according to one embodiment of the present disclosure.

[0030] FIG. 10 is a flowchart illustrating an operating method of a vehicle electronic device according to one embodiment of the present disclosure.

[0031] FIG. 11 is a flowchart illustrating an operating method of a vehicle electronic device according to one embodiment of the present disclosure.

[0032] FIG. 12 is a flowchart illustrating an operation method of a vehicle electronic device according to one embodiment of the present disclosure.

[0033] FIG. 13 is a flowchart illustrating an operation method of a vehicle electronic device according to one embodiment of the present disclosure.

[0034] FIG. 14 is a flowchart illustrating an operation method of a mobile device according to one embodiment of the present disclosure.

[0035] FIG. 15 is a flowchart illustrating an operation method of a mobile device according to one embodiment of the present disclosure.

[0036] The terms used in this specification will be briefly explained, and the present invention will be described in detail.

[0037] The terms used in this invention have been selected from widely used, current terms, taking into account the functions of the invention. However, these terms may vary depending on the intentions of those skilled in the art, precedents, the emergence of new technologies, etc. Furthermore, in certain cases, terms may be arbitrarily selected by the applicant, in which case their meanings will be described in detail in the relevant description of the invention. Therefore, the terms used in this invention should not be defined simply as names, but rather based on their inherent meanings and the overall content of the invention.

[0038] When a part of the specification is said to "include" a component, this does not exclude other components, but rather implies the inclusion of other components, unless otherwise specifically stated. Furthermore, terms such as "part," "module," etc., used throughout the specification refer to a unit that processes at least one function or operation, which may be implemented in hardware, software, or a combination of hardware and software.

[0039] Additionally, the description 'at least one of A, B, and C' means that it can be any one of 'A', 'B', 'C', 'A and B', 'A and C', 'B and C', and 'A, B, and C'.

[0040] Below, with reference to the attached drawings, embodiments of the present invention are described in detail so that those skilled in the art can easily implement the present invention. However, the present invention can be implemented in various different forms and is not limited to the embodiments described herein. In the drawings, parts irrelevant to the description have been omitted to clearly explain the present invention, and similar parts have been designated with similar reference numerals throughout the specification.

[0041] In embodiments of this specification, the term “user” or “passenger” may mean a person who controls a system, function, or operation.

[0042] In the embodiments of the present specification, “the vehicle” may mean a vehicle including a vehicle electronic device according to one embodiment.

[0043] Figure 1a is a drawing illustrating an example of sound occurring around a moving vehicle.

[0044] A vehicle including a vehicle electronic device according to one embodiment of the present disclosure may include a four-wheeled vehicle (110) or a two-wheeled vehicle (120). However, the present invention is not limited thereto, and a vehicle including a vehicle electronic device according to one embodiment may include various types of vehicles.

[0045] As the prevalence of wearable devices increases, people are increasingly wearing them while driving.

[0046] When a driver drives a vehicle (110, 120) while wearing a wearable device (130), the driver may not be able to recognize ambient sounds (140, 150, 160, 170) generated around the vehicle (110, 120) being driven due to audio data output from the wearable device (130) or noise canceling of the wearable device.

[0047] Hereinafter, a method and device for providing ambient sounds (140, 150, 160, 170) to a driver of a vehicle wearing a wearable device (130) based on driving information and the surrounding environment of the vehicle (110, 120) in order to increase safety when driving a vehicle (110, 120) will be described.

[0048] FIG. 1b is a diagram for explaining a connection relationship between a vehicle electronic device according to one embodiment of the present disclosure, a mobile device according to one embodiment of the present disclosure, and a wearable device.

[0049] A vehicle including a vehicle electronic device (200) according to one embodiment of the present disclosure may include a four-wheeled vehicle (110) or a two-wheeled vehicle (120). However, the present invention is not limited thereto, and a vehicle including a vehicle electronic device according to one embodiment may include various types of vehicles.

[0050] A vehicle electronic device (200) according to one embodiment of the present disclosure can be connected to a mobile device (800) according to one embodiment of the present disclosure through wireless communication.

[0051] A mobile device (800) according to one embodiment of the present disclosure may mean a mobile device of a user, including a driver or passenger of a vehicle.

[0052] A mobile device (800) according to one embodiment of the present disclosure may include a portable electronic device. For example, the mobile device may include at least one of a user's smartphone, cell phone, tablet personal computer (PC), or wearable device, but is not limited thereto.

[0053] A mobile device (800) according to one embodiment of the present disclosure can be connected to a wearable device (130) via wireless communication.

[0054] Here, the wireless communication may include at least one short-range communication that performs communication according to a communication standard such as Bluetooth, Wi-Fi, BLE (Bluetooth Low Energy), NFC / RFID, Wi-Fi Direct, UWB, or ZIGBEE, and long-range communication that performs communication with a server for supporting long-range communication according to a long-range communication standard. The long-range communication may be performed through a communication network according to a 3G, 4G, and / or 5G communication standard, or a network for Internet communication.

[0055] According to one embodiment of the present disclosure, a vehicle electronic device (200), a mobile device (800) and a wearable device (130) according to one embodiment of the present disclosure are connected to each other through wireless communication, so that data can be transmitted and received from the vehicle electronic device (200) according to one embodiment of the present disclosure to the mobile device (800) according to one embodiment of the present disclosure, and from the mobile device (800) according to one embodiment of the present disclosure to the wearable device (130).

[0056] Data transmitted and received between a vehicle electronic device (800) according to one embodiment of the present disclosure, a mobile device (800) according to one embodiment of the present disclosure, and a wearable device (130) will be described in detail below.

[0057] FIG. 2 is a block diagram illustrating components of a vehicle electronic device according to one embodiment of the present disclosure.

[0058] A vehicle electronic device (200) may include at least one microphone (220), a memory (230) that stores at least one command, a communication unit (240) that performs communication with a mobile device, and at least one processor (210) that executes at least one command stored in the memory (230).

[0059] The memory (230) can store various data, programs, or applications for driving and controlling the vehicle electronic device (200) according to one embodiment of the present disclosure. The memory (230) can include, for example, a non-volatile memory including at least one of a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., an SD or XD memory, etc.), a ROM (Read-Only Memory), and an EEPROM (Electrically Erasable Programmable Read-Only Memory), a PROM (Programmable Read-Only Memory), and a volatile memory such as a RAM (Random Access Memory) or an SRAM (Static Random Access Memory).

[0060] The memory (230) may store instructions, data structures, and program codes that can be read by the processor (210). In the following embodiments, the processor (210) may be implemented by executing instructions or codes of a program stored in the memory (230).

[0061] The programs stored in the memory (230) can be classified into multiple modules according to their functions, and may include, for example, an ambient sound acquisition module (232), a group identification module (234), and a sound data transmission module (236).

[0062] However, the commands or codes of the program stored in the memory (230) are not limited thereto. For example, the ambient sound acquisition module (232), the group identification module (234), and the sound data transmission module (236) are configurations for one embodiment, and the configuration of the modules included in the memory (230) may be integrated, added, or omitted according to the specifications of the vehicle electronic device (200) actually implemented. That is, two or more modules may be combined into one module, or one module may be divided into two or more modules and configured.

[0063] The ambient sound acquisition module (232), group identification module (234), and sound data transmission module (236) stored in the memory (230) refer to a unit that processes a function or operation performed by the processor (210), and this can be implemented as software such as commands, algorithms, data structures, or program codes.

[0064] The processor (210) may be composed of hardware components that perform arithmetic, logic, and input / output operations and signal processing. The processor (210) may be composed of at least one of, for example, a central processing unit (CPU), a microprocessor, a graphic processing unit (GRAP), application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), and field programmable gate arrays (FPGAs), but is not limited thereto.

[0065] The communication unit (240) can communicate with an external device or server through at least one wired or wireless communication network by means of the processor (210).

[0066] A communication unit (240) according to one embodiment may include at least one short-range communication module that performs communication according to a communication standard such as Bluetooth, Wi-Fi, BLE (Bluetooth Low Energy), NFC / RFID, Wi-Fi Direct, UWB, or ZIGBEE, and a long-range communication module that performs communication with a server for supporting long-range communication according to a long-range communication standard. The long-range communication module may perform communication through a communication network according to a 3G, 4G, and / or 5G communication standard, or a network for Internet communication.

[0067] A microphone (220) can acquire sounds generated in the vicinity of a vehicle electronic device (200) according to one embodiment of the present disclosure.

[0068] The ambient sound acquisition module (232) may be configured with instructions or program codes related to the function and / or operation of acquiring at least one ambient sound through at least one microphone (220).

[0069] According to one embodiment of the present disclosure, a processor (210) can acquire at least one ambient sound through at least one microphone (220) by executing instructions or program codes of an ambient sound acquisition module (232).

[0070] According to one embodiment of the present disclosure, the processor (210) can reduce or remove noise when noise is acquired together with ambient sound by executing commands or program codes of the ambient sound acquisition module (232).

[0071] According to one embodiment of the present disclosure, the processor (210) can reduce or remove noise acquired together with ambient sound through a filter by executing commands or program codes of the ambient sound acquisition module (232).

[0072] The filter may include, but is not limited to, at least one of a bandpass filter, a moving average filter, a finite impulse response filter (FIR filter), or an infinite impulse response filter (IIR filter).

[0073] A processor (210) according to one embodiment of the present disclosure may execute instructions or program codes of an ambient sound acquisition module (232) to cancel out noise acquired together with at least one ambient sound based on white noise corresponding to the noise.

[0074] A processor (210) according to one embodiment of the present disclosure may execute instructions or program codes of an ambient sound acquisition module (232) to reduce noise acquired together with at least one ambient sound based on destructive interference.

[0075] The group identification module (234) may be configured with instructions or program codes related to a function and / or operation of identifying a group including at least one ambient sound among a plurality of preset groups based on at least one of type information and size information of at least one ambient sound.

[0076] According to one embodiment of the present disclosure, the processor (210) executes instructions or program codes of the group identification module (234) to identify a group including at least one ambient sound among a plurality of preset groups based on at least one of type information and size information of at least one ambient sound.

[0077] For a description of the multiple groups that have been set up, refer to Fig. 3.

[0078] Figure 3 is a drawing for explaining a plurality of preset groups.

[0079] The preset multiple groups can be categorized into group 1, group 2, or group 3 depending on the importance of the surrounding sounds. However, the number of groups included in the preset multiple groups is not limited thereto.

[0080] Importance can mean the degree to which it affects the driving of a vehicle.

[0081] For example, a very high importance of ambient sound may mean that an accident is very likely to occur in a vehicle (110, 120) including an in-vehicle electronic device (200) according to an embodiment of the present disclosure when the ambient sound is not recognized.

[0082] For example, a high importance of ambient sound may mean that an accident is more likely to occur in a vehicle (110, 120) including an in-vehicle electronic device (200) according to an embodiment of the present disclosure when the ambient sound is not recognized.

[0083] For example, a low importance of ambient sound may mean that an accident is less likely to occur in a vehicle (110, 120) including an in-vehicle electronic device (200) according to an embodiment of the present disclosure when the ambient sound is not recognized.

[0084] A processor (210) according to one embodiment of the present disclosure may execute instructions or program codes of a group identification module (234) to include at least one sound having a very high importance in group 1.

[0085] At least one sound included in Group 1 may include, but is not limited to, at least one of a close-range horn sound, a close-range siren sound, an explosion sound, an impact sound, or a close-range brake screeching sound.

[0086] A processor (210) according to one embodiment of the present disclosure may execute instructions or program codes of a group identification module (234) to include at least one sound having a high importance in group 2.

[0087] At least one sound included in Group 2 may include, but is not limited to, at least one of a distant horn sound, a distant siren sound, or a distant brake screeching sound.

[0088] According to one embodiment of the present disclosure, the processor (210) may execute instructions or program codes of the group identification module (234) to include at least one sound with low importance in group 3.

[0089] At least one sound included in Group 3 may include, but is not limited to, at least one of road friction noise or driving noise of adjacent vehicles.

[0090] According to one embodiment of the present disclosure, the processor (210) may execute commands or program codes of the group identification module (234) to store at least one sound included in group 1, group 2, or group 3 in the memory (230) for each group.

[0091] At least one sound included in Group 1, Group 2 or Group 3 can be individually changed by the user.

[0092] Referring again to Figure 2,

[0093] According to one embodiment of the present disclosure, a processor (210) can identify information on the type of at least one ambient sound based on an artificial intelligence model by executing instructions or program codes of a group identification module (234).

[0094] Artificial intelligence technology (hereinafter referred to as “AI technology”) is a technology that performs operations through a neural network to analyze and / or classify input data and obtain the desired result.

[0095] These AI technologies can be implemented using algorithms. Here, an algorithm or set of algorithms for implementing AI technologies is called a neural network. Here, a neural network can receive input data, perform the aforementioned analysis and / or classification operations, and output result data. In order for a neural network to accurately output result data corresponding to the input data, the neural network needs to be trained. Here, "training" can mean inputting various data into the neural network and training the neural network so that it can discover or acquire methods for analyzing the input data, classifying the input data, and / or extracting features necessary for generating result data from the input data. Specifically, through the learning process, the neural network can learn from training data (e.g., multiple different images) and optimize and set the weight values ​​within the neural network. Then, the neural network with the optimized weight values ​​learns the input data on its own, thereby outputting the desired result.

[0096] Specifically, a neural network can be classified as a deep neural network if the number of hidden layers, which are internal layers that perform calculations, is multiple, that is, if the depth of the neural network that performs calculations increases. Examples of neural networks include, but are not limited to, a convolutional neural network (CNN), a deep neural network (DNN), a recurrent neural network (RNN), a restricted boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), and deep Q-networks. In addition, a neural network can be subdivided. For example, a CNN neural network can be subdivided into a deep convolutional neural network (DCNN) or a capsnet neural network.

[0097] In the disclosed embodiments, an "AI model" may refer to a neural network comprising at least one layer that receives input data and operates to output a desired result. Furthermore, an "AI model" may refer to an algorithm or a set of multiple algorithms that perform operations through a neural network to output a desired result, a processor for executing such an algorithm or a set thereof, software for executing such an algorithm or a set thereof, or hardware for executing such an algorithm or a set thereof.

[0098] The structure of the neural network is explained with reference to Figure 4.

[0099] FIG. 4 is a drawing for explaining an operation performed using artificial intelligence technology in one embodiment of the present disclosure.

[0100] In one embodiment of the present disclosure, the operation of identifying information on the type of at least one ambient sound may be performed using artificial intelligence (AI) technology that performs calculations through a neural network.

[0101] A neural network (420) can be trained by receiving training data. Then, the trained neural network (420) can receive input data (410) as an input terminal (430), and the output terminal (450) can perform an operation to analyze the input data (410) and output output data (460), which is the desired result. The operation through the neural network can be performed through a hidden layer (440). In FIG. 4, for convenience, the hidden layer (440) is simplified and illustrated as being formed as a single layer, but the hidden layer (440) can be formed as a plurality of layers.

[0102] A processor (210) according to one embodiment of the present disclosure may use a lossless waveform audio format (wav) as learning data when training an artificial intelligence model by executing commands or program codes of a group identification module (234).

[0103] According to one embodiment of the present disclosure, a processor (210) can execute commands or program codes of a group identification module (234) to normalize peaks of sound frequency data and extract features of the frequency data.

[0104] A processor (210) according to one embodiment of the present disclosure can train an artificial intelligence model based on the characteristics of frequency data and learning data by executing commands or program codes of a group identification module (234).

[0105] Referring again to Figure 2,

[0106] According to one embodiment of the present disclosure, the processor (210) executes instructions or program codes of the group identification module (234) to compare at least one ambient sound acquired through at least one microphone with learning data to identify information on the type of at least one ambient sound.

[0107] According to one embodiment of the present disclosure, a processor (210) may execute commands or program codes of an ambient sound acquisition module (232) to acquire sound generated from a sound source located around a vehicle through at least one microphone.

[0108] According to one embodiment of the present disclosure, the processor (210) can execute instructions or program codes of the group identification module (234) to compare at least one acquired ambient sound with learning data to identify information on the type of at least one ambient sound.

[0109] For example, a processor (210) according to one embodiment of the present disclosure may execute commands or program codes of an ambient sound acquisition module (232) to compare characteristics of frequency data of the acquired sound with learning data, thereby identifying that the acquired sound corresponds to a horn sound.

[0110] According to one embodiment of the present disclosure, the processor (210) executes the commands or program code of the group identification module (234) to compare the characteristics of the acquired sound frequency data with the learning data, thereby identifying that the acquired sound corresponds to a siren sound. However, the present invention is not limited thereto.

[0111] Training of the artificial intelligence model can be performed by a server capable of communicating with the vehicle electronic device (200) according to one embodiment of the present disclosure via a wireless communication network. For example, an external server can train the artificial intelligence model and transmit the trained artificial intelligence model to the vehicle electronic device (200).

[0112] A method for learning an artificial intelligence model in a server capable of communicating with a vehicle electronic device and a wireless communication network according to one embodiment of the present disclosure will be described with reference to FIGS. 5 and 6.

[0113] FIG. 5 is a diagram illustrating an in-vehicle electronic device according to one embodiment of the present disclosure that operates in conjunction with a server.

[0114] The server (530) may include a server, server system, server-based device, etc. that transmits and receives data to and processes data from a vehicle electronic device (200) via a communication network (520).

[0115] In the disclosed embodiment, the server (530) includes a communication unit that communicates with a vehicle electronic device (200) installed inside a vehicle (510), and a processor that performs at least one command.

[0116] The server (530) can receive information on filtering data setting criteria, types of filtering data, etc. from a vehicle electronic device (200) or an external device.

[0117] The server (530) may train an AI model and store the trained AI model. Furthermore, the server (530) may use the trained AI model and the received information to perform an operation for predicting whether a nearby vehicle has been cut in.

[0118] In general, the vehicle electronic device (200) may be limited in memory storage capacity, computational processing speed, and learning data set collection capability compared to the server (530). Therefore, operations requiring storage of large amounts of data and large amounts of computational power may be performed by the server (530), and then the necessary data and / or the AI ​​model being used may be transmitted to the vehicle electronic device (200) via a communication network. Then, the vehicle electronic device (200) may receive and utilize the necessary data and / or AI model via the server, thereby performing the necessary operations quickly and easily, even without a processor having large amounts of memory and fast computational power.

[0119] Figure 6 is a drawing for explaining Figure 5 in detail.

[0120] The vehicle electronic device (200) of FIG. 6 is described and illustrated as an example of the same case as the vehicle electronic device (200) described in FIG. 2.

[0121] Referring to FIG. 6, the server (530) may include a communication unit (532), a processor (534), and a database (Databased, DB) (536).

[0122] The communication unit (532) may include one or more components that communicate with the vehicle electronic device (200). The communication unit (532) includes at least one communication module, such as a short-range communication module, a wired communication module, a mobile communication module, a broadcast reception module, etc. Here, at least one communication module refers to a communication module that can transmit and receive data through a network that follows a communication standard, such as a tuner that performs broadcast reception, Bluetooth, WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), CDMA, WCDMA, the Internet, 3G, 4G, and / or 5G, a method that performs communication using millimeter wave (mmWAVE), etc.

[0123] For example, if the communication unit (532) performs communication using millimeter waves (mmWAVE), it can quickly transmit and receive large amounts of data. Specifically, by quickly receiving large amounts of data in a vehicle, data necessary for vehicle safety (e.g., data necessary for autonomous driving, data necessary for navigation services, etc.) and user-used content (e.g., movies, music, etc.) can be quickly provided, thereby increasing vehicle safety and / or user convenience.

[0124] Specifically, the mobile communication module included in the communication unit (532) can communicate with another device (e.g., a server (not shown)) located remotely via a communication network that complies with communication standards such as 3G, 4G, and / or 5G. Here, a communication module that communicates with a server (not shown) located remotely may be referred to as a 'remote communication module'.

[0125] The processor (534) controls the overall operation of the server (530). For example, the processor (534) may perform required operations by executing at least one instruction and at least one program of the server (530).

[0126] In addition, the DB (536) may include a memory (not shown), and may store at least one of at least one instruction, program, and data required for the server (530) to perform a predetermined operation within the memory (not shown). In addition, the DB (536) may store data required for the server (530) to perform operations according to a neural network.

[0127] Specifically, in the disclosed embodiment, the server (530) may store the neural network (420) described in FIG. 4. The neural network (420) may be stored in at least one of the processor (534) and the DB (536). The neural network (420) included in the server (530) may be a neural network that has completed training.

[0128] Additionally, the server (530) can transmit the neural network for which training has been completed to the communication unit (240) of the vehicle electronic device (200) through the communication unit (532). Then, the vehicle electronic device (200) can obtain and store the neural network for which training has been completed, and obtain the desired output data through the neural network.

[0129] Referring again to Figure 2,

[0130] According to one embodiment of the present disclosure, a processor (210) can execute instructions or program codes of a group identification module (234) to recognize the size of at least one ambient sound and obtain size information representing the size of the ambient sound.

[0131] According to one embodiment of the present disclosure, the processor (210) can obtain information on the size of at least one ambient sound in decibel (dB) values ​​by executing instructions or program codes of the group identification module (234).

[0132] According to one embodiment of the present disclosure, a processor (210) can execute commands or program codes of a group identification module (234) to predict a distance between a vehicle and a sound source based on information on the level of sound generated from at least one sound source.

[0133] For example, a processor (210) according to one embodiment of the present disclosure may execute instructions or program codes of a group identification module (234) to identify a sound generated from at least one sound source as a horn sound. If the processor (210) identifies that the horn sound has a loudness of 90 dB or higher, it may predict that the distance between the at least one sound source outputting the horn sound and the vehicle is within a preset distance (the distance is close).

[0134] For example, according to one embodiment of the present disclosure, a processor (210) may execute instructions or program codes of a group identification module (234) to identify a sound generated from at least one sound source as a siren sound. If the processor (210) determines that the size of the siren sound is 90 dB or less, it may predict that the distance between the vehicle and at least one sound source outputting the siren sound is greater than or equal to a preset distance (the distance is large).

[0135] For example, according to one embodiment of the present disclosure, a processor (210) may execute instructions or program codes of a group identification module (234) to identify a sound generated from at least one sound source as an explosion sound. If the processor (210) identifies that the magnitude of the explosion sound is 100 dB or higher, it may predict that the distance between the at least one sound source outputting the explosion sound and the vehicle is within a preset distance (the distance is close).

[0136] For example, according to one embodiment of the present disclosure, the processor (210) may execute instructions or program codes of the group identification module (234) to identify a sound generated from at least one sound source as a brake friction sound. If the processor (210) identifies that the magnitude of the brake friction sound is 100 dB or higher, the processor (210) may predict that the distance between the at least one sound source outputting the brake friction sound and the vehicle is within a preset distance (the distance is close). However, the present disclosure is not limited thereto.

[0137] According to one embodiment of the present disclosure, the processor (210) executes instructions or program codes of the group identification module (234) to identify a group including at least one ambient sound among a plurality of preset groups based on at least one of information on the type of at least one ambient sound and information on the size of at least one ambient sound.

[0138] For example, a processor (210) according to one embodiment of the present disclosure may execute instructions or program codes of a group identification module (234) to identify a sound generated from at least one sound source as a horn sound. If the processor (210) identifies that the horn sound has a loudness of 90 dB or higher, it may identify that the sound generated from at least one sound source corresponds to a close-range horn sound.

[0139] In this case, the processor (210) according to one embodiment of the present disclosure can execute the commands or program code of the group identification module (234) to identify that the identified short-range horn sound is included in group 1 having a very high importance among a plurality of preset groups.

[0140] For example, a processor (210) according to one embodiment of the present disclosure may execute instructions or program codes of a group identification module (234) to identify a sound generated from at least one sound source as a brake friction sound. If the processor (210) identifies that the magnitude of the brake friction sound is 90 dB or higher, it may identify that the sound generated from at least one sound source corresponds to a near-field brake friction sound.

[0141] In this case, the processor (210) according to one embodiment of the present disclosure can execute the commands or program code of the group identification module (234) to identify that the identified short-range brake friction sound is included in group 1 having a very high importance among a plurality of preset groups.

[0142] For example, a processor (210) according to an embodiment of the present disclosure may execute instructions or program codes of a group identification module (234) to identify a sound generated from at least one sound source as a siren sound and to identify that the horn sound has a volume of less than 90 dB. A processor (210) according to an embodiment of the present disclosure may execute instructions or program codes of a group identification module (234) to identify that a sound generated from at least one sound source corresponds to a distant siren sound.

[0143] In this case, the processor (210) according to one embodiment of the present disclosure can execute the commands or program codes of the group identification module (234) to identify that the identified remote siren sound is included in group 2 having a high importance among a plurality of preset groups.

[0144] For example, a processor (210) according to an embodiment of the present disclosure may execute commands or program codes of a group identification module (234) to identify a sound generated from at least one sound source as road friction noise. A processor (210) according to an embodiment of the present disclosure may execute commands or program codes of a group identification module (234) to identify that the identified road friction noise is included in group 3 having a low importance among a plurality of preset groups when the magnitude of the road friction noise is identified as being less than 50 dB.

[0145] The sound data transmission module (236) may be configured with instructions or program codes related to a function and / or operation of transmitting at least one ambient sound to a mobile device based on at least one of the vehicle's driving information and the vehicle's surrounding environment information and a transmission condition corresponding to an identified group.

[0146] A processor (210) according to one embodiment of the present disclosure may transmit at least one ambient sound to a mobile device by executing instructions or program codes of a sound data transmission module (236).

[0147] The driving information of the vehicle may include at least one of vehicle speed information or vehicle speed change information.

[0148] The surrounding environment information of the vehicle may include at least one of location information of at least one sound source that outputs at least one ambient sound, weather information around the vehicle, or speed information of an external vehicle located around the vehicle.

[0149] A processor (210) according to one embodiment of the present disclosure can obtain information on the surrounding environment of a vehicle through V2X (Vehicle to Everything) communication by executing commands or program codes of a sound data transmission module (236).

[0150] V2X communication refers to communication that allows vehicles to exchange information with other vehicles and infrastructure-based objects such as roads based on at least one of a wired or wireless network.

[0151] V2X communication may include at least one of V2V (Vehicle to Vehicle) communication, V2I (Vehicle to Infrastructure) communication, V2N (Vehicle to Network) communication, and V2P (Vehicle to Pedestrian) communication.

[0152] According to one embodiment of the present disclosure, a processor (210) can acquire information about the surrounding environment of a vehicle through at least one sensor (not shown) by executing commands or program codes of a sound data transmission module (236).

[0153] The sensor may include, but is not limited to, at least one of a Global Positioning System (GPS) sensor, a sound detection sensor, an image sensor, a camera, a lidar, or a radar.

[0154] A processor (210) according to one embodiment of the present disclosure can set transmission conditions for each of a plurality of preset groups by executing commands or program codes of a sound data transmission module (236).

[0155] According to one embodiment of the present disclosure, the processor (210) can set the sound included in group 1 to be transmitted to the mobile device regardless of the vehicle's driving information and the vehicle's surrounding environment information.

[0156] A processor (210) according to one embodiment of the present disclosure may identify at least one ambient sound having a very high importance as being included in group 1. The processor (210) may transmit at least one ambient sound to a mobile device regardless of driving information of the vehicle and information about the surrounding environment of the vehicle.

[0157] For example, the processor (210) according to one embodiment of the present disclosure may identify a sound generated from at least one sound source as a horn sound. The processor (210) may identify the identified horn sound as a close-range horn sound based on the loudness information of the horn sound. The processor (210) may identify the close-range horn sound as being included in group 1 among a plurality of preset groups. The processor (210) according to one embodiment of the present disclosure may execute instructions or program codes of the sound data transmission module (236) to transmit a close-range horn sound to a mobile device regardless of driving information of the vehicle (e.g., driving speed of the vehicle).

[0158] For example, a processor (210) according to one embodiment of the present disclosure may identify a sound generated from at least one sound source as an explosion sound. The processor (210) may identify the identified explosion sound based on the magnitude information of the explosion sound as a close-range explosion sound and as being included in group 1 among a plurality of preset groups. The processor (210) according to one embodiment of the present disclosure may execute instructions or program codes of the sound data transmission module (236) to transmit the close-range explosion sound to a mobile device regardless of driving information of the vehicle (e.g., driving speed of the vehicle). However, the present disclosure is not limited thereto.

[0159] The processor (210) according to one embodiment of the present disclosure can set a transmission condition to transmit the sound included in group 2 to a mobile device based on at least one of the vehicle's driving information and the vehicle's surrounding environment information.

[0160] A processor (210) according to one embodiment of the present disclosure may identify at least one ambient sound with high importance as being included in group 2. The processor (210) may transmit at least one sound included in group 2 to a mobile device based on at least one of driving information of the vehicle and information about the surrounding environment of the vehicle.

[0161] For example, the processor (210) according to one embodiment of the present disclosure may identify a sound generated from at least one sound source as a horn sound. The processor (210) may identify the horn sound identified based on the loudness information of the horn sound as a distant horn sound and as corresponding to group 2 among a plurality of preset groups. The processor (210) according to one embodiment of the present disclosure may execute instructions or program codes of the sound data transmission module (236) to transmit the distant horn sound to a mobile device based on at least one of the speed of the vehicle, the location information of the vehicle generating the horn sound, and the speed information of the vehicle generating the horn sound.

[0162] For example, the processor (210) according to one embodiment of the present disclosure may identify a sound generated from at least one sound source as a brake friction sound. The processor (210) may identify the identified brake friction sound based on the size information of the brake friction sound as corresponding to a distant brake friction sound and corresponding to group 2 among a plurality of preset groups. The processor (210) according to one embodiment of the present disclosure may execute instructions or program codes of the sound data transmission module (236) to transmit the distant brake friction sound to a mobile device based on at least one of the speed of the vehicle, weather information around the vehicle, or speed information of the vehicle generating the brake friction sound. However, the present disclosure is not limited thereto.

[0163] A processor (210) according to one embodiment of the present disclosure may identify at least one ambient sound having a high importance as being included in group 2. The processor (210) may transmit at least one sound included in group 2 to a mobile device based on driving information of the vehicle.

[0164] The driving information of the vehicle may include at least one of vehicle speed information or vehicle speed change information.

[0165] A processor (210) according to one embodiment of the present disclosure can transmit at least one sound included in group 2 to a mobile device based on speed information of a vehicle including an in-vehicle electronic device (200).

[0166] For example, the processor (210) may identify a sound generated from at least one sound source as a brake friction sound. The processor (210) according to one embodiment of the present disclosure may identify the identified brake friction sound based on the size information of the brake friction sound as corresponding to a distant brake friction sound and corresponding to group 2 among a plurality of preset groups. The processor (210) according to one embodiment of the present disclosure may transmit the distant brake friction sound to a mobile device when a vehicle including the vehicle electronic device (200) is driving at a high speed.

[0167] High-speed driving may mean a case where a vehicle including a vehicle electronic device (200) according to one embodiment of the present disclosure is driving at a certain speed or higher.

[0168] The constant speed may be set based on the speed limit of the road on which the vehicle including the vehicle electronic device (200) according to one embodiment of the present disclosure is driving, but is not limited thereto.

[0169] A processor (210) according to one embodiment of the present disclosure can obtain speed limit information of a road on which a vehicle including a vehicle electronic device (200) is driving through V2X communication.

[0170] For example, the processor (210) according to one embodiment of the present disclosure may set a constant speed to 30 km / h when a vehicle including an automotive electronic device (200) is driving on a road with a speed limit of 30 km / h.

[0171] For example, the processor (210) according to one embodiment of the present disclosure may set a constant speed to 100 km / h when a vehicle including an automotive electronic device (200) is driving on a road with a speed limit of 100 km / h. However, the present invention is not limited thereto.

[0172] The speed can be changed by the user.

[0173] For example, a user may set a constant speed to 80 km / h regardless of the speed limit of the road on which a vehicle including an in-vehicle electronic device (200) according to one embodiment of the present disclosure is driving.

[0174] For example, a user may set a constant speed to 100 km / h regardless of the speed limit of the road on which a vehicle including an in-vehicle electronic device (200) according to one embodiment of the present disclosure is driving, but is not limited thereto.

[0175] A processor (210) according to one embodiment of the present disclosure can transmit at least one sound included in group 2 to a mobile device based on speed change information of a vehicle including an in-vehicle electronic device (200).

[0176] The vehicle's speed change information may include at least one of rapid acceleration or rapid deceleration.

[0177] Rapid acceleration may mean that the speed of a vehicle including an electronic device (200) for a vehicle according to one embodiment of the present disclosure increases rapidly within a short period of time.

[0178] Rapid acceleration may mean, but is not limited to, an increase in the speed of a vehicle including an electronic device (200) for vehicles according to one embodiment of the present disclosure, for example, at a speed of 2.8 m / s or more.

[0179] Rapid deceleration may mean that the speed of a vehicle including an electronic device (200) for vehicles according to one embodiment of the present disclosure is rapidly reduced within a short period of time.

[0180] Rapid deceleration may mean, but is not limited to, a decrease in the speed of a vehicle including an electronic device (200) for vehicles according to one embodiment of the present disclosure, for example, at a speed of 2.8 m / s or more.

[0181] For example, the processor (210) may identify a sound generated from at least one sound source as a brake friction sound. The processor (210) according to one embodiment of the present disclosure may identify the identified brake friction sound based on the magnitude information of the brake friction sound as a distant brake friction sound and as corresponding to group 2 among a plurality of preset groups. The processor (210) according to one embodiment of the present disclosure may not transmit the distant brake friction sound to a mobile device when a vehicle including the vehicle electronic device (200) is driving at a low speed.

[0182] According to one embodiment of the present disclosure, the processor (210) may transmit a remote brake friction sound to a mobile device when a vehicle including an in-vehicle electronic device (200) rapidly accelerates. Here, the remote brake friction sound may refer to a brake friction sound generated from a sound source located in the direction in which the vehicle including an in-vehicle electronic device (200) according to one embodiment of the present disclosure rapidly accelerates. However, the present disclosure is not limited thereto.

[0183] For example, the processor (210) may identify a sound generated from at least one sound source as a horn sound. The processor (210) according to one embodiment of the present disclosure may identify the horn sound identified based on the horn sound volume information as corresponding to a distant horn sound and corresponding to group 2 among a plurality of preset groups. The processor (210) according to one embodiment of the present disclosure may not transmit the distant horn sound to a mobile device when a vehicle including the vehicle electronic device (200) is driving at a low speed. However, the present disclosure is not limited thereto.

[0184] According to one embodiment of the present disclosure, the processor (210) may transmit a distant horn sound to a mobile device when a vehicle including the vehicle electronic device (200) rapidly decelerates. Here, the distant horn sound may refer to a brake friction sound generated from a sound source located at the rear of the vehicle including the vehicle electronic device (200) according to one embodiment of the present disclosure. However, the present disclosure is not limited thereto.

[0185] Low-speed driving may mean a case where a vehicle including a vehicle electronic device (200) according to one embodiment of the present disclosure is driving at a speed below a certain speed.

[0186] The constant speed may be set based on the speed limit of the road on which the vehicle including the vehicle electronic device (200) according to one embodiment of the present disclosure is driving, but is not limited thereto.

[0187] A processor (210) according to one embodiment of the present disclosure can obtain speed limit information of a road on which a vehicle including an in-vehicle electronic device (200) is driving through V2X communication. However, the present invention is not limited thereto.

[0188] For example, the processor (210) according to one embodiment of the present disclosure may set a constant speed of the vehicle to 30 km / h when the vehicle including the vehicle electronic device (200) is driving on a road with a speed limit of 30 km / h.

[0189] For example, the processor (210) according to one embodiment of the present disclosure may set a constant speed of the vehicle to 80 km / h when the vehicle including the vehicle electronic device (200) is driving on a road with a speed limit of 80 km / h. However, the present invention is not limited thereto.

[0190] The speed can be changed by the user.

[0191] For example, a user may set a constant speed of a vehicle to 50 km / h regardless of the speed limit of the road on which the vehicle including the vehicle electronic device (200) according to one embodiment of the present disclosure is driving.

[0192] For example, a user may set a constant speed of a vehicle to 100 km / h regardless of the speed limit of the road on which the vehicle including the vehicle electronic device (200) according to one embodiment of the present disclosure is driving.

[0193] A processor (210) according to one embodiment of the present disclosure may identify at least one ambient sound having a high importance as being included in group 2. The processor (210) may transmit at least one sound included in group 2 to a mobile device based on ambient environment information.

[0194] The vehicle's surrounding environment information may include at least one of location information of at least one sound source that outputs at least one ambient sound, weather information around the vehicle, or speed information of external vehicles located around the vehicle, but is not limited thereto.

[0195] A processor (210) according to one embodiment of the present disclosure can identify a sound generated from at least one sound source as the sound of rain.

[0196] A processor (210) according to one embodiment of the present disclosure can obtain rainfall information based on information on the size of rain sound.

[0197] A processor (210) according to one embodiment of the present disclosure may transmit at least one sound included in group 2 to a mobile device based on precipitation information.

[0198] For example, the processor (210) may identify a sound generated from at least one sound source as a brake friction sound. According to one embodiment of the present disclosure, the processor (210) may identify the identified brake friction sound based on the size information of the brake friction sound as corresponding to a remote brake friction sound and corresponding to group 2 among a plurality of preset groups. According to one embodiment of the present disclosure, when the amount of precipitation is greater than a preset value, the processor (210) may transmit the remote brake friction sound to a mobile device.

[0199] For example, the processor (210) may identify a sound generated from at least one sound source as a siren sound. The processor (210) according to one embodiment of the present disclosure may identify the siren sound identified based on the loudness information of the siren sound as corresponding to a distant siren sound and corresponding to group 2 among a plurality of preset groups. The processor (210) according to one embodiment of the present disclosure may transmit the distant siren sound to a mobile device when the amount of precipitation is greater than a preset value.

[0200] Here, the setting value may mean, but is not limited to, 15 mm.

[0201] Settings can be changed by the user.

[0202] A processor (210) according to one embodiment of the present disclosure can obtain information about the surrounding environment of a vehicle through a sensor.

[0203] The surrounding environment information may include brightness information of a road on which a vehicle including a vehicle electronic device (200) according to one embodiment of the present disclosure is driving.

[0204] A processor (210) according to one embodiment of the present disclosure can obtain road brightness information in lux values.

[0205] A processor (210) according to one embodiment of the present disclosure may transmit at least one sound included in group 2 to a mobile device based on brightness information of a road on which a vehicle is driving.

[0206] For example, the processor (210) may identify a sound generated from at least one sound source as a siren sound. The processor (210) according to one embodiment of the present disclosure may identify the siren sound identified based on the size information of the siren sound as a distant siren sound and as corresponding to group 2 among a plurality of preset groups. The processor (210) according to one embodiment of the present disclosure may transmit the distant siren sound to a mobile device when the brightness of the road on which a vehicle including the vehicle electronic device (200) according to one embodiment of the present disclosure is driving is below a reference value.

[0207] For example, if the brightness of light acquired through a sensor by a processor (210) according to one embodiment of the present disclosure is 50 lux or less, a remote siren sound can be transmitted to a mobile device. However, the present invention is not limited thereto.

[0208] The reference value can be changed by the user.

[0209] A processor (210) according to one embodiment of the present disclosure can set a transmission condition to transmit sounds included in group 3 to a mobile device based on information about the surrounding environment of the vehicle.

[0210] A processor (210) according to one embodiment of the present disclosure may identify at least one sound with low importance as being included in group 3. The processor (210) may transmit at least one sound included in group 3 to a mobile device based on information about the surrounding environment of the vehicle.

[0211] For example, a processor (210) according to an embodiment of the present disclosure may identify a sound generated from at least one sound source as road friction sound. The processor (210) may identify the identified road friction sound as belonging to group 3 among a plurality of preset groups based on the magnitude information of the road friction sound. The processor (210) according to an embodiment of the present disclosure may execute instructions or program codes of a sound data transmission module (236) to transmit the road friction sound to a mobile device based on location information of a plurality of external vehicles located around the vehicle and information on approaching the vehicle by the plurality of external vehicles. However, the present disclosure is not limited thereto.

[0212] The transmission conditions for each of the above-described preset groups are only one example and are not limited thereto.

[0213] The transmission conditions for each of the multiple preset groups can be individually changed by the user.

[0214] Transmission conditions for each of the preset plurality of groups may be stored in the memory (230) of the vehicle electronic device (200) according to one embodiment of the present disclosure.

[0215] According to one embodiment of the present disclosure, a processor (210) may execute instructions or program codes of a sound data transmission module (236) to transmit information on the occurrence of at least one ambient sound to a mobile device.

[0216] The information on the occurrence of at least one ambient sound may include information indicating that at least one ambient sound has occurred.

[0217] For example, the information on the occurrence of at least one ambient sound may include information indicating that “a nearby horn sound has occurred” when the processor (210) according to one embodiment of the present disclosure recognizes a nearby horn sound.

[0218] For example, the information on the occurrence of at least one ambient sound may include information indicating that “a distant siren sound has occurred” when the processor (210) according to one embodiment of the present disclosure recognizes a distant siren sound. However, the present invention is not limited thereto.

[0219] A mobile device that has received information on the occurrence of at least one ambient sound can transmit a generated sound corresponding to the information on the occurrence of at least one ambient sound to a wearable device.

[0220] The generated sound corresponding to the occurrence information of at least one ambient sound may refer to a sound generated based on an artificial intelligence model on a mobile device.

[0221] The generated sound corresponding to the occurrence information of at least one ambient sound may refer to a sound stored in the memory of the mobile device.

[0222] When a delay occurs in transmitting at least one ambient sound from a vehicle electronic device (200) according to one embodiment of the present disclosure to a mobile device, the mobile device may transmit information on the occurrence of at least one ambient sound and a corresponding generated sound to the wearable device.

[0223] Accordingly, if there is a delay in the mobile device receiving at least one ambient sound from the vehicle electronics, the mobile device may transmit the generated or stored sound to the wearable device to alert the user driving the vehicle.

[0224] The group identification module (234) may further include instructions or program codes related to the function and / or operation of identifying another group including at least one ambient sound based on a change in the size information of at least one ambient sound.

[0225] According to one embodiment of the present disclosure, a processor (210) can execute instructions or program codes of a group identification module (234) to predict a distance between a vehicle and a sound source based on information on the size of at least one ambient sound generated from at least one sound source.

[0226] According to one embodiment of the present disclosure, the processor (210) may execute commands or program codes of the group identification module (234) to determine that the distance between the vehicle and the sound source outputting the at least one ambient sound has increased when the size of at least one ambient sound has decreased.

[0227] For example, the processor (210) according to one embodiment of the present disclosure may execute instructions or program codes of the group identification module (234) to determine that the distance between the sound source outputting the siren sound and the vehicle has gotten closer or further away when the size of the siren sound has gotten bigger or smaller.

[0228] For example, according to one embodiment of the present disclosure, the processor (210) may execute instructions or program codes of the group identification module (234) to determine that the distance between the sound source outputting the siren sound and the vehicle has increased when it is recognized that the size of the siren sound has changed from 90 dB to 50 dB. However, the present disclosure is not limited thereto.

[0229] According to one embodiment of the present disclosure, the processor (210) may execute commands or program codes of the group identification module (234) to determine that the distance between the vehicle and the sound source outputting the at least one ambient sound has become closer when the size of at least one ambient sound has increased.

[0230] For example, the processor (210) according to one embodiment of the present disclosure may execute the instructions or program code of the group identification module (234) to determine that the distance between the sound source outputting the horn sound and the vehicle has increased or decreased when the size of the horn sound has decreased or increased.

[0231] For example, the processor (210) according to one embodiment of the present disclosure may execute the instructions or program code of the group identification module (234) and, when it is recognized that the size of the horn sound has changed from 40 dB to 100 dB, determine that the distance between the sound source outputting the horn sound and the vehicle has become closer. However, the present invention is not limited thereto.

[0232] According to one embodiment of the present disclosure, the processor (210) executes commands or program codes of the group identification module (234) to identify a group including at least one ambient sound among a plurality of preset groups based on information on the size of at least one ambient sound.

[0233] According to one embodiment of the present disclosure, the processor (210) executes instructions or program codes of the group identification module (234) to identify a group including at least one ambient sound among a plurality of preset groups based on recognition that the size of at least one ambient sound has changed.

[0234] For example, a processor (210) according to one embodiment of the present disclosure may recognize a close-range horn sound based on at least one ambient sound's size information and type information. The processor (210) according to one embodiment of the present disclosure may execute instructions or program codes of a group identification module (234) to identify at least one ambient sound identified as a close-range horn sound as a sound included in group 1.

[0235] According to one embodiment of the present disclosure, the processor (210) can recognize that the size information of the horn sound has changed by executing the instructions or program code of the group identification module (234). For example, the processor (210) can recognize that the close-range horn sound has changed into the far-range horn sound. According to one embodiment of the present disclosure, the processor (210) can identify at least one ambient sound identified as the far-range horn sound as a sound included in group 2 by executing the instructions or program code of the group identification module (234). However, the present disclosure is not limited thereto.

[0236] For example, a processor (210) according to one embodiment of the present disclosure may recognize a distant brake friction sound based on at least one ambient sound's size information and type information. The processor (210) according to one embodiment of the present disclosure may execute instructions or program codes of a group identification module (234) to identify at least one ambient sound identified as a distant brake friction sound as a sound included in group 2.

[0237] According to one embodiment of the present disclosure, the processor (210) can recognize that the size information of the brake friction sound has changed by executing the instructions or program code of the group identification module (234). For example, the processor (210) can recognize that the long-distance brake friction sound has changed into the close-distance brake friction sound. According to one embodiment of the present disclosure, the processor (210) can identify at least one ambient sound identified as the close-distance brake friction sound as a sound included in group 1 by executing the instructions or program code of the group identification module (234). However, the present disclosure is not limited thereto.

[0238] The sound data transmission module (236) may further include instructions or program codes related to a function and / or operation of determining whether to transmit at least one ambient sound to a mobile device based on at least one of vehicle driving information and vehicle surrounding environment information and a transmission condition corresponding to the changed group, based on the change in the size of at least one ambient sound and the change in the group including the changed at least one ambient sound.

[0239] According to one embodiment of the present disclosure, the processor (210) executes instructions or program codes of the sound data transmission module (236) to determine whether to continue transmitting at least one ambient sound that was previously being transmitted to the mobile device when a change in size information of at least one ambient sound is recognized after transmitting at least one ambient sound to the mobile device.

[0240] According to one embodiment of the present disclosure, the processor (210) can execute instructions or program codes of the sound data transmission module (236) to identify that the size of at least one ambient sound being transmitted to the mobile device has been reduced, and that a group including at least one ambient sound has been changed from group 1 to group 2.

[0241] According to one embodiment of the present disclosure, the processor (210) may execute instructions or program codes of the sound data transmission module (236) to determine whether to transmit at least one ambient sound to the mobile device based on at least one of the vehicle's driving information and the vehicle's surrounding environment information and a transmission condition corresponding to group 2. However, the present disclosure is not limited thereto.

[0242] In FIG. 2, only essential components for explaining the operation of the vehicle electronic device (200) are shown, and the components included in the vehicle electronic device (200) are not limited to those shown in FIG. 2.

[0243] FIG. 7 is a diagram illustrating an embodiment of transmitting ambient sound from a vehicle electronic device according to an embodiment of the present disclosure to a mobile device according to an embodiment of the present disclosure.

[0244] The sound data transmission module (236) may further include instructions or program codes related to the function and / or operation of transmitting output information of at least one ambient sound to a mobile device.

[0245] According to one embodiment of the present disclosure, a processor (210) may execute instructions or program codes of a sound data transmission module (236) to transmit output information of at least one ambient sound to a mobile device.

[0246] The output information may include at least one of size information of at least one ambient sound or direction information of at least one sound source that outputs at least one ambient sound.

[0247] For example, the processor (210) according to one embodiment of the present disclosure may execute instructions or program codes of the sound data transmission module (236) to transmit, to the mobile device, direction information (located 170° to the left) of a sound source outputting at least one ambient sound when at least one ambient sound is output from a sound source located 170° to the left, assuming that the front of the vehicle is 0°.

[0248] For example, according to one embodiment of the present disclosure, the processor (210) may execute instructions or program codes of the sound data transmission module (236) to transmit, to the mobile device, direction information (located 90 degrees to the right) of a sound source outputting at least one ambient sound when the front of the vehicle is assumed to be 0 degrees and at least one ambient sound is output from a sound source located 90 degrees to the right. However, the present disclosure is not limited thereto.

[0249] For example, a processor (210) according to one embodiment of the present disclosure may recognize that a horn sound of approximately 100 dB has occurred at a close range. The processor (210) may transmit information on the loudness of the horn sound at a close range (approximately 100 dB) to a mobile device. However, the present disclosure is not limited thereto.

[0250] For example, the processor (210) according to one embodiment of the present disclosure may recognize that the level of sound generated from a sound source located close to a vehicle decreases as the distance between the vehicle and the sound source increases (e.g., when the level of sound decreases from 90 dB to 40 dB). The processor (210) may transmit information about the change in the level of sound (e.g., when the level of sound gradually decreases) to the mobile device.

[0251] Accordingly, the mobile device may transmit sound generated from the sound source to the wearable device so that the sound is output at increasingly smaller volumes, but this is not limited thereto.

[0252] For example, the processor (210) according to one embodiment of the present disclosure may recognize (720, 730) that the level of sound generated from a sound source (710) located far away from a vehicle (120) increases as the distance between the vehicle (120) and the sound source (710) gets closer (for example, when the level of sound increases from 30 dB to 60 dB). The processor (210) may transmit information (720, 730) on the change in the level of sound (for example, when the level of sound gradually increases) to a mobile device.

[0253] Accordingly, the mobile device can transmit sound generated from the sound source to the wearable device so that the sound is outputted at an increasingly louder volume, but this is not limited thereto.

[0254] FIG. 8 is a diagram for explaining an operation corresponding to a vehicle electronic device transmitting mixing information to a mobile device according to one embodiment of the present disclosure.

[0255] The sound data transmission module (236) may further include instructions or program codes related to the function and / or operation of transmitting mixing information of at least one ambient sound to the mobile device.

[0256] The mixing information may include information on whether to synthesize at least one ambient sound transmitted to the mobile device and at least one audio data being played on the mobile device.

[0257] Audio data may refer to sound output from media being played on a mobile device.

[0258] The audio data may include, but is not limited to, at least one of music sound or radio sound playing on a mobile device.

[0259] According to one embodiment of the present disclosure, the processor (210) may execute instructions or program codes of the sound data transmission module (236) to transmit information to the mobile device instructing not to synthesize at least one ambient sound and at least one audio data being played on the mobile device when at least one ambient sound included in group 1 having a very high importance is recognized.

[0260] In this case, the mobile device can block audio data (810) being played by the wearable device (130) and transmit only at least one ambient sound (850) (840).

[0261] According to one embodiment of the present disclosure, the processor (210) may execute instructions or program codes of the sound data transmission module (236) to transmit information instructing the mobile device not to synthesize at least one ambient sound and at least one audio data being played on the mobile device when at least one ambient sound included in the low-importance group 3 is recognized.

[0262] In this case, the mobile device may transmit audio data (810) being played to the wearable device (130) and may not transmit at least one ambient sound (850) (820).

[0263] According to one embodiment of the present disclosure, the processor (210) may execute instructions or program codes of the sound data transmission module (236) to transmit information instructing the mobile device to synthesize at least one ambient sound and at least one audio data being played on the mobile device when at least one ambient sound included in the high importance group 2 is recognized.

[0264] In this case, the mobile device can transmit a sound synthesized from at least one ambient sound (850) and audio data (810) to the wearable device (130) (830).

[0265] A processor (210) according to one embodiment of the present disclosure may execute instructions or program codes of a sound data transmission module (236) to transmit at least one ambient sound, output information of at least one ambient sound, and mixing information to a mobile device.

[0266] In this case, the mobile device can transmit a sound synthesized from audio data and ambient sound or at least one ambient sound to the wearable device based on output information and mixing information of at least one ambient sound.

[0267] For example, a mobile device may receive information instructing to synthesize at least one ambient sound with audio data based on output information and mixing information of at least one ambient sound, wherein at least one ambient sound is recognized as having a volume less than 40 dB from the left side of the vehicle. The mobile device may synthesize the at least one ambient sound with audio data at a volume lower than that of the audio data being played. The mobile device may transmit the synthesized sound to a wearable device worn on the left ear so that the synthesized sound is output from the wearable device.

[0268] For example, the mobile device may receive information instructing to synthesize the at least one ambient sound with audio data based on output information and mixing information of at least one ambient sound, wherein the at least one ambient sound is recognized as having a volume greater than or equal to 40 dB and less than or equal to 90 dB from the right side of the vehicle. The mobile device may synthesize the at least one ambient sound with audio data at a volume greater than that of the audio data being played. The mobile device may transmit the synthesized sound to the wearable device worn on the right ear so that the synthesized sound is output from the wearable device.

[0269] For example, the mobile device may receive mixing information that instructs not to synthesize at least one ambient sound with audio data being played, based on output information and mixing information of at least one ambient sound, when at least one ambient sound is recognized as having a volume of 90 dB or greater from the right side of the vehicle. The mobile device may transmit at least one ambient sound to the wearable device worn on the right ear so that only the at least one ambient sound is output at a loud volume. However, the present invention is not limited thereto.

[0270] FIG. 9 is a block diagram illustrating components of a mobile device according to one embodiment of the present disclosure.

[0271] A mobile device (900) may include a communication unit (920) that performs communication with a vehicle electronic device and a wearable device, a memory (930) that stores at least one command, and at least one processor (910) that executes at least one command stored in the memory (930).

[0272] The memory (930) can store various data, programs or applications for driving and controlling the mobile device (900) according to one embodiment of the present disclosure. The memory (930) can include, for example, a non-volatile memory including at least one of a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., an SD or XD memory, etc.), a ROM (Read-Only Memory), and an EEPROM (Electrically Erasable Programmable Read-Only Memory), a PROM (Programmable Read-Only Memory), and a volatile memory such as a RAM (Random Access Memory) or an SRAM (Static Random Access Memory).

[0273] The memory (930) may store instructions, data structures, and program codes that can be read by the processor (910). In the following embodiments, the processor (910) may be implemented by executing instructions or codes of a program stored in the memory (930).

[0274] The programs stored in the memory (930) can be classified into multiple modules according to their functions, and may include, for example, a sound data receiving module (932), a sound synthesis module (934), and a sound transmission module (936).

[0275] However, the instructions or codes of the program stored in the memory (930) are not limited thereto. For example, the sound data reception module (932), the sound synthesis module (923), and the sound transmission module (936) are configurations for one embodiment, and the configuration of the modules included in the memory (930) may be integrated, added, or omitted depending on the specifications of the mobile device (900) actually implemented. That is, two or more modules may be combined into one module, or one module may be divided into two or more modules and configured.

[0276] The sound data reception module (932), sound synthesis module (934), and sound transmission module (936) stored in the memory (930) refer to units that process functions or operations performed by the processor (910), and these can be implemented as software such as commands, algorithms, data structures, or program codes.

[0277] The processor (910) may be configured with hardware components that perform arithmetic, logic, and input / output operations and signal processing. The processor (910) may be configured with at least one of, for example, a central processing unit (CPU), a microprocessor, a graphic processing unit (GRAP), application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), and field programmable gate arrays (FPGAs), but is not limited thereto.

[0278] The communication unit (920) may perform communication with an external device or server through at least one wired or wireless communication network by the processor (910). According to one embodiment, the communication unit (920) may include at least one short-range communication module that performs communication according to a communication standard such as Bluetooth, Wi-Fi, BLE (Bluetooth Low Energy), NFC / RFID, Wi-Fi Direct, UWB, or ZIGBEE, and a long-range communication module that performs communication with a server for supporting long-range communication according to a long-range communication standard. The long-range communication module may perform communication through a communication network according to a 3G, 4G, and / or 5G communication standard, or a network for Internet communication.

[0279] A mobile device (900) according to one embodiment of the present disclosure can be wirelessly connected to a vehicle electronic device through a communication unit (920).

[0280] A mobile device (900) according to one embodiment of the present disclosure can be wirelessly connected to a wearable device through a communication unit (920).

[0281] The sound data receiving module (932) may be configured with instructions or program codes related to a function and / or operation of receiving at least one sound or at least one ambient sound generation information from a vehicle electronic device.

[0282] A processor (910) according to one embodiment of the present disclosure may execute instructions or program codes of a sound data receiving module (932) to receive at least one sound or at least one ambient sound generation information from a vehicle electronic device.

[0283] Information about the occurrence of at least one ambient sound may include information indicating that at least one ambient sound has occurred.

[0284] For example, the occurrence information of at least one ambient sound may include information indicating that “a nearby horn sound has occurred” when the vehicle electronic device recognizes a nearby horn sound.

[0285] For example, the information on the occurrence of at least one ambient sound may include information indicating that "a distant siren sound has occurred" when the vehicle electronic device recognizes a distant siren sound, but is not limited thereto.

[0286] The sound synthesis module (934) may be configured with instructions or program codes related to a function and / or operation of synthesizing at least one ambient sound or a generated sound corresponding to occurrence information of at least one ambient sound with audio data being played.

[0287] A processor (910) according to one embodiment of the present disclosure may execute instructions or program codes of a sound synthesis module (934) to synthesize a generated sound corresponding to at least one ambient sound or occurrence information of at least one ambient sound with audio data being played.

[0288] Audio data may refer to sound output from media being played on a mobile device.

[0289] The audio data may include, but is not limited to, at least one of music sound or radio sound playing on a mobile device.

[0290] A processor (910) according to one embodiment of the present disclosure can execute commands or program codes of a sound synthesis module (934) to generate a generated sound corresponding to occurrence information of at least one ambient sound based on an artificial intelligence model.

[0291] A processor (910) according to one embodiment of the present disclosure may execute instructions or program codes of a sound synthesis module (934) to store generated sounds corresponding to the occurrence information of at least one ambient sound in a memory (930) of a mobile device (900) according to one embodiment of the present disclosure.

[0292] The generated sound corresponding to the occurrence information of at least one ambient sound may mean a nearby horn sound generated based on an artificial intelligence model or stored in a memory (930) by the processor (910) according to one embodiment of the present disclosure by executing instructions or program codes of the sound synthesis module (934), for example, when the occurrence information of at least one ambient sound includes information indicating that “a nearby horn sound is generated.” However, the present invention is not limited thereto.

[0293] The generated sound corresponding to the occurrence information of at least one ambient sound may mean a distant siren sound generated based on an artificial intelligence model or stored in a memory by the processor (910) according to one embodiment of the present disclosure executing instructions or program codes of the sound synthesis module (934), for example, when the occurrence information of at least one ambient sound includes information indicating that “a distant siren sound is generated.” However, the present invention is not limited thereto.

[0294] The sound transmission module (936) may be configured with instructions or program codes related to the function and / or operation of transmitting synthesized sound to a wearable device.

[0295] A processor (910) according to one embodiment of the present disclosure can execute commands or program codes of a sound transmission module (936) to transmit synthesized sound to a wearable device.

[0296] Accordingly, even if a delay occurs in the mobile device (900) according to one embodiment of the present disclosure in receiving at least one ambient sound from a vehicle electronic device, the processor (910) according to one embodiment of the present disclosure executes the instructions or program code of the sound transmission module (936) to transmit the generated sound corresponding to the generation information of at least one ambient sound to the wearable device, thereby alerting a user driving the vehicle.

[0297] The sound data receiving module (932) may further include instructions or program codes related to the function and / or operation of receiving output information of at least one ambient sound from a vehicle electronic device.

[0298] According to one embodiment of the present disclosure, a processor (910) may execute instructions or program codes of a sound data receiving module (932) to receive output information of at least one ambient sound from a vehicle electronic device.

[0299] The output information may include at least one of size information of at least one ambient sound or direction information of at least one sound source that outputs at least one ambient sound.

[0300] For example, a processor (910) according to one embodiment of the present disclosure may execute instructions or program codes of a sound data reception module (932) to receive, from a vehicle electronic device, direction information (located 170° to the left) of a sound source outputting at least one ambient sound when at least one ambient sound is output from a sound source located 170° to the left when the front of the vehicle is assumed to be 0°.

[0301] For example, according to one embodiment of the present disclosure, the processor (910) may execute instructions or program codes of the sound data receiving module (932) to receive, when at least one ambient sound is output from a sound source located 90° to the right when the front of the vehicle is assumed to be 0° from the vehicle electronic device, direction information (located 90° to the right) of a sound source outputting at least one ambient sound. However, the present disclosure is not limited thereto.

[0302] For example, the processor (910) according to one embodiment of the present disclosure may execute instructions or program codes of the sound data receiving module (932) to receive information on the level of a nearby horn sound (about 100 dB) from the vehicle electronic device when the vehicle electronic device recognizes that a horn sound has been generated at a level of about 100 dB at a nearby location. However, the present invention is not limited thereto.

[0303] The sound transmission module (936) may further include instructions or program codes related to a function and / or operation of adjusting at least one of the size or direction of the sound synthesized in the output information.

[0304] According to one embodiment of the present disclosure, the processor (910) can adjust at least one of the size or direction of the synthesized sound by executing instructions or program codes of the sound transmission module (936).

[0305] For example, a processor (910) according to an embodiment of the present disclosure may receive output information from a vehicle electronic device indicating that at least one sound source outputting at least one ambient sound is located on the right side of the vehicle. The processor (910) according to an embodiment of the present disclosure may execute instructions or program codes of a sound transmission module (936) to adjust the direction of at least one synthesized sound so that at least one ambient sound is output from a wearable device worn on the right ear. However, the present disclosure is not limited thereto.

[0306] For example, a processor (910) according to an embodiment of the present disclosure may receive output information from a vehicle electronic device indicating that at least one sound source outputting at least one ambient sound is located on the left side of the vehicle and that the volume of at least one ambient sound is 100 dB. The processor (910) according to an embodiment of the present disclosure may execute instructions or program codes of a sound transmission module (936) to adjust the volume and direction of a synthesized sound so that at least one ambient sound is output at a volume greater than audio data being output from a wearable device worn on the left ear.

[0307] For example, a processor (910) according to an embodiment of the present disclosure may receive output information from a vehicle electronic device indicating that at least one sound source outputting at least one ambient sound is located on the right side of the vehicle and that the volume of at least one ambient sound is 40 dB. The processor (910) according to an embodiment of the present disclosure may execute instructions or program codes of a sound transmission module (936) to adjust the volume and direction of a synthesized sound so that at least one ambient sound is output at a lower volume than audio data being output from a wearable device worn on the right ear. However, the present disclosure is not limited thereto.

[0308] For example, the processor (910) according to one embodiment of the present disclosure may receive information on a change in the sound level, which indicates that the sound level generated from a sound source located close to the vehicle decreases as the distance between the vehicle and the sound source increases (e.g., the sound level decreases from 90 dB to 40 dB). The processor (910) according to one embodiment of the present disclosure may execute instructions or program codes of the sound transmission module (936) to adjust the sound level of at least one synthesized sound so that the sound is output to the wearable device gradually decreases. However, the present disclosure is not limited thereto.

[0309] For example, the processor (910) according to one embodiment of the present disclosure may receive information on a change in the sound level, which indicates that the sound level generated from a sound source located far away from the vehicle increases as the distance between the vehicle and the sound source decreases (for example, the sound level decreases from 30 dB to 60 dB). The processor (910) according to one embodiment of the present disclosure may execute instructions or program codes of the sound transmission module (936) to adjust the sound level of the synthesized sound so that the sound is output to the wearable device gradually louder. However, the present disclosure is not limited thereto.

[0310] The sound transmission module (936) may further include instructions or program codes related to the function and / or operation of transmitting the controlled sound to the wearable device.

[0311] A processor (910) according to one embodiment of the present disclosure can transmit controlled sound to a wearable device by executing commands or program codes of a sound transmission module (936).

[0312] In FIG. 9, only essential components for explaining the operation of the mobile device (900) are illustrated, and the components included in the mobile device (900) are not limited as illustrated in FIG. 9.

[0313] FIG. 10 is a flowchart illustrating an operating method of a vehicle electronic device according to one embodiment of the present disclosure.

[0314] In step 1010, the vehicle electronic device can acquire at least one ambient sound via at least one microphone.

[0315] An electronic device for a vehicle according to one embodiment of the present disclosure can reduce or eliminate noise when noise is acquired together with ambient sound.

[0316] An electronic device for a vehicle according to one embodiment of the present disclosure can reduce or remove noise acquired together with ambient sound through a filter.

[0317] The filter may include, but is not limited to, at least one of a bandpass filter, a moving average filter, an FIR filter, or an IIR filter.

[0318] An electronic device for a vehicle according to one embodiment of the present disclosure can cancel out noise acquired together with at least one ambient sound based on white noise corresponding to the noise.

[0319] An electronic device for a vehicle according to one embodiment of the present disclosure can reduce noise acquired together with at least one ambient sound based on destructive interference.

[0320] In step 1020, the vehicle electronic device can identify a group including at least one ambient sound among a plurality of preset groups based on at least one of type information and size information of at least one ambient sound.

[0321] An electronic device for a vehicle according to one embodiment of the present disclosure can identify information on the type of at least one ambient sound based on an artificial intelligence model.

[0322] Artificial intelligence technology (hereinafter referred to as “AI technology”) is a technology that performs operations through a neural network to analyze and / or classify input data and obtain the desired result.

[0323] These AI technologies can be implemented using algorithms. Here, an algorithm or set of algorithms for implementing AI technologies is called a neural network. Here, a neural network can receive input data, perform the aforementioned analysis and / or classification operations, and output result data. In order for a neural network to accurately output result data corresponding to the input data, the neural network needs to be trained. Here, "training" can mean inputting various data into the neural network and training the neural network so that it can discover or acquire methods for analyzing the input data, classifying the input data, and / or extracting features necessary for generating result data from the input data. Specifically, through the learning process, the neural network can learn from training data (e.g., multiple different images) and optimize and set the weight values ​​within the neural network. Then, the neural network with the optimized weight values ​​learns the input data on its own, thereby outputting the desired result.

[0324] Specifically, a neural network can be classified as a deep neural network if the number of hidden layers, which are internal layers that perform calculations, is multiple, that is, if the depth of the neural network that performs calculations increases. Examples of neural networks include, but are not limited to, a convolutional neural network (CNN), a deep neural network (DNN), a recurrent neural network (RNN), a restricted boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), and deep Q-networks. In addition, a neural network can be subdivided. For example, a CNN neural network can be subdivided into a deep convolutional neural network (DCNN) or a capsnet neural network.

[0325] In the disclosed embodiments, an "AI model" may refer to a neural network comprising at least one layer that receives input data and operates to output a desired result. Furthermore, an "AI model" may refer to an algorithm or a set of multiple algorithms that perform operations through a neural network to output a desired result, a processor for executing such an algorithm or a set thereof, software for executing such an algorithm or a set thereof, or hardware for executing such an algorithm or a set thereof.

[0326] Since the structure of the neural network has been described above (see Figure 4), any redundant explanation will be omitted.

[0327] An automotive electronic device according to one embodiment of the present disclosure can use a lossless waveform audio format (wav) as training data when training an artificial intelligence model.

[0328] An electronic device for a vehicle according to one embodiment of the present disclosure can extract features of frequency data by normalizing peaks of sound frequency data.

[0329] An automotive electronic device according to one embodiment of the present disclosure can train an artificial intelligence model based on characteristics of frequency data and learning data.

[0330] An electronic device for a vehicle according to one embodiment of the present disclosure can identify information on the type of at least one ambient sound by comparing at least one ambient sound obtained through at least one microphone with learning data.

[0331] For example, an in-vehicle electronic device according to one embodiment of the present disclosure may acquire a sound generated from a sound source located around the vehicle through at least one microphone. The in-vehicle electronic device may identify that the acquired sound corresponds to a horn sound by comparing the characteristics of the acquired sound's frequency data with learning data.

[0332] For example, an in-vehicle electronic device according to one embodiment of the present disclosure may acquire sounds generated from a sound source located around the vehicle via at least one microphone. The in-vehicle electronic device may compare the characteristics of the acquired sound's frequency data with learning data to identify that the acquired sound corresponds to a siren sound. However, this is not limited thereto.

[0333] Training of the AI ​​model can be performed by a server capable of communicating with an in-vehicle electronic device according to one embodiment of the present disclosure via a wireless communication network. For example, an external server can train the AI ​​model and transmit the trained AI model to the in-vehicle electronic device.

[0334] Since the method for learning an artificial intelligence model in a server capable of communicating with a vehicle electronic device and a wireless communication network according to one embodiment of the present disclosure has been described above (see FIGS. 5 and 6), a redundant description will be omitted.

[0335] An electronic device for a vehicle according to one embodiment of the present disclosure can recognize at least one ambient sound and obtain size information indicating the size of the ambient sound.

[0336] An electronic device for a vehicle according to one embodiment of the present disclosure can obtain information on the size of at least one ambient sound in decibel (dB) values.

[0337] An electronic device for a vehicle according to one embodiment of the present disclosure can identify a group including at least one ambient sound among a plurality of preset groups based on at least one of information on the type of at least one ambient sound and information on the size of at least one ambient sound.

[0338] The preset multiple groups can be classified into Group 1, Group 2, or Group 3 according to the importance of the surrounding sounds. However, the number of groups included in the preset multiple groups is not limited thereto.

[0339] Importance can mean the degree to which it affects the driving of a vehicle.

[0340] For example, a very high importance of ambient sound may mean that an accident is very likely to occur in a vehicle including an in-vehicle electronic device according to an embodiment of the present disclosure if the ambient sound is not perceived.

[0341] For example, a high importance of ambient sound may mean that an accident is more likely to occur in a vehicle including an in-vehicle electronic device according to an embodiment of the present disclosure when the ambient sound is not perceived.

[0342] For example, a low importance of ambient sound may mean that an accident is less likely to occur in a vehicle including an in-vehicle electronic device according to an embodiment of the present disclosure when the ambient sound is not perceived.

[0343] An electronic device for a vehicle according to one embodiment of the present disclosure may include at least one sound having a very high importance in group 1.

[0344] At least one sound included in Group 1 may include, but is not limited to, at least one of a close-range horn sound, a close-range siren sound, an explosion sound, an impact sound, or a close-range brake screeching sound.

[0345] An electronic device for a vehicle according to one embodiment of the present disclosure may include at least one sound having high importance in group 2.

[0346] At least one sound included in Group 2 may include, but is not limited to, at least one of a distant horn sound, a distant siren sound, or a distant brake screeching sound.

[0347] An electronic device for a vehicle according to one embodiment of the present disclosure may include at least one sound having low importance in group 3.

[0348] At least one sound included in Group 3 may include, but is not limited to, at least one of road friction noise or driving noise of adjacent vehicles.

[0349] An electronic device for a vehicle according to one embodiment of the present disclosure can store at least one sound included in group 1, group 2, or group 3 in a memory for each group.

[0350] At least one sound included in Group 1, Group 2 or Group 3 can be individually changed by the user.

[0351] An electronic device for a vehicle according to one embodiment of the present disclosure can predict a distance between a vehicle and a sound source based on information on the level of sound generated from at least one sound source.

[0352] For example, an in-vehicle electronic device according to one embodiment of the present disclosure may identify a sound generated from at least one sound source as a horn sound. If the in-vehicle electronic device identifies that the horn sound has a loudness of 90 dB or higher, the device may predict that the distance between the at least one sound source emitting the horn sound and the vehicle is within a preset distance (i.e., the distance is close).

[0353] For example, an in-vehicle electronic device according to one embodiment of the present disclosure may identify a sound generated from at least one sound source as a siren sound. If the in-vehicle electronic device identifies that the siren sound has a volume of 90 dB or less, the device may predict that the distance between the at least one sound source emitting the siren sound and the vehicle is greater than or equal to a preset distance (i.e., the distance is large).

[0354] For example, an automotive electronic device according to one embodiment of the present disclosure may identify a sound generated by at least one sound source as an explosion sound. If the automotive electronic device identifies that the magnitude of the explosion sound is 100 dB or greater, the vehicle electronic device may predict that the distance between the at least one sound source emitting the explosion sound and the vehicle is close (i.e., within a preset distance).

[0355] For example, an automotive electronic device according to one embodiment of the present disclosure may identify a sound generated by at least one sound source as a brake friction noise. If the automotive electronic device recognizes that the brake friction noise has a loudness of 100 dB or higher, the device may predict that the distance between the vehicle and at least one sound source emitting the brake friction noise is within a preset distance (i.e., the distance is close). However, this is not limited thereto.

[0356] An electronic device for a vehicle according to one embodiment of the present disclosure can identify a group including at least one ambient sound among a plurality of preset groups based on at least one of information on the type of at least one ambient sound and information on the size of at least one ambient sound.

[0357] For example, when a vehicle electronic device according to one embodiment of the present disclosure identifies a sound generated from at least one sound source as a horn sound and the horn sound has a loudness of 90 dB or more, the vehicle electronic device according to one embodiment of the present disclosure can identify that the sound generated from at least one sound source corresponds to a close-range horn sound.

[0358] In this case, the vehicle electronic device according to one embodiment of the present disclosure can identify that the identified short-range horn sound is included in group 1 having a very high importance among a plurality of preset groups.

[0359] For example, when a vehicle electronic device according to an embodiment of the present disclosure identifies a sound generated from at least one sound source as a brake friction sound and the magnitude of the brake friction sound is 90 dB or higher, the vehicle electronic device according to an embodiment of the present disclosure can identify that the sound generated from the at least one sound source corresponds to a close-range brake friction sound. The vehicle electronic device according to an embodiment of the present disclosure can identify that the identified close-range brake friction sound is included in Group 1, which has a very high importance, among a plurality of preset groups.

[0360] For example, if a vehicle electronic device according to an embodiment of the present disclosure identifies a sound generated from at least one sound source as a siren sound and the loudness of the horn sound is less than 90 dB, the vehicle electronic device according to an embodiment of the present disclosure can identify that the sound generated from the at least one sound source corresponds to a distant siren sound. The vehicle electronic device according to an embodiment of the present disclosure can identify that the identified distant siren sound is included in Group 2, which has a high priority among a plurality of preset groups.

[0361] For example, when a vehicle electronic device according to an embodiment of the present disclosure identifies a sound generated from at least one sound source as road friction noise and the magnitude of the road friction noise is less than 50 dB, the vehicle electronic device according to an embodiment of the present disclosure can identify that the identified road friction noise is included in a group 3 having a low importance among a plurality of preset groups.

[0362] In step 1030, the vehicle electronic device may transmit at least one ambient sound to a mobile device based on at least one of driving information of the vehicle and information about the surrounding environment of the vehicle and a transmission condition corresponding to the identified group.

[0363] The driving information of the vehicle may include at least one of vehicle speed information or vehicle speed change information.

[0364] The surrounding environment information of the vehicle may include at least one of location information of at least one sound source that outputs at least one ambient sound, weather information around the vehicle, or speed information of an external vehicle located around the vehicle.

[0365] An electronic device for a vehicle according to one embodiment of the present disclosure can obtain information on the surrounding environment of the vehicle through V2X (Vehicle to Everything) communication.

[0366] V2X communication refers to communication that allows vehicles to exchange information with other vehicles and infrastructure-based objects such as roads based on at least one of a wired or wireless network.

[0367] V2X communication may include at least one of V2V (Vehicle to Vehicle) communication, V2I (Vehicle to Infrastructure) communication, V2N (Vehicle to Network) communication, and V2P (Vehicle to Pedestrian) communication.

[0368] An electronic device for a vehicle according to one embodiment of the present disclosure can obtain information on the surrounding environment of the vehicle through at least one sensor.

[0369] The sensor may include, but is not limited to, at least one of a Global Positioning System (GPS) sensor, a sound detection sensor, an image sensor, a camera, a lidar, or a radar.

[0370] An electronic device for a vehicle according to one embodiment of the present disclosure can set transmission conditions for each of a plurality of preset groups.

[0371] The sound included in group 1 of the vehicle electronic device according to one embodiment of the present disclosure can be set to be transmitted to a mobile device regardless of the vehicle's driving information and the vehicle's surrounding environment information.

[0372] According to one embodiment of the present disclosure, a vehicle electronic device may identify at least one ambient sound having a very high importance as belonging to group 1. According to one embodiment of the present disclosure, a vehicle electronic device may transmit at least one ambient sound to a mobile device regardless of driving information of the vehicle and information about the surrounding environment of the vehicle.

[0373] For example, a vehicle electronic device according to one embodiment of the present disclosure may identify a sound generated from at least one sound source as a horn sound. The vehicle electronic device may identify the horn sound identified based on loudness information of the horn sound as a close-range horn sound. The vehicle electronic device may identify the close-range horn sound as belonging to group 1 among a plurality of preset groups. The vehicle electronic device may transmit the close-range horn sound to a mobile device regardless of driving information of the vehicle (e.g., driving speed of the vehicle).

[0374] For example, a vehicle electronic device according to one embodiment of the present disclosure may identify a sound generated from at least one sound source as an explosion sound. Based on the magnitude information of the explosion sound, the vehicle electronic device may identify the identified explosion sound as a close-range explosion sound and as being included in Group 1 among a plurality of preset groups. The vehicle electronic device may transmit the close-range explosion sound to a mobile device regardless of vehicle driving information (e.g., vehicle driving speed). However, the present disclosure is not limited thereto.

[0375] An electronic device for a vehicle according to one embodiment of the present disclosure may set a transmission condition to transmit sounds included in group 2 to a mobile device based on at least one of driving information of the vehicle and information about the surrounding environment of the vehicle.

[0376] An in-vehicle electronic device according to one embodiment of the present disclosure may identify at least one ambient sound having a high importance as being included in Group 2. The in-vehicle electronic device may transmit at least one sound included in Group 2 to a mobile device based on at least one of driving information of the vehicle and information about the surrounding environment of the vehicle.

[0377] For example, a vehicle electronic device according to one embodiment of the present disclosure may identify a sound generated from at least one sound source as a horn sound. The vehicle electronic device may identify the horn sound identified based on the loudness information of the horn sound as a distant horn sound and as falling into Group 2 among a plurality of preset groups. The vehicle electronic device may transmit the distant horn sound to a mobile device based on at least one of the speed of the vehicle, the location information of the vehicle generating the horn sound, and the speed information of the vehicle generating the horn sound.

[0378] For example, a vehicle electronic device according to an embodiment of the present disclosure may identify a sound generated from at least one sound source as a brake friction sound. The vehicle electronic device may identify the identified brake friction sound based on the magnitude information of the brake friction sound as corresponding to a remote brake friction sound and corresponding to group 2 among a plurality of preset groups. The vehicle electronic device may transmit the remote brake friction sound to a mobile device based on at least one of the speed of the vehicle, weather information around the vehicle, or speed information of the vehicle generating the brake friction sound. However, the present invention is not limited thereto.

[0379] An in-vehicle electronic device according to one embodiment of the present disclosure may identify at least one ambient sound having a high importance as being included in Group 2. The in-vehicle electronic device may transmit at least one sound included in Group 2 to a mobile device based on driving information of the vehicle.

[0380] The driving information of the vehicle may include at least one of vehicle speed information or vehicle speed change information.

[0381] An in-vehicle electronic device according to one embodiment of the present disclosure can transmit at least one sound included in group 2 to a mobile device based on speed information of a vehicle including the in-vehicle electronic device.

[0382] For example, a vehicle electronic device may identify a sound generated from at least one sound source as a brake friction sound. According to an embodiment of the present disclosure, the vehicle electronic device may identify the identified brake friction sound based on the magnitude information of the brake friction sound as corresponding to a remote brake friction sound and corresponding to group 2 among a plurality of preset groups. According to an embodiment of the present disclosure, the vehicle electronic device may transmit the remote brake friction sound to a mobile device when a vehicle including the vehicle electronic device is driving at a high speed.

[0383] High-speed driving may mean a case where a vehicle including an electronic device for a vehicle according to one embodiment of the present disclosure is driving at a certain speed or higher.

[0384] The constant speed may be set based on the speed limit of the road on which the vehicle including the vehicle electronic device according to one embodiment of the present disclosure is driving, but is not limited thereto.

[0385] An automotive electronic device according to one embodiment of the present disclosure can obtain speed limit information of a road on which a vehicle including the automotive electronic device is driving through V2X communication.

[0386] For example, a vehicle electronic device according to one embodiment of the present disclosure may set a constant speed to 30 km / h when a vehicle including the vehicle electronic device is driving on a road with a speed limit of 30 km / h.

[0387] For example, an in-vehicle electronic device according to one embodiment of the present disclosure may set a constant speed to 100 km / h when a vehicle including the in-vehicle electronic device is driving on a road with a speed limit of 100 km / h. However, this is not limited thereto.

[0388] The speed can be changed by the user.

[0389] For example, a user may set a constant speed to 80 km / h regardless of the speed limit of the road on which a vehicle including an in-vehicle electronic device according to one embodiment of the present disclosure is driving.

[0390] For example, a user may set a constant speed of 100 km / h regardless of the speed limit of the road on which a vehicle including an in-vehicle electronic device according to one embodiment of the present disclosure is driving, but is not limited thereto.

[0391] An in-vehicle electronic device according to one embodiment of the present disclosure can transmit at least one sound included in group 2 to a mobile device based on speed change information of a vehicle including the in-vehicle electronic device.

[0392] The vehicle's speed change information may include at least one of rapid acceleration or rapid deceleration.

[0393] Rapid acceleration may mean that the speed of a vehicle including an in-vehicle electronic device according to one embodiment of the present disclosure increases rapidly within a short period of time.

[0394] Rapid acceleration may mean, but is not limited to, an increase in the speed of a vehicle including an in-vehicle electronic device according to an embodiment of the present disclosure, for example, at a speed of 2.8 m / s or greater.

[0395] Rapid deceleration may mean that the speed of a vehicle including an in-vehicle electronic device according to one embodiment of the present disclosure is rapidly reduced within a short period of time.

[0396] Rapid deceleration may mean, but is not limited to, a decrease in the speed of a vehicle including an in-vehicle electronic device according to an embodiment of the present disclosure, for example, at a speed of 2.8 m / s or greater.

[0397] For example, a vehicle electronic device may identify a sound generated from at least one sound source as a brake friction sound. According to an embodiment of the present disclosure, the vehicle electronic device may identify the identified brake friction sound based on the magnitude information of the brake friction sound as corresponding to a remote brake friction sound and corresponding to group 2 among a plurality of preset groups. According to an embodiment of the present disclosure, the vehicle electronic device may not transmit the remote brake friction sound to a mobile device when a vehicle including the vehicle electronic device is driving at a low speed.

[0398] An in-vehicle electronic device according to one embodiment of the present disclosure may transmit a remote brake friction sound to a mobile device when a vehicle including the in-vehicle electronic device rapidly accelerates. Here, the remote brake friction sound may refer to a brake friction sound generated from a sound source located in the direction in which the vehicle including the in-vehicle electronic device according to one embodiment of the present disclosure rapidly accelerates. However, the present disclosure is not limited thereto.

[0399] For example, a vehicle electronic device may identify a sound generated from at least one sound source as a horn sound. The vehicle electronic device according to an embodiment of the present disclosure may identify the horn sound identified based on the loudness information of the horn sound as a distant horn sound and as belonging to group 2 among a plurality of preset groups. The vehicle electronic device according to an embodiment of the present disclosure may not transmit the distant horn sound to a mobile device when a vehicle including the vehicle electronic device is driving at a low speed. However, the present disclosure is not limited thereto.

[0400] An in-vehicle electronic device according to one embodiment of the present disclosure can transmit a distant horn sound to a mobile device when a vehicle including the in-vehicle electronic device rapidly decelerates. Here, the distant horn sound may refer to brake friction noise generated from a sound source located at the rear of the vehicle including the in-vehicle electronic device according to one embodiment of the present disclosure. However, the present disclosure is not limited thereto.

[0401] Low-speed driving may mean a case where a vehicle including an electronic device for a vehicle according to one embodiment of the present disclosure is driving at a speed below a certain speed.

[0402] The constant speed may be set based on the speed limit of the road on which the vehicle including the vehicle electronic device according to one embodiment of the present disclosure is driving, but is not limited thereto.

[0403] An in-vehicle electronic device according to one embodiment of the present disclosure can obtain speed limit information of a road on which a vehicle including the in-vehicle electronic device is driving through V2X communication. However, the present invention is not limited thereto.

[0404] For example, a vehicle electronic device according to one embodiment of the present disclosure may set a constant speed of the vehicle to 30 km / h when a vehicle including the vehicle electronic device is driving on a road with a speed limit of 30 km / h.

[0405] For example, an in-vehicle electronic device according to one embodiment of the present disclosure may set a constant speed of the vehicle to 80 km / h when the vehicle including the in-vehicle electronic device is driving on a road with a speed limit of 80 km / h. However, this is not limited thereto.

[0406] The speed can be changed by the user.

[0407] For example, a user may set a constant speed of a vehicle to 50 km / h regardless of the speed limit of the road on which the vehicle including the vehicle electronic device according to one embodiment of the present disclosure is driving.

[0408] For example, a user may set a constant speed of a vehicle to 100 km / h regardless of the speed limit of the road on which the vehicle including the vehicle electronic device according to one embodiment of the present disclosure is driving.

[0409] An in-vehicle electronic device according to one embodiment of the present disclosure can identify at least one ambient sound having a high importance as being included in group 2. The in-vehicle electronic device can transmit at least one sound included in group 2 to a mobile device based on ambient environment information.

[0410] The vehicle's surrounding environment information may include at least one of location information of at least one sound source that outputs at least one ambient sound, weather information around the vehicle, or speed information of external vehicles located around the vehicle, but is not limited thereto.

[0411] A vehicle electronic device can identify sounds generated from at least one sound source as rain sounds. According to one embodiment of the present disclosure, a vehicle electronic device can obtain rainfall amount information based on the volume information of the rain sounds.

[0412] An electronic device for a vehicle according to one embodiment of the present disclosure can transmit at least one sound included in group 2 to a mobile device based on precipitation information.

[0413] For example, a vehicle electronic device may identify a sound generated from at least one sound source as a brake friction sound. According to an embodiment of the present disclosure, the vehicle electronic device may identify the identified brake friction sound based on the magnitude information of the brake friction sound as corresponding to a remote brake friction sound and corresponding to group 2 among a plurality of preset groups. According to an embodiment of the present disclosure, the vehicle electronic device may transmit the remote brake friction sound to a mobile device when the amount of precipitation is greater than a preset value.

[0414] For example, a vehicle electronic device may identify a sound generated from at least one sound source as a siren sound. The vehicle electronic device according to one embodiment of the present disclosure may identify the siren sound identified based on the loudness information of the siren sound as a distant siren sound and as belonging to Group 2 among a plurality of preset groups. The vehicle electronic device according to one embodiment of the present disclosure may transmit the distant siren sound to a mobile device when the amount of precipitation is greater than a preset value.

[0415] Here, the setting value may mean, but is not limited to, 15 mm.

[0416] Settings can be changed by the user.

[0417] An electronic device for a vehicle according to one embodiment of the present disclosure can obtain information on the surrounding environment of the vehicle through a sensor.

[0418] The surrounding environment information may include brightness information of a road on which a vehicle including an in-vehicle electronic device according to one embodiment of the present disclosure is driving.

[0419] An electronic device for a vehicle according to one embodiment of the present disclosure can obtain road brightness information in lux values.

[0420] An electronic device for a vehicle according to one embodiment of the present disclosure can transmit at least one sound included in group 2 to a mobile device based on brightness information of a road on which the vehicle is driving.

[0421] For example, a vehicle electronic device may identify a sound generated from at least one sound source as a siren sound. The vehicle electronic device according to an embodiment of the present disclosure may identify the siren sound identified based on the loudness information of the siren sound as a distant siren sound and as corresponding to group 2 among a plurality of preset groups. The vehicle electronic device according to an embodiment of the present disclosure may transmit a distant siren sound to a mobile device when the brightness of a road on which a vehicle including the vehicle electronic device according to an embodiment of the present disclosure is driving is below a reference value.

[0422] For example, if the brightness of light acquired through a sensor by an automotive electronic device according to one embodiment of the present disclosure is 50 lux or less, a remote siren sound may be transmitted to a mobile device. However, this is not limited thereto.

[0423] The reference value can be changed by the user.

[0424] An electronic device for a vehicle according to one embodiment of the present disclosure can set a transmission condition to transmit sounds included in group 3 to a mobile device based on information about the surrounding environment of the vehicle.

[0425] An electronic device for a vehicle according to one embodiment of the present disclosure may identify at least one sound with low importance as belonging to group 3. The electronic device for a vehicle may transmit at least one sound belonging to group 3 to a mobile device based on information about the surrounding environment of the vehicle.

[0426] For example, a vehicle electronic device according to one embodiment of the present disclosure may identify a sound generated from at least one sound source as road friction noise. The vehicle electronic device may identify the identified road friction noise as belonging to group 3 among a plurality of preset groups based on information on the magnitude of the road friction noise. The vehicle electronic device may transmit the road friction noise to a mobile device based on information on the location of a plurality of external vehicles located around the vehicle and information on the approach of a plurality of external vehicles to the vehicle. However, the present disclosure is not limited thereto.

[0427] However, the transmission conditions for each of the multiple groups set above are only one example and are not limited thereto.

[0428] The transmission conditions for each of the multiple preset groups can be individually changed by the user.

[0429] Transmission conditions for each of the preset plurality of groups may be stored in the memory of the vehicle electronic device according to one embodiment of the present disclosure.

[0430] An automotive electronic device according to one embodiment of the present disclosure can transmit information on the occurrence of at least one ambient sound to a mobile device.

[0431] The information on the occurrence of at least one ambient sound may include information indicating that at least one ambient sound has occurred.

[0432] For example, the information on the occurrence of at least one ambient sound may include information indicating that “a close-range horn sound is generated” when the vehicle electronic device according to one embodiment of the present disclosure recognizes a close-range horn sound.

[0433] For example, information on the occurrence of at least one ambient sound may include information indicating that "a distant siren sound has occurred" when a vehicle electronic device according to one embodiment of the present disclosure recognizes a distant siren sound. However, this is not limited thereto.

[0434] A mobile device that has received information on the occurrence of at least one ambient sound can transmit a generated sound corresponding to the information on the occurrence of at least one ambient sound to a wearable device.

[0435] Accordingly, even if there is a delay in transmitting at least one ambient sound from a vehicle electronic device according to one embodiment of the present disclosure to a mobile device, the mobile device can alert a user driving the vehicle by transmitting information on the occurrence of at least one ambient sound and a corresponding generated sound to the wearable device.

[0436] FIG. 11 is a flowchart illustrating an operating method of a vehicle electronic device according to one embodiment of the present disclosure.

[0437] Steps 1020 and 1030 of FIG. 11 correspond to steps 1020 and 1030 of FIG. 10, respectively.

[0438] At step 1032, the vehicle electronics device can transmit output information of at least one ambient sound to the mobile device.

[0439] The output information may include at least one of size information of at least one ambient sound or direction information of at least one sound source that outputs at least one ambient sound.

[0440] For example, an electronic device for a vehicle according to one embodiment of the present disclosure may transmit, to a mobile device, direction information (located 170° to the left) of a sound source outputting at least one ambient sound when the front of the vehicle is assumed to be 0°, and a sound source located 170° to the left outputs at least one ambient sound.

[0441] For example, an automotive electronic device according to one embodiment of the present disclosure may transmit, to a mobile device, direction information (located 90 degrees to the right) of a sound source outputting at least one ambient sound when the front of the vehicle is assumed to be 0 degrees, and a sound source located 90 degrees to the right outputs at least one ambient sound. However, the present invention is not limited thereto.

[0442] For example, an in-vehicle electronic device according to one embodiment of the present disclosure may recognize that a horn sound of approximately 100 dB has been generated at a close range. The in-vehicle electronic device according to one embodiment of the present disclosure may transmit information on the loudness of the horn sound at a close range (approximately 100 dB) to a mobile device. However, the present disclosure is not limited thereto.

[0443] For example, a vehicle electronic device according to an embodiment of the present disclosure may recognize that the level of sound generated from a sound source located close to a vehicle decreases as the distance between the vehicle and the sound source increases (for example, when the level of sound decreases from 90 dB to 40 dB). The vehicle electronic device according to an embodiment of the present disclosure may transmit information about a change in the level of sound (the level of sound gradually decreases) to a mobile device.

[0444] Accordingly, the mobile device may transmit sound generated from the sound source to the wearable device so that the sound is output at increasingly smaller volumes, but this is not limited thereto.

[0445] For example, a vehicle electronic device according to one embodiment of the present disclosure may recognize that the level of a sound generated from a sound source located far away from the vehicle increases as the distance between the vehicle and the sound source gets closer (for example, when the level of the sound increases from 30 dB to 60 dB). The vehicle electronic device according to one embodiment of the present disclosure may transmit information about a change in the level of the sound (that the level of the sound gradually increases) to a mobile device.

[0446] Accordingly, the mobile device can transmit sound generated from the sound source to the wearable device so that the sound is outputted at an increasingly louder volume, but this is not limited thereto.

[0447] FIG. 12 is a flowchart illustrating an operation method of a vehicle electronic device according to one embodiment of the present disclosure.

[0448] Steps 1020 and 1030 of FIG. 12 correspond to steps 1020 and 1030 of FIG. 10, respectively.

[0449] At step 1034, the vehicle electronics device may transmit mixing information of at least one ambient sound to the mobile device.

[0450] The mixing information may include information on whether to synthesize at least one ambient sound transmitted to the mobile device and at least one audio data being played on the mobile device.

[0451] Audio data may refer to sound output from media being played on a mobile device.

[0452] The audio data may include, but is not limited to, at least one of music sound or radio sound playing on a mobile device.

[0453] An electronic device for a vehicle according to one embodiment of the present disclosure may transmit information to a mobile device instructing not to synthesize at least one ambient sound and at least one audio data being played on the mobile device when at least one ambient sound included in group 1 having a very high importance level is recognized.

[0454] In this case, the mobile device can block audio data being played by the wearable device and transmit only at least one ambient sound.

[0455] An in-vehicle electronic device according to one embodiment of the present disclosure may transmit information to a mobile device instructing not to synthesize at least one ambient sound and at least one audio data being played on the mobile device when at least one ambient sound included in a low-importance group 3 is recognized.

[0456] In this case, the mobile device may transmit audio data being played to the wearable device and may not transmit at least one ambient sound.

[0457] An electronic device for a vehicle according to one embodiment of the present disclosure may transmit information instructing a mobile device to synthesize at least one ambient sound and at least one audio data being played on the mobile device when at least one ambient sound included in a group 2 having a high importance level is recognized.

[0458] In this case, the mobile device can transmit a sound synthesized from at least one ambient sound and audio data to the wearable device.

[0459] An electronic device for a vehicle according to one embodiment of the present disclosure can transmit at least one ambient sound, output information of at least one ambient sound, and mixing information to a mobile device.

[0460] In this case, the mobile device can transmit a sound synthesized from audio data and ambient sound or at least one ambient sound to the wearable device based on output information and mixing information of at least one ambient sound.

[0461] For example, a mobile device may receive information instructing to synthesize at least one ambient sound with audio data based on output information and mixing information of at least one ambient sound, wherein at least one ambient sound is recognized as having a volume less than 40 dB from the left side of the vehicle. The mobile device may synthesize the at least one ambient sound with audio data at a volume lower than that of the audio data being played. The mobile device may transmit the synthesized sound to a wearable device worn on the left ear so that the synthesized sound is output from the wearable device.

[0462] For example, the mobile device may receive information instructing to synthesize the at least one ambient sound with audio data based on output information and mixing information of at least one ambient sound, wherein the at least one ambient sound is recognized as having a volume greater than or equal to 40 dB and less than or equal to 90 dB from the right side of the vehicle. The mobile device may synthesize the at least one ambient sound with the audio data at a volume greater than that of the audio data being played. The mobile device may transmit the synthesized sound to the wearable device worn on the right ear so that the synthesized sound is output from the wearable device.

[0463] For example, a mobile device may receive mixing information indicating that at least one ambient sound is recognized as having a loudness of 90 dB or greater from the right side of a vehicle based on output information and mixing information of at least one ambient sound, and that at least one ambient sound should not be synthesized with audio data being played. The mobile device may transmit at least one ambient sound to a wearable device worn on the right ear so that only the at least one ambient sound is output loudly from the wearable device. However, the present invention is not limited thereto.

[0464] FIG. 13 is a flowchart illustrating an operation method of a vehicle electronic device according to one embodiment of the present disclosure.

[0465] Steps 1020 and 1030 of FIG. 13 correspond to steps 1020 and 1030 of FIG. 10, respectively.

[0466] At step 1036, the vehicle electronic device can identify another group including at least one ambient sound based on a change in the level information of at least one ambient sound.

[0467] An electronic device for a vehicle according to one embodiment of the present disclosure can predict a distance between a vehicle and a sound source based on information on the size of at least one ambient sound generated from at least one sound source.

[0468] An electronic device for a vehicle according to one embodiment of the present disclosure may determine that the distance between the vehicle and a sound source outputting at least one ambient sound has increased when the size of at least one ambient sound has decreased.

[0469] For example, an electronic device for a vehicle according to one embodiment of the present disclosure may determine that the distance between a sound source outputting a siren sound and a vehicle has gotten closer or further away when the size of the siren sound has increased or decreased.

[0470] For example, an automotive electronic device according to one embodiment of the present disclosure may determine that the distance between the vehicle and the sound source outputting the siren sound has increased when it is recognized that the siren sound level has changed from 90 dB to 50 dB. However, the present disclosure is not limited thereto.

[0471] An electronic device for a vehicle according to one embodiment of the present disclosure may determine that the distance between the vehicle and a sound source outputting at least one ambient sound has become closer when the size of at least one ambient sound has increased.

[0472] For example, an electronic device for a vehicle according to one embodiment of the present disclosure may determine that the distance between a sound source outputting a horn sound and a vehicle has increased or decreased when the volume of the horn sound has decreased or increased.

[0473] For example, an electronic device for a vehicle according to one embodiment of the present disclosure may determine that the distance between the sound source outputting the horn sound and the vehicle has become closer when it is recognized that the loudness of the horn sound has changed from 40 dB to 100 dB. However, the present invention is not limited thereto.

[0474] An electronic device for a vehicle according to one embodiment of the present disclosure can identify a group including at least one ambient sound among a plurality of preset groups based on information on the size of at least one ambient sound.

[0475] An electronic device for a vehicle according to one embodiment of the present disclosure can identify a group including at least one ambient sound among a plurality of preset groups based on recognizing that the size of at least one ambient sound has changed.

[0476] For example, a vehicle electronic device according to one embodiment of the present disclosure may recognize a close-range horn sound based on at least one ambient sound's volume information and type information. The vehicle electronic device according to one embodiment of the present disclosure may identify at least one ambient sound identified as a close-range horn sound as a sound included in Group 1.

[0477] An electronic device for a vehicle according to one embodiment of the present disclosure can recognize that the loudness information of a horn sound has changed. An electronic device for a vehicle according to one embodiment of the present disclosure can recognize that a close-range horn sound has changed into a far-range horn sound. An electronic device for a vehicle according to one embodiment of the present disclosure can identify at least one ambient sound identified as a far-range horn sound as a sound included in Group 2. However, the present disclosure is not limited thereto.

[0478] For example, a vehicle electronic device according to one embodiment of the present disclosure may recognize a distant brake friction sound based on at least one ambient sound's size information and type information. The vehicle electronic device according to one embodiment of the present disclosure may identify at least one ambient sound identified as a distant brake friction sound as a sound included in Group 2.

[0479] A vehicle electronic device according to an embodiment of the present disclosure can recognize that the magnitude information of brake friction noise has changed. For example, a vehicle electronic device according to an embodiment of the present disclosure can recognize that a far-field brake friction noise has changed into a near-field brake friction noise. A vehicle electronic device according to an embodiment of the present disclosure can identify at least one ambient sound identified as a near-field brake friction noise as a sound included in Group 1. However, the present disclosure is not limited thereto.

[0480] In step 1038, the vehicle electronic device may determine whether to transmit at least one ambient sound to the mobile device based on at least one of driving information of the vehicle and surrounding environment information of the vehicle and a transmission condition corresponding to another group.

[0481] An electronic device for a vehicle according to one embodiment of the present disclosure may determine whether to transmit at least one ambient sound to a mobile device based on at least one of driving information of the vehicle and information about the surrounding environment of the vehicle and a transmission condition corresponding to the changed group, based on the change in the size of at least one ambient sound and the change in a group including the changed at least one ambient sound.

[0482] An electronic device for a vehicle according to one embodiment of the present disclosure may determine whether to continue transmitting at least one ambient sound that was previously being transmitted to the mobile device when a change in the size information of at least one ambient sound is recognized after transmitting at least one ambient sound to the mobile device.

[0483] According to one embodiment of the present disclosure, when it is identified that the volume of at least one ambient sound being transmitted to a mobile device has been reduced and that a group including at least one ambient sound has been changed from group 1 to group 2, the vehicle electronic device may determine whether to transmit at least one ambient sound, the volume of which has been reduced, to the mobile device based on at least one of vehicle driving information and vehicle surrounding environment information and a transmission condition corresponding to group 2. However, the present disclosure is not limited thereto.

[0484] FIG. 14 is a flowchart illustrating an operation method of a mobile device according to one embodiment of the present disclosure.

[0485] A mobile device and a vehicle electronic device according to one embodiment of the present disclosure can be connected via wireless communication.

[0486] A mobile device according to one embodiment of the present disclosure can be connected to a wearable device via wireless communication.

[0487] Here, the wireless connection may include at least one short-range communication module that performs communication according to a communication standard such as Bluetooth, Wi-Fi, BLE (Bluetooth Low Energy), NFC / RFID, Wi-Fi Direct, UWB, or ZIGBEE, and a long-range communication module that performs communication with a server to support long-range communication according to a long-range communication standard. The long-range communication module may perform communication through a communication network according to a 3G, 4G, and / or 5G communication standard, or a network for Internet communication.

[0488] At step 1410, the mobile device may receive at least one ambient sound or at least one ambient sound generation information from the vehicle electronic device.

[0489] Information about the occurrence of at least one ambient sound may include information indicating that at least one ambient sound has occurred.

[0490] For example, the occurrence information of at least one ambient sound may include information indicating that “a nearby horn sound has occurred” when the vehicle electronic device recognizes a nearby horn sound.

[0491] For example, the information on the occurrence of at least one ambient sound may include information indicating that "a distant siren sound has occurred" when the vehicle electronic device recognizes a distant siren sound, but is not limited thereto.

[0492] In step 1420, the mobile device can synthesize the audio data being played with a generated sound corresponding to at least one ambient sound or occurrence information of at least one ambient sound.

[0493] Audio data may refer to sound output from media being played on a mobile device.

[0494] The audio data may include, but is not limited to, at least one of music sound or radio sound playing on a mobile device.

[0495] A mobile device according to one embodiment of the present disclosure can generate a generated sound corresponding to occurrence information of at least one ambient sound based on an artificial intelligence model.

[0496] A mobile device according to one embodiment of the present disclosure can store a generated sound corresponding to occurrence information of at least one ambient sound in a memory of the mobile device according to one embodiment of the present disclosure.

[0497] The generated sound corresponding to the occurrence information of at least one ambient sound may refer to a nearby horn sound generated based on an artificial intelligence model or stored in memory in a mobile device according to an embodiment of the present disclosure, for example, when the occurrence information of at least one ambient sound includes information indicating that "a nearby horn sound is generated." However, the present disclosure is not limited thereto.

[0498] The generated sound corresponding to the occurrence information of at least one ambient sound may refer to a distant siren sound generated based on an artificial intelligence model or stored in memory in a mobile device according to an embodiment of the present disclosure, for example, when the occurrence information of at least one ambient sound includes information indicating that "a distant siren sound is occurring." However, the present disclosure is not limited thereto.

[0499] At step 1430, the mobile device may transmit the synthesized sound to the wearable device.

[0500] Accordingly, even if a delay occurs in receiving at least one ambient sound from a vehicle electronic device according to an embodiment of the present disclosure, the mobile device according to an embodiment of the present disclosure can warn a user driving a vehicle by transmitting information on the occurrence of at least one ambient sound and a corresponding generated sound to a wearable device.

[0501] FIG. 15 is a flowchart illustrating an operation method of a mobile device according to one embodiment of the present disclosure.

[0502] Steps 1420 and 1430 of FIG. 15 correspond to steps 1420 and 1430 of FIG. 14, respectively.

[0503] At step 1432, the mobile device can receive output information of at least one ambient sound from the vehicle electronic device.

[0504] The output information may include at least one of size information of at least one ambient sound or direction information of at least one sound source that outputs at least one ambient sound.

[0505] For example, a mobile device according to one embodiment of the present disclosure may receive direction information (located 170° to the left) of a sound source outputting at least one ambient sound when the front of the vehicle is assumed to be 0° from the vehicle electronic device, and the sound source is located 170° to the left.

[0506] For example, a mobile device according to one embodiment of the present disclosure may receive direction information (located 90 degrees to the right) of a sound source outputting at least one ambient sound when the front of the vehicle is assumed to be 0 degrees from the vehicle electronic device, and the sound source is located 90 degrees to the right. However, the present invention is not limited thereto.

[0507] For example, a mobile device according to one embodiment of the present disclosure may receive information on the level of a nearby horn sound (about 100 dB) from the vehicle electronic device when the vehicle electronic device recognizes that a horn sound of about 100 dB has been generated at a close range. However, the present disclosure is not limited thereto.

[0508] At step 1434, the mobile device can adjust at least one of the volume or direction of the synthesized sound based on the output information.

[0509] For example, a mobile device according to one embodiment of the present disclosure may receive output information from an in-vehicle electronic device indicating that at least one sound source outputting at least one ambient sound is located on the right side of the vehicle. The mobile device according to one embodiment of the present disclosure may adjust the direction of at least one synthesized sound so that at least one ambient sound is output from a wearable device worn on the right ear. However, the present disclosure is not limited thereto.

[0510] For example, a mobile device according to an embodiment of the present disclosure may receive output information from an in-vehicle electronic device indicating that at least one sound source outputting at least one ambient sound is located on the left side of the vehicle and that the at least one ambient sound has a volume of 100 dB. The mobile device according to an embodiment of the present disclosure may adjust the volume and direction of at least one synthesized sound so that the at least one ambient sound is output at a volume louder than audio data being output by a wearable device worn on the left ear.

[0511] For example, a mobile device according to an embodiment of the present disclosure may receive output information from an in-vehicle electronic device indicating that at least one sound source outputting at least one ambient sound is located on the right side of the vehicle and that the volume of at least one ambient sound is 40 dB. The mobile device according to an embodiment of the present disclosure may adjust the direction and volume of at least one synthesized sound so that the at least one ambient sound is output at a lower volume than audio data being output by a wearable device worn on the right ear. However, the present disclosure is not limited thereto.

[0512] For example, a mobile device according to one embodiment of the present disclosure may receive information about a change in sound level from an in-vehicle electronic device indicating that the sound level generated from a sound source located close to the vehicle decreases as the distance between the vehicle and the sound source increases (e.g., the sound level decreases from 90 dB to 40 dB).

[0513] In this case, a mobile device according to one embodiment of the present disclosure may adjust the sound generated from the sound source so that the sound is outputted to the wearable device at a gradually lower level. However, this is not limited thereto.

[0514] For example, a mobile device according to one embodiment of the present disclosure may receive sound level change information (sound level gradually increasing) indicating that the sound level generated from a sound source located far from the vehicle increases as the distance between the vehicle and the sound source gets closer (e.g., the sound level increases from 30 dB to 60 dB) from the vehicle electronic device.

[0515] In this case, the mobile device according to one embodiment of the present disclosure may adjust the volume of at least one synthesized sound so that the sound is outputted to the wearable device in an increasingly louder manner, but is not limited thereto.

[0516] At step 1436, the mobile device may transmit the adjusted sound to the wearable device.

[0517] An electronic device for a vehicle according to one embodiment of the present disclosure may include at least one microphone, a memory storing at least one command, a communication unit performing communication with a mobile device, and at least one processor executing at least one command stored in the memory.

[0518] The at least one processor can acquire at least one ambient sound through the at least one microphone by executing the at least one instruction.

[0519] The at least one processor can identify a group including the at least one ambient sound among a plurality of preset groups based on at least one of type information and size information of the at least one ambient sound by executing the at least one command.

[0520] The at least one processor can control the communication unit to transmit the at least one ambient sound to the mobile device based on at least one of driving information of the vehicle and surrounding environment information of the vehicle and a transmission condition corresponding to the identified group by executing the at least one command.

[0521] The at least one processor can identify the type information of the at least one ambient sound based on an artificial intelligence model by executing the at least one command.

[0522] The at least one processor can control the communication unit to transmit output information of the at least one ambient sound to the mobile device by executing the at least one command.

[0523] The above output information may include at least one of size information of the at least one ambient sound or direction information of at least one sound source that outputs the at least one ambient sound.

[0524] The at least one processor can control the communication unit to transmit mixing information to the mobile device by executing the at least one command.

[0525] The above mixing information may include information on whether to synthesize at least one ambient sound transmitted to the mobile device and at least one audio data being played on the mobile device.

[0526] The at least one processor can identify another group including the at least one ambient sound based on a change in the size information of the at least one ambient sound by executing the at least one command.

[0527] The at least one processor may determine whether to transmit the at least one ambient sound to the mobile device based on at least one of driving information of the vehicle and surrounding environment information of the vehicle and a transmission condition corresponding to the other group by executing the at least one command.

[0528] The at least one processor can control the communication unit to transmit information on the occurrence of the at least one ambient sound to the mobile device by executing the at least one command.

[0529] The surrounding environment information of the vehicle may include at least one of location information of a sound source generating the at least one surrounding sound, weather information around the vehicle, or speed information of an external vehicle located around the vehicle.

[0530] The driving information of the vehicle may include at least one of speed information of the vehicle or speed change information of the vehicle.

[0531] A mobile device according to one embodiment of the present disclosure may include a communication unit that performs communication with a vehicle electronic device and a wearable device, a memory that stores at least one command, and at least one processor that executes at least one command stored in the memory.

[0532] The at least one processor can control the communication unit to receive at least one ambient sound or information on the occurrence of the at least one ambient sound from the vehicle electronic device by executing the at least one command.

[0533] The at least one processor can synthesize the generated sound corresponding to the at least one ambient sound or the occurrence information of the at least one ambient sound with the audio data being played by executing the at least one command.

[0534] The at least one processor can control the communication unit to transmit the synthesized sound to the wearable device by executing the at least one command.

[0535] The at least one processor can control the communication unit to receive output information of the at least one ambient sound from the vehicle electronic device by executing the at least one command.

[0536] The at least one processor can control the communication unit to transmit the at least one ambient sound to the wearable device based on the output information by executing the at least one command.

[0537] The above output information may include at least one of size information of the at least one ambient sound or direction information of at least one sound source that outputs the at least one ambient sound.

[0538] The at least one processor may control the communication unit to receive output information including at least one of size information of the at least one ambient sound or direction information of at least one sound source outputting the at least one ambient sound from the vehicle electronic device by executing the at least one command.

[0539] The at least one processor can adjust at least one of the size or direction of the synthesized sound based on the output information by executing the at least one command.

[0540] The at least one processor can control the communication unit to transmit the adjusted sound to the wearable device by executing the at least one command.

[0541] A method of operating a vehicle electronic device according to one embodiment of the present disclosure may include a step of acquiring at least one ambient sound through at least one microphone.

[0542] A method of operating a vehicle electronic device according to one embodiment of the present disclosure may include a step of identifying a group including at least one ambient sound among a plurality of preset groups based on at least one of type information and size information of the at least one ambient sound.

[0543] A method of operating a vehicle electronic device according to one embodiment of the present disclosure may include a step of transmitting at least one ambient sound to the mobile device based on at least one of driving information of the vehicle and surrounding environment information of the vehicle and a transmission condition corresponding to the identified group.

[0544] A method of operating a vehicle electronic device according to one embodiment of the present disclosure may include a step of transmitting output information of at least one ambient sound to the mobile device.

[0545] The above output information may include at least one of size information of the at least one ambient sound or direction information of at least one sound source that outputs the at least one ambient sound.

[0546] A method of operating a vehicle electronic device according to one embodiment of the present disclosure may include a step of transmitting mixing information to the mobile device.

[0547] The above mixing information may include information on whether to synthesize at least one ambient sound transmitted to the mobile device and at least one audio data being played on the mobile device.

[0548] A method of operating a vehicle electronic device according to one embodiment of the present disclosure may include a step of identifying another group including the at least one ambient sound based on a change in the size information of the at least one ambient sound.

[0549] A method of operating a vehicle electronic device according to one embodiment of the present disclosure may include a step of determining whether to transmit the at least one ambient sound to the mobile device based on at least one of driving information of the vehicle and ambient environment information of the vehicle and a transmission condition corresponding to the other group.

[0550] A method of operating a vehicle electronic device according to one embodiment of the present disclosure may include a step of transmitting information on the occurrence of at least one ambient sound to the mobile device.

[0551] A method of operating a vehicle electronic device according to one embodiment of the present disclosure may include a step of identifying the type information of the at least one ambient sound based on an artificial intelligence model.

[0552] The surrounding environment information of the vehicle may include at least one of location information of a sound source generating the at least one surrounding sound, weather information around the vehicle, or speed information of an external vehicle located around the vehicle.

[0553] A method of operating a mobile device according to one embodiment of the present disclosure may include a step of receiving at least one ambient sound or information on the occurrence of the at least one ambient sound from a vehicle electronic device.

[0554] A method of operating a mobile device according to one embodiment of the present disclosure may include a step of synthesizing a generated sound corresponding to at least one ambient sound or occurrence information of the at least one ambient sound with audio data being played.

[0555] A method of operating a mobile device according to one embodiment of the present disclosure may include a step of transmitting the synthesized sound to a wearable device.

[0556] A method of operating a mobile device according to one embodiment of the present disclosure may include a step of receiving output information of at least one ambient sound from the vehicle electronic device.

[0557] A method of operating a mobile device according to one embodiment of the present disclosure may include a step of transmitting at least one ambient sound to the wearable device based on the output information.

[0558] The above output information may include at least one of size information of the at least one ambient sound or direction information of at least one sound source that outputs the at least one ambient sound.

[0559] A method of operating a mobile device according to one embodiment of the present disclosure may include receiving output information including at least one of size information of at least one ambient sound or direction information of at least one sound source outputting the at least one ambient sound from the vehicle electronic device.

[0560] A method of operating a mobile device according to one embodiment of the present disclosure may include a step of adjusting at least one of the size or direction of the synthesized sound based on the output information.

[0561] A method of operating a mobile device according to one embodiment of the present disclosure may include a step of transmitting the adjusted sound to the wearable device.

[0562] According to one embodiment of the present disclosure, at least one operating method of an automotive electronic device or a mobile device may be implemented in the form of program commands that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable medium may include program commands, data files, data structures, etc., either singly or in combination. The program commands recorded on the medium may be those specially designed and configured for the present invention or may be those known and available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and hardware devices specially configured to store and execute program commands, such as ROMs, RAMs, and flash memories. Examples of program commands include not only machine language codes generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter, etc.

[0563] Additionally, the operating method of at least one of the vehicle electronic devices or mobile devices according to the disclosed embodiments may be provided as a computer program product. The computer program product may be traded as a product between a seller and a buyer.

[0564] A computer program product may include a software program and a computer-readable storage medium on which the software program is stored. For example, a computer program product may include a product in the form of a software program (e.g., a downloadable app) distributed electronically by an electronic device manufacturer or through an electronic marketplace (e.g., Google Play Store, App Store). For electronic distribution, at least a portion of the software program may be stored on a storage medium or temporarily created. In this case, the storage medium may be a storage medium of a manufacturer's server, an electronic marketplace server, or a relay server that temporarily stores the software program.

[0565] In a system comprising a server and a client device, the computer program product may include a storage medium of the server or a storage medium of the client device. Alternatively, if a third device (e.g., a smartphone) exists that is communicatively connected to the server or the client device, the computer program product may include a storage medium of the third device. Alternatively, the computer program product may include a software program itself that is transmitted from the server to the client device or the third device, or from the third device to the client device.

[0566] In this case, one of the server, the client device, and the third device may execute the computer program product to perform the method according to the disclosed embodiments. Alternatively, two or more of the server, the client device, and the third device may execute the computer program product to perform the method according to the disclosed embodiments in a distributed manner.

[0567] For example, a server (e.g., a cloud server or an artificial intelligence server, etc.) may execute a computer program product stored on the server, thereby controlling a client device in communication with the server to perform a method according to the disclosed embodiments.

[0568] Although the embodiments have been described in detail above, the scope of the present invention is not limited thereto, and various modifications and improvements made by those skilled in the art using the basic concept of the present invention defined in the following claims also fall within the scope of the present invention.

Claims

1. In a vehicle electronic device (200), At least one microphone (220); A memory (230) storing at least one command; A communication unit (240) that performs communication with a mobile device; and At least one processor (210) for executing at least one instruction stored in the memory, The at least one processor, by executing the at least one instruction, Acquiring at least one ambient sound through at least one microphone, Based on at least one of the type information and size information of the at least one ambient sound, a group including the at least one ambient sound is identified among a plurality of preset groups, A vehicle electronic device that controls the communication unit (240) to transmit at least one ambient sound to the mobile device based on at least one of driving information of the vehicle and surrounding environment information of the vehicle and a transmission condition corresponding to the identified group.

2. In paragraph 1, The at least one processor (210) executes the at least one instruction, An automotive electronic device that identifies the type information of at least one ambient sound based on an artificial intelligence model.

3. In paragraph 1 or 2, The at least one processor (210) executes the at least one instruction, Controlling the communication unit (240) to transmit output information of at least one ambient sound to the mobile device, A vehicle electronic device, wherein the output information includes at least one of size information of the at least one ambient sound or direction information of at least one sound source outputting the at least one ambient sound.

4. In any one of paragraphs 1 to 3, The at least one processor (210) executes the at least one instruction, Controlling the communication unit (240) to transmit mixing information to the mobile device; An in-vehicle electronic device, wherein the mixing information includes information on whether to synthesize at least one ambient sound transmitted to the mobile device and at least one audio data being played on the mobile device.

5. In any one of the clauses 1 to 4, the at least one processor (210) executes the at least one instruction, Identifying another group including at least one ambient sound based on a change in the size information of at least one ambient sound, An electronic device for a vehicle, which determines whether to transmit at least one ambient sound to the mobile device based on at least one of driving information of the vehicle and surrounding environment information of the vehicle and a transmission condition corresponding to the other group.

6. In any one of the clauses 1 to 5, the at least one processor (210) executes the at least one instruction, A vehicle electronic device that controls the communication unit (240) to transmit information on the occurrence of at least one ambient sound to the mobile device.

7. In any one of paragraphs 1 to 6, An electronic device for a vehicle, wherein the surrounding environment information of the vehicle includes at least one of location information of a sound source generating the at least one surrounding sound, weather information around the vehicle, or speed information of an external vehicle located around the vehicle.

8. In a mobile device (900), A communication unit (920) that performs communication with vehicle electronic devices and wearable devices; A memory (930) storing at least one command; and At least one processor (910) for executing at least one instruction stored in the memory, The at least one processor (910) executes the at least one instruction, Controlling the communication unit (920) to receive at least one ambient sound or information on the occurrence of the at least one ambient sound from the vehicle electronic device, Synthesizing the generated sound corresponding to at least one ambient sound or occurrence information of the at least one ambient sound with the audio data being played, A mobile device that controls a communication unit (820) to transmit the synthesized sound to the wearable device.

9. In the 8th paragraph, the at least one processor (910) executes the at least one instruction, Control the communication unit (920) to receive output information including at least one of the size information of the at least one ambient sound or the direction information of at least one sound source outputting the at least one ambient sound from the vehicle electronic device, Based on the above output information, at least one of the size or direction of the synthesized sound is adjusted, A mobile device that controls the communication unit (920) to transmit the adjusted sound to the wearable device.

10. In the operating method of a vehicle electronic device, A step (S1010) of acquiring at least one ambient sound through at least one microphone; A step (S1020) of identifying a group including at least one ambient sound among a plurality of preset groups based on at least one of the type information and size information of the at least one ambient sound; and An operating method, comprising: a step (S1030) of transmitting at least one ambient sound to the mobile device based on at least one of driving information of the vehicle and surrounding environment information of the vehicle and a transmission condition corresponding to the identified group.

11. In the 10th paragraph, the step (S1030) of transmitting at least one ambient sound to the mobile device, A step (S1032) of transmitting output information of at least one ambient sound to the mobile device; An operating method, wherein the output information includes at least one of size information of the at least one ambient sound or direction information of at least one sound source outputting the at least one ambient sound.

12. In the 10th or 11th clause, the step (S1030) of transmitting at least one ambient sound to the mobile device, Including a step (S1034) of transmitting mixing information to the mobile device; A method of operation, wherein the mixing information includes information on whether to synthesize at least one ambient sound transmitted to the mobile device and at least one audio data being played on the mobile device.

13. In any one of clauses 10 to 12, the step (S1030) of transmitting at least one ambient sound to the mobile device, A step (S1036) of identifying another group including at least one ambient sound based on a change in the size information of at least one ambient sound; and An operating method comprising: a step (S1038) of determining whether to transmit at least one ambient sound to the mobile device based on at least one of driving information of the vehicle and ambient environment information of the vehicle and a transmission condition corresponding to the other group.

14. In any one of clauses 10 to 13, the operating method is: A method of operation, further comprising: a step of transmitting information on the occurrence of at least one ambient sound to the mobile device.

15. In any one of paragraphs 10 to 14, An operating method, wherein the surrounding environment information of the vehicle includes at least one of location information of a sound source generating the at least one surrounding sound, weather information around the vehicle, or speed information of an external vehicle located around the vehicle.

Images