Electronic device for vehicle, and operating method thereof

Abstract

Disclosed is an operating method of an electronic device for a vehicle, the operating method including: obtaining at least one ambient sound through a microphone; identifying a group including the at least one ambient sound from among a plurality of preset groups on the basis of at least one of type information and volume information of the at least one ambient sound; and transmitting the at least one ambient sound to a mobile device on the basis of at least one of driving information of a vehicle and ambient environment information of the vehicle and transmission conditions corresponding to the identified group.

Description

Technical Field

[0001] The present disclosure relates to an electronic device for a vehicle and an operating method thereof, and more particularly, to an electronic device for a vehicle and an operating method thereof for providing ambient sound obtained by the electronic device for a vehicle to a user.Background Art

[0002] As the wearing rate of wearable devices increases, more people tend to wear the wearable devices even while driving a vehicle.

[0003] However, when a user wearing a wearable device is consuming media while operating a vehicle, the media is likely to prevent the user from clearly hearing sounds around the vehicle.

[0004] A noise canceling function of the wearable device, the vehicle's own sound insulation, or the user's safety gear (e.g., helmets) also prevents the user from clearly hearing the ambient sounds.

[0005] Therefore, there is a growing need to provide ambient sounds to vehicle drivers wearing wearable devices based on the vehicle's driving environment and surrounding environment.Disclosure of Invention Solution to Problem

[0006] According to an embodiment of the present disclosure, an electronic device for a vehicle may include at least one microphone, memory storing at least one instruction, a communicator configured to perform communication with a mobile device, and at least one processor configured to execute the at least one instruction stored in the memory.

[0007] The at least one processor may be configured to execute the at least one instruction to obtain at least one ambient sound through the at least one microphone.

[0008] The at least one processor may be configured to execute the at least one instruction to identify a group including the at least one ambient sound among a plurality of preset groups, based on at least one of type information and volume information of the at least one ambient sound.

[0009] The at least one processor may be configured to execute the at least one instruction to control the communicator to transmit the at least one ambient sound to the mobile device, based on at least one of driving information of a vehicle and surrounding environment information of the vehicle, and a transmission condition corresponding to the identified group.

[0010] According to an embodiment of the present disclosure, a mobile device may include a communicator configured to perform communication with an electronic device for a vehicle and a wearable device, memory storing at least one instruction, and at least one processor configured to execute the at least one instruction stored in the memory.

[0011] The at least one processor may be configured to execute the at least one instruction to control the communicator to receive, from the electronic device for a vehicle, at least one ambient sound or occurrence information of the at least one ambient sound.

[0012] The at least one processor may be configured to execute the at least one instruction to synthesize the at least one ambient sound or a generated sound corresponding to the occurrence information of the at least one ambient sound with audio data being played.

[0013] The at least one processor may be configured to execute the at least one instruction to control the communicator to transmit the synthesized sound to the wearable device.

[0014] According to an embodiment of the present disclosure, an operating method of an electronic device for a vehicle may include obtaining at least one ambient sound through at least one microphone.

[0015] According to an embodiment of the present disclosure, the operating method of the electronic device for a vehicle may include identifying a group including the at least one ambient sound among a plurality of preset groups, based on at least one of type information and volume information of the at least one ambient sound.

[0016] According to an embodiment of the present disclosure, the operating method of the electronic device for a vehicle may include transmitting the at least one ambient sound to the mobile device, based on at least one of driving information of a vehicle and surrounding environment information of the vehicle, and a transmission condition corresponding to the identified group.

[0017] According to an embodiment of the present disclosure, an operating method of a mobile device may include receiving at least one ambient sound or occurrence information of the at least one ambient sound from an electronic device for a vehicle.

[0018] According to an embodiment of the present disclosure, an operating method of a mobile device may include synthesizing the at least one ambient sound or a generated sound corresponding to the occurrence information of the at least one ambient sound with audio data being played.

[0019] According to an embodiment of the present disclosure, an operating method of a mobile device may include transmitting the synthesized sound to a wearable device.Brief Description of Drawings

[0020] FIG. 1A illustrates an example of sounds occurring around a vehicle in motion. FIG. 1B is a diagram for describing a connection relationship between an electronic device for a vehicle, according to an embodiment of the present disclosure, a mobile device according to an embodiment of the present disclosure, and a wearable device. FIG. 2 is a block diagram illustrating components of an electronic device for a vehicle, according to an embodiment of the present disclosure. FIG. 3 is a diagram for describing a plurality of preset groups. FIG. 4 is a diagram for describing an operation performed by using an artificial intelligence technology, according to an embodiment of the present disclosure. FIG. 5 illustrates an electronic device for a vehicle according to an embodiment of the present disclosure, which operates in conjunction with a server. FIG. 6 is a diagram for describing FIG. 5 in detail. FIG. 7 is a diagram for describing an embodiment of transmitting an ambient sound from an electronic device for a vehicle, according to an embodiment of the present disclosure, to a mobile device according to an embodiment of the present disclosure. FIG. 8 is a diagram for describing an operation corresponding to transmission of mixing information to a mobile device from an electronic device for a vehicle, according to an embodiment of the present disclosure. FIG. 9 is a block diagram illustrating components of a mobile device, according to an embodiment of the present disclosure. FIG. 10 is a flowchart illustrating an operating method of an electronic device for a vehicle, according to an embodiment of the present disclosure. FIG. 11 is a flowchart illustrating an operating method of an electronic device for a vehicle, according to an embodiment of the present disclosure. FIG. 12 is a flowchart illustrating an operating method of an electronic device for a vehicle, according to an embodiment of the present disclosure. FIG. 13 is a flowchart illustrating an operating method of an electronic device for a vehicle, according to an embodiment of the present disclosure. FIG. 14 is a flowchart illustrating an operating method of a mobile device, according to an embodiment of the present disclosure. FIG. 15 is a flowchart illustrating an operating method of a mobile device, according to an embodiment of the present disclosure. Mode for the Invention

[0021] Terms as used herein will be described before describing embodiments of the present disclosure in detail.

[0022] The terms are selected as common terms currently widely used, taking into account functions in the present disclosure, which may however depend on intentions of ordinary people in the art, judicial precedents, emergence of new technologies, and the like. Some terms as used herein are selected at the applicant's discretion, in which case, the meaning will be explained later in detail in the description of the present disclosure. Therefore, the terms should be defined based on their meanings and descriptions throughout the present disclosure.

[0023] The term "include (or including)" or "comprise (or comprising)" is inclusive or openended and does not exclude additional, unrecited elements or method steps. The terms "unit", "module", "block", etc., as used herein each represent a unit for handling at least one function or operation, and may be implemented in hardware, software, or a combination thereof.

[0024] The expression "at least one of A, B and C" refers to one of "A", "B", "C", "A and B", "A and C", "B and C", and "A, B, and C".

[0025] Embodiments of the present disclosure will now be described in detail with reference to accompanying drawings to be readily practiced by those of ordinary skill in the art. However, the embodiments of the present disclosure may be implemented in many different forms, and are not limited to those discussed herein. In the drawings, parts unrelated to the description are omitted for clarity, and like numerals refer to like elements throughout the specification.

[0026] In embodiments of the specification, the term "user" or "passenger" may refer to a person who controls systems, functions or operations.

[0027] In embodiments of the specification, the term "vehicle" may refer to a vehicle that includes an electronic device for a vehicle, according to an embodiment.

[0028] FIG. 1A illustrates an example of sounds occurring around a vehicle in motion.

[0029] In an embodiment of the present disclosure, a vehicle including an electronic device for a vehicle may include a four-wheeled vehicle 110 or a two-wheeled vehicle 120. It is not, however, limited thereto, and the vehicle including the electronic device for a vehicle, according to an embodiment may include various types of vehicles.

[0030] As the wearing rate of wearable devices increases, there is a growing tendency for people to wear the wearable devices while operating a vehicle.

[0031] When a driver operates a vehicle 110 or 120 while wearing a wearable device 130, the driver may fail to perceive ambient sounds 140, 150, 160 and 170 occurring around the vehicle 110 or 120 in motion due to audio data output from the wearable device 130 or due to noise canceling of the wearable device.

[0032] To increase driving safety of the vehicle 110 or 120, a method and apparatus for providing the ambient sounds 140, 150, 160 and 170 to the vehicle driver wearing the wearable device 130 based on driving information and a surrounding environment of the vehicle 110 or 120 will now be described.

[0033] FIG. 1B is a diagram for describing a connection relationship between an electronic device for a vehicle, according to an embodiment of the present disclosure, a mobile device according to an embodiment of the present disclosure, and a wearable device.

[0034] A vehicle including an electronic device 200 for a vehicle, according to an embodiment of the present disclosure, may include the four-wheeled vehicle 110 or the two-wheeled vehicle 120. It is not, however, limited thereto, and the vehicle including the electronic device for a vehicle, according to an embodiment, may include various types of vehicles.

[0035] The electronic device 200 for a vehicle, according to an embodiment of the present disclosure, may be connected to a mobile device 800 according to an embodiment of the present disclosure through wireless communication.

[0036] The mobile device 800 according to an embodiment of the present disclosure may refer to a mobile device of the user including the driver or passenger of the vehicle.

[0037] The mobile device 800 according to an embodiment of the present disclosure may include a portable electronic device. For example, it may include at least one of the user's smartphone, cell phone or tablet personal computer (tablet PC), or wearable device, but is not limited thereto.

[0038] The mobile device 800 according to an embodiment of the present disclosure may be connected to the wearable device 130 through wireless communication.

[0039] The wireless communication may include at least one short-range communication for performing communication according to a communication standard such as Bluetooth, Wi-Fi, Bluetooth low energy (BLE), NFC / RFID, Wi-Fi direct, UWB or ZIGBEE, and long-range communication for performing communication with a server for supporting the long-range communication according to a long-range communication standard. The long-range communication may be performed over a communication network that conforms to 3G, 4G and / or 5G communication standards, or over a network for Internet communication.

[0040] The electronic device 200 for a vehicle, according to an embodiment of the present disclosure, the mobile device 800 according to an embodiment of the present disclosure and the wearable device are connected to one another through wireless communication, enabling data transmission and reception from the electronic device 200 for a vehicle, according to an embodiment of the present disclosure, to the mobile device 800 according to an embodiment of the present disclosure, and from the mobile device 800 according to an embodiment of the present disclosure to the wearable device 130.

[0041] Data transmitted and received among the electronic device for a vehicle 800, according to an embodiment of the present disclosure, the mobile device 800 according to an embodiment of the present disclosure and the wearable device 130 will now be described in detail.

[0042] FIG. 2 is a block diagram illustrating components of an electronic device for a vehicle, according to an embodiment of the present disclosure.

[0043] The electronic device 200 for a vehicle may include at least one microphone 220, memory 230 that stores at least one instruction, a communicator 240 that performs communication with the mobile device, and at least one processor 210 that executes at least one instruction stored in the memory 230.

[0044] The memory 230 may store various data, programs, or applications for driving and controlling the electronic device 200 for a vehicle, according to an embodiment of the present disclosure. The memory 230 may include, for example, a non-volatile memory including at least one of a flash memory, a hard disk, a multimedia card micro type memory, a card type memory (e.g., SD or XD memory), a read-only memory (ROM), an electrically erasable programmable ROM (EEPROM), or a programmable ROM (PROM), and a volatile memory such as a random access memory (RAM) or a static RAM (SRAM).

[0045] Instructions, data structures, and program codes that are readable by the processor 210 may be stored in the memory 230. In the following embodiments, the processor 210 may be implemented by executing instructions or codes of the program stored in the memory 230.

[0046] The programs stored in the memory 230 may be classified into a plurality of modules according to the functions, which may include, for example, an ambient sound obtaining module 232, a group identifying module 234 and a sound data transmitting module 236.

[0047] However, the instructions or codes of the program stored in the memory 230 are not limited thereto. For example, the ambient sound obtaining module 232, the group identifying module 234 and the sound data transmitting module 236 are components for an embodiment, and the configurations of the modules included in the memory 230 may be integrated, added or omitted depending on the specification of the electronic device 200 for a vehicle that is actually implemented. In other words, two or more modules may be merged into one, or a single module may be split into two or more modules as needed.

[0048] The ambient sound obtaining module 232, the group identifying module 234 and the sound data transmitting module 236 stored in the memory 230 may refer to units of processing functions or operations performed by the processor 210, and may be implemented in software such as instructions, algorithms, data structures or program codes.

[0049] The processor 210 may include hardware components for performing arithmetic, logical, and input / output operations and signal processing. The processor 210 may include at least one of e.g., central processing units (CPUs), microprocessors, graphic processing units (GPUs), application specific integrated circuits (ASIC), digital signal processors (DSPs), digital signal processing devices (DSPDs, programmable logic devices (PLDs), and field programmable gate arrays (FPGAs), without being limited thereto.

[0050] The communicator 240 may perform communication with an external device or server over at least one cable or wireless communication network according to the processor 210.

[0051] In an embodiment, the communicator 240 may include at least one short-range communication module for performing communication according to a communication standard such as Bluetooth, Wi-Fi, Bluetooth low energy (BLE), NFC / RFID, Wi-Fi direct, UWB or ZIGBEE, and a long-range communication module for performing communication with a server for supporting the long-range communication according to a long-range communication standard. The long-range communication module may perform communication over a communication network that conforms to 3G, 4G and / or 5G communication standards, or over a network for Internet communication.

[0052] The microphone 220 may obtain sounds occurring around the electronic device 200 for a vehicle, according to an embodiment of the present disclosure.

[0053] The ambient sound obtaining module 232 may be configured with instructions or program codes related to a function and / or operation of obtaining at least one ambient sound through the at least one microphone 220.

[0054] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the ambient sound obtaining module 232 to obtain at least one ambient sound through the at least one microphone 220.

[0055] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the ambient sound obtaining module 232 to reduce or remove noise when the noise is obtained along with the ambient sound.

[0056] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the ambient sound obtaining module 232 to reduce or remove, through a filter, noise obtained along with the ambient sound.

[0057] The filter may include, for example, at least one of a band-pass filter, a moving average filter, a finite impulse filter (FIR filter) or an infinite impulse response filter (IIR filter), but is not limited thereto.

[0058] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the ambient sound obtaining module 232 to cancel noise obtained along with the at least one ambient sound, based on white noise corresponding to the noise.

[0059] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the ambient sound obtaining module 232 to reduce noise obtained along with the at least one ambient sound, based on destructive interference.

[0060] The group identifying module 234 may be configured with instructions or program codes related to a function and / or operation of identifying a group that includes the at least one ambient sound among a plurality of preset groups, based on at least one of type information and volume information of the at least one ambient sound.

[0061] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify a group that includes the at least one ambient sound among a plurality of preset groups, based on at least one of type information and volume information of the at least one ambient sound.

[0062] The plurality of preset groups will be described with reference to FIG. 3.

[0063] FIG. 3 is a diagram for describing a plurality of preset groups.

[0064] The plurality of preset groups may be classified into group 1, group 2 or group 3 according to the importance of the ambient sounds. However, the number of groups included in the plurality of preset groups is not limited thereto.

[0065] The importance may refer to the degree to which the driving of the vehicle is affected.

[0066] For example, that the importance of an ambient sound is very high may mean that, when the ambient sound is not perceived, there is a very high possibility of an accident occurring with the vehicle 110 or 120 that includes the electronic device 200 for a vehicle, according to an embodiment of the present disclosure.

[0067] For example, that the importance of an ambient sound is high may mean that, when the ambient sound is not perceived, there is a high possibility of an accident occurring with the vehicle 110 or 120 that includes the electronic device 200 for a vehicle, according to an embodiment of the present disclosure.

[0068] For example, that the importance of an ambient sound is low may mean that, when the ambient sound is not perceived, there is a low possibility of an accident occurring with the vehicle 110 or 120 that includes the electronic device 200 for a vehicle, according to an embodiment of the present disclosure.

[0069] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to add at least one sound with very high importance to group 1.

[0070] At least one sound included in group 1 may include at least one of, for example, a short-range horn sound, a short-range siren sound, an explosion sound, an impact sound, or a short-range brake friction sound, but is not limited thereto.

[0071] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to add at least one sound with high importance to group 2.

[0072] At least one sound included in group 2 may include at least one of, for example, a long-range horn sound, a long-range siren sound, or a long-range brake friction sound, but is not limited thereto.

[0073] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to add at least one sound with low importance to group 3.

[0074] At least one sound included in group 3 may include at least one of, for example, a road friction sound or a driving sound of an adjacent vehicle, but is not limited thereto.

[0075] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to store the at least one sound included in group 1, group 2 or group 3 in the memory 230 for each group.

[0076] The at least one sound included in group 1, group 2 or group 3 may be separately changed by the user.

[0077] Referring back to FIG. 2, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify type information of the at least one ambient sound based on an artificial intelligence model.

[0078] Artificial intelligence technology (hereinafter, AI technology) is a technology to obtain a desired result by performing processes such as analysis and / or classification on input data based on operations through a neural network.

[0079] The AI technology may be implemented by using an algorithm. The algorithm or a set of algorithms to implement the AI technology is called the neural network. The neural network may receive input data, and perform an operation for analysis and / or classification to output resulting data. As such, in order for the neural network to output accurate resulting data corresponding to the input data, the neural network needs to be trained. The training may refer to training the neural network to discover or learn by the neural network itself a method of inputting various data to the neural network and analyzing the input data, a method of classifying the input data and / or a method of extracting features required to generate resulting data from the input data. Specifically, through the training procedure, the neural network may be trained with training data (e.g., a plurality of different images) to optimize and set weight values in the neural network. A desired result is then output by learning the input data through the neural network having the optimized weight values.

[0080] Specifically, when there are a plurality of hidden layers in the neural network, which perform operations, i.e., when the depth of the neural network for performing the operations increases, the neural network may be classified as a deep neural network (DNN). The neural network may include, for example, a convolutional neural network (CNN), a DNN, a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), and a deep Q-network, without being limited thereto. The neural network may also be subdivided. For example, the CNN neural network may be subdivided into a deep convolution neural network (DCNN) or a Capsnet neural network.

[0081] In a disclosed embodiment, an AI model may refer to a neural network including at least one layer that operates to receive input data and output a desired result. Furthermore, the AI model may refer to an algorithm that performs an operation through the neural network to output a desired result, a set of a plurality of algorithms, a processor for executing the algorithm or the set of algorithms, software for executing the algorithm or the set of algorithms or hardware for executing the algorithm or the set of algorithms.

[0082] A structure of the neural network will be described with reference to FIG. 4.

[0083] FIG. 4 is a diagram for describing an operation performed by using an artificial intelligence technology, according to an embodiment of the present disclosure.

[0084] The operation of identifying type information of at least one ambient sound, which is performed in an embodiment of the present disclosure, may be performed by using an AI technology that performs operations through a neural network.

[0085] A neural network 420 may be trained by receiving training data. The trained neural network 420 may receive input data 410 through an input end 430, and an output end 450 may analyze the input data 410 and perform an operation to output a desired result as output data 460. An operation through the neural network may be performed through a hidden layer 440. Although the hidden layer 440 is illustrated as being simplified as a single-stage layer in FIG. 4, the hidden layer 440 may be formed of multiple layers.

[0086] In an embodiment of the present disclosure, the processor 210 may execute instructions or program codes of the group identifying module 234 to train an AI model by using a lossless waveform audio format (wav) for training data.

[0087] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to normalize peaks of sound frequency data to extract features of the frequency data.

[0088] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to train the AI model based on the features of the frequency data and the training data.

[0089] Referring back to FIG. 2, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify type information of at least one ambient sound by comparing the at least one ambient sound obtained through the at least one microphone with the training data.

[0090] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the ambient sound obtaining module 232 to obtain sounds produced from sound sources located around the vehicle through the at least one microphone.

[0091] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify type information of the at least one obtained ambient sound by comparing the at least one ambient sound with the training data.

[0092] For example, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the ambient sound obtaining module 232 to identify that the obtained sound corresponds to a horn sound by comparing features of the frequency data of the obtained sound with the training data.

[0093] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify that the obtained sound corresponds to a siren sound by comparing the features of frequency data of the obtained sound with the training data. However, it is not limited thereto.

[0094] The AI model may be trained by a server capable of communicating with the electronic device 200 for a vehicle according to an embodiment of the present disclosure over a wireless communication network. For example, the external server may train the AI model, and transmit the trained AI model to the electronic device 200 for a vehicle.

[0095] A method by which the server capable of communicating with the electronic device for a vehicle, according to an embodiment of the present disclosure, over a wireless communication network trains the AI model will be described with reference to FIGS. 5 and 6.

[0096] FIG. 5 illustrates an electronic device for a vehicle, according to an embodiment of the present disclosure, which operates in conjunction with a server.

[0097] A server 530 may include a server, a server system, or a server-based device that transmits and receives to and from the electronic device 200 for a vehicle over a communication network 520 and processes the data.

[0098] In the disclosed embodiment, the server 530 includes a communicator for communicating with the electronic device 200 for a vehicle installed in a vehicle 510, and a processor for executing at least one instruction.

[0099] The server 530 may receive information regarding a criterion for setting filtering data, a type of the filtering data, etc., from the electronic device 200 for a vehicle or an external device.

[0100] The server 530 may train an AI model and store the trained AI model. Furthermore, the server 530 may perform an operation of predicting whether a nearby vehicle will cut in, based on the trained AI model and the received information.

[0101] In general, the electronic device 200 for a vehicle has limitations on memory storage capacity, operation processing speed, capability to collect a training data set, etc., as compared to the server 530. Hence, an operation requiring storage of massive data and a large amount of operation may be performed by the server 530, which may then transmit required data and / or an AI model in use to the electronic device 200 for a vehicle through a communication network. Hence, the electronic device 200 for a vehicle is able to perform a required operation quickly and easily by receiving, through the server, and using the required data and / or AI model, without having a large-capacity memory and a processor having high-speed calculation capability.

[0102] FIG. 6 is a diagram for describing FIG. 5 in detail.

[0103] The electronic device 200 for a vehicle of FIG. 6 is described and illustrated by taking the same case as the electronic device 200 for a vehicle as described in FIG. 2 for example.

[0104] Referring to FIG. 6, the server 530 may include a communicator 532, a processor 534, and a database (DB) 536.

[0105] The communicator 532 may include one or more components that enable communication with the electronic device 200 for a vehicle. The communicator 532 includes at least one communication module such as a short-range communication module, a wired communication module, a mobile communication module, a broadcast receiving module, etc. The at least one communication module refers to a communication module that may perform data transmission and reception over a network that conforms to a communication standard such as a communication scheme using a tuner for performing broadcast reception, Bluetooth, wireless LAN (Wi-Fi), wireless broadband (Wibro), world interoperability for microwave access (Wimax), CDMA, WCDMA, Internet, 3G, 4G, 5G and / or 5G, millimeter waves (mmWave).

[0106] For example, by performing communication by using the mmWave, the communicator 532 may quickly transmit or receive a large amount of data. Specifically, the vehicle may provide increased safety of the vehicle and / or user convenience by quickly receiving a large amount of data and quickly providing data required for safety of the vehicle (e.g., data required for autonomous driving, data required for a navigation service, etc.), user consumable content (e.g., movie, music, etc.).

[0107] Specifically, a mobile communication module included in the communicator 532 may communicate with another device (e.g., a server (not shown)) remotely located through a communication network that conforms to a communication standard such as 3G, 4G and / or 5G. The communication module that communicates with a server (not shown) remotely located may be referred to as a long-range communication module.

[0108] The processor 534 controls general operation of the server 530. For example, the processor 534 may perform required operations by executing at least one of at least one instruction and programs of the server 530.

[0109] Furthermore, the DB 536 may include memory (not shown), which may store at least one of at least one instruction, a program, or data required by the server 530 to perform a certain operation. Furthermore, the DB 536 may store data required by the server 530 to perform a neural network based operation.

[0110] Specifically, in the disclosed embodiment, the server 530 may store the neural network 420 as described above in FIG. 4. The neural network 420 may be stored in at least one of the processor 534 and the DB 536. The neural network 420 included in the server 530 may be a neural network that has completed learning.

[0111] Furthermore, the server 530 may transmit the neural network that has completed learning to the communicator 240 of the electronic device 200 for a vehicle through the communicator 532. The electronic device 200 for a vehicle may then obtain and store the neural network that has completed learning, and obtain desired output data through the neural network.

[0112] Referring back to FIG. 2, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to recognize the volume of at least one ambient sound, and obtain volume information indicating the volume of the ambient sound.

[0113] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to obtain the volume information of the at least one ambient sound in a decibel (dB) value.

[0114] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to predict a distance between the vehicle and at least one sound source based on the volume information of a sound produced from the sound source.

[0115] For example, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify the sound produced from the at least one sound source as a horn sound. When the volume of the horn sound is identified as being 90 dB or higher, the processor 210 may predict that the distance between the at least one sound source that outputs the horn sound and the vehicle is within a preset distance (short distance).

[0116] For example, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify the sound produced from the at least one sound source as a siren sound. When the volume of the siren sound is identified as being 90 dB or lower, the processor 210 may predict that the distance between the at least one sound source that outputs the siren sound and the vehicle is equal to or longer than the preset distance (long distance).

[0117] For example, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify a sound produced from at least one sound source as an explosion sound. When the volume of the explosion sound is identified as being 100 dB or higher, the processor 210 may predict that the distance between the at least one sound source that outputs the explosion sound and the vehicle is within the preset distance (short distance).

[0118] For example, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify a sound produced from at least one sound source as a brake friction sound. When the volume of the brake friction sound is identified as being 100 dB or higher, the processor 210 may predict that the distance between the at least one sound source that outputs the brake friction sound and the vehicle is within the preset distance (short distance). However, it is not limited thereto.

[0119] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify a group that includes the at least one ambient sound among a plurality of preset groups, based on at least one of type information of the at least one ambient sound and volume information of the at least one ambient sound.

[0120] For example, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify the sound produced from the at least one sound source as a horn sound. When the volume of the horn sound is identified as being 90 dB or higher, the processor 210 may identify that the sound produced from the at least one sound source corresponds to a nearby horn sound.

[0121] In this case, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify that the identified nearby horn sound is included in group 1 with very high importance among the plurality of preset groups.

[0122] For example, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify a sound produced from at least one sound source as a brake friction sound. When the volume of the brake friction sound is identified as being 90 dB or higher, the processor 210 may identify that the sound produced from the at least one sound source corresponds to a nearby brake friction sound.

[0123] In this case, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify that the identified nearby brake friction sound is included in group 1 with very high importance among the plurality of preset groups.

[0124] For example, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify the sound produced from the at least one sound source as a siren sound and identify that the volume of the horn sound is less than 90 dB. For example, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify that the sound produced from the at least one sound source corresponds to a distant siren sound.

[0125] In this case, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify that the identified distant siren sound is included in group 2 with high importance among the plurality of preset groups.

[0126] For example, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify a sound produced from at least one sound source as a road friction sound. In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify that the identified road friction sound is included in group 3 with low importance among the plurality of preset groups when the volume of the road friction sound is identified as being less than 50 dB.

[0127] The sound data transmitting module 236 may be configured with instructions or program codes related to a function and / or operation of transmitting at least one ambient sound to the mobile device, based on at least one of driving information of the vehicle and surrounding environment information of the vehicle, and a transmission condition corresponding to the identified group.

[0128] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the sound data transmitting module 236 to transmit at least one ambient sound to the mobile device.

[0129] The driving information of the vehicle may include at least one of speed information of the vehicle or speed change information of the vehicle.

[0130] The surrounding environment information of the vehicle may include at least one of location information of at least one sound source that outputs at least one ambient sound, weather information around the vehicle or speed information of an external vehicle located around the vehicle.

[0131] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the sound data transmitting module 236 to obtain the surrounding environment information of the vehicle through vehicle to everything (V2X) communication.

[0132] The V2X communication refers to communication through which the vehicle may exchange information with infrastructure-equipped objects such as other vehicles and roads, based on at least one of cable or wireless network.

[0133] The V2X communication may include at least one of vehicle to vehicle (V2V) communication, vehicle to infrastructure (V2I) communication, vehicle to network (V2N) communication, or vehicle to pedestrian (V2P) communication.

[0134] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the sound data transmitting module 236 to obtain the surrounding environment information of the vehicle through at least one sensor (not shown).

[0135] The sensor may include at least one of a global positioning system (GPS) sensor, a sound detection sensor, an image sensor, a camera, Lidar or radar, but is not limited thereto.

[0136] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the sound data transmitting module 236 to set a transmission condition for each of the plurality of preset groups.

[0137] In an embodiment of the present disclosure, the processor 210 may set a sound included in group 1 to be transmitted to the mobile device, regardless of the driving information of the vehicle and the surrounding environment information of the vehicle.

[0138] In an embodiment of the present disclosure, the processor 210 may identify at least one ambient sound with very high importance as being included in group 1. The processor 210 may transmit the at least one ambient sound to the mobile device regardless of the driving information of the vehicle and the surrounding environment information of the vehicle.

[0139] For example, in an embodiment of the present disclosure, the processor 210 may identify a sound produced from at least one sound source as a horn sound. The processor 210 may identify that the identified horn sound corresponds to a nearby horn sound, based on the volume information of the horn sound. The processor 210 may identify that the nearby horn sound is included in group 1 of the plurality of preset groups. In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the sound data transmitting module 236 to transmit the nearby horn sound to the mobile device, regardless of the driving information of the vehicle (e.g., the vehicle's driving speed).

[0140] For example, in an embodiment of the present disclosure, the processor 210 may identify a sound produced from at least one sound source as an explosion sound. The processor 210 may identify, based on the volume information of the explosion sound, that the identified explosion sound corresponds to a nearby explosion sound and is included in group 1 of the plurality of preset groups. In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the sound data transmitting module 236 to transmit the nearby explosion sound to the mobile device, regardless of the driving information of the vehicle (e.g., vehicle's driving speed). It is not, however, limited thereto.

[0141] In an embodiment of the present disclosure, the processor 210 may set a transmission condition for transmitting a sound included in group 2 to the mobile device, based on at least one of the driving information of the vehicle and the surrounding environment information of the vehicle.

[0142] In an embodiment of the present disclosure, the processor 210 may identify at least one ambient sound with high importance as being included in group 2. The processor 210 may transmit the at least one sound included in group 2 to the mobile device, based on at least one of the driving information of the vehicle and the surrounding environment information of the vehicle.

[0143] For example, in an embodiment of the present disclosure, the processor 210 may identify a sound produced from at least one sound source as a horn sound. The processor 210 may identify, based on the volume information of the horn sound, that the identified horn sound corresponds to a distant horn sound and corresponds to group 2 of the plurality of preset groups. In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the sound data transmitting module 236 to transmit the distant horn sound to the mobile device, based on at least one of the speed of the vehicle, location information of a vehicle that produces the horn sound and speed information of the vehicle that produces the horn sound.

[0144] For example, in an embodiment of the present disclosure, the processor 210 may identify a sound produced from at least one sound source as a brake friction sound. The processor 210 may identify, based on the volume information of the brake friction sound, that the identified brake friction sound corresponds to a distant brake friction sound and corresponds to group 2 of the plurality of preset groups. In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the sound data transmitting module 236 to transmit the distant brake friction sound to the mobile device, based on at least one of the speed of the vehicle, weather information around the vehicle or speed information of a vehicle that produces the brake friction sound. However, it is not limited thereto.

[0145] In an embodiment of the present disclosure, the processor 210 may identify at least one ambient sound with high importance as being included in group 2. The processor 210 may transmit the at least one sound included in group 2 to the mobile device, based on the driving information of the vehicle.

[0146] The driving information of the vehicle may include at least one of the speed information of the vehicle or the speed change information of the vehicle.

[0147] In an embodiment of the present disclosure, the processor 210 may transmit at least one sound included in group 2 to the mobile device, based on the speed information of the vehicle that includes the electronic device 200 for vehicle.

[0148] For example, the processor 210 may identify a sound produced from at least one sound source as a brake friction sound. In an embodiment of the present disclosure, the processor 210 may identify, based on the volume information of the brake friction sound, that the identified brake friction sound corresponds to a distant brake friction sound and corresponds to group 2 of the plurality of preset groups. In an embodiment of the present disclosure, the processor 210 may transmit the distant brake friction sound to the mobile device, when the vehicle that includes the electronic device 200 for vehicle is driving at high speed.

[0149] High-speed driving may refer to a case that the vehicle including the electronic device 200 for vehicle according to an embodiment of the present disclosure is driving at or above a certain speed.

[0150] The certain speed may be set based on speed limits of the road on which the vehicle including the electronic device 200 for vehicle according to an embodiment of the present disclosure is driving. However, it is not limited thereto.

[0151] In an embodiment of the present disclosure, the processor 210 may obtain information about speed limits of the road on which the vehicle including the electronic device 200 for vehicle is driving, through V2X communication.

[0152] For example, in an embodiment of the present disclosure, the processor 210 may set the certain speed to 30 km / h, when the vehicle including the electronic device 200 for vehicle is driving on a road with a speed limit of 30 km / h.

[0153] For example, in an embodiment of the present disclosure, the processor 210 may set the certain speed to 100 km / h, when the vehicle including the electronic device 200 for vehicle is driving on a road with a speed limit of 100 km / h. However, it is not limited thereto.

[0154] The certain speed may be changed by the user.

[0155] For example, the user may set the certain speed to 80 km / h regardless of the speed limits of the road on which the vehicle including the electronic device 200 for vehicle according to an embodiment of the present disclosure is driving.

[0156] For example, the user may set the certain speed to 100 km / h regardless of the speed limits of the road on which the vehicle including the electronic device for vehicle 200 according to an embodiment of the present disclosure is driving. However, it is not limited thereto.

[0157] In an embodiment of the present disclosure, the processor 210 may transmit at least one sound included in group 2 to the mobile device, based on speed change information of the vehicle including the electronic device 200 for vehicle.

[0158] The speed change information of the vehicle may include at least one of sudden acceleration or sudden deceleration.

[0159] Sudden acceleration may refer to a sudden increase in speed of the vehicle including the electronic device 200 for vehicle according to an embodiment of the present disclosure in a short period of time.

[0160] For example, sudden acceleration may refer to an increase in speed of the vehicle including the electronic device 200 for vehicle according to an embodiment of the present disclosure by a speed of 2.8 m / s or more, but is not limited thereto.

[0161] Sudden deceleration may refer to a sudden decrease in speed of the vehicle including the electronic device 200 for vehicle according to an embodiment of the present disclosure in a short period of time.

[0162] For example, sudden deceleration may refer to a decrease in speed of the vehicle including the electronic device 200 for vehicle according to an embodiment of the present disclosure by a speed of 2.8 m / s or more, but is not limited thereto.

[0163] For example, the processor 210 may identify a sound produced from at least one sound source as a brake friction sound. In an embodiment of the present disclosure, the processor 210 may identify, based on the volume information of the brake friction sound, that the identified brake friction sound corresponds to a distant brake friction sound and corresponds to group 2 of the plurality of preset groups. In an embodiment of the present disclosure, the processor 210 may not transmit the distant brake friction sound to the mobile device, when the vehicle including the electronic device 200 for vehicle is driving at low speed.

[0164] In an embodiment of the present disclosure, the processor 210 may transmit the distant brake friction sound to the mobile device, when the vehicle including the electronic device 200 for vehicle accelerates rapidly. The distant brake friction sound may refer to a brake friction sound produced from a sound source located in a direction in which the vehicle including the electronic device 200 for vehicle accelerates rapidly. However, it is not limited thereto.

[0165] For example, the processor 210 may identify a sound produced from at least one sound source as a horn sound. In an embodiment of the present disclosure, the processor 210 may identify, based on the volume information of the horn sound, that the identified horn sound corresponds to a distant horn sound and corresponds to group 2 of the plurality of preset groups. In an embodiment of the present disclosure, the processor 210 may not transmit the distant horn sound to the mobile device, when the vehicle including the electronic device 200 for vehicle is driving at low speed. However, it is not limited thereto.

[0166] In an embodiment of the present disclosure, the processor 210 may transmit the distant horn sound to the mobile device, when the vehicle including the electronic device 200 for vehicle decelerates rapidly. The distant horn sound may refer to a brake friction sound produced from a sound source located behind the vehicle including the electronic device 200 for vehicle according to an embodiment of the present disclosure. However, it is not limited thereto.

[0167] Low-speed driving may refer to a case that the vehicle including the electronic device 200 for vehicle according to an embodiment of the present disclosure is driving at less than a certain speed.

[0168] The certain speed may be set based on speed limits of the road on which the vehicle including the electronic device 200 for vehicle according to an embodiment of the present disclosure is driving. However, it is not limited thereto.

[0169] In an embodiment of the present disclosure, the processor 210 may obtain information about speed limits of the road on which the vehicle including the electronic device 200 for vehicle is driving, through V2X communication. However, it is not limited thereto.

[0170] For example, in an embodiment of the present disclosure, the processor 210 may set the certain speed of the vehicle to 30 km / h, when the vehicle including the electronic device 200 for vehicle is driving on a road with a speed limit of 30 km / h.

[0171] For example, in an embodiment of the present disclosure, the processor 210 may set the certain speed of the vehicle to 80 km / h, when the vehicle including the electronic device 200 for vehicle is driving on a road with a speed limit of 80 km / h. However, it is not limited thereto.

[0172] The certain speed may be changed by the user.

[0173] For example, the user may set the certain speed of the vehicle to 50 km / h regardless of the speed limits of the road on which the vehicle including the electronic device 200 for vehicle according to an embodiment of the present disclosure is driving.

[0174] For example, the user may set the certain speed of the vehicle to 100 km / h regardless of the speed limits of the road on which the vehicle including the electronic device 200 for vehicle according to an embodiment of the present disclosure is driving.

[0175] In an embodiment of the present disclosure, the processor 210 may identify at least one ambient sound with high importance as being included in group 2. The processor 210 may transmit the at least one sound included in group 2 to the mobile device, based on the surrounding environment information.

[0176] The surrounding environment information of the vehicle may include at least one of location information of at least one sound source that outputs at least one ambient sound, weather information around the vehicle or speed information of an external vehicle located around the vehicle. However, it is not limited thereto.

[0177] In an embodiment of the present disclosure, the processor 210 may identify a sound produced from at least one sound source as a rain sound.

[0178] In an embodiment of the present disclosure, the processor 210 may obtain precipitation information based on the volume information of the rain sound.

[0179] In an embodiment of the present disclosure, the processor 210 may transmit at least one sound included in group 2 to the mobile device, based on the precipitation information.

[0180] For example, the processor 210 may identify a sound produced from at least one sound source as a brake friction sound. In an embodiment of the present disclosure, the processor 210 may identify, based on the volume information of the brake friction sound, that the identified brake friction sound corresponds to a distant brake friction sound and corresponds to group 2 of the plurality of preset groups. In an embodiment of the present disclosure, the processor 210 may transmit the distant brake friction sound to the mobile device, when the amount of precipitation is equal to or greater than a set value.

[0181] For example, the processor 210 may identify a sound produced from at least one sound source as a siren sound. In an embodiment of the present disclosure, the processor 210 may identify, based on the volume information of the siren sound, that the identified siren sound corresponds to a distant siren sound and corresponds to group 2 of the plurality of preset groups. In an embodiment of the present disclosure, the processor 210 may transmit the distant siren sound to the mobile device, when the amount of precipitation is equal to or greater than a set value.

[0182] The set value may be 15 mm, but is not limited thereto.

[0183] The set value may be changed by the user.

[0184] In an embodiment of the present disclosure, the processor 210 may obtain surrounding environment information of the vehicle through a sensor.

[0185] The surrounding environment information may include brightness information of a road on which the vehicle including the electronic device 200 for vehicle according to an embodiment of the present disclosure is driving.

[0186] In an embodiment of the present disclosure, the processor 210 may obtain the brightness information of the road in a lux value.

[0187] In an embodiment of the present disclosure, the processor 210 may transmit at least one sound included in group 2 to the mobile device, based on the brightness information of the road on which the vehicle is driving.

[0188] For example, the processor 210 may identify a sound produced from at least one sound source as a siren sound. In an embodiment of the present disclosure, the processor 210 may identify, based on the volume information of the siren sound, that the identified siren sound corresponds to a distant siren sound and corresponds to group 2 of the plurality of preset groups. In an embodiment of the present disclosure, the processor 210 may transmit the distant siren sound to the mobile device, when the brightness of the road on which the vehicle that includes the electronic device 200 for vehicle according to an embodiment of the present disclosure is driving is equal to or less than a threshold.

[0189] For example, in an embodiment of the present disclosure, the processor 210 may transmit the distant siren sound to the mobile device when the brightness of light obtained through the sensor is equal to or less than 50 lux. However, it is not limited thereto.

[0190] The threshold may be changed by the user.

[0191] In an embodiment of the present disclosure, the processor 210 may set a transmission condition for transmitting a sound included in group 3 to the mobile device, based on the surrounding environment information of the vehicle.

[0192] In an embodiment of the present disclosure, the processor 210 may identify at least one sound with low importance as being included in group 3. The processor 210 may transmit the at least one sound included in group 3 to the mobile device, based on the surrounding environment information of the vehicle.

[0193] For example, in an embodiment of the present disclosure, the processor 210 may identify a sound produced from at least one sound source as a road friction sound. The processor 210 may identify, based on the volume information of the road friction sound, that the identified road friction sound corresponds to group 3 of the plurality of preset groups. In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the sound data transmitting module 236 to transmit the road friction sound to the mobile device, based on location information of a plurality of external vehicles located around the vehicle and approach information of the plurality of external vehicles toward the vehicle. However, it is not limited thereto.

[0194] The aforementioned transmission condition for each of the plurality of preset groups is merely an example and is not limited thereto.

[0195] The transmission condition for each of the plurality of preset groups may be changed by the user.

[0196] The transmission condition for each of the plurality of preset groups may be stored in the memory 230 of the electronic device 200 for vehicle according to an embodiment of the present disclosure.

[0197] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the sound data transmitting module 236 to transmit occurrence information of at least one ambient sound to the mobile device.

[0198] The occurrence information of the at least one ambient sound may include information indicating that at least one ambient sound has occurred.

[0199] For example, the occurrence information of the at least one ambient sound may include information indicating that a nearby horn sound has occurred, when the processor 210 according to an embodiment of the present disclosure recognizes the nearby horn sound.

[0200] For example, the occurrence information of the at least one ambient sound may include information indicating that a distant siren sound has occurred, when the processor 210 according to an embodiment of the present disclosure recognizes the distant siren sound. However, it is not limited thereto.

[0201] Upon receiving the occurrence information of the at least one ambient sound, the mobile device may transmit a generated sound corresponding to the occurrence information of the at least one ambient sound to the wearable device.

[0202] The generated sound corresponding to the occurrence information of the at least one ambient sound may refer to a sound produced by the mobile device based on an artificial intelligence model.

[0203] The generated sound corresponding to the occurrence information of the at least one ambient sound may refer to a sound stored in memory of the mobile device.

[0204] When latency occurs in transmitting the at least one ambient sound to the mobile device from the electronic device 200 for vehicle according to an embodiment of the present disclosure, the mobile device may transmit a generated sound corresponding to the occurrence information of the at least one ambient sound to the wearable device.

[0205] In a case that latency occurs when the mobile device receives the at least one ambient sound from the electronic device for vehicle, the generated sound generated or stored by the mobile device may be transmitted to the wearable device, so that the user operating the vehicle may be alerted.

[0206] The group identifying module 234 may further include instructions or program codes related to a function and / or operation of identifying another group that includes at least one ambient sound, based on a change in volume information of the at least one ambient sound.

[0207] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to predict a distance between the vehicle and at least one sound source based on the volume information of at least one ambient sound produced from the sound source.

[0208] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to determine that the distance between the vehicle and the sound source that outputs the at least one ambient sound increases, when the volume of the at least one ambient sound decreases.

[0209] For example, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to determine that the distance between the vehicle and a sound source that outputs a siren sound has decreased and then increased, when the volume of the siren sound has increased and then decreased.

[0210] For example, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to determine that the distance between the vehicle and a sound source that outputs a siren sound increases, when recognizing a change in volume of the siren sound from 90 dB to 50 dB. However, it is not limited thereto.

[0211] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to determine that the distance between the vehicle and the sound source that outputs the at least one ambient sound decreases, when the volume of the at least one ambient sound increases.

[0212] For example, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to determine that the distance between the vehicle and a sound source that outputs a horn sound has increased and then decreased, when the volume of the horn sound has decreased and then increased.

[0213] For example, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to determine that the distance between the vehicle and a sound source that outputs a horn sound decreases, when recognizing a change in volume of the horn sound from 40 dB to 100 dB. However, it is not limited thereto.

[0214] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify a group that includes the at least one ambient sound among a plurality of preset groups, based on the volume information of the at least one ambient sound.

[0215] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify a group that includes the at least one ambient sound among a plurality of preset groups, based on a change in volume of the at least one ambient sound being recognized.

[0216] For example, in an embodiment of the present disclosure, the processor 210 may recognize a nearby horn sound based on the volume information and type information of the at least one ambient sound. In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify that the at least one ambient sound identified as a nearby horn sound is included in group 1.

[0217] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to recognize a change in volume information of the horn sound. For example, the processor 210 may recognize that the nearby horn sound has changed to a distant horn sound. In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify that the at least one ambient sound identified as a distant horn sound is included in group 2. However, it is not limited thereto.

[0218] For example, in an embodiment of the present disclosure, the processor 210 may recognize a distant brake friction sound based on the volume information and type information of the at least one ambient sound. In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify that the at least one ambient sound identified as a distant brake friction sound is included in group 2.

[0219] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to recognize a change in volume information of the brake friction sound. For example, the processor 210 may recognize that the distant brake friction sound has changed to a nearby brake friction sound. In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify that the at least one ambient sound identified as a nearby brake friction sound is included in group 1. However, it is not limited thereto.

[0220] The sound data transmitting module 236 may further include instructions or program codes related to a function and / or operation of determining whether to transmit at least one ambient sound to the mobile device, based on at least one of driving information of the vehicle and surrounding environment information of the vehicle, and a transmission condition corresponding to a changed group when the volume of the at least one ambient sound is changed and the group including the at least one changed ambient sound is changed.

[0221] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to determine whether to continue to transmit, to the mobile device, the at least one ambient sound that has been being transmitted, when recognizing a change in volume information of the at least one ambient sound after the at least one ambient sound is transmitted to the mobile device.

[0222] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the sound data transmitting module 234 to identify that the group including at least one ambient sound is changed from group 1 to group 2 as the volume of the at least one ambient sound being transmitted to the mobile device is changed to be smaller.

[0223] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the sound data transmitting module 234 to determine whether to transmit the at least one ambient sound to the mobile device, based on at least one of the driving information of the vehicle and the surrounding environment information of the vehicle, and the transmission condition corresponding to group 2. However, it is not limited thereto.

[0224] In FIG. 2, only essential components for describing an operation of the electronic device 200 for vehicle are shown, and components included in the electronic device 200 for vehicle are not limited to those shown in FIG. 2.

[0225] FIG. 7 is a diagram for describing an embodiment of transmitting an ambient sound from an electronic device for vehicle according to an embodiment of the present disclosure to a mobile device according to an embodiment of the present disclosure.

[0226] The sound data transmitting module 236 may further include instructions or program codes related to a function and / or operation of transmitting output information of the at least one ambient sound to the mobile device.

[0227] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the sound data transmitting module 236 to transmit the output information of the at least one ambient sound to the mobile device.

[0228] The output information may include at least one of volume information of the at least one ambient sound or direction information of at least one sound source that outputs the at least one ambient sound.

[0229] For example, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the sound data transmitting module 236 to transmit, to the mobile device, the direction information of a sound source outputting at least one ambient sound (e.g., located at 170° to the left), when the at least one ambient sound is output from the sound source located at 170° to the left, when it is assumed that the front of the vehicle is 0°.

[0230] For example, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the sound data transmitting module 236 to transmit, to the mobile device, the direction information of a sound source outputting at least one ambient sound (e.g., located at 90° to the right), when the at least one ambient sound is output from the sound source located at 90° to the right, when it is assumed that the front of the vehicle is 0°. However, it is not limited thereto.

[0231] For example, in an embodiment of the present disclosure, the processor 210 may recognize that a horn sound has occurred at about 100 dB in a short range. The processor 210 may transmit, to the mobile device, volume information (about 100 dB) of a nearby horn sound. However, it is not limited thereto.

[0232] For example, in an embodiment of the present disclosure, the processor 210 may recognize that the volume of a sound produced from a sound source located in a short range from the vehicle decreases as the distance between the vehicle and the sound source increases (e.g., a case where the volume of the sound decreases from 90 dB to 40 dB). The processor 210 may transmit sound volume change information (indicating that the volume of the sound gradually decreases) to the mobile device.

[0233] The mobile device may then transmit, to the wearable device, the sound produced from the sound source such that the sound is output with a gradually decreasing volume. However, it is not limited thereto.

[0234] For example, in an embodiment of the present disclosure, the processor 210 may recognize that the volume of a sound produced from a sound source 710 located in a long range from the vehicle 120 increases as the distance between the vehicle 120 and the sound source 710 decreases (e.g., a case where the volume of the sound increases from 30 dB to 60 dB). The processor 210 may transmit sound volume change information 720 and 730 (indicating that the volume of the sound gradually increases) to the mobile device.

[0235] The mobile device may then transmit, to the wearable device, the sound produced from the sound source such that the sound is output with a gradually increasing volume. However, it is not limited thereto.

[0236] FIG. 8 is a diagram for describing an operation corresponding to transmission of mixing information to a mobile device from an electronic device for vehicle, according to an embodiment of the present disclosure.

[0237] The sound data transmitting module 236 may further include instructions or program codes related to a function and / or operation of transmitting mixing information of at least one ambient sound to the mobile device.

[0238] The mixing information may include information indicating whether to synthesize the at least one ambient sound transmitted to the mobile device with at least one audio data being played on the mobile device.

[0239] The audio data may refer to sound output from media being played on the mobile device.

[0240] The audio data may include, for example, at least one of music sound or radio sound being played on the mobile device, but is not limited thereto.

[0241] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the sound data transmitting module 236 to transmit, to the mobile device, information indicating that at least one ambient sound and at least one audio data being played on the mobile device are not to be synthesized, when the at least one ambient sound included in group 1 with very high importance is recognized.

[0242] In this case, the mobile device may block audio data 810 being played to the wearable device 130, and transmit only the at least one ambient sound 850 (in 840).

[0243] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the sound data transmitting module 236 to transmit, to the mobile device, information indicating that at least one ambient sound and at least one audio data being played on the mobile device are not to be synthesized, when the at least one ambient sound included in group 3 with low importance is recognized.

[0244] In this case, the mobile device may transmit the audio data 810 being played to the wearable device 130, and may not transmit the at least one ambient sound 850 (in 820).

[0245] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the sound data transmitting module 236 to transmit, to the mobile device, information indicating that at least one ambient sound and at least one audio data being played on the mobile device are to be synthesized, when the at least one ambient sound included in group 2 with high importance is recognized.

[0246] In this case, the mobile device may transmit a sound resulting from synthesizing the at least one ambient sound 850 with the audio data 810 to the wearable device 130 (in 830).

[0247] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the sound data transmitting module 236 to transmit the at least one ambient sound, output information and mixing information of the at least one ambient sound to the mobile device.

[0248] In this case, the mobile device may transmit, to the wearable device, the sound resulting from synthesizing the audio data with the ambient sound or the at least one ambient sound, based on the output information and mixing information of the at least one ambient sound.

[0249] For example, based on the output information and mixing information of the at least one ambient sound, the mobile device may receive information indicating that the at least one ambient sound is recognized with a volume of less than 40 dB from the left of the vehicle, and that the at least one ambient sound is to be synthesized with the audio data. The mobile device may synthesize the at least one ambient sound with the audio data being played, at a lower volume than of the audio data. The mobile device may transmit the synthesized sound to the wearable device worn on the left ear such that the synthesized sound is output from the wearable device.

[0250] For example, based on the output information and mixing information of the at least one ambient sound, the mobile device may receive information indicating that the at least one ambient sound is recognized with a volume of 40 dB or more and less than 90 dB from the right of the vehicle, and that the at least one ambient sound is to be synthesized with the audio data. The mobile device may synthesize the at least one ambient sound with the audio data being played, at a higher volume than of the audio data. The mobile device may transmit the synthesized sound to the wearable device worn on the right ear such that the synthesized sound is output from the wearable device.

[0251] For example, based on the output information and mixing information of the at least one ambient sound, the mobile device may receive mixing information indicating that the at least one ambient sound is recognized with a volume of 90 dB or more from the right of the vehicle, and that the at least one ambient sound is not to be synthesized with the audio data being played. The mobile device may transmit at least one ambient sound to the wearable device worn on the right ear such that only the at least one ambient sound is output from the wearable device at a large volume. However, it is not limited thereto.

[0252] FIG. 9 is a block diagram illustrating components of a mobile device, according to an embodiment of the present disclosure.

[0253] A mobile device 900 may include a communicator 920 that performs communication with the electronic device for vehicle and the wearable device, memory 930 that stores at least one instruction, and at least one processor 910 that executes the at least one instruction stored in the memory 930.

[0254] The memory 930 may store various data, programs, or applications for driving and controlling the mobile device 900 according to an embodiment of the present disclosure. The memory 930 may include, for example, a non-volatile memory including at least one of a flash memory, a hard disk, a multimedia card micro type memory, a card type memory (e.g., SD or XD memory), a read-only memory (ROM), an electrically erasable programmable ROM (EEPROM), or a programmable ROM (PROM), and a volatile memory such as a random access memory (RAM) or a static RAM (SRAM).

[0255] Instructions, data structures, and program codes that are readable by the processor 910 may be stored in the memory 930. In the following embodiments, the processor 910 may be implemented by executing instructions or codes of the program stored in the memory 930.

[0256] The programs stored in the memory 930 may be classified into a plurality of modules according to the functions, which include, for example, a sound data receiving module 932, a sound synthesizing module 934, and a sound transmitting module 936.

[0257] However, the instructions or codes of the program stored in the memory 930 are not limited thereto. For example, the sound data receiving module 932, the sound synthesizing module 923 and the sound transmitting module 936 are components for an embodiment, and the configurations of the modules included in the memory 930 may be integrated, added or omitted depending on the specification of the mobile device 900 that is actually implemented. In other words, two or more modules may be merged into one, or a single module may be split into two or more modules as needed.

[0258] The sound data receiving module 932, sound synthesizing module 934 and sound transmitting module 936 stored in the memory 930 may refer to units of processing the functions or operations performed by the processor 910, and may be implemented in software such as instructions, algorithms, data structures or program codes.

[0259] The processor 910 may include hardware components for performing arithmetic, logical, and input / output operations and signal processing. The processor 910 may include at least one of e.g., central processing units (CPUs), microprocessors, graphic processing units (GPUs), application specific integrated circuits (ASIC), digital signal processors (DSPs), digital signal processing devices (DSPDs, programmable logic devices (PLDs), and field programmable gate arrays (FPGAs), without being limited thereto.

[0260] The communicator 920 may perform communication with an external device or server over at least one cable or wireless communication network according to the processor 910. In an embodiment, the communicator 920 may include at least one short-range communication module for performing communication according to a communication standard such as Bluetooth, Wi-Fi, Bluetooth low energy (BLE), NFC / RFID, Wi-Fi direct, UWB or ZIGBEE, and a long-range communication module for performing communication with a server for supporting the long-range communication according to a long-range communication standard. The long-range communication module may perform communication over a communication network that conforms to 3G, 4G and / or 5G communication standards, or over a network for Internet communication.

[0261] In an embodiment of the present disclosure, the mobile device 900 may be connected to the electronic device for vehicle through the communicator 920.

[0262] In an embodiment of the present disclosure, the mobile device 900 may be wirelessly connected to the wearable device through the communicator 920.

[0263] The sound data receiving module 932 may be configured with instructions or program codes related to a function and / or operation of receiving at least one sound or occurrence information of the at least one ambient sound from the electronic device for vehicle.

[0264] In an embodiment of the present disclosure, the processor 910 may execute the instructions or program codes of the sound data receiving module 932 to receive at least one sound or occurrence information of the at least one ambient sound from the electronic device for vehicle.

[0265] The occurrence information of the at least one ambient sound may include information indicating that at least one ambient sound has occurred.

[0266] For example, the occurrence information of the at least one ambient sound may include information indicating that a nearby horn sound has occurred, when the electronic device for vehicle recognizes the nearby horn sound.

[0267] For example, the occurrence information of the at least one ambient sound may include information indicating that a distant siren sound has occurred, when the electronic device for vehicle recognizes the distant siren sound. However, it is not limited thereto.

[0268] The sound synthesizing module 934 may be configured with instructions or program codes related to a function and / or operation of synthesizing at least one ambient sound or a generated sound corresponding to the occurrence information of the at least one ambient sound with audio data being played.

[0269] In an embodiment of the present disclosure, the processor 910 may execute the instructions or program codes of the sound synthesizing module 934 to synthesize the at least one ambient sound or the generated sound corresponding to the occurrence information of the at least one ambient sound with audio data being played.

[0270] The audio data may refer to sound output from media being played on the mobile device.

[0271] The audio data may include, for example, at least one of music sound or radio sound being played on the mobile device, but is not limited thereto.

[0272] In an embodiment of the present disclosure, the processor 910 may execute the instructions or program codes of the sound synthesizing module 934 to create a generated sound corresponding to the occurrence information of the at least one ambient sound based on an artificial intelligence model.

[0273] In an embodiment of the present disclosure, the processor 910 may execute the instructions or program codes of the sound synthesizing module 934 to store the generated sound corresponding to the occurrence information of the at least one ambient sound in the memory 930 of the mobile device 900 according to an embodiment of the present disclosure.

[0274] The generated sound corresponding to the occurrence information of the at least one ambient sound may refer to a nearby horn sound stored in the memory 930 or created based on the artificial intelligence model by the processor 910 according to an embodiment of the present disclosure executing the instructions or program codes of the sound synthesizing module 934, when the occurrence information of the at least one ambient sound includes information indicating that the nearby horn sound has occurred. However, it is not limited thereto.

[0275] The generated sound corresponding to the occurrence information of the at least one ambient sound may refer to a distant siren sound stored in the memory or created based on the artificial intelligence model by the processor 910 according to an embodiment of the present disclosure executing the instructions or program codes of the sound synthesizing module 934, when the occurrence information of the at least one ambient sound includes information indicating that the distant siren sound has occurred. However, it is not limited thereto.

[0276] The sound transmitting module 936 may be configured with instructions or program codes related to a function and / or operation of transmitting the synthesized sound to the mobile device.

[0277] In an embodiment of the present disclosure, the processor 910 may execute the instructions or program codes of the sound transmitting module 936 to transmit the synthesized sound to the wearable device.

[0278] Hence, even when latency occurs when the mobile device 900 according to an embodiment of the present disclosure receives at least one ambient sound from the electronic device for vehicle, the processor 910 according to an embodiment of the present disclosure may execute the instructions or program codes of the sound transmitting module 936 to transmit the generated sound corresponding to the occurrence information of the at least one ambient sound to the wearable device, thereby alerting the user who is operating the vehicle.

[0279] The sound data receiving module 932 may further include instructions or program codes related to a function and / or operation of receiving output information of the at least one ambient sound from the electronic device for vehicle.

[0280] In an embodiment of the present disclosure, the processor 910 may execute the instructions or program codes of the sound data receiving module 932 to receive output information of the at least one ambient sound from the electronic device for vehicle.

[0281] The output information may include at least one of volume information of the at least one ambient sound or direction information of at least one sound source that outputs the at least one ambient sound.

[0282] For example, in an embodiment of the present disclosure, the processor 910 may execute the instructions or program codes of the sound data receiving module 932 to receive, from the electronic device for vehicle, the direction information of a sound source outputting at least one ambient sound (e.g., located at 170° to the left), when the at least one ambient sound is output from the sound source located at 170° to the left, when it is assumed that the front of the vehicle is 0°.

[0283] For example, in an embodiment of the present disclosure, the processor 910 may execute the instructions or program codes of the sound data receiving module 932 to receive, from the electronic device for vehicle, the direction information of a sound source outputting at least one ambient sound (e.g., located at 90° to the right), when the at least one ambient sound is output from the sound source located at 90° to the right, when it is assumed that the front of the vehicle is 0°. However, it is not limited thereto.

[0284] For example, in an embodiment of the present disclosure, the processor 910 may execute instructions or program codes of the sound data receiving module 932 to receive volume information (about 100 dB) of a nearby horn sound from the electronic device for vehicle, when the electronic device for vehicle recognizes that the horn sound has occurred in a short range at about 100 dB. However, it is not limited thereto.

[0285] The sound transmitting module 936 may further include instructions or program codes related to a function and / or operation of adjusting at least one of the volume or direction of the synthesized sound in the output information.

[0286] In an embodiment of the present disclosure, the processor 910 may execute the instructions or program codes of the sound transmitting module 936 to adjust at least one of the volume or direction of the synthesized sound.

[0287] For example, in an embodiment of the present disclosure, the processor 910 may receive, from the electronic device for vehicle, output information indicating that at least one sound source outputting at least one ambient sound is located on the right of the vehicle. In an embodiment of the present disclosure, the processor 910 may execute the instructions or program codes of the sound transmitting module 936 to adjust the direction of at least one synthesized sound such that at least one ambient sound is output from the wearable device worn on the right ear. However, it is not limited thereto.

[0288] For example, in an embodiment of the present disclosure, the processor 910 may receive, from the electronic device for vehicle, output information indicating that at least one sound source outputting at least one ambient sound is located on the left of the vehicle and the volume of the at least one ambient sound is 100 dB. In an embodiment of the present disclosure, the processor 910 may execute the instructions or program codes of the sound transmitting module 936 to adjust the volume and direction of a synthesized sound such that at least one ambient sound is output from the wearable device worn on the left ear at a larger volume than of audio data being output.

[0289] For example, in an embodiment of the present disclosure, the processor 910 may receive, from the electronic device for vehicle, output information indicating that at least one sound source outputting at least one ambient sound is located on the right of the vehicle and that the volume of the at least one ambient sound is 40 dB. In an embodiment of the present disclosure, the processor 910 may execute the instructions or program codes of the sound transmitting module 936 to adjust the volume and direction of the synthesized sound such that at least one ambient sound is output from the wearable device worn on the right ear at a lower volume than of the audio data being output. However, it is not limited thereto.

[0290] For example, in an embodiment of the present disclosure, the processor 910 may receive, from the electronic device for a vehicle, sound volume change information indicating that the volume of a sound produced from a sound source located in a short range from the vehicle decreases (e.g., the volume of the sound decreases from 90 dB to 40 dB) as the distance between the vehicle and the sound source increases. In an embodiment of the present disclosure, the processor 910 may execute the instructions or program codes of the sound transmitting module 936 to adjust the volume of at least one synthesized sound such that the sound is output with the gradually decreasing volume to the wearable device. However, it is not limited thereto.

[0291] For example, in an embodiment of the present disclosure, the processor 910 may receive, from the electronic device for vehicle, sound volume change information indicating that the volume of the sound produced from a sound source located in a long range from the vehicle increases (e.g., the volume of the sound decreases from 30 dB to 60 dB) as the distance between the vehicle and the sound source decreases. In an embodiment of the present disclosure, the processor 910 may execute the instructions or program codes of the sound transmitting module 936 to adjust the volume of the synthesized sound such that the sound is output with the gradually increasing volume to the wearable device. However, it is not limited thereto.

[0292] The sound transmitting module 936 may further include instructions or program codes related to a function and / or operation of transmitting the adjusted sound to the wearable device.

[0293] In an embodiment of the present disclosure, the processor 910 may execute the instructions or program codes of the sound transmitting module 936 to transmit the adjusted sound to the wearable device.

[0294] In FIG. 9, only essential components for describing an operation of the mobile device 900 are shown, and components included in the mobile device 900 are not limited to those shown in FIG. 9.

[0295] FIG. 10 is a flowchart illustrating an operating method of an electronic device for vehicle, according to an embodiment of the present disclosure.

[0296] In operation 1010, the electronic device for vehicle may obtain at least one ambient sound through at least one microphone.

[0297] In an embodiment of the present disclosure, when noise is obtained along with the ambient sound, the electronic device for vehicle may reduce or eliminate the noise.

[0298] In an embodiment of the present disclosure, the electronic device for vehicle may reduce or eliminate, through a filter, the noise obtained along with the ambient sound.

[0299] The filter may include at least one of, for example, a band-pass filter, a moving average filter, an FIR filter or an IIR filter, but is not limited thereto.

[0300] In an embodiment of the present disclosure, the electronic device for vehicle may cancel the noise obtained along with the at least one ambient sound, based on white noise corresponding to the noise.

[0301] In an embodiment of the present disclosure, the electronic device for vehicle may reduce the noise obtained along with the at least one ambient sound, based on destructive interference.

[0302] In operation 1020, the electronic device for vehicle may identify a group that includes the at least one ambient sound among a plurality of preset groups, based on at least one of type information and volume information of the at least one ambient sound.

[0303] In an embodiment of the present disclosure, the electronic device for vehicle may identify type information of the at least one ambient sound, based on an artificial intelligence model.

[0304] The artificial intelligence technology (hereinafter, AI technology) is a technology to obtain a desired result by performing processes such as analysis and / or classification on input data based on operations through a neural network.

[0305] The AI technology may be implemented by using an algorithm. The algorithm or a set of algorithms to implement the AI technology is called the neural network. The neural network may receive input data, and perform an operation for the analysis and / or classification to output resulting data. As such, in order for the neural network to output accurate resulting data corresponding to the input data, the neural network needs to be trained. The training may refer to training the neural network to discover or learn, by the neural network itself, a method of inputting various data to the neural network and analyzing the input data, a method of classifying the input data and / or a method of extracting features required to generate resulting data from the input data. Specifically, through the training procedure, the neural network may be trained with training data (e.g., a plurality of different images) to optimize and set weight values in the neural network. A desired result is then output by learning the input data through the neural network having the optimized weight values.

[0306] Specifically, when there are a plurality of hidden layers in the neural network, which perform operations, i.e., when the depth of the neural network for performing operations increases, the neural network may be classified as a deep neural network (DNN). The neural network may include, for example, a convolutional neural network (CNN), a DNN, a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), and a deep Q-network, without being limited thereto. The neural network may also be subdivided. For example, the CNN neural network may be subdivided into a deep convolution neural network (DCNN) or a Capsnet neural network.

[0307] In a disclosed embodiment, an AI model may refer to a neural network including at least one layer that operates to receive input data and output a desired result. Furthermore, the AI model may refer to an algorithm that performs an operation through the neural network to output a desired result, a set of a plurality of algorithms, a processor for executing the algorithm or the set of algorithms, software for executing the algorithm or the set of algorithms or hardware for executing the algorithm or the set of algorithms.

[0308] The structure of the neural network was described above (see FIG. 4), so the redundant description will be omitted.

[0309] In an embodiment of the present disclosure, the electronic device for vehicle may use a lossless waveform audio format (wav) for training data to train an AI model.

[0310] In an embodiment of the present disclosure, the electronic device for vehicle may normalize peaks of sound frequency data and extract features of the frequency data.

[0311] In an embodiment of the present disclosure, the electronic device for vehicle may train the AI model based on the features of the frequency data, and training data

[0312] In an embodiment of the present disclosure, the electronic device for vehicle may identify type information of at least one ambient sound by comparing the at least one ambient sound obtained through at least one microphone with the training data.

[0313] For example, in an embodiment of the present disclosure, the electronic device for vehicle may obtain a sound produced from a sound source located around the vehicle through at least one microphone. The electronic device for vehicle may identify that the obtained sound corresponds to a horn sound by comparing features of the frequency data of the obtained sound with the training data.

[0314] For example, in an embodiment of the present disclosure, the electronic device for vehicle may obtain a sound produced from a sound source located around the vehicle through the at least one microphone. The electronic device for vehicle may identify that the obtained sound corresponds to a siren sound by comparing features of the frequency data of the obtained sound with the training data. However, it is not limited thereto.

[0315] The AI model may be trained by a server capable of communicating with the electronic device for vehicle according to an embodiment of the present disclosure over a wireless communication network. For example, the external server may train the AI model, and transmit the trained AI model to the electronic device for vehicle.

[0316] A method by which the server capable of communicating with the electronic device for vehicle according to an embodiment of the present disclosure over a wireless communication network trains the AI model was described above (see FIGS. 5 and 6), so the redundant description will be omitted.

[0317] In an embodiment of the present disclosure, the electronic device for vehicle may recognize at least one ambient sound, and obtain volume information indicating the volume of the ambient sound.

[0318] In an embodiment of the present disclosure, the electronic device for vehicle may obtain the volume information of the at least one ambient sound in a decibel (dB) value.

[0319] In an embodiment of the present disclosure, the electronic device for vehicle may identify a group that includes the at least one ambient sound among a plurality of preset groups, based on at least one of type information of the at least one ambient sound and volume information of the at least one ambient sound.

[0320] The plurality of preset groups may be classified into group 1, group 2 or group 3 according to the importance of the ambient sounds. However, the number of groups included in the plurality of preset groups is not limited thereto.

[0321] The importance may refer to the degree to which the driving of the vehicle is affected.

[0322] For example, that the importance of an ambient sound is very high may mean that, when the ambient sound is not perceived, there is a very high possibility of an accident occurring with the vehicle that includes the electronic device for vehicle according to an embodiment of the present disclosure.

[0323] For example, that the importance of an ambient sound is high may mean that, when the ambient sound is not perceived, there is a high possibility of an accident occurring with the vehicle that includes the electronic device for vehicle according to an embodiment of the present disclosure.

[0324] For example, that the importance of an ambient sound is low may mean that, when the ambient sound is not perceived, there is a low possibility of an accident occurring with the vehicle that includes the electronic device for vehicle according to an embodiment of the present disclosure.

[0325] In an embodiment of the present disclosure, the electronic device for vehicle may add at least one sound with very high importance to group 1.

[0326] At least one sound included in group 1 may include at least one of, for example, a short-range horn sound, a short-range siren sound, an explosion sound, an impact sound, or a short-range brake friction sound, but is not limited thereto.

[0327] In an embodiment of the present disclosure, the electronic device for vehicle may add at least one sound with high importance to group 2.

[0328] At least one sound included in group 2 may include at least one of, for example, a long-range horn sound, a long-range siren sound, or a long-range brake friction sound, but is not limited thereto.

[0329] In an embodiment of the present disclosure, the electronic device for vehicle may add at least one sound with low importance to group 3.

[0330] At least one sound included in group 3 may include at least one of, for example, a road friction sound or a driving sound of an adjacent vehicle, but is not limited thereto.

[0331] In an embodiment of the present disclosure, the electronic device for vehicle may store the at least one sound included in group 1, group 2 or group 3 in memory for each group.

[0332] The at least one sound included in group 1, group 2 or group 3 may be separately changed by the user.

[0333] In an embodiment of the present disclosure, the electronic device for vehicle may predict a distance between the vehicle and the sound source based on the volume information of the sound produced from the at least one sound source.

[0334] For example, in an embodiment of the present disclosure, the electronic device for vehicle may identify a sound produced from at least one sound source as a horn sound. When the volume of the horn sound is identified as being 90 dB or higher, the electronic device for vehicle may predict that the distance (short distance) between the at least one sound source that outputs the horn sound and the vehicle is within a preset distance.

[0335] For example, in an embodiment of the present disclosure, the electronic device for vehicle may identify a sound produced from at least one sound source as a siren sound. When the volume of the siren sound is identified as being 90 dB or lower, the electronic device for vehicle may predict that the distance (long distance) between the at least one sound source that outputs the siren sound and the vehicle is equal to or longer than the preset distance.

[0336] For example, in an embodiment of the present disclosure, the electronic device for vehicle may identify a sound produced from at least one sound source as an explosion sound. When the volume of the explosion sound is identified as being 100 dB or higher, the electronic device for vehicle may predict that the distance (short distance) between the at least one sound source that outputs the explosion sound and the vehicle is within the preset distance.

[0337] For example, in an embodiment of the present disclosure, the electronic device for vehicle may identify a sound produced from at least one sound source as a brake friction sound. When the volume of the brake friction sound is identified as being 100 dB or higher, the electronic device for vehicle may predict that the distance (short distance) between the at least one sound source that outputs the brake friction sound and the vehicle is within the preset distance. However, it is not limited thereto.

[0338] In an embodiment of the present disclosure, the electronic device for vehicle may identify a group that includes the at least one ambient sound among a plurality of preset groups, based on at least one of type information of the at least one ambient sound and volume information of the at least one ambient sound.

[0339] For example, when the electronic device for vehicle according to an embodiment of the present disclosure identifies a sound produced from at least one sound source as a horn sound, and the volume of the horn sound is 90 dB or higher, the electronic device for vehicle according to an embodiment of the present disclosure may identify that the sound produced from the at least one sound source corresponds to a nearby horn sound.

[0340] In this case, the electronic device for vehicle according to an embodiment of the present disclosure may identify that the identified nearby horn sound is included in group 1 with very high importance among the plurality of preset groups.

[0341] For example, when the electronic device for vehicle according to an embodiment of the present disclosure identifies a sound produced from at least one sound source as a brake friction sound, and the volume of the brake friction sound is 90 dB or higher, the electronic device for vehicle according to an embodiment of the present disclosure may identify that the sound produced from the at least one sound source corresponds to a nearby brake friction sound. The electronic device for vehicle according to an embodiment of the present disclosure may identify that the identified nearby brake friction sound is included in group 1 with very high importance among the plurality of preset groups.

[0342] For example, when the electronic device for vehicle according to an embodiment of the present disclosure identifies a sound produced from at least one sound source as a siren sound, and the volume of the horn sound is less than 90 dB, the electronic device for vehicle according to an embodiment of the present disclosure may identify that the sound produced from the at least one sound source corresponds to a distant siren sound. The electronic device for vehicle according to an embodiment of the present disclosure may identify that the identified distant siren sound is included in group 2 with high importance among the plurality of preset groups.

[0343] For example, when the electronic device for vehicle according to an embodiment of the present disclosure identifies a sound produced from at least one sound source as a road friction sound, and the volume of the road friction sound is less than 50 dB, the electronic device for vehicle according to an embodiment of the present disclosure may identify that the identified road friction sound is included in group 3 with low importance among the plurality of preset groups.

[0344] In operation 1030, the electronic device for vehicle may transmit the at least one ambient sound to the mobile device, based on at least one of driving information of the vehicle and surrounding environment information of the vehicle, and a transmission condition corresponding to the identified group.

[0345] The driving information of the vehicle may include at least one of speed information of the vehicle or speed change information of the vehicle.

[0346] The surrounding environment information of the vehicle may include at least one of location information of at least one sound source that outputs at least one ambient sound, weather information around the vehicle or speed information of an external vehicle located around the vehicle.

[0347] The electronic device for vehicle according to an embodiment of the present disclosure may obtain the surrounding environment information of the vehicle through vehicle to everything (V2X) communication.

[0348] The V2X communication refers to communication through which the vehicle may exchange information with infrastructure-equipped objects such as other vehicles and roads, based on at least one of cable or wireless network.

[0349] The V2X communication may include at least one of vehicle to vehicle (V2V) communication, vehicle to infrastructure (V2I) communication, vehicle to network (V2N) communication, or vehicle to pedestrian (V2P) communication.

[0350] The electronic device for vehicle according to an embodiment of the present disclosure may obtain surrounding environment information of the vehicle through at least one sensor.

[0351] The sensor may include at least one of a global positioning system (GPS) sensor, a sound detection sensor, an image sensor, a camera, Lidar or radar, but is not limited thereto.

[0352] The electronic device for vehicle according to an embodiment of the present disclosure may set a transmission condition for each of the plurality of preset groups.

[0353] The electronic device for vehicle according to an embodiment of the present disclosure may set a sound included in group 1 to be transmitted to the mobile device, regardless of the driving information of the vehicle and the surrounding environment information of the vehicle.

[0354] The electronic device for vehicle according to an embodiment of the present disclosure may identify at least one ambient sound with very high importance as being included in group 1. The electronic device for vehicle according to an embodiment of the present disclosure may transmit the at least one ambient sound to the mobile device regardless of the driving information of the vehicle and the surrounding environment information of the vehicle.

[0355] For example, the electronic device for vehicle according to an embodiment of the present disclosure may identify a sound produced from at least one sound source as a horn sound. The electronic device for vehicle may identify that the identified horn sound corresponds to a nearby horn sound, based on the volume information of the horn sound. The electronic device for vehicle may identify that the nearby horn sound is included in group 1 of the plurality of preset groups. The electronic device for vehicle may transmit the nearby horn sound to the mobile device regardless of the driving information of the vehicle (e.g., driving speed of the vehicle).

[0356] For example, the electronic device for vehicle according to an embodiment of the present disclosure may identify a sound produced from at least one sound source as an explosion sound. The electronic device for vehicle may identify, based on the volume information of the explosion sound, that the identified explosion sound corresponds to a nearby explosion sound and is included in group 1 of the plurality of preset groups. The electronic device for vehicle may transmit the nearby explosion sound to the mobile device regardless of the driving information of the vehicle (e.g., driving speed of the vehicle). It is not, however, limited thereto.

[0357] The electronic device for vehicle according to an embodiment of the present disclosure may set a transmission condition for transmitting a sound included in group 2 to the mobile device, based on at least one of the driving information of the vehicle and the surrounding environment information of the vehicle.

[0358] The electronic device for vehicle according to an embodiment of the present disclosure may identify at least one ambient sound with high importance as being included in group 2. The electronic device for vehicle according to an embodiment of the present disclosure may transmit the at least one sound included in group 2 to the mobile device, based on at least one of the driving information of the vehicle and the surrounding environment information of the vehicle.

[0359] For example, the electronic device for vehicle according to an embodiment of the present disclosure may identify a sound produced from at least one sound source as a horn sound. The electronic device for vehicle according to an embodiment of the present disclosure may identify, based on the volume information of the horn sound, that the identified horn sound corresponds to a distant horn sound and corresponds to group 2 of the plurality of preset groups. The electronic device for vehicle may transmit the distant horn sound to the mobile device, based on at least one of speed of the vehicle, location information of a vehicle that generates the horn sound, and speed information of the vehicle that generates the horn sound.

[0360] For example, the electronic device for vehicle according to an embodiment of the present disclosure may identify a sound produced from at least one sound source as a brake friction sound. The electronic device for vehicle may identify, based on the volume information of the brake friction sound, that the identified brake friction sound corresponds to a distant brake friction sound and corresponds to group 2 of the plurality of preset groups. The electronic device for vehicle may transmit the distant brake friction sound to the mobile device, based on at least one of speed of the vehicle, weather information around the vehicle or speed information of the vehicle that produces the brake friction sound. However, it is not limited thereto.

[0361] The electronic device for vehicle according to an embodiment of the present disclosure may identify at least one ambient sound with high importance as being included in group 2. The electronic device for vehicle may transmit the at least one sound included in group 2 to the mobile device, based on the driving information of the vehicle.

[0362] The driving information of the vehicle may include at least one of speed information of the vehicle or speed change information of the vehicle.

[0363] The electronic device for vehicle according to an embodiment of the present disclosure may transmit at least one sound included in group 2 to the mobile device, based on the speed information of the vehicle that includes the electronic device for vehicle.

[0364] For example, the electronic device for vehicle may identify a sound produced from at least one sound source as a brake friction sound. The electronic device for vehicle according to an embodiment of the present disclosure may identify, based on the volume information of the brake friction sound, that the identified brake friction sound corresponds to a distant brake friction sound and corresponds to group 2 of the plurality of preset groups. The electronic device for vehicle according to an embodiment of the present disclosure may transmit the distant brake friction sound to the mobile device, when the vehicle that includes the electronic device for vehicle is driving at high speed.

[0365] High-speed driving may refer to a case that the vehicle including the electronic device for vehicle according to an embodiment of the present disclosure is driving at or above a certain speed.

[0366] The certain speed may be set based on speed limits of the road on which the vehicle including the electronic device for vehicle according to an embodiment of the present disclosure is driving. However, it is not limited thereto.

[0367] The electronic device for vehicle according to an embodiment of the present disclosure may obtain information about the speed limits of the road on which the vehicle including the electronic device for vehicle is driving, through V2X communication.

[0368] For example, the electronic device for vehicle according to an embodiment of the present disclosure may set the certain speed to 30 km / h, when the vehicle including the electronic device for vehicle is driving on a road with a speed limit of 30 km / h.

[0369] For example, the electronic device for vehicle according to an embodiment of the present disclosure may set the certain speed to 100 km / h, when the vehicle including the electronic device for vehicle is driving on a road with a speed limit of 100 km / h. However, it is not limited thereto.

[0370] The certain speed may be changed by the user.

[0371] For example, the user may set the certain speed to 80 km / h regardless of the speed limits of the road on which the vehicle including the electronic device for vehicle according to an embodiment of the present disclosure is driving.

[0372] For example, the user may set the certain speed to 100 km / h regardless of the speed limits of the road on which the vehicle including the electronic device for vehicle according to an embodiment of the present disclosure is driving. However, it is not limited thereto.

[0373] The electronic device for vehicle according to an embodiment of the present disclosure may transmit at least one sound included in group 2 to the mobile device, based on speed change information of the vehicle that includes the electronic device for vehicle.

[0374] The speed change information of the vehicle may include at least one of sudden acceleration or sudden deceleration.

[0375] Sudden acceleration may refer to a sudden increase in speed of the vehicle including the electronic device for vehicle according to an embodiment of the present disclosure in a short period of time.

[0376] For example, sudden acceleration may refer to an increase in speed of the vehicle including the electronic device for vehicle according to an embodiment of the present disclosure by a speed of 2.8 m / s or more, but is not limited thereto.

[0377] Sudden deceleration may refer to a sudden decrease in speed of the vehicle including the electronic device for vehicle according to an embodiment of the present disclosure in a short period of time.

[0378] For example, sudden deceleration may refer to a decrease in speed of the vehicle including the electronic device for vehicle according to an embodiment of the present disclosure by a speed of 2.8 m / s or more, but is not limited thereto.

[0379] For example, the electronic device for vehicle may identify a sound produced from at least one sound source as a brake friction sound. The electronic device for vehicle according to an embodiment of the present disclosure may identify, based on the volume information of the brake friction sound, that the identified brake friction sound corresponds to a distant brake friction sound and corresponds to group 2 of the plurality of preset groups. The electronic device for vehicle according to an embodiment of the present disclosure may not transmit the distant brake friction sound to the mobile device, when the vehicle that includes the electronic device for vehicle is driving at low speed.

[0380] The electronic device for vehicle according to an embodiment of the present disclosure may transmit the distant brake friction sound to the mobile device, when the vehicle that includes the electronic device for vehicle accelerates rapidly. The distant brake friction sound may refer to a brake friction sound produced from a sound source located in a direction in which the vehicle including the electronic device for vehicle according to an embodiment of the present disclosure accelerates rapidly. However, it is not limited thereto.

[0381] For example, the electronic device for vehicle may identify a sound produced from at least one sound source as a horn sound. The electronic device for vehicle according to an embodiment of the present disclosure may identify, based on the volume information of the horn sound, that the identified horn sound corresponds to a distant horn sound and corresponds to group 2 of the plurality of preset groups. The electronic device for vehicle according to an embodiment of the present disclosure may not transmit the distant horn sound to the mobile device, when the vehicle including the electronic device for vehicle is driving at low speed. However, it is not limited thereto.

[0382] The electronic device for vehicle according to an embodiment of the present disclosure may transmit the distant horn sound to the mobile device, when the vehicle including the electronic device for vehicle decelerates rapidly. The distant horn sound may refer to a brake friction sound produced from a sound source located behind the vehicle including the electronic device for vehicle according to an embodiment of the present disclosure. However, it is not limited thereto.

[0383] Low-speed driving may refer to a case that the vehicle including the electronic device for vehicle according to an embodiment of the present disclosure is driving at less than a certain speed.

[0384] The certain speed may be set based on speed limits of the road on which the vehicle including the electronic device for vehicle according to an embodiment of the present disclosure is driving. However, it is not limited thereto.

[0385] The electronic device for vehicle according to an embodiment of the present disclosure may obtain information about the speed limits of the road on which the vehicle including the electronic device for vehicle is driving, through V2X communication. However, it is not limited thereto.

[0386] For example, the electronic device for vehicle according to an embodiment of the present disclosure may set the certain speed of the vehicle to 30 km / h, when the vehicle including the electronic device for vehicle is driving on a road with a speed limit of 30 km / h.

[0387] For example, the electronic device for vehicle according to an embodiment of the present disclosure may set the certain speed of the vehicle to 80 km / h, when the vehicle including the electronic device for vehicle is driving on a road with a speed limit of 80 km / h. However, it is not limited thereto.

[0388] The certain speed may be changed by the user.

[0389] For example, the user may set the certain speed of the vehicle to 50 km / h regardless of the speed limits of the road on which the vehicle including the electronic device for vehicle according to an embodiment of the present disclosure is driving.

[0390] For example, the user may set the certain speed of the vehicle to 100 km / h regardless of the speed limits of the road on which the vehicle including the electronic device for vehicle according to an embodiment of the present disclosure is driving.

[0391] The electronic device for vehicle according to an embodiment of the present disclosure may identify at least one ambient sound with high importance as being included in group 2. The electronic device for vehicle may transmit the at least one sound included in group 2 to the mobile device, based on the surrounding environment information.

[0392] The surrounding environment information of the vehicle may include at least one of location information of at least one sound source that outputs at least one ambient sound, weather information around the vehicle or speed information of an external vehicle located around the vehicle. However, it is not limited thereto.

[0393] The electronic device for vehicle may identify a sound produced from at least one sound source as a rain sound. The electronic device for vehicle according to an embodiment of the present disclosure may obtain precipitation information based on the volume information of the rain sound.

[0394] The electronic device for vehicle according to an embodiment of the present disclosure may transmit at least one sound included in group 2 to the mobile device, based on the precipitation information.

[0395] For example, the electronic device for vehicle may identify a sound produced from at least one sound source as a brake friction sound. The electronic device for vehicle according to an embodiment of the present disclosure may identify, based on the volume information of the brake friction sound, that the identified brake friction sound corresponds to a distant brake friction sound and corresponds to group 2 of the plurality of preset groups. The electronic device for vehicle according to an embodiment of the present disclosure may transmit the distant brake friction sound to the mobile device, when the amount of precipitation is equal to or greater than a set value.

[0396] For example, the electronic device for vehicle may identify a sound produced from at least one sound source as a siren sound. The electronic device for vehicle according to an embodiment of the present disclosure may identify, based on the volume information of the siren sound, that the identified siren sound corresponds to a distant siren sound and corresponds to group 2 of the plurality of preset groups. The electronic device for vehicle according to an embodiment of the present disclosure may transmit the distant siren sound to the mobile device, when the amount of precipitation is equal to or greater than a set value.

[0397] The set value may be 15 mm, but is not limited thereto.

[0398] The set value may be changed by the user.

[0399] The electronic device for vehicle according to an embodiment of the present disclosure may obtain surrounding environment information of the vehicle through a sensor.

[0400] The surrounding environment information may include brightness information of a road on which the vehicle including the electronic device for vehicle according to an embodiment of the present disclosure is driving.

[0401] The electronic device for vehicle according to an embodiment of the present disclosure may obtain the brightness information of the road in a lux value.

[0402] The electronic device for vehicle according to an embodiment of the present disclosure may transmit at least one sound included in group 2 to the mobile device, based on the brightness information of the road on which the vehicle is driving.

[0403] For example, the electronic device for vehicle may identify a sound produced from at least one sound source as a siren sound. The electronic device for vehicle according to an embodiment of the present disclosure may identify, based on the volume information of the siren sound, that the identified siren sound corresponds to a distant siren sound and corresponds to group 2 of the plurality of preset groups. The electronic device for vehicle according to an embodiment of the present disclosure may transmit the distant siren sound to the mobile device, when the brightness of the road on which the vehicle including the electronic device for vehicle according to an embodiment of the present disclosure is driving is equal to or less than a threshold.

[0404] For example, the electronic device for vehicle according to an embodiment of the present disclosure may transmit the distant siren sound to the mobile device when the brightness of light obtained through the sensor is equal to or less than 50 lux. However, it is not limited thereto.

[0405] The threshold may be changed by the user.

[0406] The electronic device for vehicle according to an embodiment of the present disclosure may set a transmission condition for transmitting a sound included in group 3 to the mobile device, based on the surrounding environment information of the vehicle.

[0407] The electronic device for vehicle according to an embodiment of the present disclosure may identify at least one sound with low importance as being included in group 3. The electronic device for vehicle may transmit the at least one sound included in group 3 to the mobile device, based on the surrounding environment information of the vehicle.

[0408] For example, the electronic device for vehicle according to an embodiment of the present disclosure may identify a sound produced from at least one sound source as a road friction sound. The electronic device for vehicle may identify, based on the volume information of the road friction sound, that the identified road friction sound corresponds to group 3 of the plurality of preset groups. The electronic device for vehicle may transmit the road friction sound to the mobile device, based on location information of a plurality of external vehicles located around the vehicle and approach information of the plurality of external vehicles toward the vehicle. However, it is not limited thereto.

[0409] However, the transmission condition for each of the plurality of preset groups is merely an example and is not limited thereto.

[0410] The transmission condition for each of the plurality of preset groups may be changed by the user.

[0411] The transmission condition for each of the plurality of preset groups may be stored in the memory of the electronic device for vehicle according to an embodiment of the present disclosure.

[0412] The electronic device for vehicle according to an embodiment of the present disclosure may transmit occurrence information of at least one ambient sound to the mobile device.

[0413] The occurrence information of the at least one ambient sound may include information indicating that at least one ambient sound has occurred.

[0414] For example, the occurrence information of the at least one ambient sound may include information indicating that a nearby horn sound has occurred, when the electronic device for vehicle according to an embodiment of the present disclosure recognizes the nearby horn sound.

[0415] For example, the occurrence information of the at least one ambient sound may include information indicating that a distant siren sound has occurred, when the electronic device for vehicle according to an embodiment of the present disclosure recognizes the distant siren sound. However, it is not limited thereto.

[0416] Upon receiving the occurrence information of the at least one ambient sound, the mobile device may transmit a generated sound corresponding to the occurrence information of the at least one ambient sound to the wearable device.

[0417] Accordingly, even when latency occurs in transmitting the at least one ambient sound to the mobile device from the electronic device for vehicle according to an embodiment of the present disclosure, the mobile device is able to alert the user who is operating the vehicle by transmitting the generated sound corresponding to the occurrence information of the at least one ambient sound to the wearable device.

[0418] FIG. 11 is a flowchart illustrating an operating method of an electronic device for vehicle, according to an embodiment of the present disclosure.

[0419] Operations 1020 and 1030 of FIG. 11 correspond to operations 1020 and 1030 of FIG. 10, respectively.

[0420] In operation 1032, the electronic device for vehicle may transmit output information of at least one ambient sound to the mobile device.

[0421] The output information may include at least one of volume information of the at least one ambient sound or direction information of at least one sound source that outputs the at least one ambient sound.

[0422] For example, the electronic device for vehicle according to an embodiment of the present disclosure may transmit, to the mobile device, the direction information of a sound source outputting at least one ambient sound (e.g., located at 170° to the left), when the at least one ambient sound is output from the sound source located at 170° to the left, when it is assumed that the front of the vehicle is 0°.

[0423] For example, the electronic device for vehicle according to an embodiment of the present disclosure may transmit, to the mobile device, the direction information of a sound source outputting at least one ambient sound (e.g., located at 90° to the right), when the at least one ambient sound is output from the sound source located at 90° to the right, when it is assumed that the front of the vehicle is 0°. However, it is not limited thereto.

[0424] For example, the electronic device for vehicle according to an embodiment of the present disclosure may recognize that a horn sound has occurred at about 100 dB in a short range. The electronic device for vehicle according to an embodiment of the present disclosure may transmit the volume information (about 100 dB) of the nearby horn sound to the mobile device. However, it is not limited thereto.

[0425] For example, the electronic device for vehicle according to an embodiment of the present disclosure may recognize that the volume of a sound produced from a sound source located in a short range from the vehicle decreases as the distance between the vehicle and the sound source increases (e.g., a case where the volume of the sound decreases from 90 dB to 40 dB). The electronic device for vehicle according to an embodiment of the present disclosure may transmit the sound volume change information (indicating that the volume of the sound gradually decreases) to the mobile device.

[0426] The mobile device may then transmit, to the wearable device, the sound produced from the sound source such that the sound is output with a gradually decreasing volume. However, it is not limited thereto.

[0427] For example, the electronic device for vehicle according to an embodiment of the present disclosure may recognize that the volume of a sound produced from a sound source located in a long range from the vehicle increases as the distance between the vehicle and the sound source decreases (e.g., a case where the volume of the sound increases from 30 dB to 60 dB). The electronic device for vehicle according to an embodiment of the present disclosure may transmit the sound volume change information (indicating that the volume of the sound gradually increases) to the mobile device.

[0428] The mobile device may then transmit, to the wearable device, the sound produced from the sound source such that the sound is output with a gradually increasing volume. However, it is not limited thereto.

[0429] FIG. 12 is a flowchart illustrating an operating method of an electronic device for vehicle, according to an embodiment of the present disclosure.

[0430] Operations 1020 and 1030 of FIG. 12 correspond to operations 1020 and 1030 of FIG. 10, respectively.

[0431] In operation 1034, the electronic device for vehicle may transmit mixing information of at least one ambient sound to the mobile device.

[0432] The mixing information may include information indicating whether to synthesize the at least one ambient sound transmitted to the mobile device with at least one audio data being played on the mobile device.

[0433] The audio data may refer to sound output from media being played on the mobile device.

[0434] The audio data may include, for example, at least one of music sound or radio sound being played on the mobile device, but is not limited thereto.

[0435] In an embodiment of the present disclosure, the electronic device for vehicle may transmit, to the mobile device, information indicating that at least one ambient sound and at least one audio data being played on the mobile device are not to be synthesized, when the at least one ambient sound included in group 1 with very high importance is recognized.

[0436] In this case, the mobile device may block audio data being played to the wearable device 130, and transmit only the at least one ambient sound.

[0437] The electronic device for vehicle according to an embodiment of the present disclosure may transmit, to the mobile device, information indicating that at least one ambient sound and at least one audio data being played on the mobile device are not to be synthesized, when the at least one ambient sound included in group 3 with low importance is recognized.

[0438] In this case, the mobile device may transmit the audio data being played to the wearable device, and may not transmit the at least one ambient sound.

[0439] The electronic device for vehicle according to an embodiment of the present disclosure may transmit, to the mobile device, information indicating that at least one ambient sound and at least one audio data being played on the mobile device are to be synthesized, when the at least one ambient sound included in group 2 with high importance is recognized.

[0440] In this case, the mobile device may transmit, to the wearable device, a sound resulting from synthesizing the at least one ambient sound with the audio data.

[0441] The electronic device for vehicle according to an embodiment of the present disclosure may transmit, to the mobile device, at least one ambient sound, output information and mixing information of the at least one ambient sound.

[0442] In this case, the mobile device may transmit, to the wearable device, the sound resulting from synthesizing the audio data with the ambient sound or the at least one ambient sound, based on the output information and mixing information of the at least one ambient sound.

[0443] For example, based on the output information and mixing information of the at least one ambient sound, the mobile device may receive information indicating that the at least one ambient sound is recognized with a volume of less than 40 dB from the left of the vehicle, and that the at least one ambient sound is to be synthesized with the audio data. The mobile device may synthesize the at least one ambient sound with the audio data being played, at a lower volume than of the audio data. The mobile device may transmit the synthesized sound to the wearable device worn on the left ear such that the synthesized sound is output from the wearable device.

[0444] For example, based on the output information and mixing information of the at least one ambient sound, the mobile device may receive information indicating that the at least one ambient sound is recognized with a volume of 40 dB or more and less than 90 dB from the right of the vehicle, and that the at least one ambient sound is to be synthesized with the audio data. The mobile device may synthesize the at least one ambient sound with the audio data being played, at a higher volume than of the audio data. The mobile device may transmit the synthesized sound to the wearable device worn on the right ear such that the synthesized sound is output from the wearable device.

[0445] For example, based on the output information and mixing information of the at least one ambient sound, the mobile device may receive mixing information indicating that the at least one ambient sound is recognized with a volume of 90 dB or more from the right of the vehicle, and that the at least one ambient sound is not to be synthesized with the audio data being played. The mobile device may transmit at least one ambient sound to the wearable device worn on the right ear such that only the at least one ambient sound is output at a large volume from the wearable device. However, it is not limited thereto.

[0446] FIG. 13 is a flowchart illustrating an operating method of an electronic device for vehicle, according to an embodiment of the present disclosure.

[0447] Operations 1020 and 1030 of FIG. 13 correspond to operations 1020 and 1030 of FIG. 10, respectively.

[0448] In operation 1036, the electronic device for vehicle may identify another group that includes at least one ambient sound, based on a change in volume information of the at least one ambient sound.

[0449] In an embodiment of the present disclosure, the electronic device for vehicle may predict a distance between the vehicle and the sound source based on the volume information of the at least one ambient sound produced from the at least one sound source.

[0450] The electronic device for vehicle according to an embodiment of the present disclosure may determine that the distance between the vehicle and the sound source that outputs the at least one ambient sound increases, when the volume of the at least one ambient sound decreases.

[0451] For example, the electronic device for vehicle according to an embodiment of the present disclosure may determine that the distance between the vehicle and a sound source that outputs a siren sound has decreased and then increased, when the volume of the siren sound has increased and then decreased.

[0452] For example, the electronic device for vehicle according to an embodiment of the present disclosure may determine that the distance between the vehicle and a sound source that outputs a siren sound increases, when recognizing a change in volume of the siren sound from 90 dB to 50 dB. However, it is not limited thereto.

[0453] The electronic device for vehicle according to an embodiment of the present disclosure may determine that the distance between the vehicle and the sound source that outputs the at least one ambient sound decreases, when the volume of the at least one ambient sound increases.

[0454] For example, the electronic device for vehicle according to an embodiment of the present disclosure may determine that the distance between the vehicle and a sound source that outputs a horn sound has increased and then decreased, when the volume of the horn sound has decreased and then increased.

[0455] For example, the electronic device for vehicle according to an embodiment of the present disclosure may determine that the distance between the vehicle and a sound source that outputs a horn sound decreases, when recognizing a change in volume of the horn sound from 40 dB to 100 dB. However, it is not limited thereto.

[0456] The electronic device for vehicle according to an embodiment of the present disclosure may identify a group that includes the at least one ambient sound among a plurality of preset groups, based on volume information of the at least one ambient sound.

[0457] The electronic device for vehicle according to an embodiment of the present disclosure may identify a group that includes the at least one ambient sound among a plurality of preset groups, based on a change in volume of the at least one ambient sound being recognized.

[0458] For example, the electronic device for vehicle according to an embodiment of the present disclosure may recognize a nearby horn sound based on the volume information and type information of the at least one ambient sound. The electronic device for vehicle according to an embodiment of the present disclosure may identify the at least one ambient sound identified as the nearby horn sound as being included in group 1.

[0459] The electronic device for vehicle according to an embodiment of the present disclosure may recognize a change in volume information of the horn sound. The electronic device for vehicle according to an embodiment of the present disclosure may recognize the nearby horn sound having changed to a distant horn sound. The electronic device for vehicle according to an embodiment of the present disclosure may identify at least one ambient sound identified as a distant horn sound as being included in group 2. However, it is not limited thereto.

[0460] For example, the electronic device for vehicle according to an embodiment of the present disclosure may recognize a distant brake friction sound based on the volume information and type information of the at least one ambient sound. The electronic device for vehicle according to an embodiment of the present disclosure may identify at least one ambient sound identified as a distant brake friction sound as being included in group 2.

[0461] The electronic device for vehicle according to an embodiment of the present disclosure may recognize a change in volume information of the brake friction sound. For example, the electronic device for vehicle according to an embodiment of the present disclosure may recognize that the distant brake friction sound has changed to a nearby brake friction sound. The electronic device for vehicle according to an embodiment of the present disclosure may identify the at least one ambient sound identified as the nearby brake friction sound as being included in group 1. However, it is not limited thereto.

[0462] In operation 1038, the electronic device for vehicle may determine whether to transmit the at least one ambient sound to the mobile device, based on at least one of driving information of the vehicle and surrounding environment information of the vehicle, and a transmission condition corresponding to another group.

[0463] The electronic device for vehicle according to an embodiment of the present disclosure may determine whether to transmit the at least one ambient sound to the mobile device, based on at least one of the driving information of the vehicle and the surrounding environment information of the vehicle, and the transmission condition corresponding to the changed group when the volume of the at least one ambient sound is changed and the group including the at least one changed ambient sound is changed.

[0464] The electronic device for vehicle according to an embodiment of the present disclosure may determine whether to continue to transmit, to the mobile device, the at least one ambient sound that has been being transmitted, when recognizing a change in volume information of the at least one ambient sound after the at least one ambient sound is transmitted to the mobile device.

[0465] The electronic device for vehicle according to an embodiment of the present disclosure may determine whether to transmit, to the mobile device, the at least one ambient sound whose volume has changed to be lower, based on at least one of the driving information of the vehicle and the surrounding environment information of the vehicle, and the transmission condition corresponding to group 2, when the volume of the at least one ambient sound being transmitted to the mobile device is changed to be lower and the group including the at least one ambient sound is changed from group 1 to group 2. However, it is not limited thereto.

[0466] FIG. 14 is a flowchart illustrating an operating method of a mobile device, according to an embodiment of the present disclosure.

[0467] In an embodiment of the present disclosure, the mobile device and the electronic device for vehicle may be connected through wireless communication.

[0468] The mobile device according to an embodiment of the present disclosure may be connected to the wearable device through wireless communication.

[0469] The wireless connection may involve at least one short-range communication module for performing communication according to a communication standard such as Bluetooth, Wi-Fi, Bluetooth low energy (BLE), NFC / RFID, Wi-Fi direct, UWB or ZIGBEE, and a long-range communication module for performing communication with a server for supporting the long-range communication according to a long-range communication standard. The long-range communication module may perform communication over a communication network that conforms to 3G, 4G and / or 5G communication standards, or over a network for Internet communication.

[0470] In operation 1410, the mobile device may receive at least one ambient sound or occurrence information of the at least one ambient sound from the electronic device for vehicle.

[0471] The occurrence information of the at least one ambient sound may include information indicating that at least one ambient sound has occurred.

[0472] For example, the occurrence information of the at least one ambient sound may include information indicating that a nearby horn sound has occurred, when the electronic device for vehicle recognizes the nearby horn sound.

[0473] For example, the occurrence information of the at least one ambient sound may include information indicating that a distant siren sound has occurred, when the electronic device for vehicle recognizes the distant siren sound. However, it is not limited thereto.

[0474] In operation 1420, the mobile device may synthesize the at least one ambient sound or a generated sound corresponding to the occurrence information of the at least one ambient sound with audio data being played.

[0475] The audio data may refer to sound output from media being played on the mobile device.

[0476] The audio data may include, for example, at least one of music sound or radio sound being played on the mobile device, but is not limited thereto.

[0477] The mobile device according to an embodiment of the present disclosure may generate a generated sound corresponding to the occurrence information of the at least one ambient sound, based on an artificial intelligence model.

[0478] The mobile device according to an embodiment of the present disclosure may store the generated sound corresponding to the occurrence information of the at least one ambient sound in the memory of the mobile device.

[0479] The generated sound corresponding to the occurrence information of the at least one ambient sound may refer to a nearby horn sound stored in memory or created in the mobile device according to an embodiment of the present disclosure based on an artificial intelligence model, when the occurrence information of the at least one ambient sound includes information indicating that the nearby horn sound has occurred. However, it is not limited thereto.

[0480] The generated sound corresponding to the occurrence information of the at least one ambient sound may refer to a distant siren sound stored in memory or created in the mobile device according to an embodiment of the present disclosure based on an artificial intelligence model, when the occurrence information of the at least one ambient sound includes information indicating that the distant siren sound has occurred. However, it is not limited thereto.

[0481] In operation 1430, the mobile device may transmit the synthesized sound to the wearable device.

[0482] Accordingly, even when latency occurs in receiving the at least one ambient sound from the electronic device for vehicle according to an embodiment of the present disclosure, the mobile device according to an embodiment of the present disclosure is able to alert the user who is operating the vehicle by transmitting the generated sound corresponding to the occurrence information of the at least one ambient sound to the wearable device.

[0483] FIG. 15 is a flowchart illustrating an operating method of a mobile device, according to an embodiment of the present disclosure.

[0484] Operations 1420 and 1430 of FIG. 15 correspond to operations 1420 and 1430 of FIG. 14, respectively.

[0485] In operation 1432, the mobile device may receive output information of at least one ambient sound from the electronic device for vehicle.

[0486] The output information may include at least one of volume information of the at least one ambient sound or direction information of at least one sound source that outputs the at least one ambient sound.

[0487] For example, the mobile device according to an embodiment of the present disclosure may receive, from the electronic device for vehicle, the direction information of a sound source outputting at least one ambient sound (e.g., located at 170° to the left), when the at least one ambient sound is output from the sound source located at 170° to the left, when it is assumed that the front of the vehicle is 0°.

[0488] For example, the mobile device according to an embodiment of the present disclosure may receive, from the electronic device for vehicle, the direction information of a sound source outputting at least one ambient sound (e.g., located at 90° to the right), when the at least one ambient sound is output from the sound source located at 90° to the right, when it is assumed that the front of the vehicle is 0°. However, it is not limited thereto.

[0489] For example, the mobile device according to an embodiment of the present disclosure may receive volume information (about 100 dB) of a nearby horn sound from the electronic device for vehicle, when the electronic device for vehicle recognizes that the horn sound has occurred at about 100 dB in a short range. However, it is not limited thereto.

[0490] In operation 1434, the mobile device may adjust at least one of the volume or direction of the synthesized sound based on the output information.

[0491] For example, the mobile device according to an embodiment of the present disclosure may receive, from the electronic device for vehicle, output information indicating that at least one sound source outputting at least one ambient sound is located on the right of the vehicle. The mobile device according to an embodiment of the present disclosure may adjust the direction of at least one synthesized sound such that at least one ambient sound is output from the wearable device worn on the right ear. However, it is not limited thereto.

[0492] For example, the mobile device according to an embodiment of the present disclosure may receive, from the electronic device for vehicle, output information indicating that at least one sound source outputting at least one ambient sound is located on the left of the vehicle and the volume of the at least one ambient sound is 100 dB. The mobile device according to an embodiment of the present disclosure may adjust the volume and direction of at least one synthesized sound such that at least one ambient sound is output from the wearable device worn on the left ear at a higher volume than of the audio data being output.

[0493] For example, the mobile device according to an embodiment of the present disclosure may receive, from the electronic device for vehicle, output information indicating that at least one sound source outputting at least one ambient sound is located on the right of the vehicle and that the volume of the at least one ambient sound is 40 dB. The mobile device according to an embodiment of the present disclosure may adjust the direction and volume of at least one synthesized sound such that at least one ambient sound is output from the wearable device worn on the right ear at a lower volume than of the audio data being output. However, it is not limited thereto.

[0494] For example, the mobile device according to an embodiment of the present disclosure may receive, from the electronic device for vehicle, sound volume change information indicating that the volume of a sound produced from a sound source located in a short range from the vehicle decreases (e.g., the volume of the sound decreases from 90 dB to 40 dB) as the distance between the vehicle and the sound source increases.

[0495] In this case, the mobile device according to an embodiment of the present disclosure may adjust the sound produced from the sound source to be output with a gradually decreasing volume to the wearable device. However, it is not limited thereto.

[0496] For example, the mobile device according to an embodiment of the present disclosure may receive, from the electronic device for vehicle, sound volume change information (indicating that the volume of the sound gradually increases) indicating that the volume of a sound produced from a sound source located in a long range from the vehicle increases (e.g., the volume of the sound increases from 30 dB to 60 dB) as the distance between the vehicle and the sound source decreases.

[0497] In this case, the mobile device according to an embodiment of the present disclosure may adjust the volume of at least one synthesized sound to be output with a gradually increasing volume to the wearable device. However, it is not limited thereto.

[0498] In operation 1436, the mobile device may transmit the adjusted sound to the wearable device.

[0499] According to an embodiment of the present disclosure, an electronic device for vehicle may include at least one microphone, memory storing at least one instruction, a communicator configured to perform communication with a mobile device, and at least one processor configured to execute the at least one instruction stored in the memory.

[0500] The at least one processor may be configured to execute the at least one instruction to obtain at least one ambient sound through the at least one microphone.

[0501] The at least one processor may be configured to execute the at least one instruction to identify a group including the at least one ambient sound among a plurality of preset groups, based on at least one of type information and volume information of the at least one ambient sound.

[0502] The at least one processor may be configured to execute the at least one instruction to control the communicator to transmit the at least one ambient sound to the mobile device, based on at least one of driving information of a vehicle and surrounding environment information of the vehicle, and a transmission condition corresponding to the identified group.

[0503] The at least one processor may be configured to execute the at least one instruction to identify the type information of the at least one ambient sound, based on an artificial intelligence model.

[0504] The at least one processor may be configured to execute the at least one instruction to control the communicator to transmit, to the mobile device, output information of the at least one ambient sound.

[0505] The output information may include at least one of volume information of the at least one ambient sound or direction information of at least one sound source outputting the at least one ambient sound.

[0506] The at least one processor may be configured to execute the at least one instruction to control the communicator to transmit mixing information to the mobile device.

[0507] The mixing information may include information indicating whether to synthesize the at least one ambient sound transmitted to the mobile device and at least one audio data being played on the mobile device.

[0508] The at least one processor may be configured to execute the at least one instruction to identify another group that includes the at least one ambient sound, based on the volume information of the at least one ambient sound being changed.

[0509] The at least one processor may be configured to execute the at least one instruction to determine whether to transmit the at least one ambient sound to the mobile device, based on at least one of the driving information of the vehicle and the surrounding environment information of the vehicle, and a transmission condition corresponding to the other group.

[0510] The at least one processor may be configured to execute the at least one instruction to control the communicator to transmit occurrence information of the at least one ambient sound to the mobile device.

[0511] The surrounding environment information of the vehicle may include at least one of location information of a sound source that generates the at least one ambient sound, weather information around the vehicle or speed information of an external vehicle located around the vehicle.

[0512] The driving information of the vehicle may include at least one of speed information of the vehicle or speed change information of the vehicle.

[0513] According to an embodiment of the present disclosure, a mobile device may include a communicator configured to perform communication with an electronic device for vehicle and a wearable device, memory storing at least one instruction, and at least one processor configured to execute the at least one instruction stored in the memory.

[0514] The at least one processor may be configured to execute the at least one instruction to control the communicator to receive, from the electronic device for vehicle, at least one ambient sound or occurrence information of the at least one ambient sound.

[0515] The at least one processor may be configured to execute the at least one instruction to synthesize the at least one ambient sound or a generated sound corresponding to the occurrence information of the at least one ambient sound with audio data being played.

[0516] The at least one processor may be configured to execute the at least one instruction to control the communicator to transmit the synthesized sound to the wearable device.

[0517] The at least one processor may be configured to execute the at least one instruction to control the communicator to receive, from the electronic device for vehicle, output information of the at least one ambient sound.

[0518] The at least one processor may be configured to execute the at least one instruction to control the communicator to transmit, to the wearable device, the at least one ambient sound, based on the output information.

[0519] The output information may include at least one of volume information of the at least one ambient sound or direction information of at least one sound source outputting the at least one ambient sound.

[0520] The at least one processor may be configured to execute the at least one instruction to control the communicator to receive, from the electronic device for vehicle, output information including at least one of volume information of the at least one ambient sound or direction information of at least one sound source outputting the at least one ambient sound.

[0521] The at least one processor may be configured to execute the at least one instruction to adjust at least one of volume or direction of the synthesized sound, based on the output information.

[0522] The at least one processor may be configured to execute the at least one instruction to control the communicator to transmit the adjusted sound to the wearable device.

[0523] According to an embodiment of the present disclosure, an operating method of an electronic device for vehicle may include obtaining at least one ambient sound through at least one microphone.

[0524] According to an embodiment of the present disclosure, the operating method of the electronic device for vehicle may include identifying a group including the at least one ambient sound among a plurality of preset groups, based on at least one of type information and volume information of the at least one ambient sound.

[0525] According to an embodiment of the present disclosure, the operating method of the electronic device for vehicle may include transmitting the at least one ambient sound to the mobile device, based on at least one of driving information of a vehicle and surrounding environment information of the vehicle, and a transmission condition corresponding to the identified group.

[0526] According to an embodiment of the present disclosure, an operating method of an electronic device for vehicle may include transmitting output information of the at least one ambient sound to the mobile device.

[0527] The output information may include at least one of volume information of the at least one ambient sound or direction information of at least one sound source outputting the at least one ambient sound.

[0528] According to an embodiment of the present disclosure, an operating method of an electronic device for vehicle may include transmitting mixing information to the mobile device.

[0529] The mixing information may include information indicating whether to synthesize the at least one ambient sound transmitted to the mobile device with at least one audio data being played on the mobile device.

[0530] According to an embodiment of the present disclosure, the operating method of the electronic device for vehicle may include identifying another group that includes the at least one ambient sound, based on volume information of the at least one ambient sound being changed.

[0531] According to an embodiment of the present disclosure, the operating method of the electronic device for vehicle may include determining whether to transmit the at least one ambient sound to the mobile device, based on at least one of driving information of the vehicle and surrounding environment information of the vehicle, and a transmission condition corresponding to the other group.

[0532] According to an embodiment of the present disclosure, an operating method of an electronic device for vehicle may include transmitting occurrence information of the at least one ambient sound to the mobile device.

[0533] According to an embodiment of the present disclosure, an operating method of an electronic device for vehicle may include identifying the type information of the at least one ambient sound based on an artificial intelligence model.

[0534] The surrounding environment information of the vehicle may include at least one of location information of a sound source that generates the at least one ambient sound, weather information around the vehicle or speed information of an external vehicle located around the vehicle.

[0535] According to an embodiment of the present disclosure, an operating method of a mobile device may include receiving at least one ambient sound or occurrence information of the at least one ambient sound from an electronic device for vehicle.

[0536] According to an embodiment of the present disclosure, an operating method of a mobile device may include synthesizing the at least one ambient sound or a generated sound corresponding to the occurrence information of the at least one ambient sound with audio data being played.

[0537] According to an embodiment of the present disclosure, an operating method of a mobile device may include transmitting the synthesized sound to a wearable device.

[0538] According to an embodiment of the present disclosure, an operating method of a mobile device may include receiving output information of the at least one ambient sound from the electronic device for vehicle.

[0539] According to an embodiment of the present disclosure, an operating method of a mobile device may include transmitting the at least one ambient sound to the wearable device.

[0540] The output information may include at least one of volume information of the at least one ambient sound or direction information of at least one sound source outputting the at least one ambient sound.

[0541] According to an embodiment of the present disclosure, an operating method of a mobile device may include receiving, from the electronic device for vehicle, output information including at least one of volume information of the at least one ambient sound or direction information of at least one sound source outputting the at least one ambient sound.

[0542] According to an embodiment of the present disclosure, an operating method of a mobile device may include adjusting at least one of volume or direction of the synthesized sound, based on the output information.

[0543] According to an embodiment of the present disclosure, an operating method of a mobile device may include transmitting the adjusted sound to the wearable device.

[0544] According to an embodiment of the present disclosure, an operating method of at least one of an electronic device for vehicle or a mobile device may be implemented in the form of program instructions which are executable by various computing means and recorded in computer-readable media. The computer-readable medium may include program instructions, data files, data structures, etc., separately or in combination. The program instructions recorded on the medium may be designed and configured specially for the present disclosure, or may be well-known to those of ordinary skill in the art of computer software. Examples of the computer readable recording medium include a magnetic medium such as a hard disk, a floppy disk and a magnetic tape, an optical medium such as a compact disc read-only memory (CD-ROM) and a digital versatile disc (DVD), a magneto-optical medium such as a floptical disk, and a hardware device specially configured to store and perform program instructions, such as a read-only memory (ROM), a random-access memory (RAM), a flash memory, etc. Examples of the program instructions include not only machine language codes but also high-level language codes which are executable by various computing means using an interpreter.

[0545] Furthermore, an operating method of at least one of the electronic device for vehicle or the mobile device according to the disclosed embodiments may be included and provided in a computer program product. The computer program product may be a commercial product that may be traded between a seller and a buyer.

[0546] The computer program product may include a software program and a computer-readable storage medium having the software program stored thereon. For example, the computer program product may include a product in the form of a software program that is electronically distributed by the manufacturer of the electronic device or by an electronic market (e.g., Google play store ®< , or App store ®< ). For the electronic distribution, at least a portion of the software program may be stored in a storage medium or arbitrarily created. In this case, the storage medium may be one of a server of the manufacturer or of a relay server that temporarily stores the software program.

[0547] In a system including a server and a client device, the computer program product may include a storage medium of the server or a storage medium of the client device. Alternatively, when there is a third device (e.g., a smart phone) communicatively connected to the server or the client device, the computer program product may include a storage medium of the third device. In another example, the computer program product may be transferred from the server to the client device or the third device, or may include a software program itself that is transferred from the third device to the client device.

[0548] In this case, one of the server, the client device, and the third device may execute the computer program product to perform the method according to the embodiments of the present disclosure. Alternatively, two or more of the server, the client device, and the third device may execute the computer program product to perform the method according to the embodiments of the present disclosure in a distributed fashion.

[0549] For example, the server (e.g., a cloud server or an AI server) may execute the computer program product stored therein to control the client device communicatively connected to the server to perform the method according to the embodiments of the present disclosure.

[0550] Several embodiments of the present disclosure have been described, but it will be understood that various modifications can be made without departing the scope of the present disclosure. Thus, it will be apparent to those ordinary skilled in the art that the present disclosure is not limited to the embodiments described, but can encompass not only the appended claims but the equivalents.

Examples

Embodiment Construction

[0021]Terms as used herein will be described before describing embodiments of the present disclosure in detail.

[0022]The terms are selected as common terms currently widely used, taking into account functions in the present disclosure, which may however depend on intentions of ordinary people in the art, judicial precedents, emergence of new technologies, and the like. Some terms as used herein are selected at the applicant's discretion, in which case, the meaning will be explained later in detail in the description of the present disclosure. Therefore, the terms should be defined based on their meanings and descriptions throughout the present disclosure.

[0023]The term "include (or including)" or "comprise (or comprising)" is inclusive or openended and does not exclude additional, unrecited elements or method steps. The terms "unit", "module", "block", etc., as used herein each represent a unit for handling at least one function or operation, and may be implemented in hardware, soft...

Technical Field

[0001] The present disclosure relates to an electronic device for a vehicle and an operating method thereof, and more particularly, to an electronic device for a vehicle and an operating method thereof for providing ambient sound obtained by the electronic device for a vehicle to a user.Background Art

[0002] As the wearing rate of wearable devices increases, more people tend to wear the wearable devices even while driving a vehicle.

[0003] However, when a user wearing a wearable device is consuming media while operating a vehicle, the media is likely to prevent the user from clearly hearing sounds around the vehicle.

[0004] A noise canceling function of the wearable device, the vehicle's own sound insulation, or the user's safety gear (e.g., helmets) also prevents the user from clearly hearing the ambient sounds.

[0005] Therefore, there is a growing need to provide ambient sounds to vehicle drivers wearing wearable devices based on the vehicle's driving environment and surrounding environment.Disclosure of Invention Solution to Problem

[0006] According to an embodiment of the present disclosure, an electronic device for a vehicle may include at least one microphone, memory storing at least one instruction, a communicator configured to perform communication with a mobile device, and at least one processor configured to execute the at least one instruction stored in the memory.

[0007] The at least one processor may be configured to execute the at least one instruction to obtain at least one ambient sound through the at least one microphone.

[0008] The at least one processor may be configured to execute the at least one instruction to identify a group including the at least one ambient sound among a plurality of preset groups, based on at least one of type information and volume information of the at least one ambient sound.

[0009] The at least one processor may be configured to execute the at least one instruction to control the communicator to transmit the at least one ambient sound to the mobile device, based on at least one of driving information of a vehicle and surrounding environment information of the vehicle, and a transmission condition corresponding to the identified group.

[0010] According to an embodiment of the present disclosure, a mobile device may include a communicator configured to perform communication with an electronic device for a vehicle and a wearable device, memory storing at least one instruction, and at least one processor configured to execute the at least one instruction stored in the memory.

[0011] The at least one processor may be configured to execute the at least one instruction to control the communicator to receive, from the electronic device for a vehicle, at least one ambient sound or occurrence information of the at least one ambient sound.

[0012] The at least one processor may be configured to execute the at least one instruction to synthesize the at least one ambient sound or a generated sound corresponding to the occurrence information of the at least one ambient sound with audio data being played.

[0013] The at least one processor may be configured to execute the at least one instruction to control the communicator to transmit the synthesized sound to the wearable device.

[0014] According to an embodiment of the present disclosure, an operating method of an electronic device for a vehicle may include obtaining at least one ambient sound through at least one microphone.

[0015] According to an embodiment of the present disclosure, the operating method of the electronic device for a vehicle may include identifying a group including the at least one ambient sound among a plurality of preset groups, based on at least one of type information and volume information of the at least one ambient sound.

[0016] According to an embodiment of the present disclosure, the operating method of the electronic device for a vehicle may include transmitting the at least one ambient sound to the mobile device, based on at least one of driving information of a vehicle and surrounding environment information of the vehicle, and a transmission condition corresponding to the identified group.

[0017] According to an embodiment of the present disclosure, an operating method of a mobile device may include receiving at least one ambient sound or occurrence information of the at least one ambient sound from an electronic device for a vehicle.

[0018] According to an embodiment of the present disclosure, an operating method of a mobile device may include synthesizing the at least one ambient sound or a generated sound corresponding to the occurrence information of the at least one ambient sound with audio data being played.

[0019] According to an embodiment of the present disclosure, an operating method of a mobile device may include transmitting the synthesized sound to a wearable device.Brief Description of Drawings

[0020] FIG. 1A illustrates an example of sounds occurring around a vehicle in motion. FIG. 1B is a diagram for describing a connection relationship between an electronic device for a vehicle, according to an embodiment of the present disclosure, a mobile device according to an embodiment of the present disclosure, and a wearable device. FIG. 2 is a block diagram illustrating components of an electronic device for a vehicle, according to an embodiment of the present disclosure. FIG. 3 is a diagram for describing a plurality of preset groups. FIG. 4 is a diagram for describing an operation performed by using an artificial intelligence technology, according to an embodiment of the present disclosure. FIG. 5 illustrates an electronic device for a vehicle according to an embodiment of the present disclosure, which operates in conjunction with a server. FIG. 6 is a diagram for describing FIG. 5 in detail. FIG. 7 is a diagram for describing an embodiment of transmitting an ambient sound from an electronic device for a vehicle, according to an embodiment of the present disclosure, to a mobile device according to an embodiment of the present disclosure. FIG. 8 is a diagram for describing an operation corresponding to transmission of mixing information to a mobile device from an electronic device for a vehicle, according to an embodiment of the present disclosure. FIG. 9 is a block diagram illustrating components of a mobile device, according to an embodiment of the present disclosure. FIG. 10 is a flowchart illustrating an operating method of an electronic device for a vehicle, according to an embodiment of the present disclosure. FIG. 11 is a flowchart illustrating an operating method of an electronic device for a vehicle, according to an embodiment of the present disclosure. FIG. 12 is a flowchart illustrating an operating method of an electronic device for a vehicle, according to an embodiment of the present disclosure. FIG. 13 is a flowchart illustrating an operating method of an electronic device for a vehicle, according to an embodiment of the present disclosure. FIG. 14 is a flowchart illustrating an operating method of a mobile device, according to an embodiment of the present disclosure. FIG. 15 is a flowchart illustrating an operating method of a mobile device, according to an embodiment of the present disclosure. Mode for the Invention

[0021] Terms as used herein will be described before describing embodiments of the present disclosure in detail.

[0022] The terms are selected as common terms currently widely used, taking into account functions in the present disclosure, which may however depend on intentions of ordinary people in the art, judicial precedents, emergence of new technologies, and the like. Some terms as used herein are selected at the applicant's discretion, in which case, the meaning will be explained later in detail in the description of the present disclosure. Therefore, the terms should be defined based on their meanings and descriptions throughout the present disclosure.

[0023] The term "include (or including)" or "comprise (or comprising)" is inclusive or openended and does not exclude additional, unrecited elements or method steps. The terms "unit", "module", "block", etc., as used herein each represent a unit for handling at least one function or operation, and may be implemented in hardware, software, or a combination thereof.

[0024] The expression "at least one of A, B and C" refers to one of "A", "B", "C", "A and B", "A and C", "B and C", and "A, B, and C".

[0025] Embodiments of the present disclosure will now be described in detail with reference to accompanying drawings to be readily practiced by those of ordinary skill in the art. However, the embodiments of the present disclosure may be implemented in many different forms, and are not limited to those discussed herein. In the drawings, parts unrelated to the description are omitted for clarity, and like numerals refer to like elements throughout the specification.

[0026] In embodiments of the specification, the term "user" or "passenger" may refer to a person who controls systems, functions or operations.

[0027] In embodiments of the specification, the term "vehicle" may refer to a vehicle that includes an electronic device for a vehicle, according to an embodiment.

[0028] FIG. 1A illustrates an example of sounds occurring around a vehicle in motion.

[0029] In an embodiment of the present disclosure, a vehicle including an electronic device for a vehicle may include a four-wheeled vehicle 110 or a two-wheeled vehicle 120. It is not, however, limited thereto, and the vehicle including the electronic device for a vehicle, according to an embodiment may include various types of vehicles.

[0030] As the wearing rate of wearable devices increases, there is a growing tendency for people to wear the wearable devices while operating a vehicle.

[0031] When a driver operates a vehicle 110 or 120 while wearing a wearable device 130, the driver may fail to perceive ambient sounds 140, 150, 160 and 170 occurring around the vehicle 110 or 120 in motion due to audio data output from the wearable device 130 or due to noise canceling of the wearable device.

[0032] To increase driving safety of the vehicle 110 or 120, a method and apparatus for providing the ambient sounds 140, 150, 160 and 170 to the vehicle driver wearing the wearable device 130 based on driving information and a surrounding environment of the vehicle 110 or 120 will now be described.

[0033] FIG. 1B is a diagram for describing a connection relationship between an electronic device for a vehicle, according to an embodiment of the present disclosure, a mobile device according to an embodiment of the present disclosure, and a wearable device.

[0034] A vehicle including an electronic device 200 for a vehicle, according to an embodiment of the present disclosure, may include the four-wheeled vehicle 110 or the two-wheeled vehicle 120. It is not, however, limited thereto, and the vehicle including the electronic device for a vehicle, according to an embodiment, may include various types of vehicles.

[0035] The electronic device 200 for a vehicle, according to an embodiment of the present disclosure, may be connected to a mobile device 800 according to an embodiment of the present disclosure through wireless communication.

[0036] The mobile device 800 according to an embodiment of the present disclosure may refer to a mobile device of the user including the driver or passenger of the vehicle.

[0037] The mobile device 800 according to an embodiment of the present disclosure may include a portable electronic device. For example, it may include at least one of the user's smartphone, cell phone or tablet personal computer (tablet PC), or wearable device, but is not limited thereto.

[0038] The mobile device 800 according to an embodiment of the present disclosure may be connected to the wearable device 130 through wireless communication.

[0039] The wireless communication may include at least one short-range communication for performing communication according to a communication standard such as Bluetooth, Wi-Fi, Bluetooth low energy (BLE), NFC / RFID, Wi-Fi direct, UWB or ZIGBEE, and long-range communication for performing communication with a server for supporting the long-range communication according to a long-range communication standard. The long-range communication may be performed over a communication network that conforms to 3G, 4G and / or 5G communication standards, or over a network for Internet communication.

[0040] The electronic device 200 for a vehicle, according to an embodiment of the present disclosure, the mobile device 800 according to an embodiment of the present disclosure and the wearable device are connected to one another through wireless communication, enabling data transmission and reception from the electronic device 200 for a vehicle, according to an embodiment of the present disclosure, to the mobile device 800 according to an embodiment of the present disclosure, and from the mobile device 800 according to an embodiment of the present disclosure to the wearable device 130.

[0041] Data transmitted and received among the electronic device for a vehicle 800, according to an embodiment of the present disclosure, the mobile device 800 according to an embodiment of the present disclosure and the wearable device 130 will now be described in detail.

[0042] FIG. 2 is a block diagram illustrating components of an electronic device for a vehicle, according to an embodiment of the present disclosure.

[0043] The electronic device 200 for a vehicle may include at least one microphone 220, memory 230 that stores at least one instruction, a communicator 240 that performs communication with the mobile device, and at least one processor 210 that executes at least one instruction stored in the memory 230.

[0044] The memory 230 may store various data, programs, or applications for driving and controlling the electronic device 200 for a vehicle, according to an embodiment of the present disclosure. The memory 230 may include, for example, a non-volatile memory including at least one of a flash memory, a hard disk, a multimedia card micro type memory, a card type memory (e.g., SD or XD memory), a read-only memory (ROM), an electrically erasable programmable ROM (EEPROM), or a programmable ROM (PROM), and a volatile memory such as a random access memory (RAM) or a static RAM (SRAM).

[0045] Instructions, data structures, and program codes that are readable by the processor 210 may be stored in the memory 230. In the following embodiments, the processor 210 may be implemented by executing instructions or codes of the program stored in the memory 230.

[0046] The programs stored in the memory 230 may be classified into a plurality of modules according to the functions, which may include, for example, an ambient sound obtaining module 232, a group identifying module 234 and a sound data transmitting module 236.

[0047] However, the instructions or codes of the program stored in the memory 230 are not limited thereto. For example, the ambient sound obtaining module 232, the group identifying module 234 and the sound data transmitting module 236 are components for an embodiment, and the configurations of the modules included in the memory 230 may be integrated, added or omitted depending on the specification of the electronic device 200 for a vehicle that is actually implemented. In other words, two or more modules may be merged into one, or a single module may be split into two or more modules as needed.

[0048] The ambient sound obtaining module 232, the group identifying module 234 and the sound data transmitting module 236 stored in the memory 230 may refer to units of processing functions or operations performed by the processor 210, and may be implemented in software such as instructions, algorithms, data structures or program codes.

[0049] The processor 210 may include hardware components for performing arithmetic, logical, and input / output operations and signal processing. The processor 210 may include at least one of e.g., central processing units (CPUs), microprocessors, graphic processing units (GPUs), application specific integrated circuits (ASIC), digital signal processors (DSPs), digital signal processing devices (DSPDs, programmable logic devices (PLDs), and field programmable gate arrays (FPGAs), without being limited thereto.

[0050] The communicator 240 may perform communication with an external device or server over at least one cable or wireless communication network according to the processor 210.

[0051] In an embodiment, the communicator 240 may include at least one short-range communication module for performing communication according to a communication standard such as Bluetooth, Wi-Fi, Bluetooth low energy (BLE), NFC / RFID, Wi-Fi direct, UWB or ZIGBEE, and a long-range communication module for performing communication with a server for supporting the long-range communication according to a long-range communication standard. The long-range communication module may perform communication over a communication network that conforms to 3G, 4G and / or 5G communication standards, or over a network for Internet communication.

[0052] The microphone 220 may obtain sounds occurring around the electronic device 200 for a vehicle, according to an embodiment of the present disclosure.

[0053] The ambient sound obtaining module 232 may be configured with instructions or program codes related to a function and / or operation of obtaining at least one ambient sound through the at least one microphone 220.

[0054] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the ambient sound obtaining module 232 to obtain at least one ambient sound through the at least one microphone 220.

[0055] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the ambient sound obtaining module 232 to reduce or remove noise when the noise is obtained along with the ambient sound.

[0056] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the ambient sound obtaining module 232 to reduce or remove, through a filter, noise obtained along with the ambient sound.

[0057] The filter may include, for example, at least one of a band-pass filter, a moving average filter, a finite impulse filter (FIR filter) or an infinite impulse response filter (IIR filter), but is not limited thereto.

[0058] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the ambient sound obtaining module 232 to cancel noise obtained along with the at least one ambient sound, based on white noise corresponding to the noise.

[0059] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the ambient sound obtaining module 232 to reduce noise obtained along with the at least one ambient sound, based on destructive interference.

[0060] The group identifying module 234 may be configured with instructions or program codes related to a function and / or operation of identifying a group that includes the at least one ambient sound among a plurality of preset groups, based on at least one of type information and volume information of the at least one ambient sound.

[0061] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify a group that includes the at least one ambient sound among a plurality of preset groups, based on at least one of type information and volume information of the at least one ambient sound.

[0062] The plurality of preset groups will be described with reference to FIG. 3.

[0063] FIG. 3 is a diagram for describing a plurality of preset groups.

[0064] The plurality of preset groups may be classified into group 1, group 2 or group 3 according to the importance of the ambient sounds. However, the number of groups included in the plurality of preset groups is not limited thereto.

[0065] The importance may refer to the degree to which the driving of the vehicle is affected.

[0066] For example, that the importance of an ambient sound is very high may mean that, when the ambient sound is not perceived, there is a very high possibility of an accident occurring with the vehicle 110 or 120 that includes the electronic device 200 for a vehicle, according to an embodiment of the present disclosure.

[0067] For example, that the importance of an ambient sound is high may mean that, when the ambient sound is not perceived, there is a high possibility of an accident occurring with the vehicle 110 or 120 that includes the electronic device 200 for a vehicle, according to an embodiment of the present disclosure.

[0068] For example, that the importance of an ambient sound is low may mean that, when the ambient sound is not perceived, there is a low possibility of an accident occurring with the vehicle 110 or 120 that includes the electronic device 200 for a vehicle, according to an embodiment of the present disclosure.

[0069] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to add at least one sound with very high importance to group 1.

[0070] At least one sound included in group 1 may include at least one of, for example, a short-range horn sound, a short-range siren sound, an explosion sound, an impact sound, or a short-range brake friction sound, but is not limited thereto.

[0071] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to add at least one sound with high importance to group 2.

[0072] At least one sound included in group 2 may include at least one of, for example, a long-range horn sound, a long-range siren sound, or a long-range brake friction sound, but is not limited thereto.

[0073] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to add at least one sound with low importance to group 3.

[0074] At least one sound included in group 3 may include at least one of, for example, a road friction sound or a driving sound of an adjacent vehicle, but is not limited thereto.

[0075] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to store the at least one sound included in group 1, group 2 or group 3 in the memory 230 for each group.

[0076] The at least one sound included in group 1, group 2 or group 3 may be separately changed by the user.

[0077] Referring back to FIG. 2, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify type information of the at least one ambient sound based on an artificial intelligence model.

[0078] Artificial intelligence technology (hereinafter, AI technology) is a technology to obtain a desired result by performing processes such as analysis and / or classification on input data based on operations through a neural network.

[0079] The AI technology may be implemented by using an algorithm. The algorithm or a set of algorithms to implement the AI technology is called the neural network. The neural network may receive input data, and perform an operation for analysis and / or classification to output resulting data. As such, in order for the neural network to output accurate resulting data corresponding to the input data, the neural network needs to be trained. The training may refer to training the neural network to discover or learn by the neural network itself a method of inputting various data to the neural network and analyzing the input data, a method of classifying the input data and / or a method of extracting features required to generate resulting data from the input data. Specifically, through the training procedure, the neural network may be trained with training data (e.g., a plurality of different images) to optimize and set weight values in the neural network. A desired result is then output by learning the input data through the neural network having the optimized weight values.

[0080] Specifically, when there are a plurality of hidden layers in the neural network, which perform operations, i.e., when the depth of the neural network for performing the operations increases, the neural network may be classified as a deep neural network (DNN). The neural network may include, for example, a convolutional neural network (CNN), a DNN, a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), and a deep Q-network, without being limited thereto. The neural network may also be subdivided. For example, the CNN neural network may be subdivided into a deep convolution neural network (DCNN) or a Capsnet neural network.

[0081] In a disclosed embodiment, an AI model may refer to a neural network including at least one layer that operates to receive input data and output a desired result. Furthermore, the AI model may refer to an algorithm that performs an operation through the neural network to output a desired result, a set of a plurality of algorithms, a processor for executing the algorithm or the set of algorithms, software for executing the algorithm or the set of algorithms or hardware for executing the algorithm or the set of algorithms.

[0082] A structure of the neural network will be described with reference to FIG. 4.

[0083] FIG. 4 is a diagram for describing an operation performed by using an artificial intelligence technology, according to an embodiment of the present disclosure.

[0084] The operation of identifying type information of at least one ambient sound, which is performed in an embodiment of the present disclosure, may be performed by using an AI technology that performs operations through a neural network.

[0085] A neural network 420 may be trained by receiving training data. The trained neural network 420 may receive input data 410 through an input end 430, and an output end 450 may analyze the input data 410 and perform an operation to output a desired result as output data 460. An operation through the neural network may be performed through a hidden layer 440. Although the hidden layer 440 is illustrated as being simplified as a single-stage layer in FIG. 4, the hidden layer 440 may be formed of multiple layers.

[0086] In an embodiment of the present disclosure, the processor 210 may execute instructions or program codes of the group identifying module 234 to train an AI model by using a lossless waveform audio format (wav) for training data.

[0087] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to normalize peaks of sound frequency data to extract features of the frequency data.

[0088] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to train the AI model based on the features of the frequency data and the training data.

[0089] Referring back to FIG. 2, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify type information of at least one ambient sound by comparing the at least one ambient sound obtained through the at least one microphone with the training data.

[0090] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the ambient sound obtaining module 232 to obtain sounds produced from sound sources located around the vehicle through the at least one microphone.

[0091] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify type information of the at least one obtained ambient sound by comparing the at least one ambient sound with the training data.

[0092] For example, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the ambient sound obtaining module 232 to identify that the obtained sound corresponds to a horn sound by comparing features of the frequency data of the obtained sound with the training data.

[0093] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify that the obtained sound corresponds to a siren sound by comparing the features of frequency data of the obtained sound with the training data. However, it is not limited thereto.

[0094] The AI model may be trained by a server capable of communicating with the electronic device 200 for a vehicle according to an embodiment of the present disclosure over a wireless communication network. For example, the external server may train the AI model, and transmit the trained AI model to the electronic device 200 for a vehicle.

[0095] A method by which the server capable of communicating with the electronic device for a vehicle, according to an embodiment of the present disclosure, over a wireless communication network trains the AI model will be described with reference to FIGS. 5 and 6.

[0096] FIG. 5 illustrates an electronic device for a vehicle, according to an embodiment of the present disclosure, which operates in conjunction with a server.

[0097] A server 530 may include a server, a server system, or a server-based device that transmits and receives to and from the electronic device 200 for a vehicle over a communication network 520 and processes the data.

[0098] In the disclosed embodiment, the server 530 includes a communicator for communicating with the electronic device 200 for a vehicle installed in a vehicle 510, and a processor for executing at least one instruction.

[0099] The server 530 may receive information regarding a criterion for setting filtering data, a type of the filtering data, etc., from the electronic device 200 for a vehicle or an external device.

[0100] The server 530 may train an AI model and store the trained AI model. Furthermore, the server 530 may perform an operation of predicting whether a nearby vehicle will cut in, based on the trained AI model and the received information.

[0101] In general, the electronic device 200 for a vehicle has limitations on memory storage capacity, operation processing speed, capability to collect a training data set, etc., as compared to the server 530. Hence, an operation requiring storage of massive data and a large amount of operation may be performed by the server 530, which may then transmit required data and / or an AI model in use to the electronic device 200 for a vehicle through a communication network. Hence, the electronic device 200 for a vehicle is able to perform a required operation quickly and easily by receiving, through the server, and using the required data and / or AI model, without having a large-capacity memory and a processor having high-speed calculation capability.

[0102] FIG. 6 is a diagram for describing FIG. 5 in detail.

[0103] The electronic device 200 for a vehicle of FIG. 6 is described and illustrated by taking the same case as the electronic device 200 for a vehicle as described in FIG. 2 for example.

[0104] Referring to FIG. 6, the server 530 may include a communicator 532, a processor 534, and a database (DB) 536.

[0105] The communicator 532 may include one or more components that enable communication with the electronic device 200 for a vehicle. The communicator 532 includes at least one communication module such as a short-range communication module, a wired communication module, a mobile communication module, a broadcast receiving module, etc. The at least one communication module refers to a communication module that may perform data transmission and reception over a network that conforms to a communication standard such as a communication scheme using a tuner for performing broadcast reception, Bluetooth, wireless LAN (Wi-Fi), wireless broadband (Wibro), world interoperability for microwave access (Wimax), CDMA, WCDMA, Internet, 3G, 4G, 5G and / or 5G, millimeter waves (mmWave).

[0106] For example, by performing communication by using the mmWave, the communicator 532 may quickly transmit or receive a large amount of data. Specifically, the vehicle may provide increased safety of the vehicle and / or user convenience by quickly receiving a large amount of data and quickly providing data required for safety of the vehicle (e.g., data required for autonomous driving, data required for a navigation service, etc.), user consumable content (e.g., movie, music, etc.).

[0107] Specifically, a mobile communication module included in the communicator 532 may communicate with another device (e.g., a server (not shown)) remotely located through a communication network that conforms to a communication standard such as 3G, 4G and / or 5G. The communication module that communicates with a server (not shown) remotely located may be referred to as a long-range communication module.

[0108] The processor 534 controls general operation of the server 530. For example, the processor 534 may perform required operations by executing at least one of at least one instruction and programs of the server 530.

[0109] Furthermore, the DB 536 may include memory (not shown), which may store at least one of at least one instruction, a program, or data required by the server 530 to perform a certain operation. Furthermore, the DB 536 may store data required by the server 530 to perform a neural network based operation.

[0110] Specifically, in the disclosed embodiment, the server 530 may store the neural network 420 as described above in FIG. 4. The neural network 420 may be stored in at least one of the processor 534 and the DB 536. The neural network 420 included in the server 530 may be a neural network that has completed learning.

[0111] Furthermore, the server 530 may transmit the neural network that has completed learning to the communicator 240 of the electronic device 200 for a vehicle through the communicator 532. The electronic device 200 for a vehicle may then obtain and store the neural network that has completed learning, and obtain desired output data through the neural network.

[0112] Referring back to FIG. 2, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to recognize the volume of at least one ambient sound, and obtain volume information indicating the volume of the ambient sound.

[0113] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to obtain the volume information of the at least one ambient sound in a decibel (dB) value.

[0114] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to predict a distance between the vehicle and at least one sound source based on the volume information of a sound produced from the sound source.

[0115] For example, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify the sound produced from the at least one sound source as a horn sound. When the volume of the horn sound is identified as being 90 dB or higher, the processor 210 may predict that the distance between the at least one sound source that outputs the horn sound and the vehicle is within a preset distance (short distance).

[0116] For example, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify the sound produced from the at least one sound source as a siren sound. When the volume of the siren sound is identified as being 90 dB or lower, the processor 210 may predict that the distance between the at least one sound source that outputs the siren sound and the vehicle is equal to or longer than the preset distance (long distance).

[0117] For example, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify a sound produced from at least one sound source as an explosion sound. When the volume of the explosion sound is identified as being 100 dB or higher, the processor 210 may predict that the distance between the at least one sound source that outputs the explosion sound and the vehicle is within the preset distance (short distance).

[0118] For example, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify a sound produced from at least one sound source as a brake friction sound. When the volume of the brake friction sound is identified as being 100 dB or higher, the processor 210 may predict that the distance between the at least one sound source that outputs the brake friction sound and the vehicle is within the preset distance (short distance). However, it is not limited thereto.

[0119] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify a group that includes the at least one ambient sound among a plurality of preset groups, based on at least one of type information of the at least one ambient sound and volume information of the at least one ambient sound.

[0120] For example, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify the sound produced from the at least one sound source as a horn sound. When the volume of the horn sound is identified as being 90 dB or higher, the processor 210 may identify that the sound produced from the at least one sound source corresponds to a nearby horn sound.

[0121] In this case, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify that the identified nearby horn sound is included in group 1 with very high importance among the plurality of preset groups.

[0122] For example, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify a sound produced from at least one sound source as a brake friction sound. When the volume of the brake friction sound is identified as being 90 dB or higher, the processor 210 may identify that the sound produced from the at least one sound source corresponds to a nearby brake friction sound.

[0123] In this case, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify that the identified nearby brake friction sound is included in group 1 with very high importance among the plurality of preset groups.

[0124] For example, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify the sound produced from the at least one sound source as a siren sound and identify that the volume of the horn sound is less than 90 dB. For example, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify that the sound produced from the at least one sound source corresponds to a distant siren sound.

[0125] In this case, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify that the identified distant siren sound is included in group 2 with high importance among the plurality of preset groups.

[0126] For example, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify a sound produced from at least one sound source as a road friction sound. In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify that the identified road friction sound is included in group 3 with low importance among the plurality of preset groups when the volume of the road friction sound is identified as being less than 50 dB.

[0127] The sound data transmitting module 236 may be configured with instructions or program codes related to a function and / or operation of transmitting at least one ambient sound to the mobile device, based on at least one of driving information of the vehicle and surrounding environment information of the vehicle, and a transmission condition corresponding to the identified group.

[0128] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the sound data transmitting module 236 to transmit at least one ambient sound to the mobile device.

[0129] The driving information of the vehicle may include at least one of speed information of the vehicle or speed change information of the vehicle.

[0130] The surrounding environment information of the vehicle may include at least one of location information of at least one sound source that outputs at least one ambient sound, weather information around the vehicle or speed information of an external vehicle located around the vehicle.

[0131] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the sound data transmitting module 236 to obtain the surrounding environment information of the vehicle through vehicle to everything (V2X) communication.

[0132] The V2X communication refers to communication through which the vehicle may exchange information with infrastructure-equipped objects such as other vehicles and roads, based on at least one of cable or wireless network.

[0133] The V2X communication may include at least one of vehicle to vehicle (V2V) communication, vehicle to infrastructure (V2I) communication, vehicle to network (V2N) communication, or vehicle to pedestrian (V2P) communication.

[0134] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the sound data transmitting module 236 to obtain the surrounding environment information of the vehicle through at least one sensor (not shown).

[0135] The sensor may include at least one of a global positioning system (GPS) sensor, a sound detection sensor, an image sensor, a camera, Lidar or radar, but is not limited thereto.

[0136] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the sound data transmitting module 236 to set a transmission condition for each of the plurality of preset groups.

[0137] In an embodiment of the present disclosure, the processor 210 may set a sound included in group 1 to be transmitted to the mobile device, regardless of the driving information of the vehicle and the surrounding environment information of the vehicle.

[0138] In an embodiment of the present disclosure, the processor 210 may identify at least one ambient sound with very high importance as being included in group 1. The processor 210 may transmit the at least one ambient sound to the mobile device regardless of the driving information of the vehicle and the surrounding environment information of the vehicle.

[0139] For example, in an embodiment of the present disclosure, the processor 210 may identify a sound produced from at least one sound source as a horn sound. The processor 210 may identify that the identified horn sound corresponds to a nearby horn sound, based on the volume information of the horn sound. The processor 210 may identify that the nearby horn sound is included in group 1 of the plurality of preset groups. In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the sound data transmitting module 236 to transmit the nearby horn sound to the mobile device, regardless of the driving information of the vehicle (e.g., the vehicle's driving speed).

[0140] For example, in an embodiment of the present disclosure, the processor 210 may identify a sound produced from at least one sound source as an explosion sound. The processor 210 may identify, based on the volume information of the explosion sound, that the identified explosion sound corresponds to a nearby explosion sound and is included in group 1 of the plurality of preset groups. In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the sound data transmitting module 236 to transmit the nearby explosion sound to the mobile device, regardless of the driving information of the vehicle (e.g., vehicle's driving speed). It is not, however, limited thereto.

[0141] In an embodiment of the present disclosure, the processor 210 may set a transmission condition for transmitting a sound included in group 2 to the mobile device, based on at least one of the driving information of the vehicle and the surrounding environment information of the vehicle.

[0142] In an embodiment of the present disclosure, the processor 210 may identify at least one ambient sound with high importance as being included in group 2. The processor 210 may transmit the at least one sound included in group 2 to the mobile device, based on at least one of the driving information of the vehicle and the surrounding environment information of the vehicle.

[0143] For example, in an embodiment of the present disclosure, the processor 210 may identify a sound produced from at least one sound source as a horn sound. The processor 210 may identify, based on the volume information of the horn sound, that the identified horn sound corresponds to a distant horn sound and corresponds to group 2 of the plurality of preset groups. In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the sound data transmitting module 236 to transmit the distant horn sound to the mobile device, based on at least one of the speed of the vehicle, location information of a vehicle that produces the horn sound and speed information of the vehicle that produces the horn sound.

[0144] For example, in an embodiment of the present disclosure, the processor 210 may identify a sound produced from at least one sound source as a brake friction sound. The processor 210 may identify, based on the volume information of the brake friction sound, that the identified brake friction sound corresponds to a distant brake friction sound and corresponds to group 2 of the plurality of preset groups. In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the sound data transmitting module 236 to transmit the distant brake friction sound to the mobile device, based on at least one of the speed of the vehicle, weather information around the vehicle or speed information of a vehicle that produces the brake friction sound. However, it is not limited thereto.

[0145] In an embodiment of the present disclosure, the processor 210 may identify at least one ambient sound with high importance as being included in group 2. The processor 210 may transmit the at least one sound included in group 2 to the mobile device, based on the driving information of the vehicle.

[0146] The driving information of the vehicle may include at least one of the speed information of the vehicle or the speed change information of the vehicle.

[0147] In an embodiment of the present disclosure, the processor 210 may transmit at least one sound included in group 2 to the mobile device, based on the speed information of the vehicle that includes the electronic device 200 for vehicle.

[0148] For example, the processor 210 may identify a sound produced from at least one sound source as a brake friction sound. In an embodiment of the present disclosure, the processor 210 may identify, based on the volume information of the brake friction sound, that the identified brake friction sound corresponds to a distant brake friction sound and corresponds to group 2 of the plurality of preset groups. In an embodiment of the present disclosure, the processor 210 may transmit the distant brake friction sound to the mobile device, when the vehicle that includes the electronic device 200 for vehicle is driving at high speed.

[0149] High-speed driving may refer to a case that the vehicle including the electronic device 200 for vehicle according to an embodiment of the present disclosure is driving at or above a certain speed.

[0150] The certain speed may be set based on speed limits of the road on which the vehicle including the electronic device 200 for vehicle according to an embodiment of the present disclosure is driving. However, it is not limited thereto.

[0151] In an embodiment of the present disclosure, the processor 210 may obtain information about speed limits of the road on which the vehicle including the electronic device 200 for vehicle is driving, through V2X communication.

[0152] For example, in an embodiment of the present disclosure, the processor 210 may set the certain speed to 30 km / h, when the vehicle including the electronic device 200 for vehicle is driving on a road with a speed limit of 30 km / h.

[0153] For example, in an embodiment of the present disclosure, the processor 210 may set the certain speed to 100 km / h, when the vehicle including the electronic device 200 for vehicle is driving on a road with a speed limit of 100 km / h. However, it is not limited thereto.

[0154] The certain speed may be changed by the user.

[0155] For example, the user may set the certain speed to 80 km / h regardless of the speed limits of the road on which the vehicle including the electronic device 200 for vehicle according to an embodiment of the present disclosure is driving.

[0156] For example, the user may set the certain speed to 100 km / h regardless of the speed limits of the road on which the vehicle including the electronic device for vehicle 200 according to an embodiment of the present disclosure is driving. However, it is not limited thereto.

[0157] In an embodiment of the present disclosure, the processor 210 may transmit at least one sound included in group 2 to the mobile device, based on speed change information of the vehicle including the electronic device 200 for vehicle.

[0158] The speed change information of the vehicle may include at least one of sudden acceleration or sudden deceleration.

[0159] Sudden acceleration may refer to a sudden increase in speed of the vehicle including the electronic device 200 for vehicle according to an embodiment of the present disclosure in a short period of time.

[0160] For example, sudden acceleration may refer to an increase in speed of the vehicle including the electronic device 200 for vehicle according to an embodiment of the present disclosure by a speed of 2.8 m / s or more, but is not limited thereto.

[0161] Sudden deceleration may refer to a sudden decrease in speed of the vehicle including the electronic device 200 for vehicle according to an embodiment of the present disclosure in a short period of time.

[0162] For example, sudden deceleration may refer to a decrease in speed of the vehicle including the electronic device 200 for vehicle according to an embodiment of the present disclosure by a speed of 2.8 m / s or more, but is not limited thereto.

[0163] For example, the processor 210 may identify a sound produced from at least one sound source as a brake friction sound. In an embodiment of the present disclosure, the processor 210 may identify, based on the volume information of the brake friction sound, that the identified brake friction sound corresponds to a distant brake friction sound and corresponds to group 2 of the plurality of preset groups. In an embodiment of the present disclosure, the processor 210 may not transmit the distant brake friction sound to the mobile device, when the vehicle including the electronic device 200 for vehicle is driving at low speed.

[0164] In an embodiment of the present disclosure, the processor 210 may transmit the distant brake friction sound to the mobile device, when the vehicle including the electronic device 200 for vehicle accelerates rapidly. The distant brake friction sound may refer to a brake friction sound produced from a sound source located in a direction in which the vehicle including the electronic device 200 for vehicle accelerates rapidly. However, it is not limited thereto.

[0165] For example, the processor 210 may identify a sound produced from at least one sound source as a horn sound. In an embodiment of the present disclosure, the processor 210 may identify, based on the volume information of the horn sound, that the identified horn sound corresponds to a distant horn sound and corresponds to group 2 of the plurality of preset groups. In an embodiment of the present disclosure, the processor 210 may not transmit the distant horn sound to the mobile device, when the vehicle including the electronic device 200 for vehicle is driving at low speed. However, it is not limited thereto.

[0166] In an embodiment of the present disclosure, the processor 210 may transmit the distant horn sound to the mobile device, when the vehicle including the electronic device 200 for vehicle decelerates rapidly. The distant horn sound may refer to a brake friction sound produced from a sound source located behind the vehicle including the electronic device 200 for vehicle according to an embodiment of the present disclosure. However, it is not limited thereto.

[0167] Low-speed driving may refer to a case that the vehicle including the electronic device 200 for vehicle according to an embodiment of the present disclosure is driving at less than a certain speed.

[0168] The certain speed may be set based on speed limits of the road on which the vehicle including the electronic device 200 for vehicle according to an embodiment of the present disclosure is driving. However, it is not limited thereto.

[0169] In an embodiment of the present disclosure, the processor 210 may obtain information about speed limits of the road on which the vehicle including the electronic device 200 for vehicle is driving, through V2X communication. However, it is not limited thereto.

[0170] For example, in an embodiment of the present disclosure, the processor 210 may set the certain speed of the vehicle to 30 km / h, when the vehicle including the electronic device 200 for vehicle is driving on a road with a speed limit of 30 km / h.

[0171] For example, in an embodiment of the present disclosure, the processor 210 may set the certain speed of the vehicle to 80 km / h, when the vehicle including the electronic device 200 for vehicle is driving on a road with a speed limit of 80 km / h. However, it is not limited thereto.

[0172] The certain speed may be changed by the user.

[0173] For example, the user may set the certain speed of the vehicle to 50 km / h regardless of the speed limits of the road on which the vehicle including the electronic device 200 for vehicle according to an embodiment of the present disclosure is driving.

[0174] For example, the user may set the certain speed of the vehicle to 100 km / h regardless of the speed limits of the road on which the vehicle including the electronic device 200 for vehicle according to an embodiment of the present disclosure is driving.

[0175] In an embodiment of the present disclosure, the processor 210 may identify at least one ambient sound with high importance as being included in group 2. The processor 210 may transmit the at least one sound included in group 2 to the mobile device, based on the surrounding environment information.

[0176] The surrounding environment information of the vehicle may include at least one of location information of at least one sound source that outputs at least one ambient sound, weather information around the vehicle or speed information of an external vehicle located around the vehicle. However, it is not limited thereto.

[0177] In an embodiment of the present disclosure, the processor 210 may identify a sound produced from at least one sound source as a rain sound.

[0178] In an embodiment of the present disclosure, the processor 210 may obtain precipitation information based on the volume information of the rain sound.

[0179] In an embodiment of the present disclosure, the processor 210 may transmit at least one sound included in group 2 to the mobile device, based on the precipitation information.

[0180] For example, the processor 210 may identify a sound produced from at least one sound source as a brake friction sound. In an embodiment of the present disclosure, the processor 210 may identify, based on the volume information of the brake friction sound, that the identified brake friction sound corresponds to a distant brake friction sound and corresponds to group 2 of the plurality of preset groups. In an embodiment of the present disclosure, the processor 210 may transmit the distant brake friction sound to the mobile device, when the amount of precipitation is equal to or greater than a set value.

[0181] For example, the processor 210 may identify a sound produced from at least one sound source as a siren sound. In an embodiment of the present disclosure, the processor 210 may identify, based on the volume information of the siren sound, that the identified siren sound corresponds to a distant siren sound and corresponds to group 2 of the plurality of preset groups. In an embodiment of the present disclosure, the processor 210 may transmit the distant siren sound to the mobile device, when the amount of precipitation is equal to or greater than a set value.

[0182] The set value may be 15 mm, but is not limited thereto.

[0183] The set value may be changed by the user.

[0184] In an embodiment of the present disclosure, the processor 210 may obtain surrounding environment information of the vehicle through a sensor.

[0185] The surrounding environment information may include brightness information of a road on which the vehicle including the electronic device 200 for vehicle according to an embodiment of the present disclosure is driving.

[0186] In an embodiment of the present disclosure, the processor 210 may obtain the brightness information of the road in a lux value.

[0187] In an embodiment of the present disclosure, the processor 210 may transmit at least one sound included in group 2 to the mobile device, based on the brightness information of the road on which the vehicle is driving.

[0188] For example, the processor 210 may identify a sound produced from at least one sound source as a siren sound. In an embodiment of the present disclosure, the processor 210 may identify, based on the volume information of the siren sound, that the identified siren sound corresponds to a distant siren sound and corresponds to group 2 of the plurality of preset groups. In an embodiment of the present disclosure, the processor 210 may transmit the distant siren sound to the mobile device, when the brightness of the road on which the vehicle that includes the electronic device 200 for vehicle according to an embodiment of the present disclosure is driving is equal to or less than a threshold.

[0189] For example, in an embodiment of the present disclosure, the processor 210 may transmit the distant siren sound to the mobile device when the brightness of light obtained through the sensor is equal to or less than 50 lux. However, it is not limited thereto.

[0190] The threshold may be changed by the user.

[0191] In an embodiment of the present disclosure, the processor 210 may set a transmission condition for transmitting a sound included in group 3 to the mobile device, based on the surrounding environment information of the vehicle.

[0192] In an embodiment of the present disclosure, the processor 210 may identify at least one sound with low importance as being included in group 3. The processor 210 may transmit the at least one sound included in group 3 to the mobile device, based on the surrounding environment information of the vehicle.

[0193] For example, in an embodiment of the present disclosure, the processor 210 may identify a sound produced from at least one sound source as a road friction sound. The processor 210 may identify, based on the volume information of the road friction sound, that the identified road friction sound corresponds to group 3 of the plurality of preset groups. In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the sound data transmitting module 236 to transmit the road friction sound to the mobile device, based on location information of a plurality of external vehicles located around the vehicle and approach information of the plurality of external vehicles toward the vehicle. However, it is not limited thereto.

[0194] The aforementioned transmission condition for each of the plurality of preset groups is merely an example and is not limited thereto.

[0195] The transmission condition for each of the plurality of preset groups may be changed by the user.

[0196] The transmission condition for each of the plurality of preset groups may be stored in the memory 230 of the electronic device 200 for vehicle according to an embodiment of the present disclosure.

[0197] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the sound data transmitting module 236 to transmit occurrence information of at least one ambient sound to the mobile device.

[0198] The occurrence information of the at least one ambient sound may include information indicating that at least one ambient sound has occurred.

[0199] For example, the occurrence information of the at least one ambient sound may include information indicating that a nearby horn sound has occurred, when the processor 210 according to an embodiment of the present disclosure recognizes the nearby horn sound.

[0200] For example, the occurrence information of the at least one ambient sound may include information indicating that a distant siren sound has occurred, when the processor 210 according to an embodiment of the present disclosure recognizes the distant siren sound. However, it is not limited thereto.

[0201] Upon receiving the occurrence information of the at least one ambient sound, the mobile device may transmit a generated sound corresponding to the occurrence information of the at least one ambient sound to the wearable device.

[0202] The generated sound corresponding to the occurrence information of the at least one ambient sound may refer to a sound produced by the mobile device based on an artificial intelligence model.

[0203] The generated sound corresponding to the occurrence information of the at least one ambient sound may refer to a sound stored in memory of the mobile device.

[0204] When latency occurs in transmitting the at least one ambient sound to the mobile device from the electronic device 200 for vehicle according to an embodiment of the present disclosure, the mobile device may transmit a generated sound corresponding to the occurrence information of the at least one ambient sound to the wearable device.

[0205] In a case that latency occurs when the mobile device receives the at least one ambient sound from the electronic device for vehicle, the generated sound generated or stored by the mobile device may be transmitted to the wearable device, so that the user operating the vehicle may be alerted.

[0206] The group identifying module 234 may further include instructions or program codes related to a function and / or operation of identifying another group that includes at least one ambient sound, based on a change in volume information of the at least one ambient sound.

[0207] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to predict a distance between the vehicle and at least one sound source based on the volume information of at least one ambient sound produced from the sound source.

[0208] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to determine that the distance between the vehicle and the sound source that outputs the at least one ambient sound increases, when the volume of the at least one ambient sound decreases.

[0209] For example, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to determine that the distance between the vehicle and a sound source that outputs a siren sound has decreased and then increased, when the volume of the siren sound has increased and then decreased.

[0210] For example, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to determine that the distance between the vehicle and a sound source that outputs a siren sound increases, when recognizing a change in volume of the siren sound from 90 dB to 50 dB. However, it is not limited thereto.

[0211] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to determine that the distance between the vehicle and the sound source that outputs the at least one ambient sound decreases, when the volume of the at least one ambient sound increases.

[0212] For example, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to determine that the distance between the vehicle and a sound source that outputs a horn sound has increased and then decreased, when the volume of the horn sound has decreased and then increased.

[0213] For example, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to determine that the distance between the vehicle and a sound source that outputs a horn sound decreases, when recognizing a change in volume of the horn sound from 40 dB to 100 dB. However, it is not limited thereto.

[0214] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify a group that includes the at least one ambient sound among a plurality of preset groups, based on the volume information of the at least one ambient sound.

[0215] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify a group that includes the at least one ambient sound among a plurality of preset groups, based on a change in volume of the at least one ambient sound being recognized.

[0216] For example, in an embodiment of the present disclosure, the processor 210 may recognize a nearby horn sound based on the volume information and type information of the at least one ambient sound. In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify that the at least one ambient sound identified as a nearby horn sound is included in group 1.

[0217] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to recognize a change in volume information of the horn sound. For example, the processor 210 may recognize that the nearby horn sound has changed to a distant horn sound. In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify that the at least one ambient sound identified as a distant horn sound is included in group 2. However, it is not limited thereto.

[0218] For example, in an embodiment of the present disclosure, the processor 210 may recognize a distant brake friction sound based on the volume information and type information of the at least one ambient sound. In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify that the at least one ambient sound identified as a distant brake friction sound is included in group 2.

[0219] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to recognize a change in volume information of the brake friction sound. For example, the processor 210 may recognize that the distant brake friction sound has changed to a nearby brake friction sound. In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to identify that the at least one ambient sound identified as a nearby brake friction sound is included in group 1. However, it is not limited thereto.

[0220] The sound data transmitting module 236 may further include instructions or program codes related to a function and / or operation of determining whether to transmit at least one ambient sound to the mobile device, based on at least one of driving information of the vehicle and surrounding environment information of the vehicle, and a transmission condition corresponding to a changed group when the volume of the at least one ambient sound is changed and the group including the at least one changed ambient sound is changed.

[0221] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the group identifying module 234 to determine whether to continue to transmit, to the mobile device, the at least one ambient sound that has been being transmitted, when recognizing a change in volume information of the at least one ambient sound after the at least one ambient sound is transmitted to the mobile device.

[0222] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the sound data transmitting module 234 to identify that the group including at least one ambient sound is changed from group 1 to group 2 as the volume of the at least one ambient sound being transmitted to the mobile device is changed to be smaller.

[0223] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the sound data transmitting module 234 to determine whether to transmit the at least one ambient sound to the mobile device, based on at least one of the driving information of the vehicle and the surrounding environment information of the vehicle, and the transmission condition corresponding to group 2. However, it is not limited thereto.

[0224] In FIG. 2, only essential components for describing an operation of the electronic device 200 for vehicle are shown, and components included in the electronic device 200 for vehicle are not limited to those shown in FIG. 2.

[0225] FIG. 7 is a diagram for describing an embodiment of transmitting an ambient sound from an electronic device for vehicle according to an embodiment of the present disclosure to a mobile device according to an embodiment of the present disclosure.

[0226] The sound data transmitting module 236 may further include instructions or program codes related to a function and / or operation of transmitting output information of the at least one ambient sound to the mobile device.

[0227] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the sound data transmitting module 236 to transmit the output information of the at least one ambient sound to the mobile device.

[0228] The output information may include at least one of volume information of the at least one ambient sound or direction information of at least one sound source that outputs the at least one ambient sound.

[0229] For example, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the sound data transmitting module 236 to transmit, to the mobile device, the direction information of a sound source outputting at least one ambient sound (e.g., located at 170° to the left), when the at least one ambient sound is output from the sound source located at 170° to the left, when it is assumed that the front of the vehicle is 0°.

[0230] For example, in an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the sound data transmitting module 236 to transmit, to the mobile device, the direction information of a sound source outputting at least one ambient sound (e.g., located at 90° to the right), when the at least one ambient sound is output from the sound source located at 90° to the right, when it is assumed that the front of the vehicle is 0°. However, it is not limited thereto.

[0231] For example, in an embodiment of the present disclosure, the processor 210 may recognize that a horn sound has occurred at about 100 dB in a short range. The processor 210 may transmit, to the mobile device, volume information (about 100 dB) of a nearby horn sound. However, it is not limited thereto.

[0232] For example, in an embodiment of the present disclosure, the processor 210 may recognize that the volume of a sound produced from a sound source located in a short range from the vehicle decreases as the distance between the vehicle and the sound source increases (e.g., a case where the volume of the sound decreases from 90 dB to 40 dB). The processor 210 may transmit sound volume change information (indicating that the volume of the sound gradually decreases) to the mobile device.

[0233] The mobile device may then transmit, to the wearable device, the sound produced from the sound source such that the sound is output with a gradually decreasing volume. However, it is not limited thereto.

[0234] For example, in an embodiment of the present disclosure, the processor 210 may recognize that the volume of a sound produced from a sound source 710 located in a long range from the vehicle 120 increases as the distance between the vehicle 120 and the sound source 710 decreases (e.g., a case where the volume of the sound increases from 30 dB to 60 dB). The processor 210 may transmit sound volume change information 720 and 730 (indicating that the volume of the sound gradually increases) to the mobile device.

[0235] The mobile device may then transmit, to the wearable device, the sound produced from the sound source such that the sound is output with a gradually increasing volume. However, it is not limited thereto.

[0236] FIG. 8 is a diagram for describing an operation corresponding to transmission of mixing information to a mobile device from an electronic device for vehicle, according to an embodiment of the present disclosure.

[0237] The sound data transmitting module 236 may further include instructions or program codes related to a function and / or operation of transmitting mixing information of at least one ambient sound to the mobile device.

[0238] The mixing information may include information indicating whether to synthesize the at least one ambient sound transmitted to the mobile device with at least one audio data being played on the mobile device.

[0239] The audio data may refer to sound output from media being played on the mobile device.

[0240] The audio data may include, for example, at least one of music sound or radio sound being played on the mobile device, but is not limited thereto.

[0241] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the sound data transmitting module 236 to transmit, to the mobile device, information indicating that at least one ambient sound and at least one audio data being played on the mobile device are not to be synthesized, when the at least one ambient sound included in group 1 with very high importance is recognized.

[0242] In this case, the mobile device may block audio data 810 being played to the wearable device 130, and transmit only the at least one ambient sound 850 (in 840).

[0243] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the sound data transmitting module 236 to transmit, to the mobile device, information indicating that at least one ambient sound and at least one audio data being played on the mobile device are not to be synthesized, when the at least one ambient sound included in group 3 with low importance is recognized.

[0244] In this case, the mobile device may transmit the audio data 810 being played to the wearable device 130, and may not transmit the at least one ambient sound 850 (in 820).

[0245] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the sound data transmitting module 236 to transmit, to the mobile device, information indicating that at least one ambient sound and at least one audio data being played on the mobile device are to be synthesized, when the at least one ambient sound included in group 2 with high importance is recognized.

[0246] In this case, the mobile device may transmit a sound resulting from synthesizing the at least one ambient sound 850 with the audio data 810 to the wearable device 130 (in 830).

[0247] In an embodiment of the present disclosure, the processor 210 may execute the instructions or program codes of the sound data transmitting module 236 to transmit the at least one ambient sound, output information and mixing information of the at least one ambient sound to the mobile device.

[0248] In this case, the mobile device may transmit, to the wearable device, the sound resulting from synthesizing the audio data with the ambient sound or the at least one ambient sound, based on the output information and mixing information of the at least one ambient sound.

[0249] For example, based on the output information and mixing information of the at least one ambient sound, the mobile device may receive information indicating that the at least one ambient sound is recognized with a volume of less than 40 dB from the left of the vehicle, and that the at least one ambient sound is to be synthesized with the audio data. The mobile device may synthesize the at least one ambient sound with the audio data being played, at a lower volume than of the audio data. The mobile device may transmit the synthesized sound to the wearable device worn on the left ear such that the synthesized sound is output from the wearable device.

[0250] For example, based on the output information and mixing information of the at least one ambient sound, the mobile device may receive information indicating that the at least one ambient sound is recognized with a volume of 40 dB or more and less than 90 dB from the right of the vehicle, and that the at least one ambient sound is to be synthesized with the audio data. The mobile device may synthesize the at least one ambient sound with the audio data being played, at a higher volume than of the audio data. The mobile device may transmit the synthesized sound to the wearable device worn on the right ear such that the synthesized sound is output from the wearable device.

[0251] For example, based on the output information and mixing information of the at least one ambient sound, the mobile device may receive mixing information indicating that the at least one ambient sound is recognized with a volume of 90 dB or more from the right of the vehicle, and that the at least one ambient sound is not to be synthesized with the audio data being played. The mobile device may transmit at least one ambient sound to the wearable device worn on the right ear such that only the at least one ambient sound is output from the wearable device at a large volume. However, it is not limited thereto.

[0252] FIG. 9 is a block diagram illustrating components of a mobile device, according to an embodiment of the present disclosure.

[0253] A mobile device 900 may include a communicator 920 that performs communication with the electronic device for vehicle and the wearable device, memory 930 that stores at least one instruction, and at least one processor 910 that executes the at least one instruction stored in the memory 930.

[0254] The memory 930 may store various data, programs, or applications for driving and controlling the mobile device 900 according to an embodiment of the present disclosure. The memory 930 may include, for example, a non-volatile memory including at least one of a flash memory, a hard disk, a multimedia card micro type memory, a card type memory (e.g., SD or XD memory), a read-only memory (ROM), an electrically erasable programmable ROM (EEPROM), or a programmable ROM (PROM), and a volatile memory such as a random access memory (RAM) or a static RAM (SRAM).

[0255] Instructions, data structures, and program codes that are readable by the processor 910 may be stored in the memory 930. In the following embodiments, the processor 910 may be implemented by executing instructions or codes of the program stored in the memory 930.

[0256] The programs stored in the memory 930 may be classified into a plurality of modules according to the functions, which include, for example, a sound data receiving module 932, a sound synthesizing module 934, and a sound transmitting module 936.

[0257] However, the instructions or codes of the program stored in the memory 930 are not limited thereto. For example, the sound data receiving module 932, the sound synthesizing module 923 and the sound transmitting module 936 are components for an embodiment, and the configurations of the modules included in the memory 930 may be integrated, added or omitted depending on the specification of the mobile device 900 that is actually implemented. In other words, two or more modules may be merged into one, or a single module may be split into two or more modules as needed.

[0258] The sound data receiving module 932, sound synthesizing module 934 and sound transmitting module 936 stored in the memory 930 may refer to units of processing the functions or operations performed by the processor 910, and may be implemented in software such as instructions, algorithms, data structures or program codes.

[0259] The processor 910 may include hardware components for performing arithmetic, logical, and input / output operations and signal processing. The processor 910 may include at least one of e.g., central processing units (CPUs), microprocessors, graphic processing units (GPUs), application specific integrated circuits (ASIC), digital signal processors (DSPs), digital signal processing devices (DSPDs, programmable logic devices (PLDs), and field programmable gate arrays (FPGAs), without being limited thereto.

[0260] The communicator 920 may perform communication with an external device or server over at least one cable or wireless communication network according to the processor 910. In an embodiment, the communicator 920 may include at least one short-range communication module for performing communication according to a communication standard such as Bluetooth, Wi-Fi, Bluetooth low energy (BLE), NFC / RFID, Wi-Fi direct, UWB or ZIGBEE, and a long-range communication module for performing communication with a server for supporting the long-range communication according to a long-range communication standard. The long-range communication module may perform communication over a communication network that conforms to 3G, 4G and / or 5G communication standards, or over a network for Internet communication.

[0261] In an embodiment of the present disclosure, the mobile device 900 may be connected to the electronic device for vehicle through the communicator 920.

[0262] In an embodiment of the present disclosure, the mobile device 900 may be wirelessly connected to the wearable device through the communicator 920.

[0263] The sound data receiving module 932 may be configured with instructions or program codes related to a function and / or operation of receiving at least one sound or occurrence information of the at least one ambient sound from the electronic device for vehicle.

[0264] In an embodiment of the present disclosure, the processor 910 may execute the instructions or program codes of the sound data receiving module 932 to receive at least one sound or occurrence information of the at least one ambient sound from the electronic device for vehicle.

[0265] The occurrence information of the at least one ambient sound may include information indicating that at least one ambient sound has occurred.

[0266] For example, the occurrence information of the at least one ambient sound may include information indicating that a nearby horn sound has occurred, when the electronic device for vehicle recognizes the nearby horn sound.

[0267] For example, the occurrence information of the at least one ambient sound may include information indicating that a distant siren sound has occurred, when the electronic device for vehicle recognizes the distant siren sound. However, it is not limited thereto.

[0268] The sound synthesizing module 934 may be configured with instructions or program codes related to a function and / or operation of synthesizing at least one ambient sound or a generated sound corresponding to the occurrence information of the at least one ambient sound with audio data being played.

[0269] In an embodiment of the present disclosure, the processor 910 may execute the instructions or program codes of the sound synthesizing module 934 to synthesize the at least one ambient sound or the generated sound corresponding to the occurrence information of the at least one ambient sound with audio data being played.

[0270] The audio data may refer to sound output from media being played on the mobile device.

[0271] The audio data may include, for example, at least one of music sound or radio sound being played on the mobile device, but is not limited thereto.

[0272] In an embodiment of the present disclosure, the processor 910 may execute the instructions or program codes of the sound synthesizing module 934 to create a generated sound corresponding to the occurrence information of the at least one ambient sound based on an artificial intelligence model.

[0273] In an embodiment of the present disclosure, the processor 910 may execute the instructions or program codes of the sound synthesizing module 934 to store the generated sound corresponding to the occurrence information of the at least one ambient sound in the memory 930 of the mobile device 900 according to an embodiment of the present disclosure.

[0274] The generated sound corresponding to the occurrence information of the at least one ambient sound may refer to a nearby horn sound stored in the memory 930 or created based on the artificial intelligence model by the processor 910 according to an embodiment of the present disclosure executing the instructions or program codes of the sound synthesizing module 934, when the occurrence information of the at least one ambient sound includes information indicating that the nearby horn sound has occurred. However, it is not limited thereto.

[0275] The generated sound corresponding to the occurrence information of the at least one ambient sound may refer to a distant siren sound stored in the memory or created based on the artificial intelligence model by the processor 910 according to an embodiment of the present disclosure executing the instructions or program codes of the sound synthesizing module 934, when the occurrence information of the at least one ambient sound includes information indicating that the distant siren sound has occurred. However, it is not limited thereto.

[0276] The sound transmitting module 936 may be configured with instructions or program codes related to a function and / or operation of transmitting the synthesized sound to the mobile device.

[0277] In an embodiment of the present disclosure, the processor 910 may execute the instructions or program codes of the sound transmitting module 936 to transmit the synthesized sound to the wearable device.

[0278] Hence, even when latency occurs when the mobile device 900 according to an embodiment of the present disclosure receives at least one ambient sound from the electronic device for vehicle, the processor 910 according to an embodiment of the present disclosure may execute the instructions or program codes of the sound transmitting module 936 to transmit the generated sound corresponding to the occurrence information of the at least one ambient sound to the wearable device, thereby alerting the user who is operating the vehicle.

[0279] The sound data receiving module 932 may further include instructions or program codes related to a function and / or operation of receiving output information of the at least one ambient sound from the electronic device for vehicle.

[0280] In an embodiment of the present disclosure, the processor 910 may execute the instructions or program codes of the sound data receiving module 932 to receive output information of the at least one ambient sound from the electronic device for vehicle.

[0281] The output information may include at least one of volume information of the at least one ambient sound or direction information of at least one sound source that outputs the at least one ambient sound.

[0282] For example, in an embodiment of the present disclosure, the processor 910 may execute the instructions or program codes of the sound data receiving module 932 to receive, from the electronic device for vehicle, the direction information of a sound source outputting at least one ambient sound (e.g., located at 170° to the left), when the at least one ambient sound is output from the sound source located at 170° to the left, when it is assumed that the front of the vehicle is 0°.

[0283] For example, in an embodiment of the present disclosure, the processor 910 may execute the instructions or program codes of the sound data receiving module 932 to receive, from the electronic device for vehicle, the direction information of a sound source outputting at least one ambient sound (e.g., located at 90° to the right), when the at least one ambient sound is output from the sound source located at 90° to the right, when it is assumed that the front of the vehicle is 0°. However, it is not limited thereto.

[0284] For example, in an embodiment of the present disclosure, the processor 910 may execute instructions or program codes of the sound data receiving module 932 to receive volume information (about 100 dB) of a nearby horn sound from the electronic device for vehicle, when the electronic device for vehicle recognizes that the horn sound has occurred in a short range at about 100 dB. However, it is not limited thereto.

[0285] The sound transmitting module 936 may further include instructions or program codes related to a function and / or operation of adjusting at least one of the volume or direction of the synthesized sound in the output information.

[0286] In an embodiment of the present disclosure, the processor 910 may execute the instructions or program codes of the sound transmitting module 936 to adjust at least one of the volume or direction of the synthesized sound.

[0287] For example, in an embodiment of the present disclosure, the processor 910 may receive, from the electronic device for vehicle, output information indicating that at least one sound source outputting at least one ambient sound is located on the right of the vehicle. In an embodiment of the present disclosure, the processor 910 may execute the instructions or program codes of the sound transmitting module 936 to adjust the direction of at least one synthesized sound such that at least one ambient sound is output from the wearable device worn on the right ear. However, it is not limited thereto.

[0288] For example, in an embodiment of the present disclosure, the processor 910 may receive, from the electronic device for vehicle, output information indicating that at least one sound source outputting at least one ambient sound is located on the left of the vehicle and the volume of the at least one ambient sound is 100 dB. In an embodiment of the present disclosure, the processor 910 may execute the instructions or program codes of the sound transmitting module 936 to adjust the volume and direction of a synthesized sound such that at least one ambient sound is output from the wearable device worn on the left ear at a larger volume than of audio data being output.

[0289] For example, in an embodiment of the present disclosure, the processor 910 may receive, from the electronic device for vehicle, output information indicating that at least one sound source outputting at least one ambient sound is located on the right of the vehicle and that the volume of the at least one ambient sound is 40 dB. In an embodiment of the present disclosure, the processor 910 may execute the instructions or program codes of the sound transmitting module 936 to adjust the volume and direction of the synthesized sound such that at least one ambient sound is output from the wearable device worn on the right ear at a lower volume than of the audio data being output. However, it is not limited thereto.

[0290] For example, in an embodiment of the present disclosure, the processor 910 may receive, from the electronic device for a vehicle, sound volume change information indicating that the volume of a sound produced from a sound source located in a short range from the vehicle decreases (e.g., the volume of the sound decreases from 90 dB to 40 dB) as the distance between the vehicle and the sound source increases. In an embodiment of the present disclosure, the processor 910 may execute the instructions or program codes of the sound transmitting module 936 to adjust the volume of at least one synthesized sound such that the sound is output with the gradually decreasing volume to the wearable device. However, it is not limited thereto.

[0291] For example, in an embodiment of the present disclosure, the processor 910 may receive, from the electronic device for vehicle, sound volume change information indicating that the volume of the sound produced from a sound source located in a long range from the vehicle increases (e.g., the volume of the sound decreases from 30 dB to 60 dB) as the distance between the vehicle and the sound source decreases. In an embodiment of the present disclosure, the processor 910 may execute the instructions or program codes of the sound transmitting module 936 to adjust the volume of the synthesized sound such that the sound is output with the gradually increasing volume to the wearable device. However, it is not limited thereto.

[0292] The sound transmitting module 936 may further include instructions or program codes related to a function and / or operation of transmitting the adjusted sound to the wearable device.

[0293] In an embodiment of the present disclosure, the processor 910 may execute the instructions or program codes of the sound transmitting module 936 to transmit the adjusted sound to the wearable device.

[0294] In FIG. 9, only essential components for describing an operation of the mobile device 900 are shown, and components included in the mobile device 900 are not limited to those shown in FIG. 9.

[0295] FIG. 10 is a flowchart illustrating an operating method of an electronic device for vehicle, according to an embodiment of the present disclosure.

[0296] In operation 1010, the electronic device for vehicle may obtain at least one ambient sound through at least one microphone.

[0297] In an embodiment of the present disclosure, when noise is obtained along with the ambient sound, the electronic device for vehicle may reduce or eliminate the noise.

[0298] In an embodiment of the present disclosure, the electronic device for vehicle may reduce or eliminate, through a filter, the noise obtained along with the ambient sound.

[0299] The filter may include at least one of, for example, a band-pass filter, a moving average filter, an FIR filter or an IIR filter, but is not limited thereto.

[0300] In an embodiment of the present disclosure, the electronic device for vehicle may cancel the noise obtained along with the at least one ambient sound, based on white noise corresponding to the noise.

[0301] In an embodiment of the present disclosure, the electronic device for vehicle may reduce the noise obtained along with the at least one ambient sound, based on destructive interference.

[0302] In operation 1020, the electronic device for vehicle may identify a group that includes the at least one ambient sound among a plurality of preset groups, based on at least one of type information and volume information of the at least one ambient sound.

[0303] In an embodiment of the present disclosure, the electronic device for vehicle may identify type information of the at least one ambient sound, based on an artificial intelligence model.

[0304] The artificial intelligence technology (hereinafter, AI technology) is a technology to obtain a desired result by performing processes such as analysis and / or classification on input data based on operations through a neural network.

[0305] The AI technology may be implemented by using an algorithm. The algorithm or a set of algorithms to implement the AI technology is called the neural network. The neural network may receive input data, and perform an operation for the analysis and / or classification to output resulting data. As such, in order for the neural network to output accurate resulting data corresponding to the input data, the neural network needs to be trained. The training may refer to training the neural network to discover or learn, by the neural network itself, a method of inputting various data to the neural network and analyzing the input data, a method of classifying the input data and / or a method of extracting features required to generate resulting data from the input data. Specifically, through the training procedure, the neural network may be trained with training data (e.g., a plurality of different images) to optimize and set weight values in the neural network. A desired result is then output by learning the input data through the neural network having the optimized weight values.

[0306] Specifically, when there are a plurality of hidden layers in the neural network, which perform operations, i.e., when the depth of the neural network for performing operations increases, the neural network may be classified as a deep neural network (DNN). The neural network may include, for example, a convolutional neural network (CNN), a DNN, a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), and a deep Q-network, without being limited thereto. The neural network may also be subdivided. For example, the CNN neural network may be subdivided into a deep convolution neural network (DCNN) or a Capsnet neural network.

[0307] In a disclosed embodiment, an AI model may refer to a neural network including at least one layer that operates to receive input data and output a desired result. Furthermore, the AI model may refer to an algorithm that performs an operation through the neural network to output a desired result, a set of a plurality of algorithms, a processor for executing the algorithm or the set of algorithms, software for executing the algorithm or the set of algorithms or hardware for executing the algorithm or the set of algorithms.

[0308] The structure of the neural network was described above (see FIG. 4), so the redundant description will be omitted.

[0309] In an embodiment of the present disclosure, the electronic device for vehicle may use a lossless waveform audio format (wav) for training data to train an AI model.

[0310] In an embodiment of the present disclosure, the electronic device for vehicle may normalize peaks of sound frequency data and extract features of the frequency data.

[0311] In an embodiment of the present disclosure, the electronic device for vehicle may train the AI model based on the features of the frequency data, and training data

[0312] In an embodiment of the present disclosure, the electronic device for vehicle may identify type information of at least one ambient sound by comparing the at least one ambient sound obtained through at least one microphone with the training data.

[0313] For example, in an embodiment of the present disclosure, the electronic device for vehicle may obtain a sound produced from a sound source located around the vehicle through at least one microphone. The electronic device for vehicle may identify that the obtained sound corresponds to a horn sound by comparing features of the frequency data of the obtained sound with the training data.

[0314] For example, in an embodiment of the present disclosure, the electronic device for vehicle may obtain a sound produced from a sound source located around the vehicle through the at least one microphone. The electronic device for vehicle may identify that the obtained sound corresponds to a siren sound by comparing features of the frequency data of the obtained sound with the training data. However, it is not limited thereto.

[0315] The AI model may be trained by a server capable of communicating with the electronic device for vehicle according to an embodiment of the present disclosure over a wireless communication network. For example, the external server may train the AI model, and transmit the trained AI model to the electronic device for vehicle.

[0316] A method by which the server capable of communicating with the electronic device for vehicle according to an embodiment of the present disclosure over a wireless communication network trains the AI model was described above (see FIGS. 5 and 6), so the redundant description will be omitted.

[0317] In an embodiment of the present disclosure, the electronic device for vehicle may recognize at least one ambient sound, and obtain volume information indicating the volume of the ambient sound.

[0318] In an embodiment of the present disclosure, the electronic device for vehicle may obtain the volume information of the at least one ambient sound in a decibel (dB) value.

[0319] In an embodiment of the present disclosure, the electronic device for vehicle may identify a group that includes the at least one ambient sound among a plurality of preset groups, based on at least one of type information of the at least one ambient sound and volume information of the at least one ambient sound.

[0320] The plurality of preset groups may be classified into group 1, group 2 or group 3 according to the importance of the ambient sounds. However, the number of groups included in the plurality of preset groups is not limited thereto.

[0321] The importance may refer to the degree to which the driving of the vehicle is affected.

[0322] For example, that the importance of an ambient sound is very high may mean that, when the ambient sound is not perceived, there is a very high possibility of an accident occurring with the vehicle that includes the electronic device for vehicle according to an embodiment of the present disclosure.

[0323] For example, that the importance of an ambient sound is high may mean that, when the ambient sound is not perceived, there is a high possibility of an accident occurring with the vehicle that includes the electronic device for vehicle according to an embodiment of the present disclosure.

[0324] For example, that the importance of an ambient sound is low may mean that, when the ambient sound is not perceived, there is a low possibility of an accident occurring with the vehicle that includes the electronic device for vehicle according to an embodiment of the present disclosure.

[0325] In an embodiment of the present disclosure, the electronic device for vehicle may add at least one sound with very high importance to group 1.

[0326] At least one sound included in group 1 may include at least one of, for example, a short-range horn sound, a short-range siren sound, an explosion sound, an impact sound, or a short-range brake friction sound, but is not limited thereto.

[0327] In an embodiment of the present disclosure, the electronic device for vehicle may add at least one sound with high importance to group 2.

[0328] At least one sound included in group 2 may include at least one of, for example, a long-range horn sound, a long-range siren sound, or a long-range brake friction sound, but is not limited thereto.

[0329] In an embodiment of the present disclosure, the electronic device for vehicle may add at least one sound with low importance to group 3.

[0330] At least one sound included in group 3 may include at least one of, for example, a road friction sound or a driving sound of an adjacent vehicle, but is not limited thereto.

[0331] In an embodiment of the present disclosure, the electronic device for vehicle may store the at least one sound included in group 1, group 2 or group 3 in memory for each group.

[0332] The at least one sound included in group 1, group 2 or group 3 may be separately changed by the user.

[0333] In an embodiment of the present disclosure, the electronic device for vehicle may predict a distance between the vehicle and the sound source based on the volume information of the sound produced from the at least one sound source.

[0334] For example, in an embodiment of the present disclosure, the electronic device for vehicle may identify a sound produced from at least one sound source as a horn sound. When the volume of the horn sound is identified as being 90 dB or higher, the electronic device for vehicle may predict that the distance (short distance) between the at least one sound source that outputs the horn sound and the vehicle is within a preset distance.

[0335] For example, in an embodiment of the present disclosure, the electronic device for vehicle may identify a sound produced from at least one sound source as a siren sound. When the volume of the siren sound is identified as being 90 dB or lower, the electronic device for vehicle may predict that the distance (long distance) between the at least one sound source that outputs the siren sound and the vehicle is equal to or longer than the preset distance.

[0336] For example, in an embodiment of the present disclosure, the electronic device for vehicle may identify a sound produced from at least one sound source as an explosion sound. When the volume of the explosion sound is identified as being 100 dB or higher, the electronic device for vehicle may predict that the distance (short distance) between the at least one sound source that outputs the explosion sound and the vehicle is within the preset distance.

[0337] For example, in an embodiment of the present disclosure, the electronic device for vehicle may identify a sound produced from at least one sound source as a brake friction sound. When the volume of the brake friction sound is identified as being 100 dB or higher, the electronic device for vehicle may predict that the distance (short distance) between the at least one sound source that outputs the brake friction sound and the vehicle is within the preset distance. However, it is not limited thereto.

[0338] In an embodiment of the present disclosure, the electronic device for vehicle may identify a group that includes the at least one ambient sound among a plurality of preset groups, based on at least one of type information of the at least one ambient sound and volume information of the at least one ambient sound.

[0339] For example, when the electronic device for vehicle according to an embodiment of the present disclosure identifies a sound produced from at least one sound source as a horn sound, and the volume of the horn sound is 90 dB or higher, the electronic device for vehicle according to an embodiment of the present disclosure may identify that the sound produced from the at least one sound source corresponds to a nearby horn sound.

[0340] In this case, the electronic device for vehicle according to an embodiment of the present disclosure may identify that the identified nearby horn sound is included in group 1 with very high importance among the plurality of preset groups.

[0341] For example, when the electronic device for vehicle according to an embodiment of the present disclosure identifies a sound produced from at least one sound source as a brake friction sound, and the volume of the brake friction sound is 90 dB or higher, the electronic device for vehicle according to an embodiment of the present disclosure may identify that the sound produced from the at least one sound source corresponds to a nearby brake friction sound. The electronic device for vehicle according to an embodiment of the present disclosure may identify that the identified nearby brake friction sound is included in group 1 with very high importance among the plurality of preset groups.

[0342] For example, when the electronic device for vehicle according to an embodiment of the present disclosure identifies a sound produced from at least one sound source as a siren sound, and the volume of the horn sound is less than 90 dB, the electronic device for vehicle according to an embodiment of the present disclosure may identify that the sound produced from the at least one sound source corresponds to a distant siren sound. The electronic device for vehicle according to an embodiment of the present disclosure may identify that the identified distant siren sound is included in group 2 with high importance among the plurality of preset groups.

[0343] For example, when the electronic device for vehicle according to an embodiment of the present disclosure identifies a sound produced from at least one sound source as a road friction sound, and the volume of the road friction sound is less than 50 dB, the electronic device for vehicle according to an embodiment of the present disclosure may identify that the identified road friction sound is included in group 3 with low importance among the plurality of preset groups.

[0344] In operation 1030, the electronic device for vehicle may transmit the at least one ambient sound to the mobile device, based on at least one of driving information of the vehicle and surrounding environment information of the vehicle, and a transmission condition corresponding to the identified group.

[0345] The driving information of the vehicle may include at least one of speed information of the vehicle or speed change information of the vehicle.

[0346] The surrounding environment information of the vehicle may include at least one of location information of at least one sound source that outputs at least one ambient sound, weather information around the vehicle or speed information of an external vehicle located around the vehicle.

[0347] The electronic device for vehicle according to an embodiment of the present disclosure may obtain the surrounding environment information of the vehicle through vehicle to everything (V2X) communication.

[0348] The V2X communication refers to communication through which the vehicle may exchange information with infrastructure-equipped objects such as other vehicles and roads, based on at least one of cable or wireless network.

[0349] The V2X communication may include at least one of vehicle to vehicle (V2V) communication, vehicle to infrastructure (V2I) communication, vehicle to network (V2N) communication, or vehicle to pedestrian (V2P) communication.

[0350] The electronic device for vehicle according to an embodiment of the present disclosure may obtain surrounding environment information of the vehicle through at least one sensor.

[0351] The sensor may include at least one of a global positioning system (GPS) sensor, a sound detection sensor, an image sensor, a camera, Lidar or radar, but is not limited thereto.

[0352] The electronic device for vehicle according to an embodiment of the present disclosure may set a transmission condition for each of the plurality of preset groups.

[0353] The electronic device for vehicle according to an embodiment of the present disclosure may set a sound included in group 1 to be transmitted to the mobile device, regardless of the driving information of the vehicle and the surrounding environment information of the vehicle.

[0354] The electronic device for vehicle according to an embodiment of the present disclosure may identify at least one ambient sound with very high importance as being included in group 1. The electronic device for vehicle according to an embodiment of the present disclosure may transmit the at least one ambient sound to the mobile device regardless of the driving information of the vehicle and the surrounding environment information of the vehicle.

[0355] For example, the electronic device for vehicle according to an embodiment of the present disclosure may identify a sound produced from at least one sound source as a horn sound. The electronic device for vehicle may identify that the identified horn sound corresponds to a nearby horn sound, based on the volume information of the horn sound. The electronic device for vehicle may identify that the nearby horn sound is included in group 1 of the plurality of preset groups. The electronic device for vehicle may transmit the nearby horn sound to the mobile device regardless of the driving information of the vehicle (e.g., driving speed of the vehicle).

[0356] For example, the electronic device for vehicle according to an embodiment of the present disclosure may identify a sound produced from at least one sound source as an explosion sound. The electronic device for vehicle may identify, based on the volume information of the explosion sound, that the identified explosion sound corresponds to a nearby explosion sound and is included in group 1 of the plurality of preset groups. The electronic device for vehicle may transmit the nearby explosion sound to the mobile device regardless of the driving information of the vehicle (e.g., driving speed of the vehicle). It is not, however, limited thereto.

[0357] The electronic device for vehicle according to an embodiment of the present disclosure may set a transmission condition for transmitting a sound included in group 2 to the mobile device, based on at least one of the driving information of the vehicle and the surrounding environment information of the vehicle.

[0358] The electronic device for vehicle according to an embodiment of the present disclosure may identify at least one ambient sound with high importance as being included in group 2. The electronic device for vehicle according to an embodiment of the present disclosure may transmit the at least one sound included in group 2 to the mobile device, based on at least one of the driving information of the vehicle and the surrounding environment information of the vehicle.

[0359] For example, the electronic device for vehicle according to an embodiment of the present disclosure may identify a sound produced from at least one sound source as a horn sound. The electronic device for vehicle according to an embodiment of the present disclosure may identify, based on the volume information of the horn sound, that the identified horn sound corresponds to a distant horn sound and corresponds to group 2 of the plurality of preset groups. The electronic device for vehicle may transmit the distant horn sound to the mobile device, based on at least one of speed of the vehicle, location information of a vehicle that generates the horn sound, and speed information of the vehicle that generates the horn sound.

[0360] For example, the electronic device for vehicle according to an embodiment of the present disclosure may identify a sound produced from at least one sound source as a brake friction sound. The electronic device for vehicle may identify, based on the volume information of the brake friction sound, that the identified brake friction sound corresponds to a distant brake friction sound and corresponds to group 2 of the plurality of preset groups. The electronic device for vehicle may transmit the distant brake friction sound to the mobile device, based on at least one of speed of the vehicle, weather information around the vehicle or speed information of the vehicle that produces the brake friction sound. However, it is not limited thereto.

[0361] The electronic device for vehicle according to an embodiment of the present disclosure may identify at least one ambient sound with high importance as being included in group 2. The electronic device for vehicle may transmit the at least one sound included in group 2 to the mobile device, based on the driving information of the vehicle.

[0362] The driving information of the vehicle may include at least one of speed information of the vehicle or speed change information of the vehicle.

[0363] The electronic device for vehicle according to an embodiment of the present disclosure may transmit at least one sound included in group 2 to the mobile device, based on the speed information of the vehicle that includes the electronic device for vehicle.

[0364] For example, the electronic device for vehicle may identify a sound produced from at least one sound source as a brake friction sound. The electronic device for vehicle according to an embodiment of the present disclosure may identify, based on the volume information of the brake friction sound, that the identified brake friction sound corresponds to a distant brake friction sound and corresponds to group 2 of the plurality of preset groups. The electronic device for vehicle according to an embodiment of the present disclosure may transmit the distant brake friction sound to the mobile device, when the vehicle that includes the electronic device for vehicle is driving at high speed.

[0365] High-speed driving may refer to a case that the vehicle including the electronic device for vehicle according to an embodiment of the present disclosure is driving at or above a certain speed.

[0366] The certain speed may be set based on speed limits of the road on which the vehicle including the electronic device for vehicle according to an embodiment of the present disclosure is driving. However, it is not limited thereto.

[0367] The electronic device for vehicle according to an embodiment of the present disclosure may obtain information about the speed limits of the road on which the vehicle including the electronic device for vehicle is driving, through V2X communication.

[0368] For example, the electronic device for vehicle according to an embodiment of the present disclosure may set the certain speed to 30 km / h, when the vehicle including the electronic device for vehicle is driving on a road with a speed limit of 30 km / h.

[0369] For example, the electronic device for vehicle according to an embodiment of the present disclosure may set the certain speed to 100 km / h, when the vehicle including the electronic device for vehicle is driving on a road with a speed limit of 100 km / h. However, it is not limited thereto.

[0370] The certain speed may be changed by the user.

[0371] For example, the user may set the certain speed to 80 km / h regardless of the speed limits of the road on which the vehicle including the electronic device for vehicle according to an embodiment of the present disclosure is driving.

[0372] For example, the user may set the certain speed to 100 km / h regardless of the speed limits of the road on which the vehicle including the electronic device for vehicle according to an embodiment of the present disclosure is driving. However, it is not limited thereto.

[0373] The electronic device for vehicle according to an embodiment of the present disclosure may transmit at least one sound included in group 2 to the mobile device, based on speed change information of the vehicle that includes the electronic device for vehicle.

[0374] The speed change information of the vehicle may include at least one of sudden acceleration or sudden deceleration.

[0375] Sudden acceleration may refer to a sudden increase in speed of the vehicle including the electronic device for vehicle according to an embodiment of the present disclosure in a short period of time.

[0376] For example, sudden acceleration may refer to an increase in speed of the vehicle including the electronic device for vehicle according to an embodiment of the present disclosure by a speed of 2.8 m / s or more, but is not limited thereto.

[0377] Sudden deceleration may refer to a sudden decrease in speed of the vehicle including the electronic device for vehicle according to an embodiment of the present disclosure in a short period of time.

[0378] For example, sudden deceleration may refer to a decrease in speed of the vehicle including the electronic device for vehicle according to an embodiment of the present disclosure by a speed of 2.8 m / s or more, but is not limited thereto.

[0379] For example, the electronic device for vehicle may identify a sound produced from at least one sound source as a brake friction sound. The electronic device for vehicle according to an embodiment of the present disclosure may identify, based on the volume information of the brake friction sound, that the identified brake friction sound corresponds to a distant brake friction sound and corresponds to group 2 of the plurality of preset groups. The electronic device for vehicle according to an embodiment of the present disclosure may not transmit the distant brake friction sound to the mobile device, when the vehicle that includes the electronic device for vehicle is driving at low speed.

[0380] The electronic device for vehicle according to an embodiment of the present disclosure may transmit the distant brake friction sound to the mobile device, when the vehicle that includes the electronic device for vehicle accelerates rapidly. The distant brake friction sound may refer to a brake friction sound produced from a sound source located in a direction in which the vehicle including the electronic device for vehicle according to an embodiment of the present disclosure accelerates rapidly. However, it is not limited thereto.

[0381] For example, the electronic device for vehicle may identify a sound produced from at least one sound source as a horn sound. The electronic device for vehicle according to an embodiment of the present disclosure may identify, based on the volume information of the horn sound, that the identified horn sound corresponds to a distant horn sound and corresponds to group 2 of the plurality of preset groups. The electronic device for vehicle according to an embodiment of the present disclosure may not transmit the distant horn sound to the mobile device, when the vehicle including the electronic device for vehicle is driving at low speed. However, it is not limited thereto.

[0382] The electronic device for vehicle according to an embodiment of the present disclosure may transmit the distant horn sound to the mobile device, when the vehicle including the electronic device for vehicle decelerates rapidly. The distant horn sound may refer to a brake friction sound produced from a sound source located behind the vehicle including the electronic device for vehicle according to an embodiment of the present disclosure. However, it is not limited thereto.

[0383] Low-speed driving may refer to a case that the vehicle including the electronic device for vehicle according to an embodiment of the present disclosure is driving at less than a certain speed.

[0384] The certain speed may be set based on speed limits of the road on which the vehicle including the electronic device for vehicle according to an embodiment of the present disclosure is driving. However, it is not limited thereto.

[0385] The electronic device for vehicle according to an embodiment of the present disclosure may obtain information about the speed limits of the road on which the vehicle including the electronic device for vehicle is driving, through V2X communication. However, it is not limited thereto.

[0386] For example, the electronic device for vehicle according to an embodiment of the present disclosure may set the certain speed of the vehicle to 30 km / h, when the vehicle including the electronic device for vehicle is driving on a road with a speed limit of 30 km / h.

[0387] For example, the electronic device for vehicle according to an embodiment of the present disclosure may set the certain speed of the vehicle to 80 km / h, when the vehicle including the electronic device for vehicle is driving on a road with a speed limit of 80 km / h. However, it is not limited thereto.

[0388] The certain speed may be changed by the user.

[0389] For example, the user may set the certain speed of the vehicle to 50 km / h regardless of the speed limits of the road on which the vehicle including the electronic device for vehicle according to an embodiment of the present disclosure is driving.

[0390] For example, the user may set the certain speed of the vehicle to 100 km / h regardless of the speed limits of the road on which the vehicle including the electronic device for vehicle according to an embodiment of the present disclosure is driving.

[0391] The electronic device for vehicle according to an embodiment of the present disclosure may identify at least one ambient sound with high importance as being included in group 2. The electronic device for vehicle may transmit the at least one sound included in group 2 to the mobile device, based on the surrounding environment information.

[0392] The surrounding environment information of the vehicle may include at least one of location information of at least one sound source that outputs at least one ambient sound, weather information around the vehicle or speed information of an external vehicle located around the vehicle. However, it is not limited thereto.

[0393] The electronic device for vehicle may identify a sound produced from at least one sound source as a rain sound. The electronic device for vehicle according to an embodiment of the present disclosure may obtain precipitation information based on the volume information of the rain sound.

[0394] The electronic device for vehicle according to an embodiment of the present disclosure may transmit at least one sound included in group 2 to the mobile device, based on the precipitation information.

[0395] For example, the electronic device for vehicle may identify a sound produced from at least one sound source as a brake friction sound. The electronic device for vehicle according to an embodiment of the present disclosure may identify, based on the volume information of the brake friction sound, that the identified brake friction sound corresponds to a distant brake friction sound and corresponds to group 2 of the plurality of preset groups. The electronic device for vehicle according to an embodiment of the present disclosure may transmit the distant brake friction sound to the mobile device, when the amount of precipitation is equal to or greater than a set value.

[0396] For example, the electronic device for vehicle may identify a sound produced from at least one sound source as a siren sound. The electronic device for vehicle according to an embodiment of the present disclosure may identify, based on the volume information of the siren sound, that the identified siren sound corresponds to a distant siren sound and corresponds to group 2 of the plurality of preset groups. The electronic device for vehicle according to an embodiment of the present disclosure may transmit the distant siren sound to the mobile device, when the amount of precipitation is equal to or greater than a set value.

[0397] The set value may be 15 mm, but is not limited thereto.

[0398] The set value may be changed by the user.

[0399] The electronic device for vehicle according to an embodiment of the present disclosure may obtain surrounding environment information of the vehicle through a sensor.

[0400] The surrounding environment information may include brightness information of a road on which the vehicle including the electronic device for vehicle according to an embodiment of the present disclosure is driving.

[0401] The electronic device for vehicle according to an embodiment of the present disclosure may obtain the brightness information of the road in a lux value.

[0402] The electronic device for vehicle according to an embodiment of the present disclosure may transmit at least one sound included in group 2 to the mobile device, based on the brightness information of the road on which the vehicle is driving.

[0403] For example, the electronic device for vehicle may identify a sound produced from at least one sound source as a siren sound. The electronic device for vehicle according to an embodiment of the present disclosure may identify, based on the volume information of the siren sound, that the identified siren sound corresponds to a distant siren sound and corresponds to group 2 of the plurality of preset groups. The electronic device for vehicle according to an embodiment of the present disclosure may transmit the distant siren sound to the mobile device, when the brightness of the road on which the vehicle including the electronic device for vehicle according to an embodiment of the present disclosure is driving is equal to or less than a threshold.

[0404] For example, the electronic device for vehicle according to an embodiment of the present disclosure may transmit the distant siren sound to the mobile device when the brightness of light obtained through the sensor is equal to or less than 50 lux. However, it is not limited thereto.

[0405] The threshold may be changed by the user.

[0406] The electronic device for vehicle according to an embodiment of the present disclosure may set a transmission condition for transmitting a sound included in group 3 to the mobile device, based on the surrounding environment information of the vehicle.

[0407] The electronic device for vehicle according to an embodiment of the present disclosure may identify at least one sound with low importance as being included in group 3. The electronic device for vehicle may transmit the at least one sound included in group 3 to the mobile device, based on the surrounding environment information of the vehicle.

[0408] For example, the electronic device for vehicle according to an embodiment of the present disclosure may identify a sound produced from at least one sound source as a road friction sound. The electronic device for vehicle may identify, based on the volume information of the road friction sound, that the identified road friction sound corresponds to group 3 of the plurality of preset groups. The electronic device for vehicle may transmit the road friction sound to the mobile device, based on location information of a plurality of external vehicles located around the vehicle and approach information of the plurality of external vehicles toward the vehicle. However, it is not limited thereto.

[0409] However, the transmission condition for each of the plurality of preset groups is merely an example and is not limited thereto.

[0410] The transmission condition for each of the plurality of preset groups may be changed by the user.

[0411] The transmission condition for each of the plurality of preset groups may be stored in the memory of the electronic device for vehicle according to an embodiment of the present disclosure.

[0412] The electronic device for vehicle according to an embodiment of the present disclosure may transmit occurrence information of at least one ambient sound to the mobile device.

[0413] The occurrence information of the at least one ambient sound may include information indicating that at least one ambient sound has occurred.

[0414] For example, the occurrence information of the at least one ambient sound may include information indicating that a nearby horn sound has occurred, when the electronic device for vehicle according to an embodiment of the present disclosure recognizes the nearby horn sound.

[0415] For example, the occurrence information of the at least one ambient sound may include information indicating that a distant siren sound has occurred, when the electronic device for vehicle according to an embodiment of the present disclosure recognizes the distant siren sound. However, it is not limited thereto.

[0416] Upon receiving the occurrence information of the at least one ambient sound, the mobile device may transmit a generated sound corresponding to the occurrence information of the at least one ambient sound to the wearable device.

[0417] Accordingly, even when latency occurs in transmitting the at least one ambient sound to the mobile device from the electronic device for vehicle according to an embodiment of the present disclosure, the mobile device is able to alert the user who is operating the vehicle by transmitting the generated sound corresponding to the occurrence information of the at least one ambient sound to the wearable device.

[0418] FIG. 11 is a flowchart illustrating an operating method of an electronic device for vehicle, according to an embodiment of the present disclosure.

[0419] Operations 1020 and 1030 of FIG. 11 correspond to operations 1020 and 1030 of FIG. 10, respectively.

[0420] In operation 1032, the electronic device for vehicle may transmit output information of at least one ambient sound to the mobile device.

[0421] The output information may include at least one of volume information of the at least one ambient sound or direction information of at least one sound source that outputs the at least one ambient sound.

[0422] For example, the electronic device for vehicle according to an embodiment of the present disclosure may transmit, to the mobile device, the direction information of a sound source outputting at least one ambient sound (e.g., located at 170° to the left), when the at least one ambient sound is output from the sound source located at 170° to the left, when it is assumed that the front of the vehicle is 0°.

[0423] For example, the electronic device for vehicle according to an embodiment of the present disclosure may transmit, to the mobile device, the direction information of a sound source outputting at least one ambient sound (e.g., located at 90° to the right), when the at least one ambient sound is output from the sound source located at 90° to the right, when it is assumed that the front of the vehicle is 0°. However, it is not limited thereto.

[0424] For example, the electronic device for vehicle according to an embodiment of the present disclosure may recognize that a horn sound has occurred at about 100 dB in a short range. The electronic device for vehicle according to an embodiment of the present disclosure may transmit the volume information (about 100 dB) of the nearby horn sound to the mobile device. However, it is not limited thereto.

[0425] For example, the electronic device for vehicle according to an embodiment of the present disclosure may recognize that the volume of a sound produced from a sound source located in a short range from the vehicle decreases as the distance between the vehicle and the sound source increases (e.g., a case where the volume of the sound decreases from 90 dB to 40 dB). The electronic device for vehicle according to an embodiment of the present disclosure may transmit the sound volume change information (indicating that the volume of the sound gradually decreases) to the mobile device.

[0426] The mobile device may then transmit, to the wearable device, the sound produced from the sound source such that the sound is output with a gradually decreasing volume. However, it is not limited thereto.

[0427] For example, the electronic device for vehicle according to an embodiment of the present disclosure may recognize that the volume of a sound produced from a sound source located in a long range from the vehicle increases as the distance between the vehicle and the sound source decreases (e.g., a case where the volume of the sound increases from 30 dB to 60 dB). The electronic device for vehicle according to an embodiment of the present disclosure may transmit the sound volume change information (indicating that the volume of the sound gradually increases) to the mobile device.

[0428] The mobile device may then transmit, to the wearable device, the sound produced from the sound source such that the sound is output with a gradually increasing volume. However, it is not limited thereto.

[0429] FIG. 12 is a flowchart illustrating an operating method of an electronic device for vehicle, according to an embodiment of the present disclosure.

[0430] Operations 1020 and 1030 of FIG. 12 correspond to operations 1020 and 1030 of FIG. 10, respectively.

[0431] In operation 1034, the electronic device for vehicle may transmit mixing information of at least one ambient sound to the mobile device.

[0432] The mixing information may include information indicating whether to synthesize the at least one ambient sound transmitted to the mobile device with at least one audio data being played on the mobile device.

[0433] The audio data may refer to sound output from media being played on the mobile device.

[0434] The audio data may include, for example, at least one of music sound or radio sound being played on the mobile device, but is not limited thereto.

[0435] In an embodiment of the present disclosure, the electronic device for vehicle may transmit, to the mobile device, information indicating that at least one ambient sound and at least one audio data being played on the mobile device are not to be synthesized, when the at least one ambient sound included in group 1 with very high importance is recognized.

[0436] In this case, the mobile device may block audio data being played to the wearable device 130, and transmit only the at least one ambient sound.

[0437] The electronic device for vehicle according to an embodiment of the present disclosure may transmit, to the mobile device, information indicating that at least one ambient sound and at least one audio data being played on the mobile device are not to be synthesized, when the at least one ambient sound included in group 3 with low importance is recognized.

[0438] In this case, the mobile device may transmit the audio data being played to the wearable device, and may not transmit the at least one ambient sound.

[0439] The electronic device for vehicle according to an embodiment of the present disclosure may transmit, to the mobile device, information indicating that at least one ambient sound and at least one audio data being played on the mobile device are to be synthesized, when the at least one ambient sound included in group 2 with high importance is recognized.

[0440] In this case, the mobile device may transmit, to the wearable device, a sound resulting from synthesizing the at least one ambient sound with the audio data.

[0441] The electronic device for vehicle according to an embodiment of the present disclosure may transmit, to the mobile device, at least one ambient sound, output information and mixing information of the at least one ambient sound.

[0442] In this case, the mobile device may transmit, to the wearable device, the sound resulting from synthesizing the audio data with the ambient sound or the at least one ambient sound, based on the output information and mixing information of the at least one ambient sound.

[0443] For example, based on the output information and mixing information of the at least one ambient sound, the mobile device may receive information indicating that the at least one ambient sound is recognized with a volume of less than 40 dB from the left of the vehicle, and that the at least one ambient sound is to be synthesized with the audio data. The mobile device may synthesize the at least one ambient sound with the audio data being played, at a lower volume than of the audio data. The mobile device may transmit the synthesized sound to the wearable device worn on the left ear such that the synthesized sound is output from the wearable device.

[0444] For example, based on the output information and mixing information of the at least one ambient sound, the mobile device may receive information indicating that the at least one ambient sound is recognized with a volume of 40 dB or more and less than 90 dB from the right of the vehicle, and that the at least one ambient sound is to be synthesized with the audio data. The mobile device may synthesize the at least one ambient sound with the audio data being played, at a higher volume than of the audio data. The mobile device may transmit the synthesized sound to the wearable device worn on the right ear such that the synthesized sound is output from the wearable device.

[0445] For example, based on the output information and mixing information of the at least one ambient sound, the mobile device may receive mixing information indicating that the at least one ambient sound is recognized with a volume of 90 dB or more from the right of the vehicle, and that the at least one ambient sound is not to be synthesized with the audio data being played. The mobile device may transmit at least one ambient sound to the wearable device worn on the right ear such that only the at least one ambient sound is output at a large volume from the wearable device. However, it is not limited thereto.

[0446] FIG. 13 is a flowchart illustrating an operating method of an electronic device for vehicle, according to an embodiment of the present disclosure.

[0447] Operations 1020 and 1030 of FIG. 13 correspond to operations 1020 and 1030 of FIG. 10, respectively.

[0448] In operation 1036, the electronic device for vehicle may identify another group that includes at least one ambient sound, based on a change in volume information of the at least one ambient sound.

[0449] In an embodiment of the present disclosure, the electronic device for vehicle may predict a distance between the vehicle and the sound source based on the volume information of the at least one ambient sound produced from the at least one sound source.

[0450] The electronic device for vehicle according to an embodiment of the present disclosure may determine that the distance between the vehicle and the sound source that outputs the at least one ambient sound increases, when the volume of the at least one ambient sound decreases.

[0451] For example, the electronic device for vehicle according to an embodiment of the present disclosure may determine that the distance between the vehicle and a sound source that outputs a siren sound has decreased and then increased, when the volume of the siren sound has increased and then decreased.

[0452] For example, the electronic device for vehicle according to an embodiment of the present disclosure may determine that the distance between the vehicle and a sound source that outputs a siren sound increases, when recognizing a change in volume of the siren sound from 90 dB to 50 dB. However, it is not limited thereto.

[0453] The electronic device for vehicle according to an embodiment of the present disclosure may determine that the distance between the vehicle and the sound source that outputs the at least one ambient sound decreases, when the volume of the at least one ambient sound increases.

[0454] For example, the electronic device for vehicle according to an embodiment of the present disclosure may determine that the distance between the vehicle and a sound source that outputs a horn sound has increased and then decreased, when the volume of the horn sound has decreased and then increased.

[0455] For example, the electronic device for vehicle according to an embodiment of the present disclosure may determine that the distance between the vehicle and a sound source that outputs a horn sound decreases, when recognizing a change in volume of the horn sound from 40 dB to 100 dB. However, it is not limited thereto.

[0456] The electronic device for vehicle according to an embodiment of the present disclosure may identify a group that includes the at least one ambient sound among a plurality of preset groups, based on volume information of the at least one ambient sound.

[0457] The electronic device for vehicle according to an embodiment of the present disclosure may identify a group that includes the at least one ambient sound among a plurality of preset groups, based on a change in volume of the at least one ambient sound being recognized.

[0458] For example, the electronic device for vehicle according to an embodiment of the present disclosure may recognize a nearby horn sound based on the volume information and type information of the at least one ambient sound. The electronic device for vehicle according to an embodiment of the present disclosure may identify the at least one ambient sound identified as the nearby horn sound as being included in group 1.

[0459] The electronic device for vehicle according to an embodiment of the present disclosure may recognize a change in volume information of the horn sound. The electronic device for vehicle according to an embodiment of the present disclosure may recognize the nearby horn sound having changed to a distant horn sound. The electronic device for vehicle according to an embodiment of the present disclosure may identify at least one ambient sound identified as a distant horn sound as being included in group 2. However, it is not limited thereto.

[0460] For example, the electronic device for vehicle according to an embodiment of the present disclosure may recognize a distant brake friction sound based on the volume information and type information of the at least one ambient sound. The electronic device for vehicle according to an embodiment of the present disclosure may identify at least one ambient sound identified as a distant brake friction sound as being included in group 2.

[0461] The electronic device for vehicle according to an embodiment of the present disclosure may recognize a change in volume information of the brake friction sound. For example, the electronic device for vehicle according to an embodiment of the present disclosure may recognize that the distant brake friction sound has changed to a nearby brake friction sound. The electronic device for vehicle according to an embodiment of the present disclosure may identify the at least one ambient sound identified as the nearby brake friction sound as being included in group 1. However, it is not limited thereto.

[0462] In operation 1038, the electronic device for vehicle may determine whether to transmit the at least one ambient sound to the mobile device, based on at least one of driving information of the vehicle and surrounding environment information of the vehicle, and a transmission condition corresponding to another group.

[0463] The electronic device for vehicle according to an embodiment of the present disclosure may determine whether to transmit the at least one ambient sound to the mobile device, based on at least one of the driving information of the vehicle and the surrounding environment information of the vehicle, and the transmission condition corresponding to the changed group when the volume of the at least one ambient sound is changed and the group including the at least one changed ambient sound is changed.

[0464] The electronic device for vehicle according to an embodiment of the present disclosure may determine whether to continue to transmit, to the mobile device, the at least one ambient sound that has been being transmitted, when recognizing a change in volume information of the at least one ambient sound after the at least one ambient sound is transmitted to the mobile device.

[0465] The electronic device for vehicle according to an embodiment of the present disclosure may determine whether to transmit, to the mobile device, the at least one ambient sound whose volume has changed to be lower, based on at least one of the driving information of the vehicle and the surrounding environment information of the vehicle, and the transmission condition corresponding to group 2, when the volume of the at least one ambient sound being transmitted to the mobile device is changed to be lower and the group including the at least one ambient sound is changed from group 1 to group 2. However, it is not limited thereto.

[0466] FIG. 14 is a flowchart illustrating an operating method of a mobile device, according to an embodiment of the present disclosure.

[0467] In an embodiment of the present disclosure, the mobile device and the electronic device for vehicle may be connected through wireless communication.

[0468] The mobile device according to an embodiment of the present disclosure may be connected to the wearable device through wireless communication.

[0469] The wireless connection may involve at least one short-range communication module for performing communication according to a communication standard such as Bluetooth, Wi-Fi, Bluetooth low energy (BLE), NFC / RFID, Wi-Fi direct, UWB or ZIGBEE, and a long-range communication module for performing communication with a server for supporting the long-range communication according to a long-range communication standard. The long-range communication module may perform communication over a communication network that conforms to 3G, 4G and / or 5G communication standards, or over a network for Internet communication.

[0470] In operation 1410, the mobile device may receive at least one ambient sound or occurrence information of the at least one ambient sound from the electronic device for vehicle.

[0471] The occurrence information of the at least one ambient sound may include information indicating that at least one ambient sound has occurred.

[0472] For example, the occurrence information of the at least one ambient sound may include information indicating that a nearby horn sound has occurred, when the electronic device for vehicle recognizes the nearby horn sound.

[0473] For example, the occurrence information of the at least one ambient sound may include information indicating that a distant siren sound has occurred, when the electronic device for vehicle recognizes the distant siren sound. However, it is not limited thereto.

[0474] In operation 1420, the mobile device may synthesize the at least one ambient sound or a generated sound corresponding to the occurrence information of the at least one ambient sound with audio data being played.

[0475] The audio data may refer to sound output from media being played on the mobile device.

[0476] The audio data may include, for example, at least one of music sound or radio sound being played on the mobile device, but is not limited thereto.

[0477] The mobile device according to an embodiment of the present disclosure may generate a generated sound corresponding to the occurrence information of the at least one ambient sound, based on an artificial intelligence model.

[0478] The mobile device according to an embodiment of the present disclosure may store the generated sound corresponding to the occurrence information of the at least one ambient sound in the memory of the mobile device.

[0479] The generated sound corresponding to the occurrence information of the at least one ambient sound may refer to a nearby horn sound stored in memory or created in the mobile device according to an embodiment of the present disclosure based on an artificial intelligence model, when the occurrence information of the at least one ambient sound includes information indicating that the nearby horn sound has occurred. However, it is not limited thereto.

[0480] The generated sound corresponding to the occurrence information of the at least one ambient sound may refer to a distant siren sound stored in memory or created in the mobile device according to an embodiment of the present disclosure based on an artificial intelligence model, when the occurrence information of the at least one ambient sound includes information indicating that the distant siren sound has occurred. However, it is not limited thereto.

[0481] In operation 1430, the mobile device may transmit the synthesized sound to the wearable device.

[0482] Accordingly, even when latency occurs in receiving the at least one ambient sound from the electronic device for vehicle according to an embodiment of the present disclosure, the mobile device according to an embodiment of the present disclosure is able to alert the user who is operating the vehicle by transmitting the generated sound corresponding to the occurrence information of the at least one ambient sound to the wearable device.

[0483] FIG. 15 is a flowchart illustrating an operating method of a mobile device, according to an embodiment of the present disclosure.

[0484] Operations 1420 and 1430 of FIG. 15 correspond to operations 1420 and 1430 of FIG. 14, respectively.

[0485] In operation 1432, the mobile device may receive output information of at least one ambient sound from the electronic device for vehicle.

[0486] The output information may include at least one of volume information of the at least one ambient sound or direction information of at least one sound source that outputs the at least one ambient sound.

[0487] For example, the mobile device according to an embodiment of the present disclosure may receive, from the electronic device for vehicle, the direction information of a sound source outputting at least one ambient sound (e.g., located at 170° to the left), when the at least one ambient sound is output from the sound source located at 170° to the left, when it is assumed that the front of the vehicle is 0°.

[0488] For example, the mobile device according to an embodiment of the present disclosure may receive, from the electronic device for vehicle, the direction information of a sound source outputting at least one ambient sound (e.g., located at 90° to the right), when the at least one ambient sound is output from the sound source located at 90° to the right, when it is assumed that the front of the vehicle is 0°. However, it is not limited thereto.

[0489] For example, the mobile device according to an embodiment of the present disclosure may receive volume information (about 100 dB) of a nearby horn sound from the electronic device for vehicle, when the electronic device for vehicle recognizes that the horn sound has occurred at about 100 dB in a short range. However, it is not limited thereto.

[0490] In operation 1434, the mobile device may adjust at least one of the volume or direction of the synthesized sound based on the output information.

[0491] For example, the mobile device according to an embodiment of the present disclosure may receive, from the electronic device for vehicle, output information indicating that at least one sound source outputting at least one ambient sound is located on the right of the vehicle. The mobile device according to an embodiment of the present disclosure may adjust the direction of at least one synthesized sound such that at least one ambient sound is output from the wearable device worn on the right ear. However, it is not limited thereto.

[0492] For example, the mobile device according to an embodiment of the present disclosure may receive, from the electronic device for vehicle, output information indicating that at least one sound source outputting at least one ambient sound is located on the left of the vehicle and the volume of the at least one ambient sound is 100 dB. The mobile device according to an embodiment of the present disclosure may adjust the volume and direction of at least one synthesized sound such that at least one ambient sound is output from the wearable device worn on the left ear at a higher volume than of the audio data being output.

[0493] For example, the mobile device according to an embodiment of the present disclosure may receive, from the electronic device for vehicle, output information indicating that at least one sound source outputting at least one ambient sound is located on the right of the vehicle and that the volume of the at least one ambient sound is 40 dB. The mobile device according to an embodiment of the present disclosure may adjust the direction and volume of at least one synthesized sound such that at least one ambient sound is output from the wearable device worn on the right ear at a lower volume than of the audio data being output. However, it is not limited thereto.

[0494] For example, the mobile device according to an embodiment of the present disclosure may receive, from the electronic device for vehicle, sound volume change information indicating that the volume of a sound produced from a sound source located in a short range from the vehicle decreases (e.g., the volume of the sound decreases from 90 dB to 40 dB) as the distance between the vehicle and the sound source increases.

[0495] In this case, the mobile device according to an embodiment of the present disclosure may adjust the sound produced from the sound source to be output with a gradually decreasing volume to the wearable device. However, it is not limited thereto.

[0496] For example, the mobile device according to an embodiment of the present disclosure may receive, from the electronic device for vehicle, sound volume change information (indicating that the volume of the sound gradually increases) indicating that the volume of a sound produced from a sound source located in a long range from the vehicle increases (e.g., the volume of the sound increases from 30 dB to 60 dB) as the distance between the vehicle and the sound source decreases.

[0497] In this case, the mobile device according to an embodiment of the present disclosure may adjust the volume of at least one synthesized sound to be output with a gradually increasing volume to the wearable device. However, it is not limited thereto.

[0498] In operation 1436, the mobile device may transmit the adjusted sound to the wearable device.

[0499] According to an embodiment of the present disclosure, an electronic device for vehicle may include at least one microphone, memory storing at least one instruction, a communicator configured to perform communication with a mobile device, and at least one processor configured to execute the at least one instruction stored in the memory.

[0500] The at least one processor may be configured to execute the at least one instruction to obtain at least one ambient sound through the at least one microphone.

[0501] The at least one processor may be configured to execute the at least one instruction to identify a group including the at least one ambient sound among a plurality of preset groups, based on at least one of type information and volume information of the at least one ambient sound.

[0502] The at least one processor may be configured to execute the at least one instruction to control the communicator to transmit the at least one ambient sound to the mobile device, based on at least one of driving information of a vehicle and surrounding environment information of the vehicle, and a transmission condition corresponding to the identified group.

[0503] The at least one processor may be configured to execute the at least one instruction to identify the type information of the at least one ambient sound, based on an artificial intelligence model.

[0504] The at least one processor may be configured to execute the at least one instruction to control the communicator to transmit, to the mobile device, output information of the at least one ambient sound.

[0505] The output information may include at least one of volume information of the at least one ambient sound or direction information of at least one sound source outputting the at least one ambient sound.

[0506] The at least one processor may be configured to execute the at least one instruction to control the communicator to transmit mixing information to the mobile device.

[0507] The mixing information may include information indicating whether to synthesize the at least one ambient sound transmitted to the mobile device and at least one audio data being played on the mobile device.

[0508] The at least one processor may be configured to execute the at least one instruction to identify another group that includes the at least one ambient sound, based on the volume information of the at least one ambient sound being changed.

[0509] The at least one processor may be configured to execute the at least one instruction to determine whether to transmit the at least one ambient sound to the mobile device, based on at least one of the driving information of the vehicle and the surrounding environment information of the vehicle, and a transmission condition corresponding to the other group.

[0510] The at least one processor may be configured to execute the at least one instruction to control the communicator to transmit occurrence information of the at least one ambient sound to the mobile device.

[0511] The surrounding environment information of the vehicle may include at least one of location information of a sound source that generates the at least one ambient sound, weather information around the vehicle or speed information of an external vehicle located around the vehicle.

[0512] The driving information of the vehicle may include at least one of speed information of the vehicle or speed change information of the vehicle.

[0513] According to an embodiment of the present disclosure, a mobile device may include a communicator configured to perform communication with an electronic device for vehicle and a wearable device, memory storing at least one instruction, and at least one processor configured to execute the at least one instruction stored in the memory.

[0514] The at least one processor may be configured to execute the at least one instruction to control the communicator to receive, from the electronic device for vehicle, at least one ambient sound or occurrence information of the at least one ambient sound.

[0515] The at least one processor may be configured to execute the at least one instruction to synthesize the at least one ambient sound or a generated sound corresponding to the occurrence information of the at least one ambient sound with audio data being played.

[0516] The at least one processor may be configured to execute the at least one instruction to control the communicator to transmit the synthesized sound to the wearable device.

[0517] The at least one processor may be configured to execute the at least one instruction to control the communicator to receive, from the electronic device for vehicle, output information of the at least one ambient sound.

[0518] The at least one processor may be configured to execute the at least one instruction to control the communicator to transmit, to the wearable device, the at least one ambient sound, based on the output information.

[0519] The output information may include at least one of volume information of the at least one ambient sound or direction information of at least one sound source outputting the at least one ambient sound.

[0520] The at least one processor may be configured to execute the at least one instruction to control the communicator to receive, from the electronic device for vehicle, output information including at least one of volume information of the at least one ambient sound or direction information of at least one sound source outputting the at least one ambient sound.

[0521] The at least one processor may be configured to execute the at least one instruction to adjust at least one of volume or direction of the synthesized sound, based on the output information.

[0522] The at least one processor may be configured to execute the at least one instruction to control the communicator to transmit the adjusted sound to the wearable device.

[0523] According to an embodiment of the present disclosure, an operating method of an electronic device for vehicle may include obtaining at least one ambient sound through at least one microphone.

[0524] According to an embodiment of the present disclosure, the operating method of the electronic device for vehicle may include identifying a group including the at least one ambient sound among a plurality of preset groups, based on at least one of type information and volume information of the at least one ambient sound.

[0525] According to an embodiment of the present disclosure, the operating method of the electronic device for vehicle may include transmitting the at least one ambient sound to the mobile device, based on at least one of driving information of a vehicle and surrounding environment information of the vehicle, and a transmission condition corresponding to the identified group.

[0526] According to an embodiment of the present disclosure, an operating method of an electronic device for vehicle may include transmitting output information of the at least one ambient sound to the mobile device.

[0527] The output information may include at least one of volume information of the at least one ambient sound or direction information of at least one sound source outputting the at least one ambient sound.

[0528] According to an embodiment of the present disclosure, an operating method of an electronic device for vehicle may include transmitting mixing information to the mobile device.

[0529] The mixing information may include information indicating whether to synthesize the at least one ambient sound transmitted to the mobile device with at least one audio data being played on the mobile device.

[0530] According to an embodiment of the present disclosure, the operating method of the electronic device for vehicle may include identifying another group that includes the at least one ambient sound, based on volume information of the at least one ambient sound being changed.

[0531] According to an embodiment of the present disclosure, the operating method of the electronic device for vehicle may include determining whether to transmit the at least one ambient sound to the mobile device, based on at least one of driving information of the vehicle and surrounding environment information of the vehicle, and a transmission condition corresponding to the other group.

[0532] According to an embodiment of the present disclosure, an operating method of an electronic device for vehicle may include transmitting occurrence information of the at least one ambient sound to the mobile device.

[0533] According to an embodiment of the present disclosure, an operating method of an electronic device for vehicle may include identifying the type information of the at least one ambient sound based on an artificial intelligence model.

[0534] The surrounding environment information of the vehicle may include at least one of location information of a sound source that generates the at least one ambient sound, weather information around the vehicle or speed information of an external vehicle located around the vehicle.

[0535] According to an embodiment of the present disclosure, an operating method of a mobile device may include receiving at least one ambient sound or occurrence information of the at least one ambient sound from an electronic device for vehicle.

[0536] According to an embodiment of the present disclosure, an operating method of a mobile device may include synthesizing the at least one ambient sound or a generated sound corresponding to the occurrence information of the at least one ambient sound with audio data being played.

[0537] According to an embodiment of the present disclosure, an operating method of a mobile device may include transmitting the synthesized sound to a wearable device.

[0538] According to an embodiment of the present disclosure, an operating method of a mobile device may include receiving output information of the at least one ambient sound from the electronic device for vehicle.

[0539] According to an embodiment of the present disclosure, an operating method of a mobile device may include transmitting the at least one ambient sound to the wearable device.

[0540] The output information may include at least one of volume information of the at least one ambient sound or direction information of at least one sound source outputting the at least one ambient sound.

[0541] According to an embodiment of the present disclosure, an operating method of a mobile device may include receiving, from the electronic device for vehicle, output information including at least one of volume information of the at least one ambient sound or direction information of at least one sound source outputting the at least one ambient sound.

[0542] According to an embodiment of the present disclosure, an operating method of a mobile device may include adjusting at least one of volume or direction of the synthesized sound, based on the output information.

[0543] According to an embodiment of the present disclosure, an operating method of a mobile device may include transmitting the adjusted sound to the wearable device.

[0544] According to an embodiment of the present disclosure, an operating method of at least one of an electronic device for vehicle or a mobile device may be implemented in the form of program instructions which are executable by various computing means and recorded in computer-readable media. The computer-readable medium may include program instructions, data files, data structures, etc., separately or in combination. The program instructions recorded on the medium may be designed and configured specially for the present disclosure, or may be well-known to those of ordinary skill in the art of computer software. Examples of the computer readable recording medium include a magnetic medium such as a hard disk, a floppy disk and a magnetic tape, an optical medium such as a compact disc read-only memory (CD-ROM) and a digital versatile disc (DVD), a magneto-optical medium such as a floptical disk, and a hardware device specially configured to store and perform program instructions, such as a read-only memory (ROM), a random-access memory (RAM), a flash memory, etc. Examples of the program instructions include not only machine language codes but also high-level language codes which are executable by various computing means using an interpreter.

[0545] Furthermore, an operating method of at least one of the electronic device for vehicle or the mobile device according to the disclosed embodiments may be included and provided in a computer program product. The computer program product may be a commercial product that may be traded between a seller and a buyer.

[0546] The computer program product may include a software program and a computer-readable storage medium having the software program stored thereon. For example, the computer program product may include a product in the form of a software program that is electronically distributed by the manufacturer of the electronic device or by an electronic market (e.g., Google play store ®< , or App store ®< ). For the electronic distribution, at least a portion of the software program may be stored in a storage medium or arbitrarily created. In this case, the storage medium may be one of a server of the manufacturer or of a relay server that temporarily stores the software program.

[0547] In a system including a server and a client device, the computer program product may include a storage medium of the server or a storage medium of the client device. Alternatively, when there is a third device (e.g., a smart phone) communicatively connected to the server or the client device, the computer program product may include a storage medium of the third device. In another example, the computer program product may be transferred from the server to the client device or the third device, or may include a software program itself that is transferred from the third device to the client device.

[0548] In this case, one of the server, the client device, and the third device may execute the computer program product to perform the method according to the embodiments of the present disclosure. Alternatively, two or more of the server, the client device, and the third device may execute the computer program product to perform the method according to the embodiments of the present disclosure in a distributed fashion.

[0549] For example, the server (e.g., a cloud server or an AI server) may execute the computer program product stored therein to control the client device communicatively connected to the server to perform the method according to the embodiments of the present disclosure.

[0550] Several embodiments of the present disclosure have been described, but it will be understood that various modifications can be made without departing the scope of the present disclosure. Thus, it will be apparent to those ordinary skilled in the art that the present disclosure is not limited to the embodiments described, but can encompass not only the appended claims but the equivalents.

Examples

Embodiment Construction

[0021]Terms as used herein will be described before describing embodiments of the present disclosure in detail.

[0022]The terms are selected as common terms currently widely used, taking into account functions in the present disclosure, which may however depend on intentions of ordinary people in the art, judicial precedents, emergence of new technologies, and the like. Some terms as used herein are selected at the applicant's discretion, in which case, the meaning will be explained later in detail in the description of the present disclosure. Therefore, the terms should be defined based on their meanings and descriptions throughout the present disclosure.

[0023]The term "include (or including)" or "comprise (or comprising)" is inclusive or openended and does not exclude additional, unrecited elements or method steps. The terms "unit", "module", "block", etc., as used herein each represent a unit for handling at least one function or operation, and may be implemented in hardware, soft...

Claims

1. An electronic device (200) for a vehicle, comprising: at least one microphone (220); memory (230) storing at least one instruction; a communicator (240) configured to perform communication with a mobile device; and at least one processor (210) configured to execute the at least one instruction stored in the memory, wherein the at least one processor is configured to execute the at least one instruction to obtain at least one ambient sound through the at least one microphone, identify, among a plurality of preset groups, a group including the at least one ambient sound, based on at least one of type information and volume information of the at least one ambient sound, and control the communicator (240) to transmit the at least one ambient sound to the mobile device, based on at least one of driving information of a vehicle and surrounding environment information of the vehicle, and a transmission condition corresponding to the identified group.

2. The electronic device for a vehicle of claim 1, wherein the at least one processor (210) is configured to execute the at least one instruction to identify the type information of the at least one ambient sound, based on an artificial intelligence model.

3. The electronic device for a vehicle of claim 1 or 2, wherein: the at least one processor (210) is configured to execute the at least one instruction to control the communicator (240) to transmit output information of the at least one ambient sound to the mobile device, and the output information comprises at least one of volume information of the at least one ambient sound or direction information of at least one sound source outputting the at least one ambient sound.

4. The electronic device for a vehicle of any one of claims 1 to 3, wherein: the at least one processor (210) is configured to execute the at least one instruction to control the communicator (240) to transmit mixing information to the mobile device, and the mixing information comprises information indicating whether to synthesize the at least one ambient sound transmitted to the mobile device with at least one audio data being played on the mobile device.

5. The electronic device for a vehicle of any one of claims 1 to 4, wherein the at least one processor (210) is configured to execute the at least one instruction to identify another group including the at least one ambient sound, based on volume information of the at least one ambient sound being changed, and determine whether to transmit the at least one ambient sound to the mobile device, based on at least one of the driving information of the vehicle and the surrounding environment information of the vehicle, and a transmission condition corresponding to the other group.

6. The electronic device for a vehicle of any one of claims 1 to 5, wherein the at least one processor (210) is configured to execute the at least one instruction to control the communicator (240) to transmit occurrence information of the at least one ambient sound to the mobile device.

7. The electronic device for a vehicle of any one of claims 1 to 6, wherein the surrounding environment information of the vehicle comprises at least one of location information of a sound source generating the at least one ambient sound, weather information around the vehicle or speed information of an external vehicle located around the vehicle.

8. A mobile device (900) comprising: a communicator (920) configured to perform communication with an electronic device for a vehicle and a wearable device; memory (930) storing at least one instruction; and at least one processor (910) configured to execute the at least one instruction stored in the memory, wherein the at least one processor (910) is configured to execute the at least one instruction to control the communicator (920) to receive, from the electronic device for a vehicle, at least one ambient sound or occurrence information of the at least one ambient sound, synthesize the at least one ambient sound or a generated sound corresponding to the occurrence information of the at least one ambient sound with audio data being played, and control the communicator (820) to transmit the synthesized sound to the wearable device.

9. The mobile device of claim 8, wherein the at least one processor (910) is configured to execute the at least one instruction to control the communicator (920) to receive output information including at least one of volume information of the at least one ambient sound or direction information of at least one sound source outputting the at least one ambient sound, adjust at least one of the volume or direction of the synthesized sound, based on the output information, and control the communicator (920) to transmit the adjusted sound to the wearable device.

10. An operating method of an electronic device for a vehicle, the operating method comprising: obtaining at least one ambient sound through at least one microphone (S1010); identifying, among a plurality of preset groups, a group including the at least one ambient sound, based on at least one of type information and volume information of the at least one ambient sound (S1020); and transmitting the at least one ambient sound to a mobile device, based on at least one of driving information of a vehicle and surrounding environment information of the vehicle, and a transmission condition corresponding to the identified group (S1030).

11. The operating method of claim 10, wherein the transmitting of the at least one ambient sound to the mobile device (S1030) comprises transmitting output information of the at least one ambient sound to the mobile device (S1032), and wherein the output information comprises at least one of volume information of the at least one ambient sound or direction information of at least one sound source outputting the at least one ambient sound.

12. The operating method of claim 10 or 11, wherein the transmitting of the at least one ambient sound to the mobile device (S1030) comprises transmitting mixing information to the mobile device (S1034), and wherein the mixing information comprises information indicating whether to synthesize the at least one ambient sound transmitted to the mobile device with at least one audio data being played on the mobile device.

13. The operating method of any one of claims 10 to 12, wherein the transmitting of the at least one ambient sound to the mobile device (S1030) comprises identifying another group including the at least one ambient sound, based on volume information of the at least one ambient sound being changed (S1036); and determining whether to transmit the at least one ambient sound to the mobile device, based on at least one of the driving information of the vehicle and the surrounding environment information of the vehicle, and a transmission condition corresponding to the other group (S1038).

14. The operating method of any one of claims 10 to 13, further comprising: transmitting occurrence information of the at least one ambient sound to the mobile device.

15. The operating method of any one of claims 10 to 14, wherein the surrounding environment information of the vehicle comprises at least one of location information of a sound source generating the at least one ambient sound, weather information around the vehicle or speed information of an external vehicle located around the vehicle.

Images