Terminal device
Through dual authentication between the first terminal device worn on the ear hole and the vehicle-mounted device, the sound output destination is automatically switched, which solves the problem of insufficient convenience in the vehicle by the user, and realizes the use of suitable speakers without manual switching operation. Music listening experience.
Patent Information
- Application Number
- CN202110390956.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2018-07-06
- Filing Date
- 2019-06-05
- Publication Date
- 2024-11-08
- Estimated Expiration
- 2039-06-05
AI Technical Summary
In the prior art, when a user uses a terminal device to listen to music in a vehicle, he or she needs to manually switch the speaker output, resulting in insufficient convenience.
An acoustic system is designed to automatically switch the output destination of sound data by dual authentication between the first terminal device and the vehicle-mounted device worn on the ear hole, and select a suitable speaker for sound output according to the user's location and authentication status. .
The convenience of the user is improved, allowing the user to listen to music using the speakers in the first terminal device or the vehicle-mounted device according to their preferences without manual switching operations, thereby improving the user experience.
Smart Images

Figure CN113115156B_ABST
Abstract
Description
[0001] Divisional Application Statement
[0002] This application is a divisional application of the Chinese invention patent application with an application date of June 5, 2019, an invention name of “Acoustic System” and an application number of 2019104878959. Technical Field
[0003] The present invention relates to acoustic systems. Background Art
[0004] There is a terminal device that is worn on the user's ear and has the following ear hole authentication function: a reference sound is emitted from a sound emitting unit to the ear hole, an echo sound is collected using an ear hole collecting unit, and the user is authenticated based on characteristics of the echo sound specific to the user (see Japanese Unexamined Patent Application Publication No. 2010-86328 (JP2010-86328A)).
[0005] Regarding acoustic technology for improving the convenience of users in a vehicle, there is a vehicle audio notification system that enables users in the vehicle to easily understand the situation outside the vehicle by emitting corresponding sounds from speakers inside the vehicle when a microphone that collects sounds outside the vehicle has collected sounds emitted from a specific device outside the vehicle (such as a siren) (see Japanese Unexamined Patent Application Publication No. 2015-32155 (JP2015-32155A)). Summary of the invention
[0006] It is conceivable that the terminal device disclosed in JP 2010-86328A uses a user authentication function to control whether a user wearing the terminal device is allowed to perform operations such as unlocking a vehicle door. However, for example, when a user is in a vehicle and is listening to music using the terminal device and wants to switch the music to output from a speaker of the vehicle, the user must perform a switching operation.
[0007] The present invention provides an acoustic system which improves the convenience of a user when a user wearing an acoustic device having an authentication function gets on a vehicle.
[0008] One aspect of the present invention is an acoustic system, which includes: a first terminal device configured to be worn on an ear hole of a user; a vehicle-mounted device; and a second terminal device configured to send sound data to a predetermined destination among the first terminal device and the vehicle-mounted device. The first terminal device includes: a first terminal sound emitting unit configured to emit an authentication sound having a predetermined frequency and a predetermined sound pressure and a sound based on the sound data received by the first terminal device to the ear hole of the user; an ear hole sound collecting unit configured to collect an echo sound from the ear hole of the user in response to the authentication sound; and a first terminal control unit configured to perform authentication between the first terminal device and the user based on the echo sound. The vehicle-mounted device includes: a vehicle-mounted device sound emitting unit configured to emit a sound based on the sound data received or generated by the vehicle-mounted device; and a vehicle-mounted device control unit configured to perform authentication between the vehicle-mounted device and the user based on communication with the first terminal device. The second terminal device includes a second terminal control unit, which is configured to: when the vehicle-mounted device control unit does not detect that a predetermined condition including a condition that the user has been authenticated has been met, select the first terminal device as the destination of the sound data; and when the vehicle-mounted device control unit detects that the predetermined condition has been met, select one of the first terminal device and the vehicle-mounted device as the destination of the sound data.
[0009] According to this aspect, when a user who is wearing a first terminal device on his ear (the first terminal device is a device having an authentication function utilizing ear canal echo sound) gets on a vehicle, it is possible to determine which of the first terminal device and the vehicle-mounted device will emit the sound desired by the user based on a predetermined setting without requiring the user to make such a determination, thereby making it possible to provide an acoustic system that can improve user convenience.
[0010] In this aspect, the predetermined condition may also include a condition that the first terminal device is in a vehicle.
[0011] The destination of the sound data may be predetermined at least in association with the user.
[0012] The destination of the sound data may be predetermined in association with at least a type indicating a classification of the sound data.
[0013] The predetermined condition for the second terminal control unit to select the destination of the predetermined type of sound data among the sound data may further include a condition that there is no passenger other than the user in the vehicle.
[0014] The vehicle-mounted device sound emitting unit may include a plurality of speakers. The vehicle-mounted device control unit may be configured to detect the position of the user in the vehicle. The vehicle-mounted device control unit may be configured to reduce the volume of at least the speaker closest to the user or mute the speaker when detecting that the second terminal device is sending a predetermined type of sound data to the first terminal device.
[0015] The second terminal control unit may be configured to select a destination of the sound data based on the information acquired from the server.
[0016] The onboard device control unit may be configured to generate the sound data. The onboard device control unit may be configured to select the first terminal device as a destination of the sound data generated by the onboard device control unit when the user has been authenticated.
[0017] The in-vehicle device control unit may be configured to select one of the first terminal device and the in-vehicle device sound emitting unit as a destination of the sound data generated by the in-vehicle device control unit when the first terminal device is detected in the vehicle after the user has been authenticated.
[0018] The in-vehicle device control unit may be configured to select a destination of the sound data generated by the in-vehicle device control unit based on information acquired from a server.
[0019] The first terminal device may further include a voice collection unit configured to collect the user's voice. The first terminal control unit may be configured to generate sound data based on the voice collected by the voice collection unit. The first terminal control unit may be configured to: when the vehicle-mounted control unit does not detect that the user has been authenticated, select the second terminal device as the destination of the sound data generated by the first terminal control unit, and when the vehicle-mounted device control unit detects that the user has been authenticated, select the vehicle-mounted device as the destination of the sound data generated by the first terminal control unit.
[0020] The first terminal control unit may be configured such that, when the first terminal sound emitting unit is emitting the authentication sound while the first terminal sound emitting unit is emitting a sound based on sound data received by the first terminal device, the first terminal control unit emits a sound in an inaudible frequency band as the authentication sound at the same time as the sound based on the sound data is emitted. BRIEF DESCRIPTION OF THE DRAWINGS
[0021] Features, advantages, and technical and industrial significance of example embodiments of the invention will be described hereinafter with reference to the accompanying drawings, in which like numerals represent like elements, and in which:
[0022] Figure 1 is a diagram showing an example of a configuration of an acoustic system according to an embodiment of the present invention;
[0023] Figure 2 is a diagram showing functional blocks of an acoustic system according to an embodiment of the present invention;
[0024] Figure 3 is a sequence diagram showing a processing flow according to an embodiment of the present invention;
[0025] Figure 4 is a sequence diagram showing a detailed processing flow according to an embodiment of the present invention; and
[0026] Figure 5 is a sequence diagram showing an additional processing flow according to an embodiment of the present invention. DETAILED DESCRIPTION
[0027] (Outline)
[0028] An acoustic system according to one aspect of the present invention includes a first terminal device worn on the ear of a user, a second terminal device (e.g., a smart phone), and a vehicle. When the user is away from the vehicle, the second terminal device sends sound data (e.g., music) to the first terminal device. Therefore, the user can listen to music using the first terminal device. When the user gets on the vehicle, the second terminal device sets the destination of the sound data to a predetermined one of the first terminal device and the speaker of the vehicle. Therefore, even when the user does not perform an operation to set an output, the user can use the first terminal device or the speaker of the user's vehicle to listen to, for example, music according to the user's preferences, so the user's convenience is high.
[0029] (Example)
[0030] Embodiments of the present invention will be described in detail below with reference to the accompanying drawings.
[0031] <Configuration>
[0032] Figure 1 An example of a configuration of an acoustic system 100 according to the embodiment is shown. The acoustic system 100 includes, for example, a first terminal device 10 worn on an ear of a user, a second terminal device 20 carried by the user, and a vehicle-mounted device 30 mounted in a vehicle. When the first terminal device 10 is within a predetermined range 500 where the distance from the vehicle-mounted device 30 is less than a predetermined distance, the first terminal device 10 can wirelessly communicate with the vehicle-mounted device 30. The second terminal device 20 is a portable terminal device (e.g., a smartphone), and when the distance from the first terminal device 10 is less than a predetermined distance, it can wirelessly communicate with the first terminal device 10.
[0033] Figure 2An example of a functional block of the acoustic system 100 is shown. The first terminal device 10 includes a first terminal sound emitting unit 11 that emits sound to the ear hole of the user, an ear hole sound collecting unit 12 that collects sound in the ear hole of the user, a voice collecting unit 13 that collects the user's voice, and a first terminal communication unit 14 that communicates with the second terminal device 20 and the vehicle-mounted device 30, and may also include various buttons or acceleration sensors. The first terminal device 10 includes a first terminal control unit 15 that controls the operation of the constituent units.
[0034] The second terminal device 20 includes a second terminal communication unit 21 that communicates with the first terminal device 10, the vehicle-mounted device 30, and a server 40 to be described later, and may also include an input unit that receives input from a user and a display unit that displays a notification to the user. The second terminal device 20 includes a second terminal control unit 22 that controls the operation of these constituent units.
[0035] The vehicle-mounted device 30 includes a vehicle-mounted device sound emitting unit 31, a vehicle-mounted device communication unit 32 and a vehicle-mounted device control unit 33, wherein the vehicle-mounted device sound emitting unit 31 includes a speaker arranged in the vehicle, the vehicle-mounted device communication unit 32 communicates with the first terminal device 10, the second terminal device 20 and the server 40 to be described later, and the vehicle-mounted device control unit 33 controls the operation of these component units.
[0036] The first terminal control unit 15, the second terminal control unit 22 and the vehicle-mounted device control unit 33 each include a processor for performing control processing and a storage unit for appropriately storing information for the control processing. The second terminal communication unit 21 and the vehicle-mounted device communication unit 32 can perform radio communication with the external server 40 via a network (such as the Internet).
[0037] <Processing Flow>
[0038] Figure 3 is a sequence diagram showing the flow of processing performed by the first terminal device 10, the second terminal device 20, and the vehicle-mounted device 30. Figure 3 The processing details are described below. For example, when the user is wearing the first terminal device 10 on the user's ear, the processing flow starts.
[0039] (Step S101): The first terminal control unit 15 performs the first authentication. The first authentication is performed using the following method. The first terminal control unit 15 causes the first terminal sound emitting unit 11 to emit an authentication sound having a predetermined frequency and a predetermined sound pressure to the ear hole of the user. The first terminal control unit 15 causes the ear hole sound collecting unit 12 to collect the echo sound of the authentication sound from the ear hole of the user. The sound pressure characteristics of the frequency of each echo sound have a pattern that is unique to the ear hole. The first terminal control unit 15 calculates the degree of consistency between the characteristics of the collected echo sound and the characteristics of the echo sound of the ear hole of the authorized user pre-registered and stored in the first terminal device 10, and when the degree of consistency is greater than a predetermined value, the user is authenticated as an authorized user of the first terminal device 10. The first authentication is an authentication between the first terminal device 10 and the user.
[0040] (Step S102): In this step, the second terminal control unit 22 sets the destination of the sound data to the first terminal device 10. The second terminal control unit 22 causes the second terminal communication unit 21 to send the sound data to the first terminal device 10. The sound data includes, for example, music data stored in the second terminal device 20 or communication voice data when the second terminal device 20 is a mobile phone. The first terminal device 10 and the second terminal device 20 perform, for example, a process (pairing) of identifying each other as communication partners in advance, and actually start the communication of the sound data in response to a notification indicating that the authentication of the user in step S101 in this example has succeeded. The second terminal control unit 22 can detect that the first authentication has succeeded, for example, by receiving a notification from the first terminal device 10.
[0041] (Step S103): The first terminal control unit 15 causes the first terminal sound emitting unit 11 to emit sound based on the sound data received by the first terminal communication unit 14. In the case of a phone call, in parallel with the processing of steps S102 and S103, the first terminal control unit 15 causes the voice collecting unit 13 to collect the user's voice, generate sound data based on the voice, and causes the first terminal communication unit 14 to send the generated sound data to the second terminal device 20. The processing of steps S102 and S103 is equivalent to, for example, the processing of music reproduction or voice communication through wireless communication between a smart phone and a head-mounted device (such as headphones) that is generally performed. When the user performs a predetermined start operation, the processing of music reproduction or voice communication, for example, is performed, and is continuously performed until a stop operation is performed, but the aforementioned processing of music reproduction or voice communication, for example, is not performed when the start operation is not performed.
[0042] (Step S104): When the user wearing the first terminal device 10 approaches the vehicle to board the vehicle and enters the above-mentioned range 500, the first terminal device 10 and the vehicle-mounted device 30 can communicate with each other. When the first terminal communication unit 14 receives radio waves from the vehicle-mounted device 30, the first terminal control unit 15 detects that communication is possible. When the vehicle-mounted device communication unit 32 receives radio waves from the first terminal device 10, the vehicle-mounted device control unit 33 detects that communication is possible. The first terminal control unit 15 transmits authentication data for the second authentication to be described later.
[0043] (Step S105): The onboard device control unit 33 performs the second authentication. The second authentication is performed using the following method. The onboard device control unit 33 communicates with the first terminal device 10 and detects that the first terminal device 10 is in a pairing state. When the first terminal device 10 is in a pairing state and the authentication data received from the first terminal device 10 indicates that the first authentication has succeeded, the onboard device control unit 33 authenticates the user as an authorized user of the vehicle. Alternatively, the onboard device control unit 33 may receive information indicating the echo sound of the user collected by the ear hole sound collection unit 12 from the first terminal device 10 instead of the result of the first authentication as the authentication data. In this case, the onboard device control unit 33 calculates the degree of consistency between the features of the echo sound indicated by the authentication data and the features of the echo sound from the ear holes of the authorized users of the vehicle pre-registered in the onboard device 30 or the server 40, and when the first terminal device 10 is in a pairing state and the degree of consistency is greater than a predetermined value, the user is authenticated as an authorized user of the vehicle. The second authentication is authentication between the vehicle-mounted device 30 and the user via the first terminal device 10 , and when the second authentication has succeeded, various devices mounted in the vehicle permit a door unlocking operation or an engine starting operation of the vehicle.
[0044] (Step S200 ): After the user authentication by the second authentication has succeeded, a process of switching the output destination of the sound data is performed. An example of the details of the output destination switching process of step S200 will be described below.
[0045] (Example of details of step S200: steps S201 to S207): Figure 4 2 is a sequence diagram showing an example of a detailed flow of an output destination switching process. In this example, the second terminal device 20 switches the destination of the voice data.
[0046] (Step S201): For example, when the second terminal communication unit 21 receives a notification from the vehicle-mounted device 30, the second terminal control unit 22 can detect that the second authentication has succeeded. The notification can be received via the first terminal device 10. When the second authentication has succeeded, the second terminal control unit 22 inquires the server 40 about the destination of the sound data through the communication of the second terminal communication unit 21. The destination of the sound data is predetermined for each identifier of the user or for each type indicating the classification of the sound data, and the server 40 stores a table such as shown in Table 1. Regardless of the identifier of the user, the destination of the sound data can be determined. Regardless of the classification of the sound data, the destination of the sound data can be determined. The second terminal control unit 22 specifies the information required for referring to the destination of the sound data (such as the identifier or type of the user) based on the method of specifying the destination of the sound data, and inquires the server 40 about the information.
[0047] Table 1
[0048] user Genre: Music Type: Phone A Vehicle-mounted device First terminal device B First terminal device First terminal device C Vehicle-mounted device Vehicle-mounted device
[0049] (Step S202): In response to the inquiry, the server 40 notifies the second terminal device 20 of the corresponding destination. The table shown in Table 1 can be set in advance by each user according to the user's preference. Types other than music and telephone may be prepared as types of sound data or no type may be prepared.
[0050] (Step S203): The second terminal control unit 22 sets the destination transmitted from the server 40 as the destination of the sound data. For example, when the user's identifier is "A" and the type of the sound data currently being transmitted is "music", its destination is switched from the first terminal device 10 to the vehicle-mounted device 30. When the user's identifier is "A" and the type of the sound data currently being transmitted is "telephone", its destination is set to the first terminal device 10, and the result is that the destination is not switched.
[0051] (Step S204): When the destination set in step S203 is the vehicle-mounted device 30, steps S204 and S205 are performed. The second terminal control unit 22 causes the second terminal communication unit 21 to stop the transmission of the sound data to the first terminal device 10 started in step S102, and transmits the sound data to the vehicle-mounted device 30. The second terminal device 20 and the vehicle-mounted device 30 perform processing (pairing) such as pre-identifying each other as communication partners. Normally, when the ignition is turned off, etc., the vehicle-mounted device sound emitting unit 31 is not powered and cannot emit sound. Therefore, preferably, the second terminal control unit 22 determines whether the emission of sound from the vehicle-mounted device sound emitting unit 31 is possible through communication with the vehicle-mounted device 30 before performing this step, and suspends this step until the emission of sound is possible.
[0052] (Step S205): The vehicle-mounted device control unit 33 causes the vehicle-mounted device sound emitting unit 31 to emit sound based on the sound data received by the vehicle-mounted device communication unit 32. In this way, the processing flow ends.
[0053] (Step S206): When the destination set in step S203 is the first terminal device 10, steps S206 and S207 are performed. The second terminal control unit 22 causes the second terminal communication unit 21 to continuously perform the transmission of the voice data to the first terminal device 10 started in step S102.
[0054] (Step S207): The first terminal control unit 15 causes the first terminal sound emitting unit 11 to emit sound based on the sound data received by the first terminal communication unit 14. In this way, the processing flow ends.
[0055] In the above example, the destination of the sound data can be switched by the second terminal device 20. Therefore, when the user gets on the vehicle, the destination can be switched to the device that emits the sound in the first terminal device 10 and the vehicle-mounted device 30, for example, according to the type of sound data and the user's preference, without causing the user to perform a switching operation, which provides high convenience. When the second terminal device 20 has detected that a predetermined condition indicating that the second authentication success of the user wearing the first terminal device 10 is approaching the vehicle has been satisfied, or when the second terminal device 20 has detected that a predetermined condition that the user wearing the first terminal device 10 actually gets on the vehicle has been satisfied, the switching can be performed. For example, when the vehicle-mounted device control unit 33 causes the vehicle-mounted device sound emitting unit 31 to emit an audible sound or an inaudible sound (such as an ultrasonic wave or an extremely low frequency wave) having a predetermined pattern to the vehicle, the first terminal device 10 also includes a sound collecting unit that collects the sound having the predetermined pattern, and the first terminal control unit 15 performs positioning based on the sound pressure or the arrival time, and notifies the second terminal device 20 of the positioning result, it can be detected that the first terminal device 10 is in the vehicle. Instead of using such a sound, by causing the first terminal communication unit 14 and the vehicle-mounted device communication unit 32 to communicate with each other using very weak radio waves whose coverage is within the vehicle, and causing the first terminal control unit 15 to notify the second terminal device 20 when communication is possible, it is possible to detect that the first terminal device 10 is in the vehicle. In addition, various sensors or the like can be used to perform detection of the first terminal device 10 in the vehicle, and the method of detecting the occupant is not limited.
[0056] When steps S102 and S103 are not performed and transmission of sound data or emission of sound is not performed, setting of the destination in step S203 is performed, and the processing of steps S204 to S207 may be suspended until an operation such as reproduction of music is performed by the user.
[0057] When the type of the sound data is "telephone", the second terminal control unit 22 can use the hands-free microphone of the vehicle instead of using the voice collection unit 13 of the first terminal device 10 in step S204 to collect the user's communication voice. In this case, the second terminal control unit 22 requests the vehicle-mounted device 30 to send the sound collected by the hands-free microphone, and the vehicle-mounted device control unit 33 generates sound data based on the sound collected by the hands-free microphone in response to the request, and causes the vehicle-mounted device communication unit 32 to send the generated sound data to the second terminal device 20.
[0058] When the type of the sound data is "phone", the vehicle-mounted device 30 can detect the position or number of the occupants in the vehicle by using the above-mentioned occupant detection function using various sensors in the first terminal device 10 or the vehicle, and when there are occupants other than the user in the voice communication, the sound data can be sent to the first terminal device 10 regardless of the notification result in step S202. Therefore, only the user in the voice communication can listen to the voice of the communication partner privately. The destination of the sound data of the type "phone" when there are occupants other than the user can be additionally set in the server 40, and the destination of the sound data can be set based on the result of the notification in step S202 and whether there are occupants other than the user in step S203. In the voice communication in the vehicle, the volume that can be emitted from the speaker of the vehicle-mounted device sound emitting unit 31 can be reduced, or the speaker can be muted. When there are multiple speakers, at least the volume of the speaker closest to the user in the voice communication can be reduced, or the speaker can be muted. Therefore, the voice from the speaker is not easily mixed into the communication voice, so as to facilitate communication, and the occupants other than the user in the voice communication can listen to music from the speaker. This processing is not limited to the case where the type of sound data is "telephone". A specific type indicating music or the like that the user wants to enjoy privately without wanting others to listen to can be set as the type of sound data, and the same processing can be performed on this type. The same processing can be performed when there are no passengers. Therefore, it can be prevented that the user has difficulty listening to the sound from the first terminal device 10 due to the sound from the speaker.
[0059] (Example of Additional Processing of Step S200: Steps S211 to S219) Figure 5 2 is a sequence diagram showing an example of additional processing in the output destination switching process. In this additional processing, the vehicle-mounted device 30 switches the destination of the voice data. This example can be performed in parallel with steps S201 to S207.
[0060] (Step S211): In this example, the vehicle-mounted device 30 can guide the user who has succeeded in the second authentication using voice. Since the user is outside the vehicle at the time point when the second authentication has succeeded, the vehicle-mounted device control unit 33 sets the destination of the voice data generated for guidance to the first terminal device 10. When there is the generated voice data, the vehicle-mounted device control unit 33 causes the vehicle-mounted device communication unit 32 to send the generated voice data to the first terminal device 10.
[0061] (Step S212 ): The first terminal control unit 15 causes the first terminal sound emitting unit 11 to emit sound based on the sound data received by the first terminal communication unit 14 .
[0062] (Step S213 ): When the user who is wearing the first terminal device 10 gets on the vehicle, the in-vehicle device control unit 33 detects that the first terminal device 10 is in the vehicle using the above-described method.
[0063] (Step S214): The vehicle-mounted device control unit 33 inquires the server 40 of the destination of the sound data through the communication of the second terminal communication unit 21. The sound data generated by the vehicle-mounted device is, for example, a type of sound data indicating the voice of the vehicle-mounted device, and its destination is determined, for example, for each identifier of the user. The server 40 stores the table shown in Table 2, for example, in the same format as in Table 1. The destination of the sound data can be determined regardless of the identifier of the user. The second terminal control unit 22 specifies the information required to refer to the destination of the sound data (such as the identifier or type of the user) based on the method of specifying the destination of the sound data, and inquires the server 40 for the information.
[0064] Table 2
[0065] user Type: Car device voice A Vehicle-mounted device B First terminal device C Vehicle-mounted device
[0066] (Step S215): In response to the inquiry, the server 40 notifies the corresponding destination to the second vehicle-mounted device 30. The table shown in Table 2 can be set in advance by each user according to the user's preference.
[0067] (Step S216): The in-vehicle device control unit 33 sets the destination sent from the server 40 as the destination of the sound data. For example, when the user's identifier is "A", the destination is switched from the first terminal device 10 to the in-vehicle device 30. When the user's identifier is "B", the destination is set to the first terminal device 10, and the result is that the destination is not switched.
[0068] (Step S217 ): When the destination set in step S216 is the first terminal device 10 , steps S217 and S218 are performed. When there is generated voice data, the onboard device control unit 33 causes the onboard device communication unit 32 to transmit the voice data to the first terminal device 10 .
[0069] (Step S218): The first terminal device 10 causes the first terminal sound emitting unit 11 to emit sound based on the sound data received by the first terminal communication unit 14. In this way, the processing flow ends.
[0070] (Step S219): When the destination set in step S216 is the vehicle-mounted device 30, step S219 is performed. When there is generated sound data, the vehicle-mounted device control unit 33 sends the sound data to the vehicle-mounted device sound emitting unit 31 of the vehicle-mounted device 30, so that a sound based on the sound data is emitted. In this way, the processing flow ends.
[0071] In the above-mentioned additional processing, when the second authentication has succeeded (indicating that the user wearing the first terminal device 10 is approaching the vehicle), the vehicle-mounted device 30 can send a voice for urging the user to perform an operation of touching the door handle for unlocking the door, a voice indicating that the door has been unlocked in response to the user's operation, etc. to the first terminal device 10, and can appropriately guide the user outside the vehicle. When it is detected that the user wearing the first terminal device 10 actually gets on the vehicle, the destination can be switched to a device in the first terminal device 10 and the vehicle-mounted device 30 that issues a guiding voice for starting the engine, etc., for example, according to the user's preference, without requiring the user to perform a switching operation, which provides high convenience.
[0072] The first terminal control unit 15 may receive a voice command for causing the user to operate the vehicle after the second authentication. In this case, when it is detected that the second authentication has succeeded, the first terminal control unit 15 switches the destination of the sound data based on the voice command collected by the voice collecting unit 13 from the second terminal device 20 to the vehicle-mounted device 30. In this case, the vehicle-mounted device control unit 33 controls the operation of the component units of the vehicle, such as unlocking the door, based on the sound data received by the vehicle-mounted device communication unit 32. In this case, the vehicle-mounted device control unit 33 may generate sound data indicating a response voice in response to the voice command as the sound data.
[0073] When the user who started in steps S102 and S103 listens to music or conducts conversational communication through communication between the first terminal device 10 and the second terminal device 20 is maintained in step S211 or step S217, the priority order of the processing of music or communication, and the processing of voice from the vehicle-mounted device 30 or voice command to the vehicle-mounted device 30 is not particularly limited, but can be appropriately determined according to the device configuration of the first terminal device 10 or the radio communication specification or the setting from the user. The switching of the destination of various sound data or the emission of sound can be suspended or canceled, for example. For example, in the reproduction of music or voice communication, the reception of sound data of the guide voice of the vehicle-mounted device 30 or the emission of sound can be limited, or the guide voice can be emitted overlapping with the music or communication voice. In voice communication, the reception of vehicle operation using voice command can be limited. The processing of steps S201 to S207 may not be performed, and the processing of steps S211 to S219 may be performed.
[0074] The embodiment of the present invention has been described above. In this embodiment, the first terminal device 10 and the vehicle-mounted device 30 inquire the server 40 about the destination of the sound data. Therefore, it is preferred that the setting of the destination for each user and each type of sound data can be managed together by the server 40. However, the present invention is not limited to this, and the first terminal device 10, the second terminal device 20, and the vehicle-mounted device 30 can store the destination separately. The destination of the sound data may not be related to each user or each type of sound data, and the related rules are not limited.
[0075] The first authentication and the second authentication may be repeated at predetermined intervals, or may be performed whenever a vehicle operation (such as unlocking a door or starting an engine) is performed. In the first authentication, when a sensor for detecting the wearing state of the first terminal device 10 on the user's ear is provided and the first terminal control unit 15 detects the separation of the first terminal device 10 from the ear using the sensor, preferably, the authentication result is invalidated and authentication is performed again when the first terminal device 10 is worn next time. In the second authentication, when the first terminal device 10 leaves the above-mentioned range 500 and the communication radio wave with the vehicle-mounted device 30 is cut off, it is preferred that the authentication result is invalidated and authentication is performed again at the next detection of the radio wave. Therefore, the number of opportunities for user authentication can be increased, and thus security can be improved. When the authentication sound is emitted from the first terminal sound emitting unit 11 and a sound based on sound data (such as music or communication voice) is also emitted, the first terminal control unit 15 can emit a sound of an inaudible frequency band as the authentication sound and can not stop the emission of the sound based on the sound data. Therefore, the sound listened to by the user does not stop or the authentication sound does not overlap with the sound, so the user can appropriately listen to the sound based on the sound data.
[0076] When the user who is wearing the first terminal device 10 gets off the vehicle, the vehicle-mounted device control unit 33 can detect the getting off from the detection result based on the above-mentioned occupant detection method, and set the destination of the sound data to the first terminal device 10. When the user wearing the first terminal device 10 gets off the vehicle or when the user leaves the above-mentioned range 500, the second terminal control unit 22 can detect this fact, for example, by receiving the detection result from the vehicle-mounted device 30 or detecting the cutting off of the communication radio wave from the vehicle-mounted device 30, and can set the destination of the sound data to the first terminal device 10.
[0077] In addition to the second terminal device 20 and the vehicle-mounted device 30, the destination of the sound data may be set by another terminal device or another vehicle-mounted device.
[0078] (Beneficial Effects)
[0079] According to aspects of the present invention, an acoustic system can be provided which, when a user who is wearing a first terminal device 10 on his ears gets on a vehicle, can switch the destination to a device from among the first terminal device and the vehicle-mounted device that emits the sound that the user wants to hear according to a predetermined setting, without requiring the user to perform a switching operation, thereby improving user convenience.
[0080] Although embodiments of the present invention have been described above, aspects of the present invention may be understood as an acoustic system, a first terminal device and a vehicle-mounted device constituting the acoustic system, a sound emission control method performed by a control unit of the device, a sound emission control program, a non-volatile computer-readable recording medium having the sound emission control program installed therein, or a vehicle having the vehicle-mounted device installed therein.
Claims
1. A first terminal device, which is configured to be worn on the ear hole of the user and can communicate with the vehicle-mounted device and the second terminal device, characterized in that: include: a voice collecting unit configured to collect the user's voice, and The first terminal control unit is configured as follows: generating sound data based on the speech collected by the speech collecting unit, When the in-vehicle device does not detect that the user has been authenticated, selecting the second terminal device as a destination of the voice data generated by the first terminal control unit, When the in-vehicle device detects that the user has been authenticated, selecting the in-vehicle device as a destination of the voice data generated by the first terminal control unit, and In voice communication, reception of vehicle operations using voice commands is restricted.
2. The first terminal device according to claim 1, characterized in that: The first terminal device further includes: a first terminal sound emitting unit configured to emit an authentication sound having a predetermined frequency and a predetermined sound pressure and a sound based on the sound data received by the first terminal device to an ear hole of a user, and an ear hole sound collecting unit configured to collect an echo sound from an ear hole of the user in response to the authentication sound; The first terminal control unit is configured to perform authentication between the first terminal device and the user based on the echo sound.
3. The first terminal device according to claim 1, characterized in that: The vehicle-mounted device comprises: an in-vehicle device sound emitting unit configured to emit a sound based on the sound data received or generated by the in-vehicle device, and An on-vehicle device control unit is configured to control operations of component units of a vehicle based on the sound data received by the on-vehicle device.
4. The first terminal device according to claim 3, characterized in that: The in-vehicle device control unit generates sound data indicating a response voice in response to the voice command.
5. The first terminal device according to claim 4, characterized in that: The in-vehicle device control unit is configured to select one of the first terminal device and the in-vehicle device sound emitting unit as a destination of sound data generated by the in-vehicle device control unit when the first terminal device is detected to be in the vehicle.
6. The first terminal device according to claim 1, characterized in that: The second terminal device is configured to transmit the sound data to a predetermined destination among the first terminal device and the vehicle-mounted device; The second terminal device includes a second terminal control unit, and the second terminal control unit is configured as follows: selecting the first terminal device as a destination of the voice data when the vehicle-mounted device does not detect that a predetermined condition including a condition that the user has been authenticated has been satisfied; and When the in-vehicle device detects that the predetermined condition has been satisfied, one of the first terminal device and the in-vehicle device is selected as a destination of the voice data.
7. A method for controlling a first terminal device, wherein the first terminal device is configured to be worn on an ear hole of a user and is capable of communicating with a vehicle-mounted device and a second terminal device, and the first terminal device includes a voice collection unit and a first terminal control unit, the method comprising: Controlling the voice collection unit to collect the user's voice; Controlling the first terminal control unit to generate sound data based on the voice collected by the voice collecting unit; Controlling the first terminal control unit: When the in-vehicle device does not detect that the user has been authenticated, selecting the second terminal device as a destination of the voice data generated by the first terminal control unit, and When the in-vehicle device detects that the user has been authenticated, selecting the in-vehicle device as a destination of the sound data generated by the first terminal control unit; as well as The first terminal control unit is controlled to limit reception of vehicle operations using voice commands during voice communication.
8. A non-transitory computer-readable storage medium storing a program, which, when executed, implements a method of controlling a first terminal device, wherein: The first terminal device is configured to be worn on the ear hole of the user and can communicate with the vehicle-mounted device and the second terminal device, and the first terminal device includes a voice collection unit and a first terminal control unit, and the method includes: Controlling the voice collection unit to collect the user's voice; Controlling the first terminal control unit to generate sound data based on the voice collected by the voice collecting unit; Controlling the first terminal control unit: When the in-vehicle device does not detect that the user has been authenticated, selecting the second terminal device as a destination of the voice data generated by the first terminal control unit, and When the in-vehicle device detects that the user has been authenticated, selecting the in-vehicle device as a destination of the voice data generated by the first terminal control unit; and The first terminal control unit is controlled to limit reception of vehicle operations using voice commands during voice communication.
