Two-way mirroring system for audio data

Abstract

Two-way mirroring system for audio data, comprising: a display device (100) configured to output data containing video or sound via a display (121); and a source device (200) configured to be connected to the display device (100) and to output the data to the display device (100), wherein the display device (100) includes an audio transmission server (103) that encodes the sound received from a sound input device (123) and sends the encoded sound to the source device (200), and the source device (200) includes an audio transmission client (203) that receives the encoded sound sent from the audio transmission server (103) and sends the received encoded sound to an application provided inside it, wherein the source device (200) comprises: a first data transmission server (204) configured to output a control signal for controlling the opening and closing of the sound input device (123) provided in the display device (100) to the display device (100); and a first data transmission client (205) configured to receive an input end signal of the sound input from the display device (100) to the sound input device (123), the display device (100) further comprises: a second data transmission client (104) configured to receive the control signal from the first data transmission server (204); and a second data transmission server (105) configured to send the input end signal of the sound to the first data transmission client (205), wherein the application provided within the source device (200) is a speech recognition application that recognizes the sound input to the sound input device (123), and the speech recognition application outputs the control signal for controlling the closing of the sound input device (123) provided in the display device (100) to the display device (100) via the first data transmission server (204) according to the input end signal of the sound.

Description

Field of the invention

[0001] The present invention relates to a two-way mirroring system for audio data, and more particularly to a two-way mirroring system for providing two-way communication for audio data for a mirror link cable connection without a Bluetooth channel connection. background

[0002] As various multimedia services such as digital television, IPTV (Internet Protocol Television), VOD (Video On Demand), etc., and the technology for enjoying multimedia services are being developed, there is a growing demand for mobile terminals among end-user devices capable of freely accessing multimedia content such as digital video, graphics, audio, etc. To meet this growing demand, technology for sharing data via wired or wireless communication, display mirroring technology for sharing a screen via wired or wireless communication, etc., has recently been adopted in end-user devices.

[0003] To implement display mirroring, seamless data transmission between remotely located end-user devices is required. Currently, mirroring technology has unilateral directionality between the end-user devices, depending on the type of data being transmitted. Specifically, when a vehicle's head unit (radio control, head unit) and a mobile terminal are mirrored, data related to touches or operations on the head unit are sent to the mobile terminal, and the mobile terminal's screen data is sent to the head unit. The mobile terminal's audio data is also unilaterally transmitted only to the head unit. Therefore, when the mobile terminal and the head unit are mirrored, the mobile terminal and the head unit can be connected via a separate Bluetooth channel to utilize the mobile terminal's phone call service or voice recognition service.However, it is difficult to connect the mobile device and the head unit via the separate Bluetooth channel.

[0004] EP 2 690 846 A1 discloses a device for a vehicle, a mobile phone, and a device cooperation system. Specifically, pixel information is acquired via a screen of the touch panel, and the pixel information is displayed on the vehicle display part. When a user performs a pressure manipulation on the vehicle display part, a signal indicating a manipulation target area is transmitted to the mobile phone via the communication part. If it is determined that the mobile phone enters a phone call state within a certain time since the pressure manipulation on the vehicle display part is detected, the phone switches to hands-free operation.

[0005] JP 5 350 567 B1 shows a portable terminal, a vehicle-mounted device, an information display method and an information display program.

[0006] JP 2013- 198 085 A shows an information processing device, an information processing method, an information processing program and a terminal.

[0007] US 2013 / 0 045 689 A1 teaches a vehicle system for managing external communications, in particular a hands-free system. The hands-free system sends and receives communications from a personal electronic device and determines whether the vehicle is in a state to receive inputs related to operation, a display, and a hands-free control module.

[0008] US 2014 / 0 120 829 A1 describes the establishment of a wireless display session between a computing device and a vehicle head unit, in particular also a method for transmitting media data from a source device, wherein the method comprises establishing a first communication session between the source device and a sink device comprising a vehicle head unit with the source device, wherein the first communication session conforms to a communication protocol.

[0009] US 2004 / 0 058 647 A1 discloses an apparatus and method for hands-free operation of a device. SUMMARY OF THE INVENTION

[0010] The embodiment of the present inventive concept provides a two-way mirroring system for audio data capable of two-way communication for audio data such as a telephone call or voice recognition service in a mirror link via wired connection without a connection of Bluetooth communication.

[0011] A two-way mirroring system for audio data according to an embodiment of the present inventive concept includes: a display configured to output input data as a video or audio via a display;and a source device configured to be connected to the display device and output the data to the display device, wherein the display device includes an audio transmission server that encodes the sound received from a sound input device that receives the sound and sends it to the source device, and the source device includes an audio transmission client that receives the encoded sound sent from the audio transmission server and sends the received encoded sound to an application provided inside it, wherein the source device comprises: a first data transmission server configured to output a control signal for controlling the opening and closing of the sound input device provided in the display device to the display device;and a first data transmission client configured to receive an input end signal of the sound input from the display device to the sound input device. The display device further comprises: a second data transmission client configured to receive the control signal from the first data transmission server; and a second data transmission server configured to send the input end signal of the sound to the first data transmission client. The application provided within the source device is a voice recognition application that recognizes the sound input to the sound input device, and the voice recognition application outputs the control signal for controlling the closing of the sound input device provided in the display device to the display device via the first data transmission server according to the input end signal of the sound.

[0012] In one embodiment, the display device is an infotainment system provided in a vehicle, the source device is a mobile phone owned by a passenger of the vehicle, and the infotainment system and the mobile terminal are connected by a mirror link.

[0013] In one embodiment, the source device further comprises a communication device that receives and sends a telephone call, and the application provided within the source device is a telephone call application that controls the communication device.

[0014] In one embodiment, the display device and the source device are connected by a wired connection via USB (Universal Serial Bus).

[0015] A two-way mirroring system for audio data according to the present invention is capable of two-way communication for audio data such as a telephone call or voice recognition service in a mirror link through a wired connection without connection of Bluetooth communication. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] The above and other objects, features and advantages of the present invention will become more apparent from the following detailed description when taken in conjunction with the accompanying drawings, in which: Fig. 1 is a diagram illustrating a telephone call of a two-way audio data mirroring system according to an embodiment of the present inventive concept. Fig. 2 is a diagram showing speech recognition of a two-way mirroring system for sound data according to an embodiment of the present inventive concept. Fig. 3 is a diagram showing a process in which a telephone call is made in a two-way mirroring system for audio data according to an embodiment of the present inventive concept. Fig. 4 is a diagram showing a process in which a voice is recognized in a two-way mirroring system for sound data according to an embodiment of the present inventive concept. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0017] The advantages and features of the present inventive concept, and how to achieve them, will be explained through embodiments described in detail with the accompanying drawings. However, the inventive concept is not limited to the embodiments described herein and may be embodied in other aspects. Only the present embodiment is provided to explain in detail to those skilled in the art to which the invention belongs, to the extent that it is possible to easily implement the technical spirit of the present inventive concept.

[0018] In the drawings, embodiments of the present inventive concept are not limited to the specific aspects shown and are exaggerated for clarity. Although specific terms are used herein, they are used only to explain the present inventive concept and are not intended to limit the meaning or scope of the present inventive concept described in the claims.

[0019] The term "and / or" is used herein to mean including at least one of the components listed before and after the term. Also, the term "connected / coupled" is used to mean directly connecting to another component or indirectly connecting via another component. A singular form herein also includes a plural form unless specifically referenced otherwise in the term. Also, the components, steps, operations, and elements referred to as "comprise" or "comprising" as used herein mean the presence or addition of at least one of other components, steps, operations, and elements.

[0020] Hereinafter, an embodiment of the present inventive concept will be described in detail with reference to the drawings.

[0021] In a system for outputting the screen and sound generated by a source device to a display device by connecting the display device and the source device via a cable connection, the same screen and sound of the source device are sent to the display device via a cable connection. A control signal input via an input provided in the display device is also sent to the source device via a cable connection. This allows the source device to be controlled by the operation of the display device, and the controlled screen and sound are output via the display device.

[0022] The specific example of the system is typically a mirror link system. Currently, the mirror link system is applied to an infotainment system provided in a vehicle and a mobile terminal possessed by a passenger of the vehicle. Here, a display device may be the infotainment system, and a source device may be the mobile terminal. That is, through the mirror link applied to the vehicle, various applications running on the mobile terminal can be used through the infotainment system, in which the screen is larger than that of the mobile terminal and the sound volume is higher than that of the mobile terminal.

[0023] However, if the vehicle's infotainment system and the mobile terminal are connected via Mirror Link, the same screen and audio output from the mobile terminal are only sent to the display device, and the audio generated by the infotainment system is only sent via a separately connected Bluetooth connection. Specifically, when receiving a call or initiating a call on a mobile terminal, the phone call function is implemented by bidirectionally transmitting and receiving voice data through separate Bluetooth communication.

[0024] The same bidirectional process is performed even when using the voice recognition service. Afterward, even if the display device and the source device are connected by a cable connection in a shared mirror link system to bidirectionally send and receive audio data, a separate Bluetooth connection is required. However, the separate Bluetooth connection is cumbersome when using the mirror link and leads to voice data recognition errors, etc.

[0025] Because the present inventive concept bidirectionally communicates audio data via the already connected wired connection (e.g., USB) without the connection of a separate Bluetooth communication, the phone call or the voice recognition application embedded in the infotainment system of a vehicle is not required, which makes it convenient for the driver or the user in a vehicle.

[0026] Hereinafter, a head unit is an example of an infotainment system provided in a vehicle that also serves as a mirror link display device, and a smartphone is an example of a mobile phone owned by a passenger in the vehicle that also serves as a source device. However, this is not limited to these examples.

[0027] Fig. 1 is a diagram showing a telephone call of a two-way audio data mirroring system according to an embodiment of the present inventive concept.

[0028] Referring to Fig. 1, a two-way audio mirroring system includes a head unit 100 and a smartphone 200. The head unit 100 and the smartphone 200 are connected via a wired connection. Here, the wired connection may be a USB (Universal Serial Bus) connection, but the wired connection is not limited to this.

[0029] The smartphone 200 sends the screen and audio running in an application (APP1, APP2, APP3, or APP4) to the vehicle's head unit 100, which has a larger screen and better speaker. The smartphone 200 includes a screen transmission server 201 and an audio transmission server 202. The screen transmission server 201 and the audio transmission server 202 encode the screen or audio generated by the currently running application (e.g., APP1) and sends it to the head unit 100, which is connected via a wired connection.

[0030] The head unit 100 receives the screen and sound generated by the application (for example, APP1) running in the smartphone 200 via the cable-based connected communication and outputs them to the outside via a screen display device 121 or a sound source output device.

[0031] For this purpose, the head unit 100 includes a screen transmission client 101 that receives the screen data output from the screen transmission server 201 of the smartphone 200, and an audio transmission client 102 that receives the audio data of the smartphone 200 output from the audio (sound) transmission server 202.

[0032] Here, the screen transmission client 101 and the audio transmission client 102 send the received screen and audio data to a mirror link APP 111 for a mirror link, and the mirror link APP 111 outputs the received screen and audio data to the screen display device 121 and the sound source output device 122. Here, the screen display device 121 may be a display including a display panel such as a touch screen, and the sound source output device 122 may be a sound device including a speaker provided inside the vehicle.

[0033] As described above, in the mirror link, the screen and audio data are sent unidirectionally from the smartphone 200, which is the source device, to the head unit 100. As a result, in a conventional mirror link system, if the application running in the smartphone 200 is a phone APP (APP4; 211) for a phone call, the head unit and the smartphone require a separate connection via Bluetooth communication.

[0034] However, the head unit 100 of the two-way audio mirroring system includes the audio transmission server 103, and the smartphone 200 includes the audio transmission client 203. Accordingly, the two-way audio mirroring system can transmit the sound (or voice) input via the sound input device (e.g., a voice input device 123) provided in the head unit 100 to the smartphone 200. Specifically, the voice data input from the voice input device 123 is sent to the audio transmission server 103 through the mirror link APP 111, and the audio transmission server 103 encodes the sent voice data and sends it to the audio transmission client 203 provided in the smartphone 200. That is, the two-way mirroring system for audio data can send the audio data from the smartphone 200 to the head unit 100 and send the data from the head unit 100 to the smartphone 200.

[0035] Thereafter, the two-way mirroring system for audio data according to the present inventive concept can utilize the phone call function or voice recognition function of the mirror-linked smartphone 200 via the head unit 100. The phone call function and the voice recognition function will be described in detail with reference to the following Fig. 3 and Fig. 4 described.

[0036] Fig. 2 is a diagram illustrating speech recognition of a two-way mirroring system for audio data according to an embodiment of the present inventive concept. Referring to Fig. 2 includes the two-way mirroring system for sound data from Fig. 2 further comprises a data transmission client 104 and a data transmission server 105 and the smartphone 200 further comprises a data transmission server 204 and a data transmission client 205, in comparison to Fig. 1.

[0037] In the case of voice recognition of a shared mirror link, if the voice recognition application is executed in the smartphone 200, the voice input device for voice recognition should be a microphone provided in the smartphone 200. In this case, due to various sounds generated from inside the vehicle, the voice recognition error is increased and the quality of the voice recognition service is degraded.

[0038] However, because the two-way mirroring system for audio data from Fig. 2 can control the opening and closing of the voice input device 123 provided in the head unit 100 in the smartphone 200 connected via the wired connection, sends the input Tin to the smartphone 200 via the voice input device provided in the head unit 100, and recognizes the speech of the sent sound based on the above additionally included components 104, 105, 204, 205, the speech can be recognized more accurately.

[0039] Fig. 3 is a diagram showing a process through which a telephone call is made in a two-way audio data mirroring system according to an embodiment of the present inventive concept.

[0040] First, the smartphone and the head unit are connected via a wired connection via USB for the mirror link (S310).

[0041] Then, an application (for example, APP1) of the various applications provided in the smartphone is executed, the screen or sound of the executed APP1 is output to the head unit via the connected USB (S320).

[0042] Then the head unit outputs the received screen or sound to the outside through the display or speaker provided in itself (S320).

[0043] In this state, when a call is received or a call is made on the smartphone, the phone APP provided in the smartphone is executed, and the phone screen or sound generated by the execution of the phone APP is output to the head unit (S340).

[0044] The head unit 100 outputs the received phone screen or sound to the outside instead of the screen or sound output in step S320 (S350). Here, as in Fig. As described in Figure 1, because the head unit 100 includes the audio transmission server 103, it can transmit the telephone call audio input from the head unit 100 to the smartphone 200. And because the smartphone 200 includes the audio transmission client 203 that receives the audio transmitted from the audio transmission server 103, the two-way audio mirroring system can provide the telephone call service via the head unit 100 mirrored with the smartphone 200 without a separate connection via a Bluetooth connection. This means that the head unit 100 of the two-way audio mirroring system does not require a separate embedded telephone call application for a telephone call.

[0045] Fig. 4 is a diagram showing a process by which a voice is recognized in a two-way mirroring system for audio data according to an embodiment of the present inventive concept.

[0046] First, the smartphone and the head unit are connected via a cable connection through USB for the mirror link (S411).

[0047] Then, the voice recognition application (for example, a voice recognition APP) provided in the smartphone is executed (S413), and the screen or sound of the executed voice recognition APP is output to the head unit 100 via the connected USB (S415).

[0048] Then, the head unit 100 outputs the received screen or sound to the outside through the display or speaker provided in itself (S417).

[0049] Then, the voice recognition button provided in the head unit is input to receive the voice spoken by the user (S419).

[0050] Then, the key input signal input in step S419 is sent to the smartphone 200 (S421).

[0051] Then, the voice recognition APP executed in the smartphone 200 according to the key input signal sent in step S421 outputs the control signal for opening the microphone, which is a voice input device provided in the head unit, to the head unit (S423).

[0052] Then the head unit opens the microphone according to the received control signal so that the voice can be recognized (S425).

[0053] Then, the head unit records the voice through the microphone opened in step S425 and sends it to the smartphone (S427).

[0054] Then the head unit detects that the speech ends (429) and sends the end signal, which informs the end of the speech, to the smartphone (S431).

[0055] Then, according to the end signal sent in step S431, the voice recognition APP executed in the smartphone outputs the control signal for closing the microphone, which is a voice input device provided in the head unit, to the head unit (S433).

[0056] Then, the head unit closes the opened microphone based on the received control signal (S435), and the voice recognition APP executed in the smartphone recognizes the voice of the recorded voice sent from the head unit in step S427 (S437).

[0057] Here, as in Fig.2, because the head unit 100 includes the audio transmission server 103, the data transmission client 104, and the data transmission server 105, it can transmit the user's telephone call sound input from the head unit 100 to the smartphone 200. The smartphone 200 transmits the microphone control signal transmitted from the smartphone 200 to the voice input device 123 and transmits the end signal indicating an end of the voice input to the smartphone 200. And, because the smartphone 200 includes the audio transmission client 203, the data transmission server 204, and the data transmission client 205, it can receive the sound input from the head unit 100. This sends the control signal that controls the speech input device 123 provided in the head unit 100 to the head unit 100 and receives the end signal indicating the end of speech from the head unit 100.

[0058] Thereafter, the two-way audio mirroring system according to the present inventive concept can provide a service that recognizes the voice of the audio input from the head unit 100, mirrored to the smartphone 200, without connecting a separate Bluetooth communication. That is, the head unit 100 of the two-way audio mirroring system does not require a separate embedded phone call application for voice recognition and can recognize the voice of the audio input from the head unit, which is closer to the user.

[0059] In the above description, the present disclosure has been described by way of specific examples, but it should be understood that various modifications can be made without departing from the scope of the present inventive concept. Therefore, the scope of the present inventive concept is not limited to the above-described embodiments and should be defined by the appended claims and their equivalents. With the above description in mind, if the modifications and variations of the present inventive concept fall within the scope of the following claims and their equivalents, the present invention is deemed to include these modifications and variations.

Claims

[1] Two-way mirroring system for sound data, comprising: a display device (100) configured to output data containing video or sound via a display (121); and a source device (200) configured to be connected to the display device (100) and to output the data to the display device (100), wherein the display device (100) includes an audio transmission server (103) that encodes the sound received from a sound input device (123) and sends the encoded sound to the source device (200), and the source device (200) includes an audio transmission client (203) that receives the encoded sound sent from the audio transmission server (103) and sends the received encoded sound to an application provided inside it, wherein the source device (200) comprises: a first data transmission server (204) configured to output a control signal for controlling the opening and closing of the sound input device (123) provided in the display device (100) to the display device (100); and a first data transmission client (205) configured to receive an input end signal of the sound input from the display device (100) to the sound input device (123), the display device (100) further comprises: a second data transmission client (104) configured to receive the control signal from the first data transmission server (204); and a second data transmission server (105) configured to send the input end signal of the sound to the first data transmission client (205), wherein the application provided within the source device (200) is a speech recognition application that recognizes the sound input to the sound input device (123), and the speech recognition application outputs the control signal for controlling the closing of the sound input device (123) provided in the display device (100) to the display device (100) via the first data transmission server (204) according to the input end signal of the sound. [2] A two-way mirroring system according to claim 1, wherein the display device (100) is an infotainment system provided in a vehicle, the source device (200) is a mobile phone owned by a passenger of the vehicle, and the infotainment system and the mobile terminal are connected via a mirror link. [3] The two-way mirroring system according to claim 2, wherein the source device (200) further comprises a communication device (221) that receives and sends a telephone call, and the application provided within the source device (200) is a telephone call application that controls the communication device (221). [4] Two-way mirroring system according to claim 2, wherein the display device (100) and the source device (200) are connected via a Universal Serial Bus (USB) cable connection.

Images