Display device, display device cooperation system, and sound reproduction method

Abstract

To provide a display device, a display device cooperation system, and a sound reproduction method for improving convenience and functionality when a plurality of persons view the same video.SOLUTION: A display device (10) that directly transmits an audio signal to an audio signal receiving device (50, 51) by wireless communication without passing through a relay device, the display device including a wireless communication device (18), a display (13), and a controller (11), the wireless communication device transmitting a plurality of types of audio signals by multicast or broadcast wireless communication, supplementary information indicating at least the type of the audio signal is added to each of the plurality of types of audio signals, and the supplementary information includes at least one of information on the types of languages included in the multilingual broadcast signal and priorities of the languages, information on respective channel names when a plurality of broadcast programs are simultaneously displayed, and information indicating an audio reproduction position when a 3D sound source is used.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to a display device, a display device cooperation system, and an audio reproduction method. [Background technology]

[0002] Digital audiovisual devices such as digital TVs, smartphones, tablet devices, Bluetooth® speakers, etc. are widely used. Wireless communication such as Wi-Fi® and Bluetooth® is used to connect these devices, increasing the flexibility of audio signal transmission.

[0003] For example, Patent Document 1 discloses that "a wireless transmission system includes a wireless source device that wirelessly transmits AV content, and a plurality of sink devices that play the wirelessly transmitted AV content. As a representative wireless sink device, when a control command wirelessly transmitted from a wireless source device has its own group identification ID attached to the control command, the bridge device receives the control command, converts between the wireless control command communicated with the wireless source device and the wired control command communicated with the sink device, and communicates with other sink devices in the group. Furthermore, the bridge device represents the group to which the representative wireless sink device belongs, and performs wireless communication with the wireless source devices and representative wireless sink devices of other groups. (Abstract excerpt)" [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2010-279072 Summary of the Invention [Problem to be solved by the invention]

[0005] Conventionally, most audio transmission technologies use Bluetooth (registered trademark) or Wi-Fi (registered trademark) for one-to-one communication, and simultaneous and efficient transmission to multiple devices is not common. Therefore, when multiple people watch a single display device such as a television set, it has not been possible for each person to simultaneously listen to different audio.

[0006] The present invention has been made in consideration of the above-mentioned situation, and aims to provide a display device, a display device linkage system, and an audio playback method that improve convenience and functionality when multiple people watch the same video. [Means for solving the problem]

[0007] In order to solve the above problems, the present invention has the configuration described in the claims. One example of such a display device is a display device that transmits audio signals directly to an audio signal receiving device via wireless communication without using a relay device, the display device comprising: a wireless communication device, a display, and a controller that controls the wireless communication device and the display, the wireless communication device transmits multiple types of audio signals via multicast or broadcast wireless communication, each of the multiple types of audio signals is accompanied by at least information indicating the type of the audio signal, the accompanying information including at least one of information regarding the types of languages ​​included in a multilingual broadcast signal and their priority, information regarding each channel name when multiple broadcast programs are displayed simultaneously, or information indicating an audio playback position when a 3D sound source is used. [Effects of the Invention]

[0008] According to the present invention, it is possible to provide a display device, a display device linkage system, and an audio playback method that improve convenience and functionality when multiple people watch the same video. Objects, configurations, and effects other than those described above will be clarified in the following embodiments. [Brief explanation of the drawings]

[0009] [Figure 1]FIG. 2 is a functional block diagram of a TV according to the embodiment. [Figure 2] FIG. 1 is an explanatory diagram showing an overview of a TV linkage system according to a first embodiment. [Figure 3] FIG. 10 is a diagram showing an example of the UI of a TV that is a multicast or broadcast source. [Figure 4] FIG. 10 is an explanatory diagram showing an overview of a TV linkage system according to a second embodiment. [Figure 5] FIG. 10 is an explanatory diagram showing an overview of a TV linkage system according to a third embodiment. [Figure 6] FIG. 11 is a sequence diagram showing the flow of processing according to the third embodiment. [Figure 7] FIG. 10 is an explanatory diagram showing an overview of a TV linkage system according to a fourth embodiment. [Figure 8] FIG. 11 is an explanatory diagram showing an overview of a TV linkage system according to a fifth embodiment. [Figure 9] FIG. 11 is an explanatory diagram showing an overview of a TV linkage system according to a fifth embodiment. [Figure 10] FIG. 13 is an explanatory diagram showing an overview of a TV linkage system according to a sixth embodiment. [Figure 11] FIG. 13 is an explanatory diagram showing an overview of a TV linkage system according to a seventh embodiment. [Figure 12] FIG. 19 is an explanatory diagram showing an overview of a TV linkage system according to an eighth embodiment. [Figure 13] FIG. 13 is an explanatory diagram showing an overview of a TV linkage system according to a ninth embodiment. [Figure 14] FIG. 20 is an explanatory diagram showing an overview of a TV linkage system according to a tenth embodiment. [Figure 15] FIG. 20 is an explanatory diagram showing an overview of a TV linkage system according to a tenth embodiment. [Figure 16] FIG. 2 is a sequence diagram showing the processing flow of the TV linkage system. DETAILED DESCRIPTION OF THE INVENTION

[0010] The present invention is expected to contribute to diversification and technological improvement in labor-intensive industries, for example, and therefore contributes to the achievement of Sustainable Development Goal 8.2 (increasing economic productivity through diversification, technological improvement, and innovation, particularly in labor-intensive industries and industries that increase the value of goods and services) advocated by the United Nations. Hereinafter, examples of embodiments of the present invention will be described with reference to the drawings. The same components are designated by the same reference numerals throughout the drawings, and redundant explanations will be omitted.

[0011] HDMI, Bluetooth, and WiFi used in the following explanation are all registered trademarks.

[0012] FIG. 1 is a functional block diagram of a television device (TV 10) that is a display device according to this embodiment.

[0013] The TV 10 is composed of a TV tuner 12, a display 13, a memory 14, a video / audio communication device 15, a wired LAN communication device 16, a wireless LAN communication device 17, a Bluetooth communication device 18 (corresponding to the first wireless communication device), an external device connector 19, a built-in speaker 20, and a microphone 21, all of which are connected to a controller 11.

[0014] The controller 11 includes a processor 11a that controls the entire TV 10 according to a predetermined program, a calendar clock 11b, and a timer 11c, and is capable of timing control of audio output and video display.

[0015] The memory 14 includes a work area 14a that temporarily stores basic operating programs and other programs for executing application programs, as well as data as needed when various application programs are executed, and a storage area 14b that stores information such as various setting values, various programs, and moving image data even when power is not supplied.

[0016] The work area 14a is implemented by a volatile memory such as a RAM (Random Access Memory).

[0017] The storage area 14b may be implemented by a nonvolatile storage device such as a flash ROM, a solid state drive (SSD), or a hard disk drive (HDD).

[0018] The TV 10 can expand its functions by downloading new application programs from an application server via the Internet. At this time, the downloaded new application programs are stored in the storage area 14b. The controller 11 loads the new application programs stored in the storage area 14b into the work area 14a, and then executes the loaded new application programs, thereby enabling the TV 10 to realize a variety of new functions.

[0019] The display 13 is a display device such as a liquid crystal panel or an organic EL display, and displays images and the like that are video-processed after receiving broadcast waves from an antenna via the TV tuner 12.

[0020] The TV tuner 12 is composed of a terrestrial digital tuner, a BS / CS digital tuner, an OFDM demodulation unit, an MPEG decoder, and the like.

[0021] The TV 10 has a function to select one audio and output it from a speaker by processing multilingual broadcasts such as bilingual broadcasts received by the TV tuner 12 with a processor 11a, or to output two languages ​​simultaneously, and also has a function to output multiple broadcast programs simultaneously.

[0022] The audio-video communication device 15 is connected one-to-one with an external device, etc. The "external device" here refers to a device that transmits an uncompressed video signal to the TV 10 via HDMI or receives it from the TV 10, and can be any type of device, such as a personal computer (including a gaming PC described later), a projector, or a home theater device.

[0023] The wireless LAN communication device 17 not only transmits and receives data to and from wireless communication devices such as a smartphone 51 or a tablet, but is also capable of connecting to the Internet via an access point.

[0024] The wired LAN communicator 16 is connected to the Internet via a home gateway and transmits and receives data to and from a server. The wired LAN communicator 16 is also connected to an STB (Set Top Box) and receives broadcast signals such as cable broadcasts, satellite broadcasts, terrestrial television broadcasts, and IP broadcasts (broadband, VOD, etc.) from the STB.

[0025] The Bluetooth communication device 18 communicates via Bluetooth with audio signal receiving devices (Bluetooth terminals) capable of Bluetooth communication, such as a smartphone 51, a tablet, a Bluetooth speaker, or wireless earphones. Note that the use of multiple antennas enables diversity and detection of the direction of radio wave arrival.

[0026] The Bluetooth communication device 18 supports multicast and broadcast protocols, and wirelessly transmits and receives multicast audio (two-way communication) and broadcast audio. It also receives signals from multiple Bluetooth devices. In this embodiment, Bluetooth Low Energy is used as a communication method that enables simultaneous Bluetooth communication between the TV 10 and multiple Bluetooth devices.

[0027] Broadcasting does not require prior pairing and is easy to use, while multicasting requires prior registration of audio signal receiving devices, making it less convenient than broadcasting but more secure in terms of security and privacy.

[0028] By using multicast or broadcast for audio communication, one-to-many or many-to-many communication can be performed efficiently, and the power required for communication and the radio wave bandwidth used can be reduced compared to one-to-one communication. The following explanation uses multicast as an example, but the same effects can be achieved even if broadcast is used instead.

[0029] The external device connector 19 exchanges signals with devices such as a home hub 190 (see FIG. 4). An independent wired connection is possible, but a network connection using a wireless LAN communication device 17 or a shared Bluetooth communication device 18 may also be used.

[0030] The built-in speaker 20 outputs sound from the TV 10 .

[0031] The microphone 21 can input external sounds into the TV 10. This allows voice control and calls via the Internet.

[0032] When the remote control 30 receives an operation input from the user, it transmits the input information to the TV 10. This allows the user to remotely control the TV 10. The remote control 30 is an example of an operation member.

[0033] First Embodiment The first embodiment relates to a TV-linked system 100 in which a TV 10 transmits multiple types of audio signals by multicast or broadcast, and multiple audio signal receiving devices individually select one of the multiple types of audio signals and output the audio. In this embodiment, Bluetooth Low Energy is used as the wireless communication standard between the TV 10 and the audio signal receiving devices. Therefore, hereinafter, the "audio signal receiving device" will be referred to as an LE-Audio terminal. In the embodiments described below, smart speakers 50, 50a, and 50b, a smartphone 51, a tablet, and wireless earphones 81 and 82 are given as specific examples of LE-Audio terminals. However, any type of device, such as wireless headphones or a game console, can be used as long as it is capable of wireless communication and audio playback using the Bluetooth Low Energy standard.

[0034] FIG. 2 is an explanatory diagram showing an overview of the processing of the TV linkage system 100 according to the first embodiment.

[0035] The TV linkage system 100 is a system in which audio signals are transmitted and received directly between the TV 10 and each of the smart speaker 50 and the smartphone 51 via wireless communication without going through a relay device.

[0036] The TV 10 receives the bilingual broadcast signal, displays the image on the display 13, and outputs the audio from the built-in speaker 20. The TV 10 wirelessly transmits the Japanese audio signal and the English audio signal by multicast or broadcast.

[0037] The multicast signal or broadcast signal wirelessly transmitted by multicast or broadcast from the TV 10 includes an audio signal of the broadcast played on the TV 10. Furthermore, the multicast signal or broadcast signal is supplemented with supplementary information indicating the name of the transmitting device, "Living TV," and language information included in the multilingual broadcast signal, for example, "Japanese" or "English."

[0038] The TV 10 can also broadcast a signal with the same content as the multicast signal. In this case, audio can be output as long as the audio signal receiving device can receive the broadcast signal, regardless of the settings of the TV 10. For ease of explanation, the following description will be given assuming that the TV 10 transmits a multicast signal, but the same effects can be achieved even if the multicast signal is referred to as a "broadcast signal" in the following description.

[0039] The TV 10 encodes (encrypts) and transmits the multicast signal so that the number of LE-Audio terminals that can receive the signal is limited.

[0040] As an example, the smart speaker 50 is set in advance to give priority to outputting Japanese audio. When the smart speaker 50 receives a multicast signal from the TV 10, it selects a Japanese audio signal from the multicast signal and plays back the audio. On the other hand, the smartphone 51 is set to output English audio, and when it receives a multicast signal from the TV 10, it selects an English audio signal from the multicast signal and plays back the audio.

[0041] In this way, the TV 10 simultaneously transmits multiple audio signals in the case of multilingual and multichannel audio. The LE-Audio device refers to the additional information, selects the necessary audio signal as appropriate, and plays (outputs) the audio. The additional information may include the channel names of the multichannel audio (front right, front left, center, rear right, rear left). This makes it possible to play, for example, 5.1-channel surround sound using multiple Bluetooth speakers.

[0042] As described above, the TV 10 wirelessly transmits multiple types of audio signals by multicast, and the LE-Audio terminals select the necessary audio signals from the multicast signals as appropriate, thereby enabling desired audio to be output to each of the different LE-Audio terminals.

[0043] (TV10 setting UI) FIG. 3 is a diagram showing an example of the UI of the TV 10 that is the multicast or broadcast source.

[0044] The controller 11 of the TV 10 displays a setting screen 130 on the display 13 for setting a set name (corresponding to a transmitting device name) of the TV 10. The setting screen 130 is provided with a registration field 130a for registering the name of the TV 10. The user sets the set name of the TV 10, such as "living room TV" or "bedroom TV," using the remote control 30. The setting operation may be performed by operating a menu on the remote control 30 or by inputting characters.

[0045] The set name of the TV 10 that has been set is added to the multicast signal as the transmitting device name. This allows the LE-Audio terminal receiving the multicast signal to identify which transmitting device sent the audio signal, even when receiving multicast signals from multiple TVs, making it easier to select a signal on the LE-Audio terminal.

[0046] Second Embodiment The second embodiment is an embodiment in which a gateway function of an LE-Audio terminal is implemented in the TV 10 of the TV linkage system 100 according to the first embodiment.

[0047] FIG. 4 is an explanatory diagram showing an overview of a TV linkage system 100a according to the second embodiment.

[0048] In Fig. 4, a doorbell 41 installed at the entrance is connected to the external device connector 19 of the TV 10 by wire or wirelessly. When the TV 10 receives a signal from the doorbell 41, it creates a corresponding audio signal and transmits it wirelessly to the LE-Audio terminal by multicast. At the same time, this audio may be output from the built-in speaker 20 of the TV 10.

[0049] In this case, the audio signal may be a bell sound such as "ping pong" like a doorbell, or a synthesized or recorded voice saying "There's a visitor."

[0050] The external device connector 19 may be connected directly to the doorbell by wire or wirelessly, or may be connected via a home hub 190.

[0051] In FIG. 4, home IoT devices 191, 192, and 193 are further connected to the TV 10 via a home hub 190. The TV 10 may multicast signals acquired from the home IoT devices 191, 192, and 193 via the home hub 190 to an LE-Audio terminal, for example, a smart speaker 50 or a smartphone 51. Home IoT device 191 is a window lock, home IoT device 192 is a front door key, and home IoT device 193 is a front door light. The window lock and front door key are examples of home appliances, and the front door light is an example of a home appliance.

[0052] Multicast signals include signals to notify the state of the door lock, signals that are connected to a doorbell button or the like to send two-way signals when a visitor arrives, etc. In the above description, if the smart speaker 50 or smartphone 51 outputs the audio of a TV program when it receives a multicast signal from the home hub 190 or the like, it may be possible to make the audio output of the multicast signal input from the home hub 190 or the like easier to hear by, for example, lowering the audio volume of the TV program or temporarily stopping the output.

[0053] It is also possible to configure the TV 10 so that when the power is turned off at night, the home hub 190 checks whether the door is locked and, if it is not locked, transmits a warning voice message. In this case, a message may be displayed on the screen of the display 13 at the same time.

[0054] On the other hand, when a user inputs a command to lock or turn off the lights by voice from the LE-Audio terminal, an audio signal is sent from the LE-Audio terminal to the TV 10, and the TV 10 analyzes the audio and converts the audio signal into a control signal for each of the home IoT devices 191, 192, and 193. The TV 10 then sends a control signal to one of the home IoT devices 191, 192, and 193 via the home hub 190 to lock the doors and windows and turn off lights such as the porch light. At this time, a confirmation voice message such as "Locking" or "Porch light turned off" is sent by multicast broadcast.

[0055] According to this embodiment, a user can use a TV 10 or an LE-Audio terminal to send control signals to any of the home IoT devices 191, 192, and 193 located at a remote location indoors, and perform controls such as locking doors and windows and turning off lights such as entrance lights.

[0056] <Third embodiment> The third embodiment is an embodiment in which, in the TV 10 of the TV linkage system 100 according to the first embodiment, the audio output from an audio signal receiving device connected to the TV 10 is adjusted and synchronized with the audio output timing and video display timing from the TV 10.

[0057] FIG. 5 is an explanatory diagram showing an overview of a TV linkage system 100b according to the third embodiment.

[0058] The TV linkage system 100b takes measures to reduce delays between the TV 10 and the LE-Audio terminal. In the example of Fig. 5, smart speakers 50a and 50b are illustrated as the LE-Audio terminals.

[0059] When audio, such as when receiving a TV broadcast, is wirelessly transmitted via broadcast or multicast, audio may be output simultaneously from multiple smart speakers 50a, 50b. If the timing of these audio outputs differs significantly, the audio may become difficult to hear. Therefore, the delay time from signal reception to audio output at each LE-Audio terminal is managed to adjust the video display and audio output timing on the TV 10. More specifically, one method involves combining wireless communication via broadcast or multicast with communication with individual devices.

[0060] The flow of delay countermeasure processing between the TV 10 and the LE-Audio terminal will be described with reference to Fig. 6. Fig. 6 is a sequence diagram showing the flow of processing in the third embodiment.

[0061] The TV 10 multicasts an audio signal (S101), and measures the time elapsed from that time (t1) using the timer 11c (S102).

[0062] Each of the smart speakers 50a and 50b receives the multicast signal and plays (outputs) audio (S103).

[0063] The microphone 21 of the TV 10 collects the sounds V2a and V2b played by the smart speakers 50a and 50b (S104). The controller 11 measures the times t2a and t2b at which the sounds V2a and V2b are collected, respectively, using the timer 11c, and calculates the time difference Δt1 between the times t2a and t2b.

[0064] The time difference Δt1 is a predetermined value t thIf the delay time is greater than the predetermined delay time, the smart speaker 50a specifies the destination of the information by specifying the MAC address when transmitting by multicast or by identifying the destination using additional information, and then transmits the playback delay time information (S105). Based on the received playback delay time information, the smart speaker 50a delays the time from receiving the multicast signal to outputting the audio by Δt1. Therefore, Δt1 corresponds to the playback delay time. More specifically, for example, the smart speaker 50a uses a memory to adjust the delay time by Δt1 from receiving the multicast signal to outputting the audio signal obtained as audio (S106).

[0065] Next, the TV 10 multicasts the audio signal again (S107), and measures the time elapsed from that time (t3) using the timer 11c (S108).

[0066] Each of the smart speakers 50a and 50b receives the multicast signal and plays (outputs) audio (S109).

[0067] The microphone 21 of the TV 10 collects the sounds V2a and V2b played by each smart speaker 50a and 50b, and the controller 11 measures the times t4a and t4b at which the sounds V2a and V2b are collected using the timer 11c, and calculates the time difference Δt2 between the times t4a and t4b (S110).

[0068] Here, Δt2 is a predetermined time t th If it is equal to or less than this, the delay time difference adjustment process ends.

[0069] On the other hand, Δt2 is the time thIf the delay time Δt1 is greater than the threshold, smart speaker 50a is controlled using the same procedure as described above to reset the playback delay time Δt1 set above to 0, and smart speaker 50b is controlled using the same method as described above, starting with S101, to delay the time from receiving the multicast signal to outputting the audio by Δt1. Then, the audio signal is multicast again, and each smart speaker 50a, 50b receives the multicast signal and collects the audio V2a, V2b played back, measuring the times t2a, t2b at which the audio was collected, and calculating the time difference Δt1 between times t2a, t2b. Using the method described above, the timing of the audio output from each smart speaker can be adjusted.

[0070] In addition, if the delay time until the video is displayed due to the video signal processing of TV10 is longer than the delay time until the audio is output from smart speakers 50a and 50b, the timing of wireless transmission by broadcast or multicast and the delay time of audio output may be determined so that the timing of video display and the timing of audio output from smart speakers 50a and 50b roughly coincide.

[0071] Furthermore, it is also possible to configure the TV 10 so that audio from each speaker is acquired by the microphone 21 built into the TV and the delay time is calibrated. This reduces the calculation load on the TV 10 and saves hardware resources, as it is only necessary to delay the display of the video signal by the time calibrated in step S105 when a multicast signal is transmitted, without having to perform the processes of steps S101 to S109 every time.

[0072] Furthermore, the delay time may change depending on the wireless communication conditions. In this case, the change in the delay time can be detected by the microphone 21 and the delay time can be corrected. For example, if a change in the delay time until audio is output from the smart speakers 50a and 50b is detected, the TV 10 can send a signal to the smart speakers 50a and 50b using the method described above to change the delay time from audio signal reception to output, or the timing deviation can be corrected by temporarily suspending and then resuming transmission of the multicast or broadcast signal.

[0073] <Fourth embodiment> The fourth embodiment is an embodiment in which the TV 10 in the TV linkage system 100 according to the first embodiment receives and plays back a multicast signal.

[0074] 7 is an explanatory diagram showing an overview of a TV linkage system 100c according to a fourth embodiment. When a smartphone 51 receives an incoming call, the call audio is wirelessly transmitted by multicast or broadcast and received by the TV 10. The TV 10 is set in advance to receive a multicast signal from a specific smartphone 51.

[0075] As a result, for example, when the smartphone 51 starts transmitting call audio via multicast, the TV 10 receives this and outputs the transmitted audio from the built-in speaker 20. At this time, if, for example, a broadcast is being received, the audio may be mixed and output as appropriate, or the audio of the received broadcast may be muted.

[0076] Furthermore, the call status display 61 of the smartphone 51 on the screen of the display 13 may display the device name of the smartphone 51, "Mx Phone," and the text "In call" indicating the status, thereby making it possible to determine the call status of the LE-Audio terminal connected to the TV 10 via wireless communication.

[0077] According to this embodiment, the user does not need to perform the switching operation required for one-to-one communication between devices, and calls can be made using the built-in speaker 20 of the TV 10, improving convenience and functionality.

[0078] Fifth Embodiment The fifth embodiment is an embodiment in which a two-way conversation is carried out between the TV 10 of the TV linkage system 100 according to the first embodiment and each of the audio signal receiving devices connected to the TV 10.

[0079] Fig. 8 is an explanatory diagram showing an overview of a TV-linked system 100d according to a fifth embodiment. Fig. 9 is also an explanatory diagram showing an overview of a TV-linked system 100e according to a fifth embodiment, but differs from the example in Fig. 8 in that two-way communication is also performed between smart speakers 50a and 50b.

[0080] 8 and 9 are diagrams showing a state in which smart speakers 50a and 50b each having a built-in microphone and a TV 10 are performing two-way multicast communication with each other.

[0081] In FIG. 8, the TV 10 and smart speaker 50a, and the TV 10 and smart speaker 50b are wirelessly connected. Through multicast communication from the TV 10, the voices of the call partners using the smart speakers 50a and 50b are output from the speakers of the TV 10. The TV 10 also relays the voice input from the smart speaker 50a to the smart speaker 50b, and relays the voice input from the smart speaker 50b to the smart speaker 50a. This enables three-way calls using the TV 10, the smart speakers 50a, and 50b, and can be used as an intercom.

[0082] 9, the smart speaker 50a and the smart speaker 50b are also wirelessly connected to each other. This allows conversation between the smart speakers 50a and 50b without going through the TV 10.

[0083] According to this embodiment, there is no need to install a central server to perform audio mixing or switching, and three or more parties can participate, and participants can freely join and leave the call. Intercom calls using multicast or broadcast can be made not only between the TV 10 and the smart speakers 50a and 50b, but also between TVs 10 equipped with microphones 21 or a smartphone 51.

[0084] Furthermore, the localization of the voice may be controlled to change depending on the other party.

[0085] For example, if there are multiple callers, the TV 10 controls the positioning and outputs the audio so that the first caller sounds from the center, the second from the right, and the third caller from the left. This makes it easier to identify the voices of the callers. The caller's LE-Audio terminal can be identified using a MAC address or the like by pairing them in advance. Alternatively, they may be identified using a device name included in the additional information of the multicast transmission signal.

[0086] The localization of each LE-Audio device can also be fixed to a preset position. For example, you can set it so that the sound from the smart speaker in the kitchen comes from the left, and the sound from the TV in the children's room comes from the right.

[0087] Furthermore, multiple Bluetooth antennas may be provided, and the direction of the caller may be determined using a direction detection function, and the audio localization may be set to correspond to that direction. Audio localization can be set not only by simply splitting the audio between left and right, but also over a wider range using surround sound or virtual surround sound, etc.

[0088] Sixth Embodiment The sixth embodiment is an embodiment in which a setting screen for each LE-Audio terminal is displayed on the display 13 of the TV 10 in the TV linkage system 100 according to the first embodiment, and a setting operation is accepted.

[0089] FIG. 10 is an explanatory diagram showing an overview of a TV linkage system 100f according to the sixth embodiment.

[0090] Bluetooth devices such as the smart speaker 50a often do not have an interface for performing complex operations or settings. Therefore, in order to select multicast or broadcast signals, a Bluetooth device setting screen 131 is displayed on the TV 10 as shown in Fig. 10, and the Bluetooth device can be set by operating the remote control 30 or the like.

[0091] The setting screen 131 may be configured to display a list of connected Bluetooth devices, select a device to be set, select the priority of multicast or broadcast audio to be output by the selected device, set whether to allow reception for each transmitting device, or select a language to prioritize in the case of multilingual audio. In addition, for battery-operated devices, the battery charge status may be displayed.

[0092] The setting screen 131 shows the setting contents of the smart speaker 50a connected to the TV 10, and the setting contents of the device name “Speaker Mx” are as follows: - (The audio language played) Japanese is prioritized Receive multicast or broadcast signals from "MaxTV-55A" -Do not receive multicast or broadcast signals from "MxPhone" This shows that whether or not to receive a signal from "MaxTV-55A" is changed by operating the remote control 30.

[0093] According to this embodiment, even if the LE-Audio terminal does not have a comprehensive UI such as a setting screen, it is possible to easily perform settings for each LE-Audio terminal using the TV 10.

[0094] In this embodiment, an LE-Audio terminal such as a smart speaker may store supplementary information (such as the name of the transmitting device and the audio type) of multicast or broadcast signals received in the past as a reception history, and transmit a list of this information to the TV 10. The TV 10 sets reception availability and priority based on the received list information, and transmits the setting contents from the TV 10 to the LE-Audio terminal, thereby realizing the desired settings.

[0095] In addition, to improve operability, these setting operations may be configured so that when the TV 10 is not transmitting or receiving broadcast or multicast signals, the TV 10 reads the connection history stored in the storage area 14b and displays a list of Bluetooth devices connected to the TV 10 on the setting screen 131 for setting.

[0096] Seventh Embodiment The seventh embodiment is an embodiment in which each LE-Audio terminal sets whether or not communication with a new LE-Audio terminal is possible, using the display 13 of the TV 10 in the TV linkage system 100 according to the first embodiment.

[0097] FIG. 11 is an explanatory diagram showing an overview of a TV linkage system 100g according to the seventh embodiment.

[0098] In the embodiment of FIG. 11, a case will be described in which a device receives a new, unconfigured multicast signal.

[0099] The smartphone 51 detects new broadcast communication from the smart speaker 50a, which is an unknown Bluetooth device, and notifies the paired TV 10 of this fact. This notification may be one-to-one communication, or may be broadcast or multicast.

[0100] The TV 10 receives this notification and displays on the display 13 a new device notification 64 notifying that the smartphone 51 has detected a new broadcast communication, and a playback necessity button 65.

[0101] The new device notification 64 includes the name of the device that received the broadcast from the new device, "MxPhone," and the text "There is a broadcast" that indicates the status.

[0102] The playback necessity button 65 displays a setting option for whether or not to play back the broadcast signal received by the "MxPhone."

[0103] When the user makes a selection using the remote control 30, the TV 10 sends a necessary setting instruction to the smartphone 51 in accordance with the selection result, for example, a control signal to the smartphone 51 to relay the audio signal of the smart speaker 50 and transmit it to the TV 10, or a control signal to the smartphone 51 not to relay the audio signal of the smart speaker 50. This transmission may be performed by multicast or broadcast from the TV 10. An LE-Audio terminal that receives a multicast signal from the TV 10 interprets, for example, the Mac address included in the control signal, and discards the received control signal if it is not a control signal intended for the terminal itself.

[0104] According to this embodiment, the user can perform a setting operation on the screen of the TV 10 to allow or disallow each LE-Audio terminal to communicate with a new LE-Audio terminal.

[0105] Also, it is possible to display only a small indicator for a short time, and set the name of the broadcasting device and whether or not it is possible to receive the broadcasting device by operating a separate menu, etc., so as not to interfere with the display of content on the TV 10.

[0106] The indicator may be displayed on the screen, or may be notified by an LED or the like outside the screen.

[0107] The above describes the case where the Bluetooth device is a smartphone 51, but when setting up a device that does not have an advanced UI, such as a smart speaker 50 or wireless earphones 81, convenience is improved in that easy-to-understand operation is possible using the TV 10 screen.

[0108] Even when setting up the smartphone 51, the setting can be completed using only the TV screen being watched and the remote control 30, which is very convenient.

[0109] Eighth Embodiment The eighth embodiment is an embodiment in which an exhibition mode suitable for in-store demonstrations is implemented in the TV 10 of the TV linkage system 100 according to the first embodiment.

[0110] FIG. 12 is an explanatory diagram showing an overview of a TV linkage system 100h according to the eighth embodiment.

[0111] Many TVs have a display mode as a function for displaying in stores. Therefore, when operating the TV10 of the TV Linkage System 100h in display mode, it is desirable to pair it with the LE-Audio device carried by the customer and set it up to receive multicast signals so that actual operation can be confirmed.

[0112] However, if another customer attempts to test the LE-Audio terminal-related functions of this embodiment after a connection has been made, it is not desirable for the LE-Audio terminal of the customer who tested the function immediately before to be connected and for the audio to be output from the LE-Audio terminal of the customer who tested the function immediately before.

[0113] To prevent the above-described behavior, the pairing settings of the TV 10 are limited to a small number in exhibition mode. When the TV 10 is paired with a new LE-Audio terminal 51 in exhibition mode, the previous settings are discarded, and multicast transmissions are not received by the previously paired LE-Audio terminal 52. More specifically, for example, the TV 10 can be configured to be able to set at least two multicast groups, and when pairing with a new LE-Audio terminal in exhibition mode, communication can be performed using a multicast group different from the multicast group previously paired. In this case, by discarding the settings of the multicast group used for the initial communication, it is possible to prevent the TV 10 from reconnecting to a device that was previously connected.

[0114] The number of devices that can be paired in the exhibition mode may be limited to one.

[0115] Ninth Embodiment In the ninth embodiment, in the TV 10 of the TV linkage system 100 according to the first embodiment, the screen of the display 13 is divided to simultaneously display multiple broadcast programs, and the audio signals of the multiple broadcasts are multicast, and one of them is selected and output as audio on the LE-Audio terminal side. Audio channel name information is added to each of the audio signals of the multiple broadcasts.

[0116] FIG. 13 is an explanatory diagram showing an overview of a TV linkage system 100i according to the ninth embodiment.

[0117] The TV 10 displays two broadcast programs on channels 1 and 2. Audio output from the built-in speaker 20 of the TV 10 is stopped, and the audio signals of channels 1 and 2 are multicast.

[0118] Each of the wireless earphones 81 and 82 receives audio signals of both channels 1 and 2. Then, the wireless earphone 81 outputs the audio of channel 1, and the wireless earphone 82 outputs the audio of channel 2.

[0119] According to this embodiment, even if there are multiple programs that you want to watch on one TV 10, you can select the audio to watch on the wireless earphones 81 and 82, so you can watch multiple programs on one TV 10 at the same time.

[0120] Tenth Embodiment The tenth embodiment is an embodiment in which the TV 10 of the TV linkage system 100 according to the first embodiment synthesizes specific position audio signals that can be heard at multiple audio playback positions from a 3D sound source, and multicasts or broadcasts the multiple specific position audio signals.

[0121] FIG. 14 is an explanatory diagram showing an overview of a TV linkage system 100j according to the tenth embodiment.

[0122] The TV linkage system 100j records an orchestral performance using a 3D sound source, and synthesizes three types of audio signals on the TV 10, each representing a tone that can be heard by Audiences 1, 2, and 3, who are assumed to be in different seats. The 3D sound source generates a sound source signal for each instrument, and adds the position and orientation of the sound source to the audio signal as metadata. The sound source signals are then synthesized according to the positions of Audiences 1, 2, and 3, to generate a specific position audio signal that reproduces the tone that can be heard at each position.

[0123] The TV 10 multicasts or broadcasts three types of specific location audio signals.

[0124] The wireless earphones 81 and 82 output audio signals for the audiences 1 and 3.

[0125] FIG. 15 is an explanatory diagram showing an overview of a TV linkage system 100k according to the tenth embodiment.

[0126] In the TV linkage system 100k, a TV 10 and a PC 110 (for example, a gaming PC equipped with a GPU) are connected via HDMI, and the TV 10 is used as a monitor for the PC 110.

[0127] Video and audio signals of e-sports and live game commentary are sent from the PC 110 to the TV 10. Assume that these audio signals are also generated by a 3D sound source.

[0128] The TV 10 or PC 110 synthesizes and multicasts or broadcasts the audio signals heard at the positions of Player 1 and Player 2, who appear in the same scene. In Figure 15, the positions of Player 1 and Player 2 and the Monster are different, and the body orientations of Player 1 and Player 2 are different, so the volume and direction of the monster's footsteps sneaking up from behind are different between Channels 1 and 2. Therefore, by selecting Player 1 or Player 2 as the player they wish to experience, users wearing wireless earphones 81 and 82 can hear audio from different specific positions, even when multiple people are playing a game, allowing each user to hear more immersion in the game.

[0129] According to this embodiment, a sound source signal collected by a 3D sound source is added to one video signal, and audio signals having different positions and localizations are synthesized and multicast or broadcast on the TV 10 or the PC 110. This allows multiple users to watch the same video while listening to audio from different positions in the same video.

[0130] In addition, in the TV linkage system 100k, the TV 10 is used as a monitor of the PC 110, but the same effects can be achieved even if a display for a PC that does not have a TV tuner 12 is used as the TV 10. In this case, a multicast or broadcast function may be implemented in the PC 110.

[0131] Furthermore, in each of the above embodiments, if it is necessary to receive broadcasts, connecting a monitor and a microphone to the PC 110 equipped with a television tuner can achieve the same effects as in each of the embodiments using the TV 10.

[0132] FIG. 16 is a sequence diagram showing the flow of processing in the TV linkage system 100 according to each of the above embodiments.

[0133] In the TV linkage system 100, an LE-Audio terminal, for example, a smartphone 51 multicasts or broadcasts a beacon signal (S1), and the TV 10 receives the beacon signal.

[0134] The TV 10 displays the setting screen 130, receives input information according to the setting screen (S2), and transmits the input information (S3). The LE-Audio terminal sets the type of audio to be played based on the transmitted input information (S4). In this state, the LE-Audio terminal is on standby.

[0135] When the TV 10 receives the broadcast signal and starts displaying the broadcast program (S5), the Bluetooth communicator 18 multicasts or broadcasts a plurality of audio signals of the broadcast program (S6: transmission step).

[0136] The LE-Audio terminal receives and plays back the multicast or broadcast audio signal (S7: receiving step and playing step).

[0137] When the TV 10 receives the broadcast signal and starts displaying the broadcast program (S5), the Bluetooth communicator 18 multicasts or broadcasts a plurality of audio signals of the broadcast program (S6).

[0138] When the LE-Audio terminal receives a call (S8), it multicasts or broadcasts the call audio (S9), which is received by the TV 10, which outputs the call audio, displays the status, and accepts audio input from the microphone 21 (S10). The TV 10 multicasts or broadcasts the audio input from the microphone 21 (S11), and transmits the audio from the LE-Audio terminal to the call recipient (S12).

[0139] Although not shown in FIG. 16, the TV 10 is also connected to home IoT devices 191, 192, and 193, and transfers signals from the home IoT devices 191, 192, and 193 to the LE-Audio terminal.

[0140] Although the present embodiment has been described above, it goes without saying that the configuration for realizing the technology of the present invention is not limited to the above embodiment, and various modifications are possible. For example, it is possible to replace part of the configuration of one embodiment with the configuration of another embodiment, or to add the configuration of another embodiment to the configuration of one embodiment. All of these fall within the scope of the present invention. Furthermore, numerical values, messages, etc. appearing in the text and figures are merely examples, and the effects of the present invention will not be impaired even if different ones are used.

[0141] For example, in each of the above embodiments, the TV 10 can also set transmission conditions for multicast or broadcast signals. It may be controlled so that transmission begins when it receives a Bluetooth beacon and confirms the presence of a registered device, and not transmit multicast or broadcast signals when no registered device exists (when Bluetooth communication is not in progress). By suppressing unnecessary transmission, it is possible to reduce power consumption and suppress radio wave interference of Bluetooth signals.

[0142] The programs described in each processing example may be independent programs, or multiple programs may constitute a single application program. The order in which each process is performed may also be changed.

[0143] The functions of the present invention described above may be realized in part or in whole by hardware, for example, by designing them as integrated circuits. Alternatively, they may be realized by software, such as by a microcontroller unit interpreting and executing an operating program that realizes each function. Hardware and software may also be used in combination.

[0144] Furthermore, the control lines and information lines shown in the diagram are those considered necessary for explanation, and do not necessarily represent all the control lines and information lines on the product. In reality, it can be assumed that almost all components are interconnected. [Explanation of symbols]

[0145] 10:TV 11: Controller 11a: Processor 11b: Calendar Clock 11c: Timer 12: TV tuner 13: Display 14: Memory 14a: Work area 14b: Storage area 15:HDMI communication device 16:Wired LAN communication device 17:Wireless LAN communication device 18: Bluetooth communication device 19: External device connector 20: Built-in speaker 21: Microphone 30: Remote control 41: Doorbell 50, 50a, 50b: Smart speakers 51: Smartphone 61: Call status display 64:New device notification 65: Playback button 81, 82: Wireless earphones 100, 100a, 100b, 100c, 100d, 100e, 100f, 100g, 100h, 100i, 100j, 100k: TV linked system 130: Settings screen 130a: Registration column 131: Settings screen 190: Home Hub 191, 192, 193: Home IoT devices

Claims

1. A display device that transmits an audio signal directly to an audio signal receiving device by wireless communication without going through a relay device, A wireless communication device; The display and a controller that controls the wireless communication device and the display; Equipped with the wireless communication device transmits a plurality of types of audio signals by multicast or broadcast wireless communication; each of the plurality of types of audio signals is added with supplementary information indicating at least the type of the audio signal; The supplementary information includes at least one of information regarding the types of languages ​​included in the multilingual broadcast signal and their priority order, information regarding the channel names of multiple broadcast programs when they are displayed simultaneously, and information indicating the audio playback position when a 3D sound source is used. A display device characterized by:

2. The display device according to claim 1 , the controller is configured to be able to set the priority based on user input; A display device characterized by:

3. The display device according to claim 1 , the display device is connected to at least one of a doorbell, a home appliance, or a consumer electronics device; The controller displays a notification indicating the content of the detection signal of the doorbell, the detection signal of the household equipment device, or the detection signal of the household appliance on the display; The wireless communication device transmits the detection signal of the doorbell, the detection signal of the household equipment device, or the detection signal of the home appliance by multicast or broadcast wireless communication. A display device characterized by:

4. The display device according to claim 1 , Built-in speaker and a microphone; the controller further controls the built-in speaker and the microphone; an audio signal receiving device that receives the audio signal wirelessly transmitted by multicast or broadcast from the wireless communication device, and the microphone collects the audio that reproduces the audio signal; the controller measures a delay time between the time when the microphone collects the sound and the time when the wireless communication device transmits the sound signal; adjusting the timing of audio output from the built-in speaker based on the delay time so that the timing of outputting the audio signal from the built-in speaker approaches the timing of receiving and reproducing the audio signal by the audio signal receiving device; A display device characterized by:

5. The display device according to claim 4, the controller adjusts a display timing on the display based on the delay time so that the video displayed on the display is synchronized with a timing at which the audio signal receiving device receives and plays the audio signal; A display device characterized by:

6. The display device according to claim 1 , It also has a built-in speaker, the controller further controls the built-in speaker; the wireless communication device performs two-way communication with the audio signal receiving device, and receives an audio signal wirelessly transmitted by multicast or broadcast from the audio signal receiving device; the controller outputs the received audio signal from the built-in speaker, and displays on the display a status indication indicating that the audio signal wirelessly transmitted from the audio signal receiving device is being played back; A display device characterized by:

7. The display device according to claim 1 , Further, an operation member is provided for performing an input operation on the display, the wireless communication device performs two-way communication with the audio signal receiving device; the controller displays on the display a setting screen for setting a type of audio signal to be reproduced by the audio signal receiving device; When input information corresponding to the setting screen is received from the operation member, the wireless communication device transmits the input information to the audio signal receiving device. A display device characterized by:

8. The display device according to claim 1 , the controller displays a plurality of programs side by side on one screen of the display; the wireless communication device transmits the audio signals of the plurality of programs by wireless communication of multicast or broadcast; A display device characterized by:

9. The display device according to claim 1 , the controller synthesizes, for each of a plurality of positions within a display image, a specific position audio signal that can be heard at that position based on information indicating an audio playback position when the 3D sound source is used; The wireless communication device transmits the synthesized plurality of specific position audio signals for each of the positions by multicast or broadcast wireless communication. A display device characterized by:

10. A display device linkage system configured by connecting a display device and an audio signal receiving device via wireless communication, The display device includes: a first wireless communication device that transmits an audio signal directly to the audio signal receiving device without going through a relay device; The display and a controller that controls the first wireless communication device and the display; Equipped with The audio signal receiving device includes: a second wireless communication device that directly receives the audio signal from the display device without going through a relay device; an audio player that plays back the audio received by the second wireless communication device; Equipped with the first wireless communication device transmits a plurality of types of audio signals by multicast or broadcast wireless communication; A name of a transmitting device of each of the plurality of types of audio signals and additional information indicating the type of the audio signal are added to each of the plurality of types of audio signals, The supplementary information includes at least one of information regarding the types of languages ​​included in the multilingual broadcast signal and their priority order, information regarding the channel names of multiple broadcast programs when they are displayed simultaneously, and information indicating the audio playback position when a 3D sound source is used; the audio reproducer reproduces a preset type of audio signal from among the plurality of types of audio signals received by the second wireless communication device. A display device linkage system characterized by:

11. An audio reproducing method executed by connecting a display device and an audio signal receiving device via wireless communication, a transmitting step in which the display device transmits a plurality of types of audio signals by multicast or broadcast wireless communication; a receiving step in which the audio signal receiving device receives the plurality of types of audio signals; a reproduction step in which the audio signal receiving device reproduces one of the plurality of types of audio signals; each of the plurality of types of audio signals is added with supplemental information indicating the type of the audio signal; The supplementary information includes at least one of information regarding the types of languages ​​included in the multilingual broadcast signal and their priority order, information regarding the channel names of multiple broadcast programs when they are displayed simultaneously, and information indicating the audio playback position when a 3D sound source is used; In the reproducing step, an audio signal of a type set in advance in the audio signal receiving device is reproduced.

1. An audio playback method comprising:

Images