Indication device

Abstract

Provided is a display device that directly transmits and receives an audio signal through wireless communication between the display device and an audio signal receiver without the use of a relay device as an intermediary, the display device comprising a wireless communication device, a display, and a controller that controls the wireless communication device and the display. The wireless communication device transmits a plurality of types of audio signals through multicast or broadcast wireless communications, and supplementary information indicating at least the type of audio signal is added to each of the plurality of types of audio signals.

Description

Technical Field

[0001] The present invention relates to a display device. Place related.

Background Art

[0002] Digital audio-visual devices such as digital TVs, smartphones, tablet terminals, and Bluetooth (registered trademark) speakers are widely used. For cooperation between these devices, wireless communications such as WiFi (registered trademark) and Bluetooth (registered trademark) are used, and the freedom of audio signal transmission has been enhanced.

[0003] For example, Patent Document 1 discloses that "a wireless transmission system includes a wireless source device that wirelessly transmits AV content and a plurality of sink devices that reproduce the wirelessly transmitted AV content. When the group identification ID of the bridge device is added to the control command wirelessly transmitted from the wireless source device as the representative wireless sink device, the bridge device receives the control command and mutually converts the wireless control command communicated with the wireless source device and the wired control command communicated with the sink device, and communicates with other sink devices in the group. Further, on behalf of the group to which the representative wireless sink device belongs, it performs wireless communication with the wireless source device and the representative wireless sink devices of other groups. (Abstract excerpt)".

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] Traditionally, many audio transmission technologies have relied on one-to-one communication via Bluetooth® or Wi-Fi®, and have not been used to transmit audio to multiple devices simultaneously and efficiently. Consequently, when multiple people are viewing a single display device such as a television, it has not been possible for each person to simultaneously listen to different audio.

[0006] This invention was made in view of the above circumstances, and is a display device that improves the convenience and functionality when multiple people view the same video. Place The purpose is to provide it. [Means for solving the problem]

[0007] To solve the above problems, the present invention has the configuration described in the claims. For example, a display device that transmits an audio signal directly to an audio signal receiving device via wireless communication without going through a relay device, comprising a wireless communication device, a display, and a controller that controls the wireless communication device and the display, A microphone and a built-in speaker, The wireless communication device includes a plurality of types of voice signals that transmit multiple types of voice signals by multicast or broadcast wireless communication, and each of the plurality of types of voice signals is accompanied by at least supplementary information indicating the type of voice signal. The controller further controls the microphone and the built-in speaker, the wireless communication device communicates bidirectionally with the audio signal receiving device, the microphone collects the audio that the audio signal receiving device receives and reproduces from the wireless communication device via multicast or broadcast, the controller detects the direction of the audio signal receiving device with respect to the display device based on the audio collected by the microphone, and controls the localization of the audio when outputting the audio received from the audio signal receiving device through the built-in speaker. It is characterized by the following: [Effects of the Invention]

[0008] According to the present invention, it is possible to provide a display device that improves convenience and functionality when multiple people view the same video. Other objectives, configurations, and effects will be revealed in the following embodiments. [Brief explanation of the drawing]

[0009] [Figure 1] A functional block diagram of the TV according to this embodiment. [Figure 2] An explanatory diagram showing an overview of the TV linkage system according to the first embodiment. [Figure 3]A diagram showing an example of the UI of a TV that serves as a multicast or broadcast source. [Figure 4] An explanatory diagram showing the outline of the TV cooperation system according to the second embodiment. [Figure 5] An explanatory diagram showing the outline of the TV cooperation system according to the third embodiment. [Figure 6] A sequence diagram showing the flow of processing in the third embodiment. [Figure 7] An explanatory diagram showing the outline of the TV cooperation system according to the fourth embodiment. [Figure 8] An explanatory diagram showing the outline of the TV cooperation system according to the fifth embodiment. [Figure 9] An explanatory diagram showing the outline of the TV cooperation system according to the fifth embodiment. [Figure 10] An explanatory diagram showing the outline of the TV cooperation system according to the sixth embodiment. [Figure 11] An explanatory diagram showing the outline of the TV cooperation system according to the seventh embodiment. [Figure 12] An explanatory diagram showing the outline of the TV cooperation system according to the eighth embodiment. [Figure 13] An explanatory diagram showing the outline of the TV cooperation system according to the ninth embodiment. [Figure 14] An explanatory diagram showing the outline of the TV cooperation system according to the tenth embodiment. [Figure 15] An explanatory diagram showing the outline of the TV cooperation system according to the tenth embodiment. [Figure 16] A sequence diagram showing the flow of processing of the TV cooperation system.

Modes for Carrying Out the Invention

[0010] The present invention contributes to, for example, 8.2 of the Sustainable Development Goals (SDGs) proposed by the United Nations (increasing the productivity of the economy through diversification, technological improvement, and innovation, mainly in industries that can expect diversification and technological improvement, such as labor-intensive industries), because diversification and technological improvement can be expected for labor-intensive industries. Hereinafter, examples of embodiments of the present invention will be described with reference to the drawings. The same components are denoted by the same reference numerals throughout the drawings, and redundant descriptions are omitted.

[0011] HDMI, Bluetooth, and WiFi used in the following description are all registered trademarks.

[0012] FIG. 1 is a functional block diagram of a television device (TV10) which is a display device according to the present embodiment.

[0013] TV10 is configured by connecting a TV tuner 12, a display 13, a memory 14, a video and audio communicator 15, a wired LAN communicator 16, a wireless LAN communicator 17, a Bluetooth communicator 18 (corresponding to a first wireless communicator), an external device connector 19, a built-in speaker 20, and a microphone 21 to a controller 11.

[0014] The controller 11 includes a processor 11a that controls the entire TV10 according to a predetermined program, a calendar clock 11b, and a timer 11c, and is capable of controlling the timing of audio output and video display.

[0015] The memory 14 includes a work area 14a that temporarily holds data as needed when executing a basic operation program, other application programs, and various application programs, and a storage area 14b that holds information stored even when power is not supplied, such as various setting values, various programs, and moving image data.

[0016] The work area 14a is, for example, a RAM (Rand oVolatile memory such as m-access memory is used.

[0017] Storage area 14b may utilize non-volatile storage devices such as flash ROM, SSD (Solid State Drive), or HDD (Hard Disk Drive).

[0018] TV10 can have its functionality expanded by downloading new application programs from the application server via the internet. The downloaded new application programs are stored in the storage area 14b. The controller 11 then deploys the new application programs stored in the storage area 14b to the work area 14a, and by executing these deployed new application programs, TV10 can implement a variety of new functions.

[0019] The display 13 is a display device such as an LCD panel or an OLED display, and displays images and the like that which are received by the TV tuner 12 from broadcast radio waves received from the antenna and processed by the TV tuner 12.

[0020] The TV tuner 12 consists of a terrestrial digital tuner, a BS / CS digital tuner, an OFDM demodulation unit, an MPEG decoder, and the like.

[0021] TV10 has the function of selecting one audio track to output through the speaker or outputting two languages ​​simultaneously by processing the multilingual broadcasts, such as two-language broadcasts, received by the TV tuner 12 using the processor 11a. It also has the function of outputting multiple broadcast programs simultaneously.

[0022] The video and audio communication device 15 is connected on a one-to-one basis to an external device. "External device" here refers to a device that transmits or receives uncompressed video signals to the TV 10, for example, via HDMI, and can be of any type, including personal computers (including gaming PCs, as described later), projectors, and home theater equipment.

[0023] The wireless LAN communication device 17 can send and receive data with wireless communication devices such as smartphones 51 and tablets, and can also connect to the internet through an access point.

[0024] The wired LAN communication device 16 connects to the internet via a home gateway and sends and receives data to and from the server. The wired LAN communication device 16 is also connected to an STB (Set Top Box) and receives broadcast signals from the STB, such as cable broadcasting, satellite broadcasting, terrestrial television broadcasting, and IP broadcasting (broadband, VOD, etc.).

[0025] The Bluetooth communicator 18 communicates via Bluetooth with Bluetooth-enabled audio signal receiving devices (Bluetooth terminals) such as smartphones 51, tablets, Bluetooth speakers, and wireless earphones. Multiple antennas enable diversity and detection of the direction of incoming radio waves.

[0026] The Bluetooth communicator 18 supports multicast and broadcast protocols and wirelessly transmits and receives multicast voice (two-way communication) and broadcast voice. It also receives signals from multiple Bluetooth terminals. In this embodiment, Bluetooth Low Energy is used as a communication method that enables simultaneous Bluetooth communication between the TV 10 and multiple Bluetooth terminals.

[0027] Broadcasting does not require prior pairing and is easy to use. On the other hand, multicasting requires prior registration of audio signal receiving devices, making it less convenient than broadcasting, but it offers higher security and privacy.

[0028] By using multicast or broadcast for voice communication, one-to-many and many-to-many communication can be performed efficiently, reducing the power consumption and radio bandwidth used compared to one-to-one communication. The following explanation uses multicast as an example, but similar effects can be achieved by substituting broadcast.

[0029] The external device connector 19 exchanges signals with devices such as the home hub 190 (see Figure 4). A separate wired connection is acceptable, but a network connection using the wireless LAN communication device 17 or a shared Bluetooth communication device 18 may also be used.

[0030] The built-in speaker 20 outputs sound from the TV 10.

[0031] The microphone 21 can pick up external audio on the TV 10. This enables voice control and calls over the internet.

[0032] When the remote control 30 receives an operation input from the user, it transmits the input information to the TV 10. This allows the user to remotely control the TV 10. The remote control 30 is an example of an operating component.

[0033] <First Embodiment> The first embodiment relates to a TV-linked system 100 in which a TV 10 transmits multiple types of audio signals via multicast or broadcast, and each of the multiple audio signal receiving devices individually selects one of the multiple types of audio signals to output as audio. In this embodiment, Bluetooth Low Energy is used as the wireless communication standard between the TV 10 and the audio signal receiving devices. Therefore, "audio signal receiving devices" will be referred to as LE-Audio terminals below. As specific examples of LE-Audio terminals in the embodiments described later, smart speakers 50, 50a, 50b, smartphones 51, tablets, and wireless earphones 81, 82 are given, but any device capable of wireless communication and audio playback using the Bluetooth Low Energy standard is acceptable, regardless of type, such as wireless headphones or game consoles.

[0034] Figure 2 is an explanatory diagram showing an overview of the processing of the TV linkage system 100 according to the first embodiment.

[0035] The TV-linked system 100 is a system that transmits and receives audio signals directly between the TV 10, the smart speaker 50, and the smartphone 51 via wireless communication, without the need for relay devices.

[0036] TV10 receives broadcast signals for bilingual broadcasts, displays the video on display 13, and outputs audio from the built-in speaker 20. TV10 wirelessly transmits the Japanese audio signal and the English audio signal via multicast or broadcast, respectively.

[0037] The multicast or broadcast signal wirelessly transmitted from TV10 via multicast or broadcast includes the audio signal of the broadcast played back on TV10. Furthermore, the multicast or broadcast signal is accompanied by the name of the transmitting device, "Living TV," and additional information indicating the language included in the multilingual broadcast signal, such as "Japanese" or "English."

[0038] TV10 can also transmit a signal with the same content as a multicast signal via broadcast. In this case, regardless of the TV10's settings, audio output is possible if the audio signal receiving device can receive the broadcast signal, depending on its selection. For the sake of explanation, the following explanation assumes that TV10 transmits a multicast signal, but the same effect can be achieved by substituting "broadcast signal" for "multicast signal" in the following explanation.

[0039] TV10 encodes (encrypts) the multicast signal before transmitting it, so that only LE-Audio terminals that can receive it are authorized to do so.

[0040] For example, smart speaker 50 is pre-configured to prioritize outputting Japanese voice. When smart speaker 50 receives a multicast signal from TV 10, it selects the Japanese voice signal from the multicast signal and plays the voice. On the other hand, smartphone 51 is configured to output English voice, and when it receives a multicast signal from TV 10, it selects the English voice signal from the multicast signal and plays the voice.

[0041] In this way, TV10 transmits multiple audio signals simultaneously in the case of multilingual and multichannel audio. The LE-Audio terminal refers to the supplementary information and appropriately selects the necessary audio signals to play (output) the audio. The supplementary information may include the channel names of the multichannel audio (front right, front left, center, rear right, rear left), etc. This makes it possible to play, for example, 5.1 channel surround sound using multiple Bluetooth speakers.

[0042] As described above, TV10 wirelessly transmits multiple types of audio signals via multicast, and LE-Audio terminals can select the necessary audio signals from the multicast signals as needed, thereby outputting the desired audio for each different LE-Audio terminal.

[0043] (TV10 settings UI) Figure 3 shows an example of the UI of TV10, which is a multicast or broadcast source.

[0044] The TV10 controller 11 displays a setting screen 130 on the display 13 to set the TV10's set name (corresponding to the transmitting device name). The setting screen 130 includes a registration field 130a for registering the name of the TV10. The user uses the remote control 30 to set the TV10's set name, such as "Living Room TV" or "Bedroom TV". The setting operation can also be performed using menu operations or text input operations with the remote control 30.

[0045] The set name of TV10 is appended to the multicast signal as the transmitting device name. This allows an LE-Audio terminal receiving a multicast signal to identify which transmitting device sent the audio signal, even when receiving multicast signals from multiple TVs, making signal selection easier on the LE-Audio terminal.

[0046] <Second Embodiment> The second embodiment is the TV linkage system 10 according to the first embodiment. 0 This is an embodiment in which the gateway function for the LE-Audio terminal is implemented in TV10.

[0047] Figure 4 is an explanatory diagram showing an overview of the TV linkage system 100a according to the second embodiment.

[0048] In Figure 4, a doorbell 41 installed at the entrance is connected to the external device connector 19 of the TV 10 by wire or wirelessly. When the TV 10 receives a signal from the doorbell 41, it creates a corresponding audio signal and wirelessly transmits it to the LE-Audio terminal via multicast. At the same time, the TV 10 may output this audio from its built-in speaker 20.

[0049] In this case, the audio signal could be a bell sound like a doorbell, such as "ding-dong," or it could be a synthesized or recorded voice saying something like "You have a visitor."

[0050] The external device connector 19 may be connected directly to the doorbell by wire or wireless connection, or it may be connected via the home hub 190.

[0051] In Figure 4, home IoT devices 191, 192, and 193 are further connected to the TV 10 via the home hub 190. The TV 10 may multicast the signals acquired from home IoT devices 191, 192, and 193 via the home hub 190 to an LE-Audio terminal, such as a smart speaker 50 or a smartphone 51. Home IoT device 191 is a window lock, home IoT device 192 is a front door lock, and home IoT device 193 is a front door light. Window locks and front door locks are examples of residential equipment, and the front door light is an example of a home appliance.

[0052] Multicast signals include notifications of the locking status, and signals that connect to doorbell buttons, etc., to send bidirectional signals when there is a visitor. In the above description, if the smart speaker 50 or smartphone 51 was outputting audio from a TV program when it received a multicast signal from the home hub 190, etc., it may, for example, lower the volume of the TV program's audio or temporarily stop the output to make the audio output from the multicast signal input from the home hub 190, etc., easier to hear.

[0053] Furthermore, when the TV 10 is operated at night to turn off its power, the home hub 190 can be configured to check the locking status and send an alert voice message if the door is unlocked. In this case, a message may also be displayed on the screen of the display 13 at the same time.

[0054] On the other hand, when a user inputs a command to lock or turn off a door or light via voice from an LE-Audio terminal, the LE-Audio terminal sends an audio signal to the TV10, which performs voice analysis and converts the audio signal into control signals for each of the home IoT devices 191, 192, and 193. The TV10 may then send a control signal to one of the home IoT devices 191, 192, or 193 via the home hub 190 to lock the doors and windows and turn off lights such as the porch light. In this case, confirmation voice messages such as "Locking" or "Porch light turned off" are transmitted via multicast broadcast.

[0055] According to this embodiment, the user can use the TV 10 and LE-Audio terminal to send control signals to any of the home IoT devices 191, 192, or 193 located in a remote location indoors, thereby enabling actions such as locking doors and windows and turning off lights such as porch lights.

[0056] <Third Embodiment> The third embodiment is the TV linkage system 10 according to the first embodiment. 0 In TV10, this embodiment adjusts and synchronizes the audio output from an audio signal receiving device connected to TV10 with the audio output timing and video display timing from TV10.

[0057] Figure 5 is an explanatory diagram showing an overview of the TV-linked system 100b according to the third embodiment.

[0058] The TV-linked system 100b implements delay countermeasures between the TV 10 and the LE-Audio terminal. In the example shown in Figure 5, smart speakers 50a and 50b are shown as LE-Audio terminals.

[0059] When transmitting audio wirelessly via broadcast or multicast, such as during TV broadcast reception, audio may be output simultaneously from multiple smart speakers 50a and 50b. If the timing of these audio outputs is significantly different, the audio may become difficult to hear. Therefore, the delay time from signal reception to audio output at each LE-Audio terminal is managed to adjust the timing of video display and audio output on TV10. More specifically, one method is to use a combination of wireless communication via broadcast or multicast and communication with individual devices.

[0060] The delay mitigation process flow between TV10 and LE-Audio terminal will be explained with reference to Figure 6. Figure 6 is a sequence diagram showing the process flow of the third embodiment.

[0061] TV10 multicasts the audio signal (S101) and measures the elapsed time from that time (t1) using timer 11c (S102).

[0062] Each smart speaker 50a and 50b receives a multicast signal and plays (outputs) audio (S103).

[0063] The microphone 21 of TV10 collects the audio V2a and V2b played by each smart speaker 50a and 50b (S104). The controller 11 measures the times t2a and t2b when audio V2a and V2b were collected, respectively, using the timer 11c, and calculates the time difference Δt1 between times t2a and t2b.

[0064] The time difference Δt1 is a predetermined value t thIf the delay is greater, the destination of the information is identified by specifying the MAC address when sending via multicast, or by identifying the destination using supplementary information, and the playback delay time information is sent (S105). Based on the received playback delay time information, the smart speaker 50a delays the time from receiving the multicast signal to outputting the audio by Δt1. Therefore, Δt1 corresponds to the playback delay time. More specifically, for example, the memory of the smart speaker 50a adjusts the time from receiving the multicast signal to outputting the obtained audio signal as audio by delaying it by Δt1 (S106).

[0065] Next, TV10 multicasts the audio signal again (S107), and the elapsed time from that time (t3) is measured by timer 11c (S108).

[0066] Each smart speaker 50a and 50b receives a multicast signal and plays (outputs) audio (S109).

[0067] The microphone 21 of TV10 collects the audio V2a and V2b played by each smart speaker 50a and 50b, and the controller 11 measures the times t4a and t4b when audio V2a and V2b were collected, respectively, using the timer 11c, and calculates the time difference Δt2 between times t4a and t4b (S110).

[0068] Here, Δt2 is a predetermined time t th The delay time difference adjustment process will terminate if the following conditions are met:

[0069] On the other hand, Δt2 is a predetermined time t thIf the volume increases further, the smart speaker 50a is controlled using the same procedure as described above to reset the playback delay time Δt1 set above to 0, and the smart speaker 50b is controlled by performing the process starting from S101 in the same way as above to delay the time from receiving the multicast signal to outputting the audio by Δt1. Then, the audio signal is multicast again, and the audio V2a and V2b played back by each smart speaker 50a and 50b after receiving the multicast signal are collected, the collection times t2a and t2b are measured, and the time difference Δt1 between times t2a and t2b is calculated. The timing of the audio output by each smart speaker can be adjusted using the method described above.

[0070] Furthermore, if the delay time from the video signal processing of TV10 to the display of the video is greater than the delay time from the smart speakers 50a and 50b to the output of sound, the broadcast or multicast wireless transmission timing and the delay time of the sound output may be determined so that the timing of the video display and the timing of the sound output from the smart speakers 50a and 50b roughly coincide.

[0071] Furthermore, it is also possible to configure the TV to acquire audio from each speaker using a built-in microphone 21 and perform delay time calibration. This reduces the computational load on the TV 10 and saves hardware resources, as it only needs to delay the display of the video signal by the amount of time calibrated in step S105 when a multicast signal is transmitted, rather than having to perform the processing from steps S101 to S109 every time.

[0072] Furthermore, the delay time may change depending on the wireless communication conditions. In this case, the microphone 21 can detect the change in delay time and correct the delay time. That is, for example, if it is detected that the delay time from when the smart speakers 50a and 50b output sound has changed, the TV 10 can send a signal to the smart speakers 50a and 50b to change the delay time from when the voice signal is received to when it is output, using the method described above, or the timing discrepancy can be corrected by temporarily interrupting and then resuming the transmission of a multicast or broadcast signal.

[0073] <Fourth Embodiment> The fourth embodiment is the TV linkage system 10 according to the first embodiment. 0 This is an embodiment in which TV10 receives and plays back a multicast signal.

[0074] Figure 7 is an explanatory diagram showing an overview of the TV-linked system 100c according to the fourth embodiment. When a call comes in on the smartphone 51, it wirelessly transmits the call audio via multicast or broadcast, and the TV 10 receives it. The TV 10 is pre-configured to receive multicast signals from a specific smartphone 51.

[0075] As a result, for example, when a call audio is transmitted via multicast from a smartphone 51, the TV 10 receives it and outputs the transmitted audio from its built-in speaker 20. At this time, if, for example, a broadcast is being received, the audio may be mixed and output as appropriate, or the audio from the broadcast may be muted.

[0076] Furthermore, the call status of the smartphone 51 may be determined by displaying the device name of the smartphone 51, "Mx Phone," and the status indicator text, "On Call," on the display 13 screen as a call status indicator 61 for the smartphone 51.

[0077] According to this embodiment, the user does not need to perform the switching operation required when devices communicate one-to-one, and calls can be made using the TV10's built-in speaker 20, improving convenience and functionality.

[0078] <Fifth Embodiment> The fifth embodiment is the TV linkage system 10 according to the first embodiment. 0 This is an embodiment that enables two-way conversation between TV10 and an audio signal receiving device connected to TV10.

[0079] Figure 8 is an explanatory diagram showing an overview of the TV-linked system 100d according to the fifth embodiment. Figure 9 is also an explanatory diagram showing an overview of the TV-linked system 100e according to the fifth embodiment, but it differs from the example in Figure 8 in that it also performs bidirectional communication between the smart speakers 50a and 50b.

[0080] Figures 8 and 9 show the state in which smart speakers 50a and 50b, which have built-in microphones, and TV 10 are communicating bidirectionally with each other via multicast.

[0081] In Figure 8, TV10 and smart speaker 50a, and TV10 and smart speaker 50b are wirelessly connected. Multicast communication from TV10 allows the voice of the person being spoken to using smart speakers 50a and 50b to be output from the speaker of TV10. TV10 also relays the voice input from smart speaker 50a to smart speaker 50b, and the voice input from smart speaker 50b to smart speaker 50a. This enables three-way communication using TV10, smart speakers 50a and 50b, allowing it to be used as an intercom.

[0082] In Figure 9, a wireless connection is also established between smart speaker 50a and smart speaker 50b. This allows for conversation between smart speakers 50a and 50b without going through TV 10.

[0083] According to this embodiment, there is no need to set up a central server to mix or switch audio, and it is possible for three or more parties to participate, and to freely join and leave calls. Multicast or broadcast intercom calls can be made not only with TV10 and smart speakers 50a and 50b, but also with TV10 units equipped with microphones 21 or with smartphones 51.

[0084] Furthermore, the system may be controlled to change the localization of the voice depending on the person being spoken to.

[0085] For example, if there are multiple callers, TV10 controls the sound localization so that the first caller is heard from the center, the second from the right, and the third from the left. This makes it easier to identify the voices of the callers. The LE-Audio terminals that are the callers can be identified using their MAC addresses or other means after prior pairing. Alternatively, they can be identified by the device name included in the supplementary information of the multicast transmission signal.

[0086] Furthermore, the positioning of each LE-Audio device can be fixed to a pre-set location. For example, you can pre-set the audio from the smart speaker in the kitchen to come from the left, and the audio from the TV in the child's room to come from the right.

[0087] Furthermore, the system may be equipped with multiple Bluetooth antennas and use direction detection to determine the direction of the person being spoken to, and the audio localization may be set to correspond to that direction. In addition to simple left / right distribution, audio localization can also be set to a wider range using surround sound or virtual surround sound.

[0088] <Sixth Embodiment> The sixth embodiment is the TV linkage system 10 according to the first embodiment. 0 This embodiment displays the settings screen for each LE-Audio terminal on the TV10's display 13 and accepts setting operations.

[0089] Figure 10 is an explanatory diagram showing an overview of the TV linkage system 100f according to the sixth embodiment.

[0090] Bluetooth devices such as the smart speaker 50a often lack an interface for complex operations and settings. Therefore, in order to select multicast or broadcast signals, the Bluetooth device settings screen 131 is displayed on the TV 10 as shown in Figure 10, and the Bluetooth device settings are configured to be performed using a remote control 30 or the like.

[0091] The settings screen 131 may be configured to display a list of connected Bluetooth devices, allow selection of the device to configure, select the priority of multicast or broadcast audio output by the selected device, set whether each transmitting device can receive audio, or select the preferred language in the case of multilingual audio. In the case of battery-operated devices, the battery charge status may also be displayed.

[0092] Settings screen 131 shows the settings of the smart speaker 50a connected to TV10, and the settings for the device named "Speaker Mx" are as follows: • (The language of the audio to be played will be) Japanese first. • Receive multicast or broadcast signals from "MaxTV-55A" • Does not receive multicast or broadcast signals from "MxPhone" This indicates that the ability to receive signals from "MaxTV-55A" is being changed using the remote control 30.

[0093] According to this embodiment, even LE-Audio terminals that lack a well-developed UI such as a settings screen can be easily configured for each LE-Audio terminal using the TV10.

[0094] In this embodiment, an LE-Audio terminal such as a smart speaker may retain supplementary information (such as the name of the transmitting device and the type of audio) of multicast or broadcast signals it has received in the past as a reception history and send a list of these to the TV10. Based on the information in the received list, the TV10 can determine whether to accept or reject the signals and set priorities, and then send the settings from the TV10 to the LE-Audio terminal to realize the desired settings.

[0095] Furthermore, to improve usability, these settings may be configured so that when no broadcast or multicast signals are being transmitted or received, the TV 10 reads the connection history stored in the storage area 14b and displays a list of Bluetooth devices connected to the TV 10 on the settings screen 131 for configuration.

[0096] <Seventh Embodiment> The seventh embodiment is the TV linkage system 10 according to the first embodiment. 0 This embodiment uses the display 13 of TV10 to allow each LE-Audio terminal to set whether or not to communicate with a new LE-Audio terminal.

[0097] Figure 11 is an explanatory diagram showing an overview of the TV-linked system 100g according to the seventh embodiment.

[0098] The embodiment shown in Figure 11 describes the case where the device receives a new multicast signal that has not yet been set.

[0099] The smartphone 51 detects a new broadcast communication from an unknown Bluetooth device, the smart speaker 50a, and notifies the paired TV 10 of this. This notification may be a one-to-one communication, a broadcast, or a multicast.

[0100] TV10 receives this notification and displays a new device notification 64 on the display 13 indicating that the smartphone 51 has detected a new broadcast communication, along with a playback button 65.

[0101] New device notification 64 includes the name of the device that received the broadcast from the new device, "MxPhone," and the text indicating its status, "There is a broadcast."

[0102] The Playback / Release button 65 displays options for whether or not to play back the broadcast signal received by the "MxPhone".

[0103] When a user makes a selection using the remote control 30, the TV 10 sends instructions to the smartphone 51 for the necessary settings, such as a control signal to the smartphone 51 to relay the audio signal from the smart speaker 50 to the TV 10, or a control signal to the smartphone 51 not to relay the audio signal from the smart speaker 50. This transmission may be made by multicast or broadcast from the TV 10. An LE-Audio terminal that receives a multicast signal from the TV 10 interprets, for example, the MAC address included in the control signal and discards the received control signal if it is not a control signal for itself.

[0104] According to this embodiment, the user can configure each LE-Audio terminal to allow or deny communication with a new LE-Audio terminal on the TV10 screen.

[0105] Alternatively, only a small indicator could be displayed for a short time, and the name of the broadcast device and settings for reception availability could be handled separately through menu operations, so as not to interfere with content display on TV10.

[0106] The indicator may be displayed on the screen, or it may be notified via an LED or other means outside the screen.

[0107] The above explanation described the case where the Bluetooth device is a smartphone 51, but when setting up devices that do not have an advanced UI, such as smart speakers 50 or wireless earphones 81, convenience is improved by enabling easy operation using the TV 10 screen.

[0108] Even when setting up a smartphone 51, the setup can be completed using only the TV screen being viewed and the remote control 30, making it highly convenient.

[0109] <Eighth Embodiment> The eighth embodiment is the TV linkage system 10 according to the first embodiment. 0 This is an embodiment of TV10 that implements a display mode suitable for in-store demonstrations.

[0110] Figure 12 is an explanatory diagram showing an overview of the TV linkage system 100h according to the eighth embodiment.

[0111] TV10 devices often have a display mode for in-store displays. Therefore, when operating the TV10 of the TV-linked system 100h in display mode, it is desirable to pair it with an LE-Audio terminal carried by a customer, configure it to receive multicast signals, and verify its actual operation.

[0112] However, if another customer attempts to test the LE-Audio terminal-related functions according to this embodiment after an initial connection, it is undesirable for the device to connect to the LE-Audio terminal of the customer who tested it immediately before, and for the audio to be output from the LE-Audio terminal of the customer who tested it immediately before.

[0113] To prevent the above-mentioned behavior, in exhibition mode, the pairing settings for TV10 are limited to a small number. When TV10 pairs with a new LE-Audio terminal 51 in exhibition mode, the previous settings are discarded, and even if a multicast transmission is made, it will not be received by the previously paired LE-Audio terminal 52. More specifically, for example, TV10 should be configured to allow the setting of at least two multicast groups, and when pairing with a new LE-Audio terminal in exhibition mode, it should communicate using a multicast group different from the multicast group that was paired immediately before. In this case, by discarding the settings of the multicast group used for the initial communication, it is possible to prevent reconnection with devices that have been connected in the past.

[0114] In display mode, the number of paired devices may be limited to one.

[0115] <Ninth Embodiment> The ninth embodiment is the TV linkage system 10 according to the first embodiment. 0 In this embodiment, the TV 10 divides the screen of the display 13 to simultaneously display multiple broadcast programs, multicasts the audio signals of these multiple broadcasts, and allows the LE-Audio terminal to select one of them for audio output. Audio channel name information is added to each of the audio signals of the multiple broadcasts.

[0116] Figure 13 is an explanatory diagram showing an overview of the TV linkage system 100i according to the ninth embodiment.

[0117] TV10 displays two broadcast programs, channel 1 and channel 2. The TV10's built-in speaker 20 stops outputting audio and multicasts the audio signals for channel 1 and channel 2.

[0118] Wireless earphones 81 and 82 each receive audio signals from channels 1 and 2. Wireless earphone 81 then outputs the audio from channel 1, and wireless earphone 82 outputs the audio from channel 2.

[0119] According to this embodiment, even if there are multiple programs to watch on a single TV 10, the audio can be selected and viewed using the wireless earphones 81 and 82, so multiple programs can be watched on a single TV 10 at the same time.

[0120] <Tenth Embodiment> The tenth embodiment is the TV linkage system 10 according to the first embodiment. 0 In TV10, this embodiment involves synthesizing specific location audio signals heard at multiple audio playback positions from a 3D sound source, and then multicasting or broadcasting the multiple specific location audio signals.

[0121] Figure 14 is an explanatory diagram showing an overview of the TV-linked system 100j according to the 10th embodiment.

[0122] The TV-linked system 100j records the orchestra's performance using 3D sound sources, and TV 10 synthesizes three types of audio signals, each representing the timbre heard by Audience 1, 2, and 3, who are assumed to be in different seats. In the 3D sound source, a sound source signal is generated for each instrument, and the position and localization of the sound source are added to the audio signal as metadata. Then, the sound source signals are synthesized according to the positions of Audience 1, 2, and 3 to generate a specific-position audio signal that reproduces the timbre heard at each position.

[0123] TV10 multicasts or broadcasts three types of location-specific audio signals.

[0124] Wireless earphones 81 and 82 output audio signals to Audience 1 and 3.

[0125] Figure 15 is an explanatory diagram showing an overview of the TV-linked system 100k according to the 10th embodiment.

[0126] The TV-linked system 100k connects TV10 and PC110 (the PC being, for example, a gaming PC equipped with a GPU) via HDMI, and uses TV10 as the monitor for PC110.

[0127] TV10 receives video and audio signals for e-sports and game commentary from PC110. It is assumed that these audio signals are also generated using a 3D sound source.

[0128] TV10 or PC110 synthesizes the audio signals heard at the positions of Player1 and Player2, who appear in the same scene, and multicasts or broadcasts them. In Figure 15, the positions of Player1 and Player2 and the Monster, as well as the orientation of Player1 and Player2's bodies, are different, so the volume and direction of the Monster's footsteps sneaking up from behind differ between channels 1 and 2. Therefore, users wearing wireless earphones 81 and 82 can choose either Player1 or Player2, the player they want to experience, allowing each user to hear different location-specific audio even when multiple people are playing the game, thus increasing immersion in the game.

[0129] According to this embodiment, an audio signal collected by a 3D sound source is added to a single video signal, and the TV 10 or PC 110 synthesizes audio signals with different positions and localizations and broadcasts them via multicast. This allows multiple users to watch the same video while listening to audio from different positions within the same video.

[0130] Furthermore, in the TV-linked system 100k, TV 10 was used as the monitor for PC 110, but the same effect can be achieved by using a PC display without a TV tuner 12 as TV 10. In that case, multicast or broadcast functionality may be implemented in PC 110.

[0131] Furthermore, in each of the above embodiments, if it is necessary to receive a broadcast, connecting a monitor and a microphone to the PC110 equipped with a TV tuner will produce the same effects and advantages as in each embodiment using the TV10.

[0132] Figure 16 is a sequence diagram showing the processing flow of the TV linkage system 100 according to each of the above embodiments.

[0133] In the TV-linked system 100, an LE-Audio terminal, such as a smartphone 51, multicasts or broadcasts a beacon signal (S1), which is received by the TV 10.

[0134] TV10 displays the settings screen 130, receives input information corresponding to the settings screen (S2), and transmits the input information (S3). The LE-Audio terminal sets the type of audio to be played based on the transmitted input information (S4). In this state, the LE-Audio terminal enters standby mode.

[0135] When TV10 receives a broadcast signal and begins displaying the broadcast program (S5), the Bluetooth communicator 18 multicasts or broadcasts multiple audio signals of the broadcast program (S6: transmission step).

[0136] The LE-Audio terminal receives and plays back multicast or broadcast audio signals (S7: receiving step and playback step).

[0137] When TV10 receives a broadcast signal and begins displaying the broadcast program (S5), the Bluetooth communicator 18 multicasts or broadcasts multiple audio signals of the broadcast program (S6).

[0138] When the LE-Audio terminal receives a call (S8), it multicasts or broadcasts the call audio (S9), which is received by the TV10, which outputs the call audio, displays the status, and accepts audio input from the microphone 21 (S10). The TV10 multicasts or broadcasts the audio input from the microphone 21 (S11), and transmits the audio from the LE-Audio terminal to the call destination (S12).

[0139] Although not shown in Figure 16, TV10 is also connected to home hub IoT devices 191, 192, and 193, and transfers signals from home hub IoT devices 191, 192, and 193 to the LE-Audio terminal.

[0140] Although this embodiment has been described above, it goes without saying that the configurations for realizing the technology of the present invention are not limited to the above-described embodiment, and various modifications are conceivable. For example, it is possible to replace a part of the configuration of one embodiment with the configuration of another embodiment, and it is also possible to add the configuration of another embodiment to the configuration of one embodiment. All of these fall within the scope of the present invention. Furthermore, the numbers and messages that appear in the text and figures are merely examples, and using different ones will not impair the effects of the present invention.

[0141] For example, in each of the above embodiments, the TV10 can also set the transmission conditions for multicast or broadcast signals. It may be controlled to start transmission when it receives a Bluetooth beacon and confirms the existence of a registered device, and not transmit multicast or broadcast signals if no registered device exists (not in Bluetooth communication state). By suppressing unnecessary transmissions, power consumption can be reduced and radio interference with Bluetooth signals can be suppressed.

[0142] Furthermore, the programs described in each processing example may be independent programs, or multiple programs may constitute a single application program. The order in which each processing step is executed may also be changed.

[0143] The functions of the present invention described above may be implemented in hardware, either partially or entirely, by designing them, for example, using an integrated circuit. Alternatively, they may be implemented in software by a microcontroller unit or the like interpreting and executing an operating program that implements each of these functions. Hardware and software may also be used in combination.

[0144] Furthermore, the control lines and information lines shown in the diagram are those deemed necessary for explanation and do not necessarily represent all control lines and information lines on the product. In reality, it is reasonable to assume that almost all components are interconnected. [Explanation of symbols]

[0145] 10: TV 11: Controller 11a: Processor 11b: Calendar Clock 11c: Timer 12: TV tuner 13: Display 14: Memory 14a: Work area 14b: Storage area 15: Video and audio Communication device 16:Wired LAN communication device 17:Wireless LAN communication device 18: Bluetooth communication device 19: External device connector 20: Built-in speaker 21: Microphone 30: Remote control 41: Doorbell 50, 50a, 50b: Smart speakers 51: Smartphone 61: Call status display 64:New device notification 65: Playback required / not required button 81, 82: Wireless earphones hmm 1 00, 100a, 100b, 100c, 100d, 100e, 100f, 100g, 100h, 100i, 100j, 100k: TV-linked system 130: Settings screen 130a: Registration field 131: Settings screen 190: Home Hub 191, 192, 193: Home IoT machine

Claims

1. A display device that transmits audio signals directly to an audio signal receiving device via wireless communication without using a relay device, Wireless communication equipment, The display and A controller that controls the wireless communication device and the display, A microphone and, Built-in speaker, Equipped with, The aforementioned wireless communication device transmits multiple types of voice signals via multicast or broadcast wireless communication. Each of the aforementioned multiple types of audio signals is accompanied by at least supplementary information indicating the type of audio signal, The controller further controls the microphone and the built-in speaker, The wireless communication device performs bidirectional communication with the voice signal receiving device. The audio signal receiving device receives and reproduces an audio signal wirelessly transmitted from the wireless communication device via multicast or broadcast, and the microphone collects the audio. The controller detects the direction of the audio signal receiving device relative to the display device based on the sound collected by the microphone, Controls the localization of the sound when outputting the sound received from the aforementioned audio signal receiving device through the built-in speaker. A display device characterized by the following features.

2. A display device that transmits audio signals directly to an audio signal receiving device via wireless communication without using a relay device, Wireless communication equipment, The display and A controller that controls the wireless communication device and the display, An operating member for performing input operations to the aforementioned display, Equipped with, The aforementioned wireless communication device transmits multiple types of voice signals via multicast or broadcast wireless communication. Each of the aforementioned multiple types of audio signals is accompanied by at least one piece of information indicating the type of audio signal. It is added, The wireless communication device performs bidirectional communication with the voice signal receiving device. When the wireless communication device receives a signal from the voice signal receiving device indicating that it has received a new multicast or broadcast wireless signal from an external device, The controller displays a settings screen on the display that allows the audio signal receiving device to communicate with the new external device, When the wireless communication device receives input information corresponding to the setting screen from the operating member, it transmits the input information to the audio signal receiving device. A display device characterized by the following features.

3. A display device according to claim 1 or claim 2, The display device is connected to at least one of a doorbell, a home appliance, or a household appliance. The controller displays a notification on the display indicating the content of the detection signal from the doorbell, the detection signal from the home equipment, or the detection signal from the home appliance. The wireless communication device transmits the detection signal of the doorbell, the detection signal of the residential equipment, or the detection signal of the home appliance via multicast or broadcast wireless communication. A display device characterized by the following features.

4. A display device according to claim 1, The audio signal receiving device, which receives the audio signal wirelessly transmitted by multicast or broadcast from the wireless communication device, has the microphone collect the audio reproduced from the audio signal. The controller measures the delay time between the timing when the microphone collects the sound and the timing when the wireless communication device transmits the sound signal. The timing of the audio output from the built-in speaker is adjusted based on the delay time so that the timing of the audio signal output from the built-in speaker is brought closer to the timing at which the audio signal receiving device receives and plays the audio signal. A display device characterized by the following features.

5. A display device according to claim 2, Built-in speaker, It also has a microphone, The controller further controls the built-in speaker and the microphone, The audio signal receiving device, which receives the audio signal wirelessly transmitted by multicast or broadcast from the wireless communication device, has the microphone collect the audio reproduced from the audio signal. The controller measures the delay time between the timing when the microphone collects the sound and the timing when the wireless communication device transmits the sound signal. The timing of the audio output from the built-in speaker is adjusted based on the delay time so that the timing of the audio signal output from the built-in speaker is brought closer to the timing at which the audio signal receiving device receives and plays the audio signal. A display device characterized by the following features.

6. A display device according to claim 4 or claim 5, The controller adjusts the display timing on the display based on the delay time so that the image displayed on the display is synchronized with the timing when the audio signal receiving device receives and plays the audio signal. A display device characterized by the following features.

7. A display device according to claim 1, The controller outputs the audio signal received by the wireless communication device from the audio signal receiving device through the built-in speaker, and displays a status indicator on the display that the audio signal wirelessly transmitted from the audio signal receiving device is being played back. A display device characterized by the following features.

8. A display device according to claim 2, It also has built-in speakers, The controller further controls the built-in speaker, The wireless communication device receives the voice signal transmitted wirelessly by multicast or broadcast from the voice signal receiving device. The controller outputs the received audio signal from the built-in speaker and displays a status indicator on the display showing that it is playing back the audio signal wirelessly transmitted from the audio signal receiving device. A display device characterized by the following features.

9. A display device according to claim 1, The system further includes an operating member for performing input operations to the aforementioned display, The controller displays a setting screen on the display for setting the type of audio signal to be played back by the audio signal receiving device. When the wireless communication device receives input information corresponding to the setting screen from the operating member, it transmits the input information to the audio signal receiving device. A display device characterized by the following features.

10. A display device according to claim 2, The controller displays a setting screen on the display for setting the type of audio signal to be played back by the audio signal receiving device. When the wireless communication device receives input information corresponding to the setting screen from the operating member, it transmits the input information to the audio signal receiving device. A display device characterized by the following features.

11. A display device according to claim 1 or claim 2, The controller displays multiple programs side by side on one screen of the display, The wireless communication device transmits each audio signal of the plurality of programs by multicast or broadcast wireless communication. A display device characterized by the following features.

12. A display device according to claim 1 or claim 2, The controller synthesizes specific location audio signals that can be heard at each of multiple locations within the displayed image, based on 3D sound source information. The wireless communication device transmits a plurality of specific location voice signals synthesized for each of the locations via multicast or broadcast wireless communication. A display device characterized by the following features.

Images