Signal processing apparatus

Abstract

To provide a signal processing apparatus and the like that can process signals transmitted through different networks.SOLUTION: A signal processing apparatus and the like described in claims are provided.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a signal processing device and the like. [Background technology]

[0002] "MPEG-H MMT," which can transmit signals over multiple networks such as communications and broadcasting, has the potential to become the new standard. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication WO2013 / 190787 Summary of the Invention [Problem to be solved by the invention]

[0004] A signal processing device capable of processing signals transmitted via different networks is provided. [Means for solving the problem]

[0005] According to one aspect of the present invention there is provided a signal processing device as set out in the claims. [Brief description of the drawings]

[0006] [Figure 1] 1 is a block diagram showing a schematic configuration of a distribution system according to a first embodiment. [Diagram 2] 4 is a diagram for explaining a schematic processing operation of a synchronization unit 23. FIG. [Diagram 3] FIG. 11 is a block diagram showing a schematic configuration of a distribution system according to a second embodiment. [Figure 4] FIG. 11 is a block diagram showing a schematic configuration of a distribution system according to a third embodiment. [Diagram 5] FIG. 13 is a block diagram showing a schematic configuration of a distribution system according to a fourth embodiment. [Figure 6]FIG. 13 is a block diagram showing a schematic configuration of a distribution system according to a fifth embodiment. [Figure 7] FIG. 13 is a block diagram showing a schematic configuration of a distribution system according to a sixth embodiment. [Figure 8] FIG. 4 is a diagram showing an example of the contents stored in a storage unit 2E. [Figure 9] FIG. 13 is a block diagram showing a schematic configuration of a distribution system according to a seventh embodiment. [Figure 10] FIG. 13 is a block diagram showing a schematic configuration of a distribution system according to an eighth embodiment. [Figure 11] FIG. 1 is a diagram for explaining a schematic process of completion. [Figure 12] FIG. 13 is a block diagram showing a schematic configuration of a recorder 5 according to a ninth embodiment. [Figure 13] FIG. 23 is a block diagram showing a schematic configuration of a smartphone 6 according to a tenth embodiment. [Figure 14] FIG. 13 is a diagram showing an example of a two-dimensional display. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0007] (First embodiment) When a video signal and an audio signal are transmitted through different networks, a difference in transmission delay may occur. Even so, if timing information such as presentation time information and time stamps is added to the video signal and the audio signal, the two can be synchronized and played back on the receiver side. However, when the device that plays the video signal and the device that plays the audio signal are different, such as a typical example where the video signal is played back on a television and the audio signal is played back on an external speaker using an amplifier connected to the television, it is difficult to achieve synchronization.

[0008] Therefore, in the first embodiment, a mechanism is provided that allows the video signal and the audio signal to be reproduced in synchronization even in such a case.

[0009] 1 is a block diagram showing a schematic configuration of a distribution system according to a first embodiment. This distribution system is made up of a broadcasting device 1, a television (signal processing device) 2, an amplifier 3 connected to the television 2, and a speaker 4 connected to the amplifier 3. Note that the amplifier 3 and the speaker 4 may be integrated. The television 2 and the amplifier 3 form a signal processing system.

[0010] The broadcasting device 1 has a content storage unit 11, a video transmission unit 12, and an audio transmission unit 13. However, the content storage unit 11, the video transmission unit 12, and the audio transmission unit 13 do not necessarily have to be included in one broadcasting device 1, and may be distributed across multiple devices.

[0011] The content storage unit 11 stores a content signal. The content signal is composed of a video signal and an audio signal that are associated with each other and should be played back in synchronization. The video transmission unit 12 transmits the video signal to the television via a broadcast network. The audio transmission unit 13 transmits the audio signal to the television via a communication network (such as the Internet; the same applies below).

[0012] Timing information is added to the video signal and audio signal. For example, the video signal and audio signal may be composed of a plurality of packets, and the packets may contain the timing information. The timing information may be presentation time information, and the receiver side can know which packets of the video signal and audio signal should be reproduced at each time. The timing information may also be a timestamp, and the receiver side can simultaneously reproduce a packet of the video signal with a certain timestamp and a packet of the audio signal with the same timestamp.

[0013] The television 2, which is an example of a signal processing device, includes a video receiving unit 21, an audio receiving unit 22, a synchronization unit 23, a display 24, a speaker 25, and an output unit . The video receiving unit 21 receives a video signal via a broadcast network. The audio receiving unit 22 receives an audio signal via a communication network. However, the received video signal and audio signal are not necessarily synchronized, and one may be received earlier than the other due to a difference in transmission delay between the broadcast network and the communication network.

[0014] Therefore, the synchronization unit 23 controls the playback timing of the video signal and / or the audio signal so that the video signal and the audio signal are played back in synchronization with each other. More specifically, the synchronization unit 23 synchronizes the video signal and the audio signal based on the timing information. For example, when the transmission delay time differs depending on the network, the synchronization unit 23 compensates for the difference in the transmission delay time by delaying the signal received earlier.

[0015] 2 is a diagram for explaining the processing operation of the synchronization unit 23. As shown in FIG. 2(a), it is assumed that the audio signal is received with a delay of dt1 from the video signal. This is understood from the timing information added to the video signal and the audio signal. In this case, the synchronization unit 23 delays the video signal by dt1 by using a frame memory or the like, and synchronizes it with the audio signal as shown in FIG. 2(c). On the other hand, as shown in FIG. 2(b), if the video signal is received with a delay of dt2 from the audio signal, the synchronization unit 23 delays the audio signal by dt2, and synchronizes it with the video signal as shown in FIG. 2(c).

[0016] The synchronization unit 23 can perform such processing for each unit in which timing information is added. For example, when timing information is added to each packet, the synchronization unit 23 adjusts the delay time for each packet. Also, when timing information is added to each frame, the synchronization unit 23 adjusts the delay time for each frame.

[0017] In this way, a video signal and an audio signal synchronized with each other are generated. The former can be reproduced on a display 24 built into the television 2. The latter can be reproduced on a speaker 25 built into the television 2, but when reproducing the audio signal on an external speaker 4 via an amplifier 3, the speaker 25 of the television 2 may be muted. Furthermore, before and after the processing in the synchronization unit 23, video processing and / or audio processing may be performed as necessary.

[0018] The television 2 is connected to the amplifier 3 by, for example, an HDMI (registered trademark) cable. When an audio signal is to be reproduced on the speaker 4 connected to the amplifier 3, the output unit 26 outputs the audio signal output from the synchronization unit 23, in other words, the audio signal synchronized with the video signal, to the amplifier 3. The audio receiving unit 31 of the amplifier 3 receives such an audio signal. Then, this audio signal is subjected to audio processing as necessary and reproduced on the speaker 4.

[0019] In the television 2, if the time taken for the synchronized video signal to be output from synchronization unit 23 and played on display 24 is approximately equal to the time taken for the synchronized audio signal to be output from output unit 26 to audio receiving unit 31 of amplifier 3 and played on speaker 4, it is possible to synchronize the video signal played on the television 2 with the audio signal played on speaker 4 via amplifier 3. If the time required for internal processing in amplifier 3 is known, such as when the television 2 and amplifier 3 are made by the same manufacturer, synchronization unit 23 can synchronize the video signal and audio signal with greater accuracy by taking this time into consideration.

[0020] In this way, in the first embodiment, the video signal and the audio signal are synchronized and then the audio signal is transmitted to the amplifier 3, so that even if the television 2 that reproduces the video signal and the amplifier 3 (speaker 4) that reproduces the audio signal are different, the two signals can be reproduced in a synchronized manner. With this configuration, the amplifier 3 does not require a communication function for receiving the audio signal via a communication network or a mechanism for adjusting the reproduction timing of the audio signal.

[0021] Second embodiment The second embodiment is a modification of the first embodiment, in which an audio signal before synchronization is output to an amplifier, and information required for synchronization processing is also notified to the amplifier, and synchronization processing is performed on the amplifier side. The following mainly describes the differences.

[0022] Fig. 3 is a block diagram showing a schematic configuration of a distribution system according to the second embodiment. Note that the broadcasting device in Fig. 1 is omitted. The television 2 further includes a control unit 27.

[0023] The control unit 27 generates a signal (hereinafter, referred to as a synchronization control signal) that can be used to synchronize the video signal and the audio signal. As a specific example, the control unit 27 may detect a delay time (transmission time difference) between the video signal and the audio signal and generate a synchronization control signal indicating this delay time. The delay time here is a time indicating how much time is delayed between the video signal and the audio signal in receiving the other signal, for example, dt1 in FIG. 2(a) or dt2 in FIG. 2(b). The delay time is grasped from timing information added to the video signal and the audio signal. Note that even if a signal is used for another purpose, if it can be used to synchronize the video signal and the audio signal, that signal may be used as the synchronization control signal.

[0024] The output unit 26 outputs the audio signal before synchronization and the synchronization control signal to the amplifier 3. For example, both of these two signals may be supplied to the amplifier 3 via an HDMI cable. Alternatively, the audio signal may be supplied to the amplifier 3 via an HDMI cable, and the synchronization control signal may be supplied to the amplifier 3 via another path such as short-range wireless communication.

[0025] An audio receiving unit 31 of the amplifier 3 receives the audio signal before synchronization. The amplifier 3 also has a synchronization unit 32, which synchronizes the audio signal received by the audio receiving unit 31 with the video signal reproduced by the television 2 based on a synchronization control signal. When the synchronization control signal indicates a delay time, the synchronization unit 32 delays the audio signal according to the delay time. For example, as shown in FIG. 2(b), when the video signal is delayed by dt2, the synchronization unit 32 delays the audio signal by dt2 and synchronizes it with the video signal in the television 2. The synchronized audio signal is then reproduced by the speaker 4.

[0026] As shown in Fig. 2(a), when the audio signal is delayed, the video signal is delayed in the television synchronization unit 23 to synchronize the video signal with the audio signal. Therefore, there is no need to delay the audio signal in the amplifier synchronization unit 32. Therefore, the synchronization control signal may indicate that there is no need to delay the audio signal, or may simply indicate that the audio signal is delayed relative to the video signal, or may indicate that the delay time is zero.

[0027] In this way, in the second embodiment, since the synchronization control signal is output to the amplifier 3, even if the television 2 that reproduces the video signal and the amplifier 3 that reproduces the audio signal are different, the two signals can be reproduced in sync. With this configuration, the amplifier 3 does not need a communication function for receiving the audio signal via a communication network. In addition, since the audio signal is supplied to the amplifier 3 from near the audio receiving unit 22 of the television 2, this is suitable for cases where audio processing is to be avoided on the television 2 side as much as possible and performed on the amplifier 3 side. The synchronization control signal may be generated when the synchronization unit 23 performs the synchronization process.

[0028] (Third embodiment) In the third embodiment, it is possible to switch between supplying an unsynchronized audio signal and a synchronization control signal to an amplifier, or supplying a synchronized audio signal to an amplifier. The following mainly describes the differences from the first and second embodiments.

[0029] Fig. 4 is a block diagram showing a schematic configuration of a distribution system according to the third embodiment. Note that the broadcasting device in Fig. 1 is omitted. The television 2 further includes an information acquisition unit 28 that acquires information about the amplifier 3.

[0030] The information of the amplifier 3 is information indicating whether the amplifier 3 should receive an audio signal before synchronization and a synchronization control signal, or whether the amplifier 3 should receive a synchronized audio signal. Alternatively, the information of the amplifier 3 may be information indicating whether the amplifier 3 can process a synchronization control signal. As an example, the information of the amplifier 3 may be information that can determine whether the amplifier 3 has the synchronization unit 32 of FIG. 3. In this case, the information of the amplifier 3 may be information that directly indicates whether the amplifier 3 has the synchronization unit 32, or may be identification information such as the model number of the amplifier 3. In the latter case, the model numbers of the amplifiers 3 that have the synchronization unit 32 and the amplifiers 3 that do not have the synchronization unit 32 may be stored in a database in the television 2 (or that can be referenced from the television 2). As another example, the information of the amplifier 3 may be set for the amplifier 3 by the user.

[0031] The information acquisition unit 28 may acquire the information on the amplifier 3 from the amplifier 3 via, for example, an HDMI cable, or may directly accept settings from the user. The information on the amplifier 3 is notified to the output unit 26.

[0032] Separately from this, a user setting is input to the output unit 26. The user setting here is a setting as to whether to supply a synchronized audio signal to the amplifier 3 as shown in Fig. 1, or to supply an audio signal before synchronization and a synchronization control signal to the amplifier 3 as shown in Fig. 3.

[0033] Then, based on the information of the amplifier 3 and / or the user setting, the output unit 26 outputs either the audio signal before synchronization and the synchronization control signal, or the synchronized (synchronized) audio signal to the amplifier 3. In the latter case, the synchronization control signal may or may not be supplied to the amplifier 3.

[0034] When an audio signal before synchronization and a synchronization control signal are supplied, a synchronization section (not shown) of the amplifier 3 synchronizes the video signal and the audio signal by delaying the audio signal based on the synchronization control signal. When a synchronized audio signal is supplied, there is no need for the synchronization section to operate in particular even if it is present. Note that it is desirable for the output section 26 to notify the amplifier 3 of information indicating whether the signal is an audio signal before synchronization or an audio signal after synchronization.

[0035] The relationship between the information on the amplifier 3 and the user settings may be prioritized as appropriate. As an example, the user may be provided with three options for the user settings, "before synchronization," "after synchronization," and "automatic," and when "before synchronization" or "after synchronization" is selected, the selected audio signal is supplied regardless of the information on the amplifier 3, and when "automatic" is selected, the audio signal is supplied based on the information on the amplifier 3. As another example, the information on the amplifier 3 may be prioritized as a general rule, and when the information on the amplifier 3 is unknown (cannot be obtained), an audio signal according to the user settings may be supplied.

[0036] When the output unit 26 uses only the user settings, the information acquisition unit 28 can be omitted, and when the output unit 26 uses only the information of the amplifier 3, the user settings can be omitted.

[0037] In the above-mentioned first to third embodiments, a television receives a video signal and an audio signal and outputs the audio signal to an amplifier. In contrast, in a signal processing device that receives a video signal and an audio signal, when the audio signal is reproduced in the signal processing device and the video signal is reproduced in another connected device, the video signal is output to the other device. In this case, too, a synchronized video signal may be output as described in the first embodiment, or a video signal and a synchronization control signal before synchronization may be output as described in the second embodiment, or a user may be allowed to select either of the two as described in the third embodiment.

[0038] Furthermore, in the first to third embodiments, when the video signal is reproduced by an external device connected to the television 2, the output unit 26 may output the video signal to that device. In this case as well, a synchronized video signal may be output as described in the first embodiment, or a video signal and a synchronization control signal before synchronization may be output as described in the second embodiment, or either of the two may be selectable as described in the third embodiment.

[0039] (Fourth embodiment) Paragraph 0053 of Patent Document 1 discloses that after selecting a channel by a broadcast stream, a viewing instruction is separately received from a user, and an instruction to acquire a communication stream is issued. However, in this case, the user must separately select a channel related to the broadcast network and issue a viewing instruction related to the communication network, which is very troublesome. Therefore, in this embodiment, a mechanism is provided that allows the user to easily configure settings for both networks.

[0040] 5 is a block diagram showing a schematic configuration of a distribution system according to the fourth embodiment. The distribution system includes a broadcasting device 1 and a television 2.

[0041] The broadcast device 1 includes a content storage unit 11, a broadcast transmission unit 14, and a communication unit 15. However, the content storage unit 11, the broadcast transmission unit 14, and the communication unit 15 do not necessarily have to be included in one broadcast device 1, and may be distributed across multiple devices.

[0042] A plurality of content signals are stored in the content storage unit 11. Each content signal is composed of a video signal and an audio signal that are associated with each other and should be reproduced in a synchronized manner, and each of the content signals is provided with timing information.

[0043] The broadcast transmitting unit 14 multiplexes video signals in a plurality of content signals and transmits the video signals to the television 2 via the broadcast network. In this embodiment, it is assumed that the communication unit 15 transmits audio signals by unicast, and receives a request signal (described later) from the television 2 via the communication network, and obtains an audio signal indicated by the request signal from the content storage unit 11 and transmits it to the television 2 via the communication network.

[0044] The television 2, which is an example of a signal processing device, has an operation reception unit 29, a broadcast receiving unit 2A, a tuner (selection unit) 2B, a request unit 2C, a communication unit 2D, a synchronization unit 23, a display 24, and a speaker 25.

[0045] The operation reception unit 29 receives a user operation. The user operation may be an operation on a remote control, or an operation on a button (not shown) provided on the television 2 main body. In this embodiment, the user operation is to set which channel of the multiplexed video signals to select. This channel selection is performed by pressing a channel selection key on the remote control, selecting a currently distributed content from an electronic program guide displayed on the display 24, pressing a channel selection button provided on the television 2 main body, or the like.

[0046] The broadcast receiving unit 2A receives a plurality of multiplexed video signals via a broadcast network. The tuner 2B selects one of the multiplexed video signals in response to a user operation received by an operation receiving unit 29 from a user.

[0047] The request unit 2C generates a request signal for requesting an audio signal associated with a selected video signal. In this embodiment, the request unit 2C generates the request signal in response to a user operation received by the operation receiving unit 29 from a user.

[0048] To give an easy-to-understand example, assume that there are content signals from first to third broadcasting stations (hereinafter, referred to as 1ch, 2ch, and 3ch, respectively) as content signals. When a user selects 2ch by user operation, tuner 2B selects the video signal of 2ch, and request unit 2C generates a request signal for requesting the audio signal of 2ch.

[0049] In this way, one user operation (such as pressing a channel selection key on the remote control described above) is used for both channel selection by the tuner 2B and request signal generation by the request unit 2C. This allows the user to perform settings for both the broadcast network and the communication network with one operation, saving time and effort.

[0050] The communication unit 2D transmits a request signal to the broadcast device 1 via the communication network. Then, the communication unit 2D receives an audio signal transmitted from the communication unit 15 in response to the request signal. The received audio signal is an audio signal associated with the video signal selected by the tuner 2B.

[0051] Synchronization unit 23, display 24, and speaker 25 are as described above. Note that synchronization unit 23 desirably synchronizes the video signal selected by tuner 2B with the audio signal received by communication unit 2D, taking into consideration the delay between when request unit 2C generates a request signal, when communication unit 2D transmits the request signal to broadcast device 1, and when communication unit 2D receives the audio signal.

[0052] In this way, in the fourth embodiment, a single user operation can be used to control both the broadcast network and the communication network, thereby reducing the burden on the user.

[0053] In addition, when the signal processing device is a smartphone or a tablet, the user operation may be an operation on a touch panel, or in the case of a personal computer, an operation on a mouse or a keyboard, and it is sufficient that some input interface can be used to select a station. This is the same for other embodiments. In addition, it is not necessary for the signals transmitted via the broadcast network and the communication network to be video signals and audio signals, and both may be video signals (or audio signals), or some kind of control signal.

[0054] Fifth embodiment The fifth embodiment described next is a modification of the fourth embodiment. The following description will focus on the differences from the fourth embodiment.

[0055] 6 is a block diagram showing a schematic configuration of a distribution system according to the fifth embodiment. The distribution system includes a broadcasting device 1 and a television 2. A difference from the fourth embodiment is that a request unit 2C in the television 2 receives a notification from the tuner 2B of which video signal the tuner 2B has selected and generates a request signal.

[0056] Taking an example similar to that of the fifth embodiment, when 2ch is selected by a user operation, the tuner 2B selects the video signal of 2ch. Then, the tuner 2B notifies the request unit 2C that the video signal of 2ch has been selected. In response to this, the request unit 2C generates a request signal for requesting the audio signal of 2ch.

[0057] This also reduces the burden on the user. In both the fourth and fifth embodiments, settings for both the broadcast network and the communication network can be made based on a single user operation.

[0058] The roles of the tuner 2B and the request unit 2C may be interchanged. That is, the request unit 2C may generate a request signal for requesting one audio signal based on a user operation, and may notify the tuner 2B of which audio signal is requested, and the tuner 2B may select a channel upon receiving this notification.

[0059] Sixth embodiment The sixth embodiment is a modified example of the fourth and fifth embodiments. In this embodiment, it is assumed that a plurality of audio signals are associated with a single video signal in a single content signal. The plurality of audio signals may be, for example, a main audio signal and a secondary audio signal, a plurality of audio signals in different languages, or audio signals with different amounts of information, such as stereo audio and 5.1ch audio.

[0060] Fig. 7 is a block diagram showing a schematic configuration of a distribution system according to the sixth embodiment. The sixth embodiment is different from the fourth and fifth embodiments in that the television 2 further includes a storage unit 2E. The storage unit 2E stores which of the above-mentioned multiple audio signals should be requested. Note that this storage unit 2E may be located outside the television.

[0061] 8 is a diagram showing an example of the contents stored in the storage unit 2E. In this example, which of a plurality of audio signals is requested for each video signal (for each channel) is stored in advance. The stored contents may be set by the user according to the user's preference or language used. Alternatively, the stored contents may be set automatically according to a contract or the like. For example, when a paid contract for receiving 5.1ch audio is made, this may be set via a broadcast network or a communication network.

[0062] Each item of the stored contents may be common to all channels, or may be different for each channel. For example, it is desirable to have the same language for all channels. Also, it is desirable for the amount of information to differ for each channel, such as having 5.1ch audio only for channels that mainly feature music programs.

[0063] The request unit 2C generates a request signal for requesting a specific audio signal based on the user operation accepted by the operation accepting unit 29 and the stored contents of the storage unit 2E. In the example of Fig. 8, when 2ch is selected by the user operation, the request unit 2C refers to the storage unit 2E, generates a request signal for requesting Japanese and stereo audio from the 2ch audio signals, and transmits the request signal to the broadcasting device 1.

[0064] When there are multiple audio signals associated with the 2ch video signal, the communication unit 15 of the broadcasting device 1 selects one of them in response to the request signal, and transmits it to the television via the communication network.

[0065] In this way, in the sixth embodiment, the audio signal to be requested is stored in the storage unit 2E, so that even when there are a plurality of audio signals associated with a video signal, the user's work can be reduced.

[0066] In FIG. 7, the request unit 2C operates based on a user operation received by the operation receiving unit 29, as in the fourth embodiment, but the request unit 2C may also operate upon receiving a notification from the tuner 2B, as in the fifth embodiment.

[0067] Seventh embodiment In the fourth to sixth embodiments, an audio signal is transmitted via a communication network in response to a request from the television 2. In contrast, in the seventh embodiment described next, a plurality of audio signals are transmitted by so-called multicast, and one of the audio signals is selected on the television 2 side. The following description will focus on the differences.

[0068] 9 is a block diagram showing a schematic configuration of a distribution system according to a seventh embodiment. In this embodiment, the communication unit 15 of the broadcasting device 1 transmits a plurality of audio signals (multiplexed as necessary) without receiving a request from the television 2 and without specifying a transmission destination. This type of transmission form is also called multicast and is similar to transmission via a broadcasting network. The plurality of audio signals are, for example, audio signals in content signals from a plurality of broadcasting stations.

[0069] A communication unit 2D in the television 2 receives a plurality of audio signals. The television 2 also includes a selection unit 2F, which selects one of the audio signals in response to a user operation received by an operation reception unit 29.

[0070] In this embodiment, one user operation is used for both tuning by the tuner 2B and selection by the selection unit 2F. This allows the user to perform settings for both the broadcast network and the communication network with one operation, saving time and effort.

[0071] This embodiment is similar to the fourth embodiment, but may be the same as the fifth embodiment. That is, the tuner 2B may select one video signal based on a user operation, and may notify the selection unit 2F of which audio signal has been selected, and the selection unit 2F may make a selection upon receiving this notification. Of course, the roles of the tuner 2B and the selection unit 2F may be interchanged. Moreover, a storage unit 2E may be provided as in the sixth embodiment, and the selection unit 2F may also refer to the storage unit 2E when making a selection.

[0072] Eighth embodiment In the case of smartphones and other devices, it can be difficult to receive signals from broadcast networks or communications networks, but even in such situations it is necessary to be able to play video and audio signals as much as possible. Therefore, in the eighth embodiment, audio signals are received from both the broadcast network and the communication network, and one of them is selected and played back.

[0073] 10 is a block diagram showing a schematic configuration of a distribution system according to an eighth embodiment. The following mainly describes the differences from the above-mentioned embodiments. In this embodiment, a smartphone is assumed as the signal processing device, but the present invention is also applicable to other electronic devices, and is particularly suitable for mobile devices such as notebook PCs and tablets, and mobile communication devices such as in-car televisions (which may also be built into car navigation systems).

[0074] A broadcast transmitting unit 14 in the broadcasting device 1 transmits a video signal and a first audio signal to be reproduced in synchronization with the video signal via a broadcasting network. A communication unit 15 transmits a second audio signal to be reproduced in synchronization with the video signal via a communication network. The second audio signal may be substantially the same as the first audio signal (except for differences due to differences in transmission networks) or may be different, and a specific example will be described later.

[0075] The smartphone 6 includes a broadcast receiving unit 61, a communication receiving unit 62, a determination unit 63, an output unit 64, a synchronization unit 65, a display 66, and a speaker 67. The broadcast receiving unit 61 receives a video signal and a first audio signal via a broadcast network. The communication receiving unit 62 receives a second audio signal via a communication network. The determination unit 63 determines which of the first audio signal and the second audio signal should be reproduced. The output unit 64 selects and outputs the first audio signal or the second audio signal according to the determination result. Note that the output unit 64 may perform a predetermined process on the first audio signal or the second audio signal before outputting it for processing at a later stage.

[0076] The synchronization unit 65 and the like are as described above. Since the video signal and the first audio signal should be synchronized, the synchronization unit 65 may synchronize the video signal and the second audio signal only when the second audio signal is output.

[0077] The determination unit 63 may determine which of the first and second audio signals is to be reproduced, which is better, based on the status of the broadcast network and the communication network, and the reception quality of the first and second audio signals. The status of the broadcast network and the communication network may be determined, for example, from the reception strength of the broadcast network (broadcast waves) and the reception strength of the communication network (radio waves for communication). The reception quality may be determined from an error rate or S / N ratio detected when demodulating and decoding a video signal or an audio signal. In either case, it is only necessary to predetermine the relationship between the network status or the reception quality of the audio signal and which one should be selected.

[0078] In the case where the first audio signal and the second audio signal are substantially the same as the reproduced audio, with only differences arising from differences in the transmission networks, the determination unit 63 determines that one of the first audio signal and the second audio signal that can be reproduced with high quality should be reproduced, and may determine which one should be reproduced if both signals can be reproduced to the same degree.

[0079] The second audio signal may be of higher quality, such as the first audio signal being stereo audio and the second audio signal being 5.1ch audio. The first audio signal may be audio in a basic language (for example, Japanese in the case of a smartphone intended for use by Japanese people), and the second audio signal may be audio in a language selected by the user from among multiple languages.

[0080] In such a case, since the user would prefer to play the second audio signal over the first audio signal, it is preferable for the determination unit 63 to determine that the second audio signal should be played back preferentially. For example, if both the first and second audio signals can be played back to the same degree, the determination unit 63 determines that the second audio signal should be played back. Then, the determination unit 63 determines that the first audio signal should be played back only when playback of the second audio signal is impossible (including cases where the second audio signal would be unbearable even if it could be played back, or where the first audio signal sounds clearer when played back).

[0081] Conversely, if it is considered that the user desires the reproduction of the first audio signal, the determination unit 63 may determine that the first audio signal is to be preferentially reproduced. The details are the same as above.

[0082] However, even when it is determined that the second audio signal should be reproduced, a portion of the second audio signal may be lost. In that case, the output unit 64 may output the lost portion while complementing the corresponding portion of the first audio signal in real time.

[0083] FIG. 11 is a diagram for explaining the complementation process. When the communication receiving unit 62 cannot receive the packet P2 of the second audio signal normally, the output unit 64 performs complementation using the packet P12 (corresponding to the packet P2) of the first audio signal received by the broadcast receiving unit 61. In this case, the output unit 64 can grasp the packet in the first audio signal corresponding to the packet in the second audio signal that cannot be normally received based on the timing information included in the first audio signal and the second audio signal. That is, the packet P2 is provided with a timing signal T2, and it can be seen that the packet P12 provided with the corresponding timing signal T2 should be used for complementation. If necessary, packets before and after the packet P12 may be used for complementation.

[0084] If the packet P12 and the packet P2 are substantially the same, the output unit 64 may simply replace the portion of the packet P2 with the packet P12. If the two are different, the output unit 64 may perform the necessary conversion. For example, if the first audio signal is stereo audio and the second audio signal is 5.1ch audio, the output unit 64 may convert the stereo audio to 5.1ch audio by a known method at the time of complementation. If the former and latter are in different languages, the output unit 64 may translate the language at the time of complementation. If the two are not audio signals but video signals with different resolutions, the output unit 64 may perform resizing at the time of complementation.

[0085] In this way, in the eighth embodiment, since the determination unit 63 is provided, it is possible to play back the appropriate one of the audio signal received via the broadcast network and the audio signal received via the communication network.

[0086] In this embodiment, the final output destination of the output unit 64 is the speaker 67, but for example, if the signal processing device is a television, the output destination may be an amplifier as described in the first embodiment, and if the signal processing device is a recorder, the output destination may be a storage medium, and there are no particular restrictions on the output destination.

[0087] Ninth embodiment In this embodiment, a recorder is mainly assumed as the signal processing device. Video signals and audio signals including timing information have a larger data volume than video signals and audio signals without timing information, which puts a strain on the recording capacity. Therefore, in this embodiment, the timing information is removed before recording.

[0088] 12 is a block diagram showing a schematic configuration of a recorder 5 according to a ninth embodiment. The recorder 5, which is an example of a signal processing device, includes a video receiving unit 51, an audio receiving unit 52, a synchronization unit 53, an output unit 54, a recording medium 55, and a reading unit 56. The recording medium 55 may be inside the recorder 5, such as an internal hard disk, or may be inserted from the outside, such as an optical disk.

[0089] The video receiving unit 51 receives a video signal, and the audio receiving unit 52 receives an audio signal via different networks (for example, the former via a broadcast network and the latter via a communication network). The synchronization unit 53 synchronizes the video signal and the audio signal based on timing information contained in the video signal and the audio signal. The output unit 54 outputs the synchronized video signal and audio signal to a recording medium 55, and records the video signal and the audio signal therein in a synchronized state.

[0090] Here, the video signal and audio signal may be recorded on the recording medium with the timing information included, but it is preferable that the output unit 54 removes at least a part of the timing information in the video signal and / or the timing information in the audio signal before outputting them. Although the timing information is necessary to synchronize the video signal and the audio signal, it is not necessary to retain the information once they are synchronized. Therefore, by removing the timing information, the signals can be recorded on the recording medium 55 efficiently.

[0091] In addition, the output unit 54 may convert the format of the video signal and audio signal and record them on the recording medium 55, for example, converting a signal conforming to MPEG-H MMT into a signal conforming to MPEG2-TS and recording it.

[0092] The readout unit 56 reads out the video and audio signals recorded on the recording medium 55 in a synchronized state, and outputs them to an external device (not shown) such as a television. At this time, if necessary, the readout unit 56 may convert the format of the read video and audio signals, for example by adding timing information to the signals, before outputting them. This is effective when it is assumed that the external device to which the signals are to be output will process video and audio signals including timing information, or will process signals in a specific format.

[0093] In this way, in the ninth embodiment, since recording is performed by removing the timing signal, the capacity required for recording can be reduced. The output unit 54 may output the video signal and audio signal from which the timing information has been removed to a device other than the recording medium 55 (for example, in the first to third embodiments). Furthermore, the timing information may be removed when the synchronization unit 53 synchronizes the video signal and audio signal.

[0094] (Tenth embodiment) When receiving signals from both a broadcast network and a communication network, it is insufficient if only the broadcast network can be normally received or only the communication network can be normally received. In particular, in a mobile device such as a smartphone, if the device is not in an appropriate position, the device cannot stably receive signals from the broadcast network or the communication network. Therefore, in this embodiment, a mechanism is provided to assist the user in grasping the appropriate position.

[0095] 13 is a block diagram showing a schematic configuration of a smartphone 6 according to a tenth embodiment. In this embodiment, the smartphone 6, which is an example of a signal processing device, includes a broadcast reception level detection unit 68, a communication reception level detection unit 69, and a display control unit 6A. The rest is the same as in the above-mentioned embodiment.

[0096] The broadcast reception level detection unit 68 detects the reception level of the broadcast network (broadcast wave). The communication reception level detection unit 69 detects the reception level of the communication network (communication radio wave). The display control unit 6A two-dimensionally displays the reception strength of the broadcast network and the reception strength of the communication network on the display 66.

[0097] 14 is a diagram showing an example of a two-dimensional display. As shown in the figure, the reception level of the broadcast network can be displayed on the horizontal axis, and the reception level of the communication network can be displayed on the vertical axis.

[0098] The circle in the figure indicates the current reception strength (although there may be a slight time lag), and if the reception strength changes due to the smartphone 6 moving, for example, it is desirable for the display control unit 6A to move the position of this circle in real time and display it.

[0099] The square marks in the figure indicate the target values ​​for normal reproduction of currently received broadcast signals and communication signals. These positions may differ depending on the received signal, such as the type of broadcast signal and the selected channel. There may be multiple target values, and a target value for reproduction with the highest quality and a target value for reproduction with the minimum quality may be displayed.

[0100] While viewing this display, the user can move or adjust the antenna so that both the current reception strength of the broadcast network and the reception strength of the communication network exceed the target reception strength values.

[0101] Such a display is started, for example, in response to a user operation. The display control unit 6A may display the maximum reception strength of the broadcast network and the communication network after the start time, and in this case, may move the position every time the maximum value is updated. This allows the user to grasp the reception strength within the possible range at that time, even if the reception strength does not reach the target value.

[0102] All or part of the signal processing devices described above may be functions realized by a processor executing a predetermined program. In addition, not all of the functional units in each signal processing device are essential, and they may be omitted as necessary, other functional units may be added, or the signal processing devices may be distributed among multiple devices. Furthermore, multiple embodiments may be combined. Based on the above embodiment, for example, the following configurations are conceivable.

[0103] [A-1] (First embodiment) a first receiving unit that receives a first signal via a first network; a second receiving unit that receives, via a second network, a second signal to be reproduced in synchronization with the first signal; a synchronization unit that synchronizes the first signal and the second signal (that controls the first signal and / or the second signal so that the first signal and the second signal are reproduced in synchronization with each other); an output unit that outputs the synchronized second signal to an external device.

[0104] [A-1'] a first receiving unit that receives a video signal via a first network; a second receiving unit that receives, via a second network, an audio signal to be reproduced in synchronization with the video signal; a synchronization unit that synchronizes the video signal and the audio signal; a display on which the video signal is reproduced; an output unit that outputs the synchronized audio signal to an amplifier, A television, wherein one of the first network and the second network is a broadcast network and the other is a communication network.

[0105] [B-1] (Second embodiment) a first receiving unit that receives a first signal via a first network; a second receiving unit that receives, via a second network, a second signal to be reproduced in synchronization with the first signal; a control unit that generates a control signal that can be used to synchronize the first signal and the second signal; an output unit that outputs the control signal and the second signal to an external device.

[0106] [C-1] (Third embodiment) a first receiving unit that receives a first signal via a first network; a second receiving unit that receives, via a second network, a second signal to be reproduced in synchronization with the first signal; a control unit that generates a control signal that can be used to synchronize the first signal and the second signal; a synchronization unit that synchronizes the first signal and the second signal; and an output unit that outputs either the control signal and the second signal, or the synchronized second signal to an external device based on information of a connected external device and / or user settings.

[0107] [C-2] The control signal is indicates a delay time difference between the first signal and the second signal; indicating the time by which the second signal should be delayed; A signal processing device according to B-1 or C-1.

[0108] [D-1] A receiving device comprising a receiving unit that receives the second signal output from the output unit in the signal processing device according to any one of A-1 to C-2.

[0109] [E-1] A signal processing device according to any one of A-1 to C-2, A signal processing system comprising the receiving device according to D-1.

[0110] [F-1] (Fourth embodiment) A receiving unit that receives a signal including a plurality of signals (a plurality of multiplexed signals) via a broadcast network; A selection unit that selects a first signal from the plurality of signals; a request unit that generates a request signal that requests transmission of a second signal, which is to be reproduced in synchronization with the first signal, via a communication network; An operation receiving unit that receives a user operation, A signal processing device, wherein the selection unit not only selects the first signal but also the request unit generates the request signal based on one of the user operations.

[0111] [F-2] The signal processing device according to F-1, wherein the one user operation is a channel selection operation.

[0112] [F-3] (Sixth embodiment) A signal processing device as described in F-1,2, wherein there are multiple signals to be reproduced in synchronization with the first signal, and the request unit generates the request signal by referring to a memory unit that stores which of the signals is to be requested as the second signal.

[0113] [G-1] a first receiving unit configured to receive a signal including a plurality of signals via a first network; A selection unit that selects a first signal from the plurality of signals; a second receiving unit that receives, via a second network, a second signal to be reproduced in synchronization with the first signal; An operation receiving unit that receives a user operation, The signal processing device, wherein the first signal is selected and the second signal is received based on one of the user operations.

[0114] [H-1] (Seventh embodiment) a first receiving unit configured to receive a signal including a plurality of signals via a first network; a first selection unit that selects a first signal from the plurality of signals; a second receiving unit configured to receive a signal including a plurality of signals via a second network; a second selection unit that selects a second signal to be reproduced in synchronization with the first signal from the plurality of signals; An operation receiving unit that receives a user operation, The signal processing device, wherein, based on one of the user operations, not only the first selection unit selects the first signal, but also the second selection unit selects the second signal.

[0115] [I-1] (Eighth embodiment) a first receiving unit that receives a video signal and a first audio signal to be reproduced in synchronization with the video signal via a first network; a second receiving unit that receives, via a second network, a second audio signal to be reproduced in synchronization with the video signal; a determination unit that determines whether the first audio signal or the second audio signal should be reproduced; and an audio output unit that outputs the first audio signal or the second audio signal depending on a result of the determination.

[0116] [I-2] The determination unit is If both the first audio signal and the second audio signal are reproducible, determining that the second audio signal should be reproduced; The signal processing device according to I-1, which determines that the first audio signal should be reproduced when the second audio signal cannot be reproduced.

[0117] [I-3] The signal processing device according to I-1 or 2, wherein the determination unit makes a determination depending on a state of the first network and / or the second network.

[0118] [I-4] The signal processing device according to I-1,3, wherein the determination unit makes a determination depending on reception quality of at least one of the received video signal, the first audio signal, and the second audio signal.

[0119] [I-5] The audio output unit is When it is determined that the first audio signal should be reproduced, a missing portion of the first audio signal is complemented by the second audio signal, and / or The signal processing device according to I-1 to I-7, wherein, when it is determined that the second audio signal should be reproduced, a missing portion of the second audio signal is complemented by using the first audio signal.

[0120] [I-6] The signal processing device described in I-5, wherein the audio output unit synchronizes and complements the first audio signal and the second audio signal.

[0121] [I-7] The signal processing device according to I-1 to I-6, further comprising a synchronization processing unit that synchronizes the first signal and the second audio signal.

[0122] [J-1] (Eighth embodiment) a first receiving unit that receives a first signal via a broadcast network; a second receiving unit that receives a second signal of the same type as the first signal via a communication network; a determination unit that determines whether the first signal or the second signal should be reproduced; an output unit that outputs the first signal or the second signal depending on a result of the determination.

[0123] [J-2] A signal processing device according to J-1, wherein the first signal and the second signal are both video signals or both audio signals.

[0124] [J-3] The output unit is Complementing missing portions of the first signal using the second signal when it is determined that the first signal should be reproduced, and / or The signal processing device according to J-2, which, when it is determined that the second signal should be reproduced, complements a missing portion of the second signal using the first signal.

[0125] [K-1] (Eighth embodiment) a first receiving unit that receives a first signal via a first network; a second receiving unit that receives a second signal of the same type as the first signal via a second network; an output unit that outputs the first signal while complementing it with the second signal.

[0126] [L-1] (Ninth embodiment) a first receiving unit that receives a first signal including timing information via a first network; a second receiving unit for receiving, via a second network, a second signal including timing information to be reproduced in synchronization with the first signal; a synchronization unit that synchronizes the first signal and the second signal based on the timing information; an output unit that removes at least a portion of timing information from the synchronized first signal and the synchronized second signal and outputs the signal.

[0127] [L-2] The signal processing device according to L-1, wherein the output destination of the output unit is a recording medium.

[0128] [M-1] (Tenth embodiment) A signal processing device comprising a display control unit that causes a display to two-dimensionally display the reception strength of a broadcast network and the reception strength of a communication network at a specific time.

[0129] [M-2] The signal processing device according to M-1, wherein the display control unit performs a two-dimensional display with the reception strength of the network as a first axis and the reception strength of the communication network as a second axis.

[0130] [M-3] a first receiving unit that receives a first signal via a broadcast network; a second receiving unit that receives a second signal to be reproduced in synchronization with the first signal via a communication network; The signal processing device described in M-1,2, wherein the display control unit also causes the display to display target values ​​for the receiving strength of a broadcast network for reproducing the first signal and the receiving strength of a communication network for reproducing the second signal.

[0131] [M-4] The signal processing device according to M-1 to M-3, wherein the display control unit causes a display to two-dimensionally display the reception strength of the broadcast network and the reception strength of the communication network in real time.

[0132] [M-5] The signal processing device according to M-1 to M-4, wherein the display control unit starts two-dimensional display in response to a user operation, and causes the display to also display maximum values ​​of the reception strength of the broadcast network and the communication network after the start point.

[0133] In the above, the first network and the second network are, for example, a broadcast network or a communication network (such as the Internet), but may be other networks capable of transmitting signals, and may be one-way or two-way communication, except in certain cases. The broadcast network may be terrestrial digital broadcasting, BS broadcasting, CS broadcasting, cable broadcasting, etc., and there is no limit to the type. Furthermore, the communication network may be multicast or unicast, except in certain cases. Examples of the signal processing device include a television, a recorder, a smartphone, a mobile phone, a tablet, an amplifier, a tuner, a car navigation system, and a personal computer.

[0134] The first signal and the second signal are, for example, video signals and audio signals, but may be control signals, etc., except in certain cases. Both the first signal and the second signal may be video signals, and may be, for example, an image from one viewpoint and an image from another viewpoint in a 3D video or a multi-view video, or may be one part and another part in a high-resolution video. In addition, both the first signal and the second signal may be audio signals. Furthermore, each of the first signal and the second signal may include multiple signals (which may also be video signals, audio signals, etc.) by multiplexing, etc. [Explanation of symbols]

[0135] 2. Television

Claims

1. A television having built-in speakers, a first receiving means for receiving a first video signal through a first transmission path; a second receiving means for receiving, via a second transmission path, a first audio signal to be reproduced in synchronization with the first video signal; a synchronizing means for synchronizing the first video signal and the first audio signal based on timing information included in the first video signal and / or the first audio signal to generate a second video signal and a second audio signal synchronized with each other, the second audio signal being capable of being reproduced by the built-in speaker; an output unit that outputs the second audio signal to an audio device that is external to the television and is different from the built-in speaker.

2. 1. A signal processing device, comprising: a first receiving means for receiving a first video signal through a first transmission path; a second receiving means for receiving, via a second transmission path, a first audio signal to be reproduced in synchronization with the first video signal; a synchronization means for synchronizing the first video signal and the first audio signal based on timing information included in the first video signal and / or the first audio signal to generate a second video signal and a second audio signal that are synchronized with each other; an output unit that outputs the second audio signal to an audio device externally connected to the signal processing device.

3. The signal processing device according to claim 2 , wherein the audio device is connected to the signal processing device by an HDMI cable.

4. Equipped with a built-in speaker, 4. The signal processing device according to claim 2, wherein the built-in speaker is muted when the second audio signal is reproduced by the external audio device.

5. Equipped with a built-in speaker, 4. The signal processing device according to claim 2, wherein the second audio signal can be reproduced by the built-in speaker, but when the second audio signal is reproduced by the external audio device, the built-in speaker is muted.

6. 6. A signal processing device according to claim 2, excluding one that outputs the second video signal to the audio device, and excluding one in which the audio device is an AV amplifier.

7. 7. The signal processing device according to claim 1, wherein the audio equipment is an AV amplifier.

8. A signal processing device, receiving a first video signal via a first transmission path; receiving a first audio signal to be reproduced in synchronization with the first video signal through a second transmission path; synchronizing the first video signal and the first audio signal based on timing information included in the first video signal and / or the first audio signal to generate a second video signal and a second audio signal that are synchronized with each other; The signal processing method further comprises outputting the second audio signal to an audio device external to the signal processing device.

9. A signal processing device a synchronization means for synchronizing a first video signal received via a first receiving path with a first audio signal received via a second receiving path, the first video signal being to be reproduced in synchronization with the first video signal, based on timing information included in the first video signal and / or the first audio signal, to generate a second video signal and a second audio signal that are synchronized with each other; a signal processing program that causes the signal processing device to function as an output unit that outputs the second audio signal to an external audio device;

10. A television capable of receiving a video signal via a first network and an audio signal to be reproduced in synchronization with the video signal via a second network, and reproducing the received video signal and audio signal in synchronization with each other, A television that outputs to the audio device either a pre-synchronized audio signal or a synchronized audio signal, the output being determined based on at least one of information about an audio device connected to the television and a user setting.

11. A signal processing device capable of receiving a video signal via a first network and an audio signal to be reproduced in synchronization with the video signal via a second network, and reproducing the received video signal and audio signal in synchronization with each other, A signal processing device that outputs to the audio device either a pre-synchronized audio signal or a synchronized audio signal, the pre-synchronized audio signal being determined based on at least one of information of an audio device connected to the signal processing device and a user setting.

12. A signal processing device capable of receiving a video signal via a first network and an audio signal to be reproduced in synchronization with the video signal via a second network, and reproducing the received video signal and audio signal in synchronization with each other, a signal processing device that outputs, to the audio device, either a pre-synchronized audio signal or a synchronized audio signal, the pre-synchronized audio signal being determined based on information about an audio device connected to the signal processing device;

13. A signal processing device capable of receiving a video signal via a first network and an audio signal to be reproduced in synchronization with the video signal via a second network, and reproducing the received video signal and audio signal in synchronization with each other, A signal processing device that outputs either a pre-synchronized audio signal or a synchronized audio signal, which is determined based on a user setting, to an audio device connected to the signal processing device.

14. A signal processing device capable of receiving a video signal via a first network and an audio signal to be reproduced in synchronization with the video signal via a second network, and reproducing the received video signal and audio signal in synchronization with each other, a signal processing device that outputs either an unsynchronized audio signal or a synchronized audio signal to the audio device;

15. The signal processing device according to any one of claims 11 to 14, wherein the signal processing device is a television.

Images