Transmitting device, transmitting method, receiving device and receiving method

Abstract

The present transmitting device appropriately realizes the simultaneous transmission and reproduction of a compressed audio signal and a linear PCM signal. The transmitting device transmits a continuous audio signal in a prescribed unit to a receiving side through a prescribed transmission path. The continuous audio signal in a prescribed unit is obtained by alternately arranging an audio signal of a prescribed unit including a compressed audio signal and an audio signal of a prescribed unit including a linear PCM signal. The prescribed unit is, for example, a subframe unit.

Description

Technical Field

[0001] The technology of the present invention relates to a transmitting device, a transmitting method, a receiving device, and a receiving method. Background Art

[0002] Transmission of linear PCM signals based on the digital audio interface standard IEC 60958 is widely used. For example, IEC 60958 is disclosed in Patent Document 1. In addition, transmission based on IEC 61937, in which compressed audio signals are transmitted through the IEC 60958 protocol, is also commonly used for various audio codec transmissions.

[0003] The following are examples of such interfaces. The coaxial terminal and the optical output terminal are commercial products known as Sony Philips Digital Interface (SPDIF). In addition, the IEC 60958 protocol is mapped to the High Definition Multimedia Interface (HDMI), Mobile High Definition Link (MHL) and DisplayPort (DisplayPort) as interfaces for multimedia including video, which are commercially available.

[0004] Reference List

[0005] Patent Literature

[0006] Patent Document 1: Japanese Patent Application Laid-Open No. 2009-130606 Summary of the invention

[0007] Technical issues

[0008] When a television is used as a transmitting device and an audio amplifier is used as a receiving / reproducing device, only the sound of the content appearing on the television screen is sent to the audio amplifier for reproduction. Compressed audio codecs are often used for content, and technologies that allow high-quality reproduction, such as multi-channel audio and object-based audio, have been developed. In the case of the codecs described above, powerful digital signal processor (DSP) capabilities are required for decoding, or a large number of speakers need to be arranged, such as a 5.1 channel configuration.

[0009] Therefore, since decoding and reproduction implemented in a television set are high load, a compressed audio signal is generally sent to an audio amplifier through a digital audio interface so that the audio amplifier reproduces sound. There are various forms of content, such as content received through broadcasting, content obtained through playback media such as a Blu-ray disc to be input to a television set, and content streamed or downloaded through the Internet.

[0010] On the other hand, it is necessary to reproduce sound in a television set not only for the playback of content but also for other situations. Examples of such situations include response sounds of user interfaces such as remote controls, synthesized sounds obtained by synthesizing artificial voices and used for artificial intelligence (AI) functions and navigation functions, and multilingual support (multiple languages ​​are initially applied to the content and translated in real time, for example, on the Internet or in the television set). In most of these cases, real-time performance is required compared to the case of content playback. In this case, a linear PCM signal is sent to avoid delays due to decoding. A similar situation also occurs when digital audio transmission is implemented between onboard devices in a vehicle.

[0011] Here, if switching is sequentially implemented between the transmission of compressed audio signals and the transmission of linear PCM signals to implement reproduction, the continuity of content playback will be significantly lost, resulting in a reduction in playback quality. It is also possible to decode the compressed audio signal, mix it with the linear PCM signal, and transmit the signal obtained by mixing. But the TV set does not have the ability to decode all compressed audio signals. In addition, delays will occur during the decoding and mixing process. This is disadvantageous for the application in which real-time performance is necessary as described above. For example, in the case of game content, MPEG-4AAC is used to provide background music. If, for example, there is a delay when transmitting a linear PCM signal in response to the operation implemented by the user through a game controller, it will be difficult for the user to feel comfortable when playing the game.

[0012] In other words, the problem is that there is no digital audio interface method or device that allows the simultaneous transmission and reception of compressed audio signals and linear PCM signals. For this reason, only low-quality speaker reproduction implemented in television sets is applied to linear PCM signals. This leads to a significant deterioration in the user experience. In addition, the problem would be solved if multiple digital audio interfaces were provided and the compressed audio signals and linear PCM signals were sent to different audio amplifiers for reproduction. This would lead to increased costs and more complex device settings. Therefore, what is obtained is a system that is impractical for the average user.

[0013] It is an object of the present invention's techniques to successfully transmit and receive compressed audio signals and linear PCM signals simultaneously.

[0014] Solutions to the Problem

[0015] An idea of ​​the technology of the present invention is to provide a transmitting device, which includes a transmitting part that transmits an audio signal continuous in prescribed units to a receiving side through a prescribed transmission line, wherein the audio signal continuous in prescribed units is obtained by alternately arranging an audio signal of prescribed units including a compressed audio signal and an audio signal of prescribed units including a linear PCM signal.

[0016] In the technology of the present invention, the transmitting part transmits the audio signal in a prescribed unit to the receiving side through a prescribed transmission line. For example, the prescribed transmission line may be one of a coaxial cable, an optical cable, an Ethernet (IEC 61883-6) cable, an HDMI cable, an MHL cable, and a DisplayPort cable.

[0017] The audio signal continuous in the prescribed unit is obtained by alternately arranging the audio signal of the prescribed unit including the compressed audio signal and the audio signal of the prescribed unit including the linear PCM signal. For example, the prescribed unit may be a subframe unit. In addition, the linear PCM signal may be, for example, an audio signal requiring real-time performance. In addition, a first acquisition part for acquiring the compressed audio signal and a second acquisition part for acquiring the linear PCM signal may be included.

[0018] As described above, in the technology of the present invention, a continuous audio signal in a prescribed unit obtained by alternately arranging an audio signal of a prescribed unit including a compressed audio signal and an audio signal of a prescribed unit including a linear PCM signal is transmitted to the receiving side through a prescribed transmission line. This makes it possible to successfully transmit the compressed audio signal and the linear PCM signal at the same time.

[0019] It should be noted that, in the technology of the present invention, for example, an information adder may be further included, the information adder adding identification information to the audio signal transmitted by the transmitting part, the identification information indicating that the audio signal transmitted by the transmitting part is obtained by alternately arranging an audio signal including a prescribed unit of a compressed audio signal and an audio signal including a prescribed unit of a linear PCM signal. In this case, the information adder may add the identification information using a predetermined number of prescribed bit segments of the channel state of each block configured for each of the prescribed units. Such addition of identification information allows the receiving side to easily recognize that the audio signal continuous in prescribed units is obtained by alternately arranging an audio signal including a prescribed unit of a compressed audio signal and an audio signal including a prescribed unit of a linear PCM signal.

[0020] Furthermore, in the technology of the present invention, for example, an information adder may be further included, which adds configuration information indicating the configuration of the linear PCM signal to the audio signal transmitted by the transmitting section. In this case, the information adder may add the configuration information using, for example, a predetermined number of prescribed bit sections for the channel state of each block configured for each of the prescribed units. Such addition of configuration information allows the receiving side to easily recognize the configuration of the linear PCM signal.

[0021] Furthermore, in the technology of the present invention, for example, an information adder may be included, which adds information related to the linear PCM signal to the audio signal transmitted by the transmitting section. In this case, the information adder may, for example, use a continuous predetermined number of user data bits of the prescribed unit to add the information related to the linear PCM signal. Such addition of information related to the linear PCM signal allows the receiving side to appropriately process the linear PCM signal.

[0022] In addition, another idea of ​​the technology of the present invention provides a receiving device, which includes a receiving part that receives an audio signal continuous in prescribed units from a transmitting side through a prescribed transmission line, wherein the audio signal continuous in prescribed units is obtained by alternately arranging an audio signal of prescribed units including a compressed audio signal and an audio signal of prescribed units including a linear PCM signal.

[0023] In the technology of the present invention, a receiving part receives a continuous audio signal in a prescribed unit from a transmitting side through a prescribed transmission line. The continuous audio signal in a prescribed unit is obtained by alternately arranging an audio signal of a prescribed unit including a compressed audio signal and an audio signal of a prescribed unit including a linear PCM signal. For example, a processor may be further included, and the processor processes the compressed audio signal and the linear PCM signal to obtain an output linear PCM signal.

[0024] As described above, in the technology of the present invention, a continuous audio signal in a prescribed unit is received from a transmission side through a prescribed transmission line, and the continuous audio signal in a prescribed unit is obtained by alternately arranging an audio signal in a prescribed unit including a compressed audio signal and an audio signal in a prescribed unit including a linear PCM signal. This makes it possible to successfully reproduce the compressed audio signal and the linear PCM signal at the same time.

[0025] It should be noted that in the technology of the present invention, for example, configuration information indicating the configuration of the linear PCM signal may be added to the audio signal received by the receiving section, and the processor may process the linear PCM signal based on the configuration information. This allows the processor to appropriately process the linear PCM signal according to the configuration of the linear PCM signal.

[0026] Furthermore, in the technology of the present invention, for example, information related to the linear PCM signal can be added to the audio signal received by the receiving section, and the processor can process the linear PCM signal based on the information related to the linear PCM signal. This allows the processor to appropriately process the linear PCM signal based on the information related to the linear PCM signal. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1 is a block diagram showing a configuration example of an AV system according to the embodiment.

[0028] Figure 2 An example of a language name displayed on the display portion of the audio amplifier is shown.

[0029] Figure 3 is a block diagram showing a configuration example of an HDMI receiving section of a television set and an HDMI transmitting section of an audio amplifier.

[0030] Figure 4 A cycle for each item of transmission data when image data having a width of 1920 pixels and a height of 1080 lines is transmitted through the TMDS channel is shown.

[0031] Figure 5 Shows the pinout of the HDMI connector.

[0032] Figure 6 A configuration example of a high-speed bus interface of a television set is shown.

[0033] Figure 7 A configuration example of a high-speed bus interface for an audio amplifier is shown.

[0034] Figure 8 The frame configuration in the IEC 60958 standard is shown.

[0035] Fig. 9 The subframe configuration in the IEC 60958 standard is shown.

[0036] Fig.10 The signal modulation scheme in the IEC 60958 standard is shown.

[0037] Fig.11 Channel coding of the preamble in the IEC 60958 standard is shown.

[0038] Fig.12 The IEC 61937-1 interface format is shown.

[0039] Fig.13 An interface format when a compressed audio signal and a linear PCM signal are transmitted simultaneously (first method) is shown.

[0040] Fig.14 The format of the channel status corresponding to the interface format (first method) is schematically shown.

[0041] Fig.15An example of the correspondence between the value "subframe configuration value (SCV)" and the configuration of the linear PCM signal is shown.

[0042] Fig.16 An example of a frame configuration when the entire stream is transmitted at 48 kHz and when the linear PCM signal has a "mono LPCM" configuration is shown.

[0043] Fig.17 An example of a frame configuration when the entire stream is transmitted at 96 kHz and when the linear PCM signal has a "2-channel stereo LPCM" configuration is shown.

[0044] Fig.18 An example of a frame configuration when the entire stream is transmitted at 96 kHz and when the linear PCM signal has a "mono LPCM" configuration is shown.

[0045] Fig.19 An example of a frame configuration when a compressed audio signal and a linear PCM signal are alternately arranged for each frame is shown.

[0046] Fig. 20 An interface format when a compressed audio signal and a linear PCM signal are transmitted simultaneously (second method) is shown.

[0047] Fig.21 The format of the channel status corresponding to the interface format (second method) is schematically shown.

[0048] Fig. 22 An example of the correspondence between the value "multi-channel configuration value (MCV)" and the configuration of the linear PCM signal is shown.

[0049] Fig.23 Examples of frame configurations in the case of an 8-bit two-channel configuration and a 16-bit monophonic configuration are shown.

[0050] Fig.24 Examples of frame configurations in the case of a 16-bit two-channel configuration and a 16-bit two-channel stereo configuration are shown.

[0051] Fig.25 An example of a frame configuration when a two-channel stereo linear PCM signal and a 5.1-channel linear PCM signal are transmitted is shown.

[0052] Fig.26 An interface format when the first method and the second method are used in combination is shown.

[0053] Fig. 27 An example of a user data message is shown.

[0054] Fig.28An example of information related to a linear PCM signal is shown.

[0055] Fig.29 It is a diagram for describing an operation performed when an operation of switching sound (language) is performed using a television set.

[0056] Fig.30 is a block diagram showing an example of a configuration in which a game console is connected to a television set in order to play a game.

[0057] Fig.31 is a block diagram showing a configuration example of connecting a microphone to a television set in order to sing karaoke songs.

[0058] Fig.32 is a block diagram showing a configuration example of using a navigation system by connecting to a television set. DETAILED DESCRIPTION

[0059] Embodiments for implementing the technology of the present invention (hereinafter referred to as "embodiments") will be described below. It should be noted that the description will be made in the following order.

[0060] 1. Embodiment

[0061] 2. Modification

[0062] <1. Embodiment>

[0063] [Configuration example of AV system]

[0064] Figure 1 One configuration example of the AV system 10 according to the embodiment is shown. The AV system 10 includes a television set 100 and an audio amplifier 200. A receiving antenna 121 for television broadcasting, a Blu-ray disc (BD) player 122, and the Internet 123 are connected to the television set 100. In addition, a two-channel or multi-channel speaker system 250 is connected to the audio amplifier 200. It should be noted that "Blu-ray" is a registered trademark.

[0065] The TV set 100 and the audio amplifier 200 are connected via an HDMI cable 300. It should be noted that "HDMI" is a registered trademark. The TV set 100 includes an HDMI terminal 101 connected to an HDMI receiving section (HDMI RX) 102 and a high-speed bus interface 103 included in a communication section. The audio amplifier 200 includes an HDMI terminal 201 connected to an HDMI transmitting section (HDMI TX) 202 and a high-speed bus interface 203 included in a communication section. One end of the HDMI cable 300 is connected to the HDMI terminal 101 of the TV set 100, and the other end is connected to the HDMI terminal 201 of the audio amplifier 200.

[0066] The television set 100 includes an HDMI receiving section 102, a high-speed bus interface 103, and an SPDIF transmitting circuit 104. In addition, the television set 100 includes a system controller 105, a user interface 106, a digital broadcast receiving circuit 107, a content playback circuit 108, a sound synthesis circuit 109, an Ethernet interface 110, and a downmixing section 111. It should be noted that "Ethernet" is a registered trademark. In addition, in the example shown, in order to simplify the description, the corresponding image-related components are omitted when necessary.

[0067] The system controller 105 controls the operation of each component of the television set 100. A user interface 106 is connected to the system controller 105. The user interface 106 is included in an operation section used by a user to implement various operations, and includes, for example, a remote controller, a touch panel, a mouse, a keyboard, a gesture input section that detects instruction input using a camera, and a voice input section that implements instruction input using voice.

[0068] The digital broadcast receiving circuit 107 processes the television broadcast signal input from the receiving antenna 121, and outputs a compressed audio signal related to the broadcast content. The Ethernet interface 110 communicates with another server via the Internet 123. The content playback circuit 108 selectively extracts a compressed audio signal for broadcast content obtained by the digital broadcast receiving circuit 107, a compressed audio signal for playback content provided by the BD player 122, or a compressed audio signal for Internet content obtained via the Ethernet interface 110, and transmits the extracted compressed audio signal to the SPDIF transmission circuit 104.

[0069] The sound synthesis circuit 109 receives data of an operation sound corresponding to an operation performed on the user interface 106 from the system controller 105, generates a linear PCM signal for the operation sound, and transmits the generated linear PCM signal to the SPDIF transmission circuit 104. Real time performance is ensured by such a linear PCM signal for the operation sound. In addition, the sound synthesis circuit 109 receives data of a notification sound used to notify the user of the receipt of an e-mail from the system controller 105, generates a linear PCM signal for the notification sound, and transmits the generated linear PCM signal to the SPDIF transmission circuit 104.

[0070] In addition, the sound synthesis circuit 109 receives the subtitle data from the digital broadcast receiving circuit 107, generates a linear PCM signal for subtitle sound using subtitle reading software, and transmits the generated linear PCM signal to the SPDIF transmission circuit 104. Real-time performance is ensured by such a linear PCM signal for subtitle sound. Examples of such a case include a case where the broadcast content is a foreign movie, the language of the sound provided by the compressed audio signal is a foreign language, and the foreign movie is a movie with Japanese subtitles. It should be noted that the same applies to the case where there is subtitle data for playback content from the BD player 122 instead of the broadcast content.

[0071] In addition, the voice synthesis circuit 109 receives the voice from the translation server ( Figure 1 The text data of the translated sound (not shown) is obtained by generating a linear PCM signal for the translated sound, and the generated linear PCM signal is transmitted to the SPDIF transmission circuit 104.

[0072] Here, the Ethernet interface 110 receives, for example, a PCM sound signal for the lines in the first language obtained by a compressed audio decoding circuit 206 of the audio amplifier 200 to be described later, through the HDMI transmitting section 202 of the audio amplifier 200 and the HDMI receiving section 102 of the TV 100, and sends the PCM sound signal for the lines in the first language to the translation server so as to receive text data of the translated sound of the lines in the second language from the translation server.

[0073] The downmixing section 111 performs decoding and downmixing on the multi-channel compressed audio signal extracted by the content playback circuit 108, thereby generating a two-channel linear PCM stereo signal, and transmits the generated signal to the SPDIF transmission circuit 104. This allows the multi-channel compressed audio signal and the two-channel linear PCM stereo signal to be simultaneously transmitted from the SPDIF transmission circuit 104. In this case, it is determined by the receiving side which signal will be reproduced. In the example shown, only the audio amplifier 200 is a reproducer on the receiving side, but this method is effective when reproducers with different reproduction capabilities are placed in corresponding rooms among a plurality of rooms.

[0074] The HDMI receiving section 102 implements communication based on HDMI, thereby receiving image data and sound data supplied to the HDMI terminal 101 through the HDMI cable 300. The high-speed bus interface 103 is an interface for a bidirectional communication path formed using a spare line and a hot plug detection (HPD) line included in the HDMI cable 300. It should be noted that the HDMI receiving section 102 and the high-speed bus interface 103 will be described in detail later.

[0075] The SPDIF transmission circuit 104 is a circuit used to transmit a digital audio transmission signal (hereinafter referred to as "SPDIF signal" as the case may be) conforming to the IEC 60958 standard. The SPDIF transmission circuit 104 is a transmission circuit conforming to the IEC 60958 standard. It should be noted that the SPDIF signal will be described in detail later.

[0076] In the present embodiment, the SPDIF transmission circuit 104 transmits the compressed audio signal and the linear PCM signal at the same time. Here, as conceivable methods for simultaneously transmitting the compressed audio signal and the linear PCM signal, there are a first method and a second method.

[0077] In the first method, an audio signal that is continuous for each subframe is obtained by alternately arranging an audio signal for each subframe including a compressed audio signal and an audio signal for each subframe including a linear PCM signal.

[0078] In this case, identification information indicating the configuration of the audio signal (the audio signal that is continuous for each subframe is obtained by alternately arranging the audio signal for each subframe including the compressed audio signal and the audio signal for each subframe including the linear PCM signal), configuration information indicating the configuration of the linear PCM signal, information related to the linear PCM signal, and the like are added to the SPDIF signal transmitted from the SPDIF transmission circuit 104. Examples of the content indicated by the configuration information include mono, two-channel stereo, 5.1 channels, and 7.1 channels. In addition, examples of the information related to the linear PCM signal include language information and speaker position information.

[0079] In the second method, the audio signal for each subframe is a mixed signal of a compressed audio signal and a linear PCM signal.

[0080] In this case, identification information indicating the configuration of the audio signal (the audio signal for each subframe is a mixed signal of the compressed audio signal and the linear PCM signal), configuration information indicating the configuration of the linear PCM signal, information related to the linear PCM signal, and the like are added to the SPDIF signal transmitted from the SPDIF transmission circuit 104. Examples of the contents indicated by the configuration information include a two-channel configuration of an 8-bit linear PCM signal, a two-channel stereo configuration of an 8-bit linear PCM signal, and a one-channel configuration of a 16-bit linear PCM signal. In addition, examples of the information related to the linear PCM signal include language information and speaker position information.

[0081] The audio amplifier 200 includes an HDMI transmission section 202, a high-speed bus interface 203, and an SPDIF reception circuit 204. In addition, the audio amplifier 200 includes a system controller 205, a compressed audio decoding circuit 206, an audio mixer 207, an amplifier 208, a display section 209, and an Ethernet interface 210.

[0082] The system controller 205 controls the operation of each component of the audio amplifier 200. The HDMI transmission section 202 implements communication based on HDMI, thereby transmitting baseband video (image) data and baseband sound data to the HDMI cable 300 through the HDMI terminal 201. The high-speed bus interface 203 is an interface for a bidirectional communication path formed using a spare line and a hot plug detection (HPD) line included in the HDMI cable 300. It should be noted that the HDMI transmission section 202 and the high-speed bus interface 203 will be described in detail later.

[0083] The SPDIF receiving circuit 204 is a circuit used to receive an SPDIF signal (a digital audio signal conforming to the IEC 60958 standard). The SPDIF receiving circuit 204 is a receiving circuit conforming to the IEC 60958 standard. Based on identification information indicating the configuration of the audio signal, the SPDIF receiving circuit 204 separates the audio signal to obtain a compressed audio signal and a linear PCM signal.

[0084] The compressed audio decoding circuit 206 decodes the compressed audio signal received from the SPDIF receiving circuit 204 to obtain a two-channel or multi-channel linear PCM signal.

[0085] Based on the configuration information indicating the configuration of the linear PCM signal, the audio mixer 207 mixes the linear PCM signal obtained by the SPDIF receiving circuit 204 with the linear PCM signal obtained by the compressed audio decoding circuit 206, thereby obtaining a two-channel or multi-channel output linear PCM signal.

[0086] It should be noted that the mixing process used herein includes selecting only one of the linear PCM signals. In addition, the mixing process used herein includes selecting one of the linear PCM signals when the linear PCM signals for multiple channels are transmitted.

[0087] Here, the audio mixer 207 performs rendering processing to obtain PCM sound signals for channels suitable for the configuration of the speaker system 250. In addition, when, for example, speaker position information is added as information related to the linear PCM signal to the linear PCM signal obtained by the SPDIF receiving circuit 204, the audio mixer 207 performs rendering processing so that the sound provided by the linear PCM signal is localized at the speaker position. The amplifier 208 amplifies the two-channel or multi-channel output linear PCM signal provided by the audio mixer 207, thereby providing the amplified signal to the speaker system 250.

[0088] It should be noted that, for example, information indicating that the preset speaker position information is applied may be added to the configuration information indicating the configuration of the linear PCM signal. In this case, the preset speaker position information may be used.

[0089] The display section 209 displays, for example, the state of the audio amplifier 200. For example, when the linear PCM signal from the compressed audio decoding circuit 206 is a signal for a sound of a first language and the linear PCM signal obtained by the SPDIF circuit 204 is a signal for a sound of a second language, the audio mixer 207 selects one of the linear PCM signals and displays the language name associated with the selected linear PCM signal on the display section 209. Here, information on the language of the sound provided by the linear PCM signal from the compressed audio decoding circuit 206 is embedded in the compressed audio signal itself, and information on the language of the sound provided by the linear PCM signal obtained by the SPDIF circuit 204 is added to the audio signal received by the SPDIF receiving circuit 204. Figure 2 (a), (b) and (c) of FIG. 2 each show an example of a language name displayed on the display section 209.

[0090] "Configuration example of HDMI transmitter and HDMI receiver"

[0091] Figure 3 Shows Figure 1 1 and 2. The HDMI receiving section 102 of the television set 100 and the HDMI transmitting section 202 of the audio amplifier 200 in the AV system 10 of FIG. 1 are configuration examples.

[0092] The HDMI transmitting section 202 transmits differential signals for a single screen of baseband (uncompressed) image data to the HDMI receiving section 102 through multiple channels in a single direction in an effective image period (hereinafter referred to as an "active video period") obtained by excluding a horizontal blanking period and a vertical blanking period from a period between a specific vertical synchronization signal and a next vertical synchronization signal (hereinafter referred to as a "video field" as the case may be). In addition, the HDMI transmitting section 202 transmits differential signals corresponding to auxiliary data associated with the image data, including sound data, control packets, and the like, to the HDMI receiving section 102 through multiple channels in a single direction in the horizontal blanking period and the vertical blanking period.

[0093] The HDMI transmission section 202 includes a source signal processor 71 and an HDMI transmitter 72. The source signal processor 71 is supplied with baseband uncompressed image (video) data and baseband uncompressed sound (audio) data. The source signal processor 71 performs necessary processing on the supplied image data and sound data, and provides the HDMI transmitter 72 with each data on which necessary processing has been performed. In addition, the source signal processor 71 exchanges control information and status notification information (control / status) with the HDMI transmitter 72, for example, when necessary.

[0094] The HDMI transmitter 72 converts the image data provided by the source signal processor 71 into corresponding differential signals, and sends the differential signals to the HDMI receiving part 102 through multiple channels (i.e., three TMDS channels #0, #1 and #2) in a single direction. The HDMI receiving part 102 is connected to the HDMI transmitting part 202 via the HDMI cable 300.

[0095] In addition, the transmitter 72 converts auxiliary data and control data into corresponding differential signals, the auxiliary data is provided by the source signal processor 71 and includes sound data associated with uncompressed image data, control packets, etc., and the control data is used to control the vertical synchronization signal (VSYNC) and the horizontal synchronization signal (HSYNC). The source signal processor 71 transmits the differential signal to the HDMI receiving section 102 through three TMDS channels #0, #1 and #2 in a single direction, and the HDMI receiving section 102 is connected to the HDMI transmitting section 202 through the HDMI cable 300.

[0096] In addition, the transmitter 72 sends a pixel clock synchronized with the image data sent through the three TMDS channels #0, #1 and #2 to the HDMI receiving section 102 via the TMDS clock channel, and the HDMI receiving section 102 is connected to the HDMI transmitting section 202 via the HDMI cable 300.

[0097] The HDMI receiving section 102 receives differential signals corresponding to image data and transmitted in a single direction through a plurality of channels in an active video period from the HDMI transmitting section 202. In addition, the HDMI receiving section 102 receives differential signals corresponding to auxiliary data and control data, respectively, and transmitted from the HDMI transmitting section 202 through a plurality of channels in a horizontal blanking period and a vertical blanking period.

[0098] The HDMI receiving section 102 includes an HDMI receiver 81 and a synchronization signal processor 82. The HDMI receiver 81 receives a differential signal corresponding to image data and differential signals corresponding to auxiliary data and control data, respectively, in synchronization with a pixel clock, which is transmitted in a single direction through TMDS channels #0, #1, and #2 from the HDMI transmitting section 202, and the pixel clock is also transmitted through the TMDS clock channel from the HDMI transmitting section 202, which is connected to the HDMI receiving section 102 through the HDMI cable 300. In addition, the HDMI receiver 81 converts the differential signals into image data, auxiliary data, control data, respectively, and provides the obtained data to the synchronization signal processor 82 as necessary.

[0099] The synchronization signal processor 82 performs necessary processing on the data supplied from the HDMI receiver 81 and outputs the processed data. In addition, the synchronization signal processor 82 exchanges control information and status notification information (Control / Status) with the HDMI receiver 81, for example, when necessary.

[0100] The three TMDS channels #0, #1, and #2 used to serially transmit image data, auxiliary data, and control data in a single direction from the HDMI transmitting section 202 to the HDMI receiving section 102 in synchronization with the pixel clock, and the TMDS clock channel as a transmission channel used to transmit the pixel clock are HDMI transmission channels. In addition to these channels, transmission channels called display data channels (DDC) 83 and CEC lines 84 are also HDMI transmission channels.

[0101] The DDC 83 includes two lines (signal lines) (not shown) included in the HDMI cable 300, and is used by the source device to read an enhanced extended display identification (E-EDID) from a sync device connected to the source device through the HDMI cable 300. In other words, the sync device includes the EDID-ROM 85. The source device reads the E-EDID stored in the EDID-ROM 85 from the sync device through the DDC 83, and recognizes the setting and performance of the sync device connected to the source device through the HDMI cable 300 based on the read E-EDID.

[0102] The CEC line 84 includes a single line (not shown) included in the HDMI cable 300 and is used by the source device and the sync device to implement bidirectional communication of control data.

[0103] In addition, the HDMI cable 300 includes a line 86 connected to a hot plug detection (HPD) pin. The source device can use the line 86 to detect the connection with the synchronization device. In addition, the HDMI cable 300 includes a line 87 used to provide power from the source device to the synchronization device. In addition, the HDMI cable 300 includes a spare line 88.

[0104] Figure 4 The period for each transmission data when image data having a width of 1920 pixels and a height of 1080 lines is transmitted through the TMDS channel is shown. Corresponding to the various types of transmission data, there are three types of periods in the video field in which the transmission data is transmitted through the three HDMI TMDS channels, which are the video data period 24, the data island period 25, and the control period 26.

[0105] Here, the period of the video field is the period from the rising edge (active edge) of a specific vertical synchronization signal to the rising edge of the next vertical synchronization signal, and the period of the video field is divided into a horizontal blanking period 22, a vertical blanking period 23 and an effective pixel period (active video period) 21, and the effective pixel period 21 is a period obtained by excluding the horizontal blanking period and the vertical blanking period from the period of the video field.

[0106] The video data period 24 is allocated to the effective pixel period 21. Data of effective pixels (active pixels) of 1920 pixels and 1080 lines constituting a single screen of uncompressed image data is transmitted in the video data period 24. The data island period 25 and the control period 26 are allocated to the horizontal blanking interval 22 and the vertical blanking interval 23. Auxiliary data is transmitted in the data island period 25 and the control period 26.

[0107] In other words, the data island period 25 is allocated to a part of the horizontal blanking period 22 and a part of the vertical blanking period 23. For example, a packet of sound data, which is data not related to control among the auxiliary data, is transmitted in the data island period 25. The control period 26 is allocated to another part of the horizontal blanking period 22 and another part of the vertical blanking period 23. For example, a control packet for controlling the vertical synchronization signal and the horizontal synchronization signal is transmitted in the control period 26, which is data related to control among the auxiliary data.

[0108] Figure 5 1 shows the pin arrangement of the HDMI connector. The figure shows an example of the pin arrangement corresponding to type A. Two lines as differential lines for transmitting TMDS data #i+ and TMDS data #i-, which are differential signals corresponding to TMDS channel #i, are connected to the pins assigned TMDS data #i+ (pins with pin numbers 1, 4, and 7) and the pins assigned TMDS data #i- (pins with pin numbers 3, 6, and 9), respectively.

[0109] Furthermore, a CEC line 84 for carrying a CEC signal corresponding to control data is connected to a pin having a pin number 13, and a pin having a pin number 14 is a spare pin. Furthermore, a line for carrying a serial data (SDA) signal such as E-EDID is connected to a pin having a pin number 16, and a line for carrying a serial clock (SCL) signal as a clock signal used for synchronization when transmitting and receiving the SDA signal is connected to a pin having a pin number 15. The DDC 83 described above includes a line for carrying an SDA signal and a line for carrying an SCL signal.

[0110] In addition, the HPD line 86 described above, which is used by the source device to detect connection with the sync device, is connected to the pin with pin number 19. In addition, the power line 87 described above, which is used to supply power, is connected to the pin with pin number 18.

[0111] "Configuration Example of High-Speed ​​Bus Interface"

[0112] Figure 6 Shows Figure 1 The HDMI cable 300 is a schematic diagram of a configuration example of a high-speed bus interface 103 of the television set 100 in the AV system 10 of FIG. 1. The Ethernet interface 110 implements local area network (LAN) communication, that is, transmission and reception of Ethernet signals using a transmission line including a pair of spare lines and an HPD line among a plurality of lines included in the HDMI cable 300. The SPDIF transmission circuit 104 transmits an SPDIF signal using a transmission line including the pair of lines described above.

[0113] The television set 100 includes a LAN signal transmission circuit 441, a terminator 442, AC coupling capacitors 443 and 444, a LAN signal reception circuit 445, a subtraction circuit 446, adder circuits 449 and 450, and an amplifier 451. These components are included in the high-speed bus interface 103. In addition, the television set 100 includes a choke coil 461, a resistor 462, and a resistor 463 included in the plug connection transmission circuit 128.

[0114] The series circuit of the AC coupling capacitor 443, the terminator 442, and the AC coupling capacitor 444 is connected between the 14-pin terminal 521 and the 19-pin terminal 522 of the HDMI terminal 101. In addition, the series circuit of the resistor 462 and the resistor 463 is connected between the power supply line (+5.0V) and the ground line. In addition, the connection point to which the resistor 462 and the resistor 463 are each connected is connected to the connection point Q4 through the choke coil 461, and the connection point Q4 is the connection point to which the 19-pin terminal 522 and the AC coupling capacitor 444 are each connected.

[0115] The connection point P3 to which the AC coupling capacitor 443 and the terminator 442 are respectively connected is connected to the output side of the adder circuit 449, and is connected to the positive input side of the LAN signal receiving circuit 445. In addition, the connection point P4 to which the AC coupling capacitor 444 and the terminator 442 are respectively connected is connected to the output side of the adder circuit 450, and is connected to the negative input side of the LAN signal receiving circuit 445.

[0116] One of the input sides of the adder circuit 449 is connected to the positive output side of the LAN signal transmission circuit 441, and the SPDIF signal output from the SPDIF transmission circuit 104 is supplied to the other input side of the adder circuit 449 through the amplifier 451. In addition, one of the input sides of the adder circuit 450 is connected to the negative output side of the LAN signal transmission circuit 441, and the SPDIF signal output from the SPDIF transmission circuit 104 is supplied to the other input side of the adder circuit 450 through the amplifier 451.

[0117] The transmission signal (transmission data) SG417 is provided from the Ethernet interface 110 to the input side of the LAN signal transmission circuit 441. In addition, the output signal SG418 of the LAN signal receiving circuit 445 is provided to the positive terminal of the subtraction circuit 446, and the transmission signal SG417 is provided to the negative terminal of the subtraction circuit 446. In the subtraction circuit 446, the transmission signal SG417 is subtracted from the output signal SG418 of the LAN signal receiving circuit 445, thereby obtaining the reception signal (reception data) SG419. When the LAN signal (Ethernet signal) is carried as a differential signal by the backup line and the HPD line, the reception signal SG419 is the carried LAN signal. The reception signal SG419 is provided to the Ethernet interface 110.

[0118] Figure 7 Shows Figure 1 The HDMI cable 610 is a schematic diagram of a configuration example of the high-speed bus interface 203 of the audio amplifier 200 of the AV system 10. The Ethernet interface 210 implements local area network (LAN) communication, that is, transmission and reception of Ethernet signals using a transmission line including a pair of spare lines and an HPD line among a plurality of lines included in the HDMI cable 610. The SPDIF reception circuit 204 receives the SPDIF signal using the transmission line including the pair of lines described above.

[0119] The audio amplifier 200 includes a LAN signal transmission circuit 411, a terminator 412, AC coupling capacitors 413 and 414, a LAN signal reception circuit 415, a subtraction circuit 416, an adder circuit 419, and an amplifier 420. These components are included in the high-speed bus interface 203. In addition, the audio amplifier 200 includes a pull-down resistor 431, a resistor 432, a capacitor 433, and a comparator 434 included in the plug connection detection circuit 221. Here, the resistor 432 and the capacitor 433 are included in a low-pass filter.

[0120] A series circuit of the AC coupling capacitor 413, the terminator 412, and the AC coupling capacitor 414 is connected between the 14-pin terminal 511 and the 19-pin terminal 512 of the HDMI terminal 201. A connection point P1 to which the AC coupling capacitor 413 and the terminator 412 are respectively connected is connected to the positive output side of the LAN signal transmission circuit 411, and is connected to the positive input side of the LAN signal reception circuit 415.

[0121] The connection point P2 to which the AC coupling capacitor 414 and the terminator 412 are respectively connected is connected to the negative output side of the LAN signal transmission circuit 411, and is connected to the negative input side of the LAN signal reception circuit 415. A transmission signal (transmission data) SG411 is supplied from the Ethernet interface 210 to the input side of the LAN signal transmission circuit 411.

[0122] The output signal SG412 of the LAN signal receiving circuit 415 is supplied to the positive terminal of the subtraction circuit 416, and the transmission signal (transmission data) SG411 is supplied to the negative terminal of the subtraction circuit 416. In the subtraction circuit 416, the transmission signal SG411 is subtracted from the output signal SG412 of the LAN signal receiving circuit 415, thereby obtaining the reception signal SG413. When the LAN signal (Ethernet signal) is carried as a differential signal by the backup line and the HPD line, the reception signal SG413 is the carried LAN signal. The reception signal SG413 is supplied to the Ethernet interface 210.

[0123] The connection point Q2 to which the AC coupling capacitor 414 and the 19-pin terminal 512 are respectively connected is connected to the ground line through the pull-down resistor 431, and is connected to the ground line through the series circuit of the resistor 432 and the capacitor 433. In addition, the output signal of the low-pass filter obtained at the connection point to which the resistor 432 and the capacitor 433 are respectively connected is supplied to one of the input terminals of the comparator 434. In the comparator 434, the output signal of the low-pass filter is compared with the reference voltage Vref2 (+1.4V) supplied to the other input terminal of the comparator 434. The output signal SG415 of the comparator 434 is supplied to the control part (CPU) (not shown) of the audio amplifier 200.

[0124] Furthermore, a connection point P1 to which the AC coupling capacitor 413 and the terminator 412 are respectively connected is connected to one of the input terminals of the adder circuit 419. Furthermore, a connection point P2 to which the AC coupling capacitor 414 and the terminator 412 are respectively connected is connected to the other input terminal of the adder circuit 419. An output signal of the adder circuit 419 is provided to the SPDIF receiving circuit 204 through the amplifier 420. When the SPDIF signal is carried as an in-phase signal by the spare line and the HPD line, the output signal of the adder circuit 419 is the carried SPDIF signal.

[0125] "Details of SPDIF signal"

[0126] First, an overview of the IEC 60958 standard is described. Figure 8The frame configuration in the IEC 60958 standard is shown. Each frame includes two subframes. In the case of 2-channel stereo, the first subframe includes the left channel signal and the second subframe includes the right channel signal.

[0127] A preamble is provided at the beginning of a subframe, which will be described later. "M" indicating the preamble is given for the left channel signal, and "W" indicating the preamble is given for the right channel signal. It should be noted that "B" indicating the start of a block is given for the preamble at the beginning of each 192 frames. In other words, one block includes 192 frames. A channel state described later is created for each block.

[0128] Fig. 9 1 shows a subframe configuration in the IEC 60958 standard. A subframe includes a total of 32 time slots, namely, the 0th to 31st time slots. The 0th to 3rd time slots correspond to the preamble (synchronization preamble). As described above, the preamble is represented by one of "M", "W" and "B" to distinguish between left and right channels and indicate the starting position of a block.

[0129] The 4th to 27th time slots correspond to the main data field, and when a 24-bit code range is used, all of the 4th to 27th time slots correspond to audio data. In addition, when a 20-bit code range is used, the 8th to 27th time slots correspond to audio data (audio sample words). In the latter case, the 4th to 7th time slots can be used as additional information (auxiliary sample bits). The example shown is the latter case.

[0130] The 28th time slot corresponds to the validity flag of the main data field. The 29th time slot corresponds to one bit of user data. By accumulating 29 time slots of each frame, a series of user data can be constructed. A message of user data is formed for each 8-bit information unit (IU), and a single message includes 3 to 129 information units.

[0131] There can be zero to eight "0" bits between information units. The beginning of an information unit is identified by the leading bit "1". The first seven information units in a message are reserved, and the user can set any information for the eighth and subsequent information units. Messages are separated by eight or more "0" bits.

[0132] The 30th time slot corresponds to one bit of the channel state. By accumulating the 30th time slot of each frame for each block, a series of channel states can be constructed. It should be noted that the beginning position of a block is indicated by the preamble (0th to 3rd time slots) represented by "B", as described above.

[0133] The 31st time slot corresponds to a parity bit. The parity bit is added so that the sum of "0" and "1" included in the 4th to 31st time slots is an even number.

[0134] Fig.10 The signal modulation scheme in the IEC 60958 standard is shown. Biphase mark modulation is implemented for the 4th to 31st time slots obtained by excluding the preamble from the subframe. A clock with twice the rate of the original signal (source coding) is used when implementing biphase mark modulation. When the clock cycle of the original signal is separated into the first half and the second half, the output when implementing biphase mark modulation is inverted at the edge of the first half clock cycle without exception. In addition, at the edge of the second half clock cycle, the output is inverted when the original signal indicates "1", and the output is not inverted when the original signal indicates "0". This makes it possible to extract the clock component of the original signal from the signal to which biphase mark modulation is implemented.

[0135] Fig.11 The channel coding of the preamble in the IEC 60958 standard is shown. As described above, bi-phase mark modulation is implemented for the 4th to 31st time slots in the subframe. On the other hand, normal bi-phase mark modulation is implemented for the preambles of the 0th to 3rd time slots, and the preambles of the 0th to 3rd time slots are treated in the form of a bit pattern synchronized with a double-speed clock. In other words, two bits are assigned to each time slot among the 0th to 3rd time slots, thereby obtaining the 8-bit pattern shown in the figure.

[0136] When the most recent state is "0", "11101000" is assigned to the preamble "B", "11100010" is assigned to the preamble "M", and "11100100" is assigned to the preamble "W". On the other hand, when the most recent state is "1", "00010111" is assigned to the preamble "B", "00011101" is assigned to the preamble "M", and "00011011" is assigned to the preamble "W".

[0137] The format used to transmit compressed audio signals via a protocol compliant with the IEC 60958 standard is defined in the IEC 61937-1 standard. Fig.12 The IEC 61937-1 interface format is shown. Fig.12 (a) shows a frame configuration. A single block includes 192 frames, and the format includes a series of blocks. Fig.12 (b) shows that each frame includes two subframes.

[0138] A preamble is provided at the beginning of a subframe, and a preamble of a subframe at the beginning of one block is given "B" indicating the start of one block. In addition, "W" and "M" are alternately given to preambles located at the beginning of subsequent subframes, respectively.

[0139] Fig.12(c) shows the subframe configuration. In the case of an SPDIF signal including a compressed audio signal of a specified number of channels, the bit stream of the compressed audio signal is separated, and the bit stream obtained by the separation is sequentially inserted into the 12th to 27th time slots of each subframe. In other words, the upper 16 bits of the 24-bit audio data segment of the 4th to 27th time slots of each subframe are used to transmit the compressed audio signal.

[0140] In the present embodiment, the compressed audio signal and the linear PCM signal are transmitted simultaneously. As described above, the first method and the second method are conceivable methods for transmitting the compressed audio signal and the linear PCM signal simultaneously.

[0141] The first method is described in detail. In this case, an audio signal that is continuous for each subframe is obtained by alternately arranging an audio signal for each subframe including a compressed audio signal and an audio signal for each subframe including a linear PCM signal.

[0142] Fig.13 The interface format when the first method is adopted is shown. Fig.13 (a) shows a frame configuration. A single block includes 192 frames, and the format includes a series of blocks.

[0143] Fig.13 (b) shows that each frame includes two subframes. The odd subframes store compressed audio signals in accordance with the IEC61937-1 standard, and the even subframes store audio signals in the linear PCM format in accordance with the IEC60958 standard.

[0144] It should be noted that odd-numbered subframes can store audio signals in linear PCM format and even-numbered subframes can store compressed audio formats, but the positional relationship is predetermined.

[0145] As described above, identification information indicating the configuration of the audio channel (the audio signal that is continuous for each subframe is obtained by alternately arranging the audio signal for each subframe including the compressed audio signal and the audio signal for each subframe including the linear PCM signal) and configuration information indicating the configuration of the linear PCM signal are added to the audio signal transmitted from the SPDIF transmission circuit 104. In the present embodiment, the channel status bits are used to add the various items of information.

[0146] Fig.14 The format of the channel status when the first method is adopted is schematically shown. The entire channel status includes bytes 0 to 23. The a=“0” of the 0th bit indicates that the channel status is for consumer use. In addition, as in the case of the IEC 61937-1 interface format, the b=“1” of the 1st bit indicates that it is used for the transmission of compressed audio signals.

[0147] It should be noted that, regarding the three bits from the 3rd to the 5th bit, "000" is assigned in the conventional IEC 61937-1 interface format, and the operation is satisfactorily implemented using the same application as the conventional IEC 61937-1 interface format. However, different values ​​may be assigned to distinguish the format from the conventional IEC 61937-1 interface format. In the example shown, "100" is assigned.

[0148] Regarding the four bits from the 49th to the 52nd bit, "0000" is assigned in the conventional IEC 61937-1 interface format. However, a value different from the conventional IEC 61937-1 interface format is assigned, and the value represents identification information (subframe configuration) indicating the configuration of the audio signal. Here, for example, "1111" is assigned, indicating that an audio signal that is continuous for each subframe is obtained by alternately arranging an audio signal for each subframe including a compressed audio signal and an audio signal for each subframe including a linear PCM signal.

[0149] Furthermore, when "1111" is assigned to the four bits of bits 49 to 52, as described above, the subsequent eight bits of bits 53 to 60 are valid. The eight bits represent configuration information indicating the configuration of the linear PCM signal.

[0150] Fig.15 An example of the correspondence between the value of the eight bits "subframe configuration value" from the 53rd to the 60th bit and the configuration "configuration" of the linear PCM signal is shown. For example, "10000000" represents "mono LPCM", "01000000" represents "2-channel stereo LPCM", "00100000" represents "5.1-channel LPCM", and "10100000" represents "7.1-channel LPCM".

[0151] Fig.16 An example of a frame configuration when the entire stream is sent at 48kHz and when the linear PCM signal has a "mono LPCM" configuration is shown. In this case, the odd subframes include the compressed audio signal and the even subframes include the mono linear PCM signal. It should be noted that, as described previously, when the entire stream is sent at 48kHz, the 48kHz linear PCM signal is sent over at most one channel. Therefore, if the SCV specifies two or more channels, this will be invalid.

[0152] Fig.17An example of a frame configuration when the entire stream is transmitted at 96kHz and when the linear PCM signal has a "2-channel stereo LPCM" configuration is shown. When the entire stream is transmitted at 48kHz, the 48kHz linear PCM signal is transmitted through two channels. In this case, transmission through the first channel (usually the L channel) is implemented in the W preamble next to the B preamble at the beginning of the block, and transmission through the second channel (usually the R channel) is implemented in the W preamble next to the M preamble after the W preamble next to the B preamble. Transmission through the first channel and transmission through the second channel are then alternately implemented.

[0153] Likewise, the increase in the transmission rate of the entire stream makes it possible to transmit, for example, "5.1 channel LPCM" and "7.1 channel LPCM".

[0154] It should be noted that the insertion of the invalid subframe makes it possible to reduce the sampling frequency of the portion corresponding to the linear PCM signal. Fig.18 An example of a frame configuration when the entire stream is transmitted at 96kHz and when the linear PCM signal has a "mono LPCM" configuration is shown. In this case, every fourth subframe is an invalid subframe. When the transmission rate is 96kHz and the SCV specifies "mono LPCM", the linear PCM signal has the frame configuration shown in the figure.

[0155] The above describes an example in which the compressed audio signal and the linear PCM signal are alternately arranged for each subframe. However, it is also possible to adopt a configuration in which the compressed audio signal and the linear PCM signal are alternately arranged for each frame. Fig.19 An example of a frame configuration in this case is shown. In this case, a compressed audio signal is sent in the B preamble at the beginning of a block, and a linear PCM signal is sent in the M preamble after the W preamble next to the B preamble and in the W preamble next to the M preamble. The previously described process is then repeated.

[0156] The second method is described in detail below. In this case, the audio signal for each subframe is a mixture of a compressed audio signal and a linear PCM signal.

[0157] Fig. 20 The interface format when a compressed audio signal and a linear PCM signal are transmitted simultaneously is shown. Fig. 20 (a) and (b) are similar to Fig.12 (a) and (b) of . Fig.13 (c) shows the subframe configuration. The upper 16 bits of the 24-bit audio data segment of the 4th to 27th time slots of each subframe are used to transmit the compressed audio signal, and the lower 8 bits are used to transmit the linear PCM signal.

[0158] As described above, identification information indicating the configuration of the audio channel (the audio signal for each subframe is a mixed signal of the compressed audio signal and the linear PCM signal) and configuration information indicating the configuration of the linear PCM signal are added to the audio signal transmitted from the SPDIF transmission circuit 104. In the present embodiment, the channel status bits are used to add the various items of information.

[0159] Fig.21 The format of the channel status when the compressed audio signal and the linear PCM signal are sent simultaneously is schematically shown. The entire channel status includes bytes 0 to 23. The a=“0” of the 0th bit indicates that the channel status is for consumer use. In addition, as in the case of the IEC 61937-1 interface format, the b=“1” of the 1st bit indicates that it is used for the transmission of the compressed digital audio signal.

[0160] It should be noted that, regarding the three bits from the 3rd to the 5th bit, "000" is assigned in the conventional IEC 61937-1 interface format, and the operation is satisfactorily implemented using the same application as the conventional IEC 61937-1 interface format. However, different values ​​may be assigned to distinguish the format from the conventional IEC 61937-1 interface format. In the example shown, "100" is assigned.

[0161] Regarding the four bits from the 49th to the 52nd bit, "0000" is assigned in the conventional IEC 61937-1 interface format. However, a value different from the conventional IEC 61937-1 interface format is assigned, and the value represents identification information indicating that the audio signal for each subframe is a mixed signal of a compressed audio signal and a linear PCM signal. In the example shown, "1111" is assigned. In addition, the value of the four bits from the 49th to the 52nd bit indicates that the audio signal for each subframe is a mixed signal, and the subsequent eight bits from the 53rd to the 60th bit are valid.

[0162] The eight bits represent configuration information indicating the configuration of the linear PCM signal. Fig. 22 An example of the correspondence between the value of the eight bits "multi-channel configuration value" from the 53rd to the 60th bit and the configuration of the linear PCM signal is shown. For example, "10000000" represents the "8-bit LPCM 2-channel" configuration, that is, the 8-bit dual-channel configuration. In addition, for example, "01000000" represents the "8-bit LPCM stereo 2-channel" configuration, that is, the 8-bit dual-channel stereo configuration.

[0163] In addition, for example, "00100000" represents a "16-bit LPCM 1 channel" configuration, that is, a 16-bit mono configuration. In addition, for example, "10100000" represents a "16-bit LPCM 2 channel" configuration, that is, a 16-bit dual-channel configuration. In addition, for example, "01100000" represents a "16-bit LPCM stereo 2 channel" configuration, that is, a 16-bit dual-channel stereo configuration. In addition, for example, "11100000" represents a "16-bit LPCM 4 channel" configuration, that is, a 16-bit four-channel configuration.

[0164] Fig.23 (a) shows an example of a frame configuration in the case of an 8-bit dual-channel configuration. In this case, the eight-bit linear PCM signal of channel 1 is assigned to the lower eight bits of the A channel, and the eight-bit linear PCM signal of channel 2 is assigned to the lower eight bits of the B channel.

[0165] Fig.23 (b) shows an example of a frame configuration in the case of a 16-bit mono configuration. In this case, the linear PCM signal of the upper eight bits of channel 1 is assigned to the lower eight bits of channel A, and the linear PCM signal of the lower eight bits of channel 1 is assigned to the lower eight bits of channel B.

[0166] Fig.24 (a) shows an example of a frame configuration in the case of a 16-bit two-channel configuration. When the transmission rate is doubled, that is, for example, when the original sampling frequency is 48kHz and the transmission rate is 96kHz, the sampling frequency of the linear PCM signal is not changed to 96kHz, but remains at 48kHz.

[0167] In this case, the linear PCM signal of the upper eight bits of channel 1 is assigned to the lower eight bits of the odd-numbered A channel from the beginning of the block, and the linear PCM signal of the lower eight bits of channel 1 is assigned to the lower eight bits of the odd-numbered B channel from the beginning of the block. The linear PCM signal of the upper eight bits of channel 2 is assigned to the lower eight bits of the even-numbered A channel from the beginning of the block, and the linear PCM signal of the lower eight bits of channel 2 is assigned to the lower eight bits of the even-numbered B channel from the beginning of the block.

[0168] Fig.24 (b) shows an example of a frame configuration in the case of a 16-bit two-channel stereo configuration. When the transmission rate is doubled, that is, for example, when the original sampling frequency is 48kHz and the transmission rate is 96kHz, the sampling frequency of the linear PCM signal is not changed to 96kHz, but remains at 48kHz.

[0169] In this case, the linear PCM signal of the upper eight bits of the L channel is assigned to the lower eight bits of the odd-numbered A channel from the beginning of the block, and the linear PCM signal of the lower eight bits of the L channel is assigned to the lower eight bits of the odd-numbered B channel from the beginning of the block. The linear PCM signal of the upper eight bits of the R channel is assigned to the lower eight bits of the even-numbered A channel from the beginning of the block, and the linear PCM signal of the lower eight bits of the R channel is assigned to the lower eight bits of the even-numbered B channel from the beginning of the block.

[0170] In addition, although its illustration is omitted, when the frame configuration is a 16-bit four-channel configuration, the transmission rate is increased to four times, and a 4-channel linear PCM signal is assigned. Similarly, the number of channels can be increased, the number of bits can be set to 32 bits, and a linear PCM signal of, for example, 5.1 channels can also be transmitted. Its detailed description is omitted.

[0171] Fig.25 An example of a frame configuration when a two-channel stereo linear PCM signal and a 5.1-channel linear PCM signal are transmitted is shown. In this case, the two-channel stereo linear PCM signal is assigned to the first pair of A and B channels from the beginning of the block, and the 5.1-channel linear PCM signal is assigned to the subsequent three pairs of A and B channels. The previously described process is then repeated.

[0172] It should be noted that the first method and the second method described above may be used in combination to increase the number of channels that may be used to transmit a linear PCM signal. Fig.26 An interface format when the first method and the second method are used in combination is shown. Fig.26 (a) shows a frame configuration. A single block includes 192 frames, and the format includes a series of blocks.

[0173] Fig.26 (b) shows that each frame includes two subframes. The odd subframes store compressed audio signals in accordance with the IEC61937-1 standard, and the even subframes store audio signals in the linear PCM format in accordance with the IEC60958 standard.

[0174] In addition, the upper 16 bits of the 24-bit audio data segment of the 4th to 27th time slots of the odd subframe storing the compressed audio signal are used to transmit the compressed audio signal, and the lower 8 bits are used to transmit the linear PCM signal.

[0175] Furthermore, as described previously, various information related to the linear PCM signal is added to the audio signal transmitted from the SPDIF transmission circuit 104. In the present embodiment, the information is added using user bits.

[0176] Fig. 27An example of a user data message is shown. The user data message includes ten information units (IUs). Information about "IEC 61937-1 ID", that is, identification information indicating the type of information, is arranged in bits 4 to 0 of the second IU and bits 5 to 2 of the third IU. In addition, a four-byte information field is provided in bits 1 to 0 of the third IU and bits 5 to 0 of the fourth to eighth IUs. It should be noted that the number of bytes used for the information field is not limited to four.

[0177] Fig.28 An example of information is shown. For example, when "IEC 61937-1ID" is "10000000", language information about the sound provided by the linear PCM signal is indicated. In this case, ASCII character information indicating the abbreviation of the language name is arranged in a four-byte information field. In addition, for example, when "IEC 61937-1ID" is "01000000", information about the position of the speaker that reproduces the sound provided by the linear PCM signal is indicated. In this case, information indicating the channel number, angle, height, and distance are arranged in a four-byte information field. It should be noted that the information shown is merely an example, and the information is not limited to this. Fig. 27 The use of the user data message shown in makes it possible to send various information related to the linear PCM signal to the receiving side.

[0178] As described earlier, in Figure 1 In the AV system 10 shown in FIG. 1 , the television set 100 can successfully transmit the compressed audio signal and the linear PCM signal to the audio amplifier 200 at the same time, and further the audio amplifier 200 can successfully reproduce the compressed audio signal and the linear PCM signal at the same time.

[0179] Furthermore, when watching the image of the broadcast content using the television set 100 and enjoying the 5.1 channel surround sound using the audio amplifier 200, for example, Figure 1 The following processing is implemented in the AV system 10 shown in . (1) A notification sound used to notify that an e-mail has been received can be reproduced. (2) The sound of an operation performed on the user interface 106 can be reproduced. (3) The sound obtained by converting the subtitle data can be reproduced. (4) The language of the sound reproduced by the audio amplifier 200 can be switched, and the language name can be displayed on the display portion 209 of the audio amplifier 200. (5) The sound provided by the linear PCM signal can be reproduced, and the position where the reproduced sound is to be located can be changed based on the speaker position information.

[0180] It should be noted that the effects described herein are not limiting but illustrative, and may provide additional effects.

[0181] <2. Modification>

[0182] It should be noted that in the previously described embodiment, when the sound provided by the compressed audio signal is the first language and the sound provided by the linear PCM signal is the second language, the language can be switched by an operation performed by the user using the audio amplifier 200. However, the switching operation can also be performed using the television 100.

[0183] Fig.29 is a diagram for describing the operations performed in this case, in which the routes related to the operations are indicated by dotted lines. Fig.29 In, use Figure 1 The same reference numerals as those in Figure 1 First, the user uses the user interface 106 (such as a remote controller) of the television 100 to implement an operation of switching sound. In response to the operation, the system controller 105 of the television 100 sends a sound switching command to the system controller 205 of the audio amplifier 200 through the CEC line of the HDMI cable 300.

[0184] The system controller 205 of the audio amplifier 200 controls the audio mixer 207 to switch the sound based on the sound switching command, and reports the completion of switching the sound to the system controller 105 of the television 100 through the CEC line of the HDMI cable 300. Based on the report, the system controller 105 of the television 100 displays the name of the language used after the switching is implemented on the display 112.

[0185] Fig.30 FIG. 1 shows an example of a configuration in which a game console 124 is connected to a television set 100 for playing games. Fig.30 In, use Figure 1 The same reference numerals as those in Figure 1 In this case, the compressed audio signal of the soundtrack and the linear PCM signal of the real-time response sound given by the game controller are output from the game machine 124. These multi-channel compressed audio signals and the linear PCM signal are provided to the SPDIF transmission circuit 104 so as to be simultaneously transmitted to the audio amplifier 200. The soundtrack and the real-time response sound are simultaneously reproduced by the audio amplifier 200.

[0186] It should be noted that a linear PCM signal for arbitrarily changing a sound source for localizing a position of a sound may be output from the gaming machine 124, the linear PCM signal may be supplied to the SPDIF transmission circuit 104, and the linear PCM signal and the compressed audio signal may be simultaneously transmitted to the audio amplifier 200. In this case, the speaker position information is added as information related to the linear PCM signal, which results in the localization processing being implemented in real time in the audio mixer 207 of the audio amplifier 200.

[0187] Fig.31 A configuration example is shown in which a microphone 125 is connected to the television set 100 so as to sing a karaoke song. Fig.31 In, use Figure 1 The same reference numerals as those in Figure 1 In this case, for example, a karaoke compressed audio signal is obtained from the BD player 122. In addition, a linear PCM signal corresponding to the user's singing is obtained from the microphone 125. The karaoke compressed audio signal and the linear PCM signal from the microphone 125 are provided to the SPDIF transmission circuit 104 for simultaneous transmission to the audio amplifier 200. The sound of the accompaniment music and the sound of the singing are simultaneously reproduced in the audio amplifier 200.

[0188] In this case, the sound of the accompaniment is provided by a karaoke compressed audio signal, and the sound of singing is provided by a linear PCM signal, whose quality level is higher than that of the sound of the accompaniment. This leads to the advantage that the sound of singing sounds better. In addition, the sound of singing is sent by a linear PCM signal, so the time delay is lower. This leads to being able to sing easily.

[0189] Fig.32 1 shows a configuration example of using the navigation system 126 by connecting to the television set 100, which is intended to be used in a vehicle. Fig.32 In, use Figure 1 The same reference numerals as those in Figure 1 In this case, the linear PCM signal of the audio guide from the navigation system 126 is provided to the SPDIF transmission circuit 104 to be transmitted to the audio amplifier 200 simultaneously with the compressed audio signal. In the audio amplifier 200, the navigation sound is reproduced in real time in a state of being superimposed on the reproduced sound of the broadcast content or the playback content.

[0190] It should be noted that in VR / AR applications, the technology of the present invention is also applicable when real-time changing background sounds and synthesized sounds are sent simultaneously, but a detailed description thereof is omitted. In this case, the background sounds are sent by compressed audio signals and the synthesized sounds are sent by linear PCM signals. In addition, in the field of health care, the technology of the present invention is also applicable when signals for controlling the motors at each position of the massage chair are sent through linear PCM channels while playing multi-channel music on the massage chair. Linear PCM allows the representation of DC levels, although it is difficult to provide such representation using compression.

[0191] In the foregoing embodiments, an example of using HDMI ARC as an IEC 60958 transmission line is described. However, it is also conceivable to use a coaxial cable or an optical cable as an example of an IEC 60958 transmission line. It is also conceivable to use an HDMI transmission line as an example of an IEC 60958 transmission line. In addition, it is also conceivable to use an HDMI transmission line as an example of an IEC 60958 transmission line. In this case, the SPDIF signal (IEC 60958 signal) is mapped to an audio sample packet to be sent in the forward direction, which is the same direction as the video transmission. Similarly, it is also conceivable to use, for example, an IEC 61883-6 transmission line, an MHL transmission line, or a display port transmission line (DP transmission line) as an example of an IEC 60958 transmission line. In these cases, the SPDIF signal (IEC 60958 signal) is also mapped to an audio sample packet to be sent in the forward direction, which is the same direction as the video transmission.

[0192] In addition, the advantageous embodiments of the present disclosure are described in detail above with reference to the accompanying drawings. However, the technical scope of the present disclosure is not limited to these examples. It is obvious that a person of ordinary skill in the technical field of the present disclosure can conceive of various changes or modifications within the scope of the technical idea of ​​an embodiment of the present disclosure. It should be understood that such changes or modifications certainly also fall within the technical scope of the present disclosure.

[0193] Furthermore, the technology may also take the following configurations.

[0194] (1) A sending device, comprising:

[0195] The transmitting part transmits a continuous audio signal in prescribed units to a receiving side through a prescribed transmitting line, wherein the continuous audio signal in prescribed units is obtained by alternately arranging an audio signal in prescribed units including a compressed audio signal and an audio signal in prescribed units including a linear PCM signal.

[0196] (2) The transmitting device according to (1), wherein

[0197] The prescribed unit is a subframe unit.

[0198] (3) The transmitting device according to (1) or (2), wherein

[0199] The linear PCM signal is an audio signal requiring real-time performance.

[0200] (4) The transmitting device according to any one of (1) to (3), further comprising:

[0201] An information adder adds identification information to the audio signal transmitted by the transmitting section, the identification information indicating that the audio signal transmitted by the transmitting section is obtained by alternately arranging an audio signal including a prescribed unit of a compressed audio signal and an audio signal including a prescribed unit of a linear PCM signal.

[0202] (5) The transmitting device according to any one of (1) to (4), wherein

[0203] The information adder adds identification information using a predetermined number of prescribed bit sections for the channel state of each block per the prescribed unit configuration.

[0204] (6) The transmitting device according to any one of (1) to (5), further comprising:

[0205] An information adder adds configuration information indicating a configuration of the linear PCM signal to the audio signal transmitted by the transmitting section.

[0206] (7) The transmitting device according to (6), wherein

[0207] The information adder adds configuration information using a predetermined number of prescribed bit sections for the channel status of each block per the prescribed unit configuration.

[0208] (8) The transmitting device according to any one of (1) to (7), further comprising:

[0209] An information adder adds information related to the linear PCM signal to the audio signal transmitted by the transmitting section.

[0210] (9) The transmitting device according to (8), wherein

[0211] The information adder adds the information related to the linear PCM signal using a continuous predetermined number of user data bits of the prescribed unit.

[0212] (10) The transmitting device according to any one of (1) to (9), further comprising:

[0213] acquiring a first acquired portion of a compressed audio signal; and

[0214] A second acquired portion of the linear PCM signal is acquired.

[0215] (11) The transmitting device according to any one of (1) to (10), wherein

[0216] The prescribed transmission line is one of a coaxial cable, an optical cable, an Ethernet (IEC 61883-6) cable, an HDMI cable, an MHL cable, and a DisplayPort cable.

[0217] (12) A sending method, comprising:

[0218] An audio signal continuous in prescribed units is transmitted to a receiving side through a prescribed transmission line, wherein the audio signal continuous in prescribed units is obtained by alternately arranging an audio signal of prescribed units including a compressed audio signal and an audio signal of prescribed units including a linear PCM signal.

[0219] (13) A receiving device comprising:

[0220] The receiving part receives the audio signal continuous in prescribed units from the transmitting side through the prescribed transmission line, wherein the audio signal continuous in prescribed units is obtained by alternately arranging the audio signal of prescribed units including the compressed audio signal and the audio signal of prescribed units including the linear PCM signal.

[0221] (14) The receiving device according to (13), further comprising:

[0222] The processor processes the compressed audio signal and the linear PCM signal to obtain an output linear PCM signal.

[0223] (15) The receiving device according to (14), wherein

[0224] Configuration information indicating the configuration of the linear PCM signal is added to the audio signal received by the receiving section, and

[0225] The processor processes the linear PCM signal based on the configuration information.

[0226] (16) A receiving device according to (14) or (15), wherein

[0227] Information related to the linear PCM signal is added to the audio signal received by the receiving section, and

[0228] The processor processes the linear PCM signal based on the information related to the linear PCM signal.

[0229] (17) A receiving method, comprising:

[0230] An audio signal continuous in prescribed units is received from a transmission side through a prescribed transmission line, wherein the audio signal continuous in prescribed units is obtained by alternately arranging an audio signal of prescribed units including a compressed audio signal and an audio signal of prescribed units including a linear PCM signal.

[0231] Reference numerals list

[0232] 10——AV system

[0233] 100 – Television

[0234] 101——HDMI terminal

[0235] 102——HDMI receiving part

[0236] 103——High-speed bus interface

[0237] 104——SPDIF sending circuit

[0238] 105——System Controller

[0239] 106 - User Interface

[0240] 107——Digital broadcast receiving circuit

[0241] 108——Content playback circuit

[0242] 109——Sound synthesis circuit

[0243] 110 - Ethernet interface

[0244] 111 - Downmix

[0245] 112——Display

[0246] 121——Receiving antenna

[0247] 122——BD player

[0248] 123 - Internet

[0249] 124——Game consoles

[0250] 125——Microphone

[0251] 126——Navigation System

[0252] 200——Audio Amplifier

[0253] 201——HDMI terminal

[0254] 202——HDMI transmission part

[0255] 203——High-speed bus interface

[0256] 204——SPDIF receiving circuit

[0257] 205——System Controller

[0258] 206——Compressed audio decoding circuit

[0259] 207——Audio Mixer

[0260] 208——Amplifier

[0261] 209——Display section

[0262] 210 - Ethernet interface

[0263] 250——Speaker system

[0264] 300 - HDMI cable

Claims

1. A sending device, comprising: a transmitting section that transmits an audio signal that is continuous in prescribed units to a receiving side through a prescribed transmission line, wherein the audio signal that is continuous in prescribed units is obtained by alternately arranging a compressed audio signal included in the audio signal and a linear PCM signal included in the audio signal, wherein the compressed audio signal and the linear PCM signal are arranged alternately according to the configuration of the linear PCM signal, and The configuration of the linear PCM signal is determined based on a correspondence between a corresponding value indicated in each corresponding prescribed unit and the configuration of the linear PCM signal in the corresponding prescribed unit.

2. The transmitting device according to claim 1, wherein The prescribed unit is a subframe unit.

3. The transmitting device according to claim 1, wherein The linear PCM signal is an audio signal requiring real-time performance.

4. The transmitting device according to claim 1, further comprising An information adder adds identification information indicating that the audio signal transmitted by the transmitting section is obtained by alternately arranging a compressed audio signal included in the audio signal and a linear PCM signal included in the audio signal.

5. The transmitting device according to claim 4, wherein The information adder adds identification information using a predetermined number of prescribed bit sections for the channel state of each block per the prescribed unit configuration.

6. The transmitting device according to claim 1, further comprising: An information adder adds configuration information indicating a configuration of the linear PCM signal to the audio signal transmitted by the transmitting section.

7. The transmitting device according to claim 6, wherein The information adder adds configuration information using a predetermined number of prescribed bit sections for the channel status of each block per the prescribed unit configuration.

8. The transmitting device according to claim 1, further comprising: An information adder adds information related to the linear PCM signal to the audio signal transmitted by the transmitting section.

9. The transmitting device according to claim 8, wherein The information adder adds the information related to the linear PCM signal using a continuous predetermined number of user data bits of the prescribed unit.

10. The transmitting device according to claim 1, further comprising: Acquire a first acquired portion of a compressed audio signal; as well as A second acquired portion of the linear PCM signal is acquired.

11. The transmitting device according to claim 1, wherein The prescribed transmission line is one of a coaxial cable, an optical cable, an Ethernet (IEC 61883-6) cable, an HDMI cable, an MHL cable, and a DisplayPort cable.

12. A sending method, comprising: transmitting an audio signal that is continuous in a prescribed unit to a receiving side through a prescribed transmission line, wherein the audio signal that is continuous in a prescribed unit is obtained by alternately arranging a compressed audio signal included in the audio signal and a linear PCM signal included in the audio signal, wherein the compressed audio signal and the linear PCM signal are arranged alternately according to the configuration of the linear PCM signal, and The configuration of the linear PCM signal is determined based on a correspondence between a corresponding value indicated in each corresponding prescribed unit and the configuration of the linear PCM signal in the corresponding prescribed unit.

13. A receiving device, comprising: a receiving section that receives an audio signal that is continuous in prescribed units from a transmitting side through a prescribed transmission line, the audio signal that is continuous in prescribed units being obtained by alternately arranging a compressed audio signal included in the audio signal and a linear PCM signal included in the audio signal, wherein the compressed audio signal and the linear PCM signal are arranged alternately according to the configuration of the linear PCM signal, and The configuration of the linear PCM signal is determined based on a correspondence between a corresponding value indicated in each corresponding prescribed unit and the configuration of the linear PCM signal in the corresponding prescribed unit.

14. The receiving device according to claim 13, further comprising: A processor processes the compressed audio signal and the linear PCM signal to obtain an output linear PCM signal.

15. The receiving device according to claim 14, wherein Configuration information indicating the configuration of the linear PCM signal is added to the audio signal received by the receiving section, and The processor processes the linear PCM signal based on the configuration information.

16. The receiving device according to claim 14, wherein Information related to the linear PCM signal is added to the audio signal received by the receiving section, and The processor processes the linear PCM signal based on the information related to the linear PCM signal.

17. A receiving method, comprising: receiving an audio signal continuous in prescribed units from a transmission side through a prescribed transmission line, the audio signal continuous in prescribed units being obtained by alternately arranging a compressed audio signal included in the audio signal and a linear PCM signal included in the audio signal, wherein the compressed audio signal and the linear PCM signal are arranged alternately according to the configuration of the linear PCM signal, and The configuration of the linear PCM signal is determined based on a correspondence between a corresponding value indicated in each corresponding prescribed unit and the configuration of the linear PCM signal in the corresponding prescribed unit.

Images