Transmission device, transmission method, reception device, and reception method

Abstract

A novel interface is provided which supports simultaneous transmission of an audio signal and a MIDI signal. A signal continuous in predetermined units is transmitted to a receiving side via a prescribed transmission path. The signal continuous in predetermined units includes a signal of a first predetermined unit including an audio signal and a signal of a second predetermined unit including a MIDI signal. The audio signal is, for example, a linear PCM signal which constitutes a stereo 2-channel audio signal. The MIDI signal includes, for example, packet data having a prescribed length which is divided into a plurality of units, included in a plurality of signals in the second predetermined unit, and transmitted.

Description

Technical Field

[0001] This technology relates to a transmitting device, a transmitting method, a receiving device, and a receiving method. Background Technology

[0002] The IEEE 1394 serial digital interface standard typically enables stable simultaneous transmission of audio signals and MIDI (Musical Instrument Digital Interface) signals. For example, Patent Document 1 describes IEEE 1394 and MIDI signals.

[0003] With the advent of High Definition Multimedia Interface (HDMI), production of products using IEEE 1394 has ceased, and the computer-based Universal Serial Bus (USB) has been adopted for the simultaneous transmission of audio and MIDI signals. Furthermore, HDMI does not support the simultaneous transmission of audio and MIDI signals.

[0004] Furthermore, as a digital audio interface, IEC 60958 is widely used for transmitting linear PCM signals. Additionally, IEC 61937, which transmits compressed audio signals over the IEC 60958 protocol, is also widely used and for transmission by various audio codecs.

[0005] These are commercially used in actual products by mapping the IEC 60958 protocol to the following formats: coaxial and optical output terminals known as the Sony Philips Digital Interface (SPDIF); High Definition Multimedia Interface (HDMI) as a multimedia interface that includes video; Mobile High Definition Link (MHL); and DisplayPort.

[0006] Reference List

[0007] Patent documents

[0008] Patent Document 1: Japanese Patent Application Publication No. 9-116593 Summary of the Invention

[0009] The problem to be solved by the present invention

[0010] When using computers, latency and maximum data volume depend heavily on the performance of the computer, device drivers, and software. For this reason, when using computers, there is a risk of compromised real-time performance or data loss. Therefore, there is a need for a real-time interface that can be used stably and reliably.

[0011] The purpose of this technology is to provide a new interface that supports the simultaneous transmission of audio and MIDI signals.

[0012] Solution to the problem

[0013] The concept of this technology lies in a transmitting device, which includes:

[0014] The transmitting unit transmits signals in predetermined units to the receiving side via a predetermined transmission path, wherein...

[0015] The signals in predetermined units include: a first predetermined unit of signals including audio signals and a second predetermined unit of signals including MIDI signals.

[0016] In this technology, signals in predetermined units are transmitted from a transmitting unit to a receiving side via a predetermined transmission path. For example, the predetermined unit may be a subframe unit. Furthermore, the predetermined transmission path may be, for example, a coaxial cable, optical fiber, Ethernet (IEC 61883-6) cable, HDMI cable, MHL cable, or display port cable.

[0017] The signal, in a series of predetermined units, includes a first predetermined unit of signal comprising an audio signal and a second predetermined unit of signal comprising a MIDI signal. For example, the audio signal may be a linear PCM signal constituting a stereo 2-channel audio signal. In this case, simultaneous transmission of the stereo 2-channel audio signal and the MIDI signal can be stably performed.

[0018] For example, a MIDI signal may include packets of data of a predetermined length, and these packets may be divided into multiple segments and transmitted by being included in multiple segments of a second predetermined unit of signal. In this case, for example, the packets of data of the predetermined length may be 32-bit, 64-bit, 96-bit, or 128-bit packets, and are divided into multiple segments of 16 bits each. By dividing and transmitting the data as described above, transmission can be performed even if the data length of the packets constituting the MIDI signal exceeds the data payload area of ​​the predetermined unit of signal.

[0019] Furthermore, in this case, for example, in a signal comprising a second predetermined unit containing a MIDI signal, the MIDI signal can be inserted on the low-order side, and identification information can be inserted on the high-order side. The identification information identifies whether the MIDI signal inserted on the low-order side is at least the beginning of a segment or a continuous segment. By inserting the identification information as described above, the receiving side can identify whether the MIDI signal included in the signal of the second predetermined unit is the beginning of a segment or a continuous segment, and can correctly reconfigure and receive the group.

[0020] Then, in this case, for example, the identification information can be set such that even when data including a predetermined number of bits of the MIDI signal on the low bit side and the identification information on the high bit side is reproduced as audio data, the volume is less than or equal to a predetermined value. Therefore, even if the data is incorrectly reproduced as audio data, damage to the audio amplifier and speakers can be avoided.

[0021] Furthermore, for example, packet data constituting the MIDI signal can be inserted from any bit position in the data payload area of ​​the signal of the second predetermined unit. If not all packet data can be inserted into the data payload area, the remaining portion of the packet data can be inserted from the first bit position in the data payload area of ​​the next second predetermined unit signal, and the packet data constituting the MIDI signal can be sent. In this case, the packet data can be inserted into the data payload area of ​​the signal of the second predetermined unit according to the generation timing of the MIDI signal.

[0022] Furthermore, for example, a one-byte packet of data constituting a MIDI signal can be inserted into a one-byte region of the two-byte data payload area in a second predetermined unit of the signal and then transmitted. In this case, since the packet of data constituting the MIDI signal is inserted along the byte alignment, the processing on the receiving side can be simplified.

[0023] Furthermore, for example, a one-byte packet of data constituting a MIDI signal can be inserted into a byte region of a two-byte data payload area in a second predetermined unit of the signal, and the other byte region can be set as an extended byte region and transmitted. In this case, using the extended byte region, unique extensions can be performed, such as higher resolution speed, increased number of channels, etc.

[0024] Furthermore, for example, the signal of the second predetermined unit may include multiple channels of the MIDI signal. Therefore, MIDI signals from multiple systems can be sent virtually, and the number of channels can be increased.

[0025] As described above, in this technology, a first predetermined unit of signal including an audio signal and a second predetermined unit of signal including a MIDI signal are included in the transmitted signal in predetermined units. For this reason, simultaneous transmission of audio and MIDI signals can be stably performed.

[0026] Note that, in this technology, for example, an information adding unit may also be included, which adds identification information to signals that are continuous in predetermined units. This identification information identifies signals comprising a first predetermined unit of audio signals and a second predetermined unit of MIDI signals. In this case, for example, the information adding unit can add the identification information by using a predetermined bit region configured for each of each of the predetermined units. By adding the identification information as described above, the receiving side can easily identify that the signals continuous in predetermined units include both the first predetermined unit of audio signals and the second predetermined unit of MIDI signals.

[0027] Furthermore, another concept of this technology is that,

[0028] A receiving device comprising:

[0029] A receiving unit receives signals in predetermined units from a transmitting side via a predetermined transmission path, wherein...

[0030] The signals in predetermined units include: a first predetermined unit of signals including audio signals and a second predetermined unit of signals including MIDI signals.

[0031] In this technology, a receiving unit receives a predetermined number of continuous signals from a transmitting side via a predetermined transmission path. The signals, occurring in predetermined units, include a first predetermined unit of signals comprising audio signals and a second predetermined unit of signals comprising MIDI signals. For example, the audio signal may be a linear PCM signal constituting a stereo 2-channel audio signal. In this case, the stereo 2-channel audio signal and the MIDI signal can be received simultaneously and stably.

[0032] As described above, in this technology, a first predetermined unit of signal including an audio signal and a second predetermined unit of signal including a MIDI signal are included in the received signal that is continuous in predetermined units. For this reason, simultaneous reception of audio and MIDI signals can be stably performed.

[0033] Note that this technology may also include, for example, a processing unit that performs processing using audio signals and MIDI signals. In this case, processing can be performed using stable and simultaneously received audio signals and MIDI signals. For example, the processing unit may synthesize the audio signal with an audio signal obtained from a MIDI signal using a MIDI sound source to obtain an output audio signal. Attached Figure Description

[0034] Figure 1 This is a block diagram illustrating a configuration example of a transmitting / receiving system as a first embodiment.

[0035] Figure 2 This is a diagram showing an example of a message to be inserted into a universal MIDI data packet in MIDI 2.0.

[0036] Figure 3 This is a diagram showing a configuration example of the note-on message in MIDI 2.0.

[0037] Figure 4 This is a diagram showing the frame configuration in the IEC 60958 standard.

[0038] Figure 5 This is a diagram showing the subframe configuration in the IEC 60958 standard.

[0039] Figure 6 This is a diagram illustrating an example of the frame configuration of an SPDIF signal in the case of simultaneously including a stereo 2-channel audio signal and a MIDI signal as a linear PCM signal.

[0040] Figure 7 This is a diagram showing a configuration example of a subframe that includes MIDI signals.

[0041] Figure 8 This is a diagram illustrating an example of sending a note-on message in MIDI 2.0.

[0042] Figure 9 This is a schematic diagram illustrating the format of the channel status when transmitting linear PCM signals and MIDI signals simultaneously.

[0043] Figure 10 This is a diagram illustrating an example of a method for inserting a signal into a subframe when simultaneously transmitting a linear PCM signal and a MIDI 1.0 signal.

[0044] Figure 11 This is a diagram illustrating an example of a method for inserting a signal into a subframe when simultaneously transmitting a linear PCM signal and a MIDI 1.0 signal.

[0045] Figure 12 This diagram illustrates the simultaneous transmission of MIDI signals and linear PCM signals across multiple channels.

[0046] Figure 13 This is a diagram illustrating the IEC 61937-1 interface format.

[0047] Figure 14 This is a diagram illustrating an example of the frame configuration of an SPDIF signal when only MIDI signals are being transmitted.

[0048] Figure 15 This is a schematic diagram illustrating the format of the channel status when only MIDI signals are being transmitted.

[0049] Figure 16 This is a block diagram illustrating a configuration example of an acoustic system as a second embodiment.

[0050] Figure 17 This is a block diagram illustrating a configuration example of an AV system as a third embodiment.

[0051] Figure 18 This is a block diagram illustrating a configuration example of an HDMI receiving unit for a television receiver and an HDMI transmitting unit for an audio amplifier.

[0052] Figure 19 This is a diagram illustrating an example configuration of a high-speed bus interface for a television receiver.

[0053] Figure 20 This is a diagram illustrating an example configuration of the high-speed bus interface of an audio amplifier.

[0054] Figure 21 This is a block diagram illustrating a configuration example of a game system as a fourth embodiment. Detailed Implementation

[0055] The following is a description of a mode for implementing the present invention (which will be referred to below as an "implementation"). Note that the description will be presented in the following order.

[0056] 1. First Implementation Method

[0057] 2. Second Implementation Method

[0058] 3. Third Implementation Method

[0059] 4. Fourth Implementation Method

[0060] 5. Modified Example

[0061] <1. First Implementation Method>

[0062] [Configuration example of a sending / receiving system]

[0063] Figure 1 An example configuration of a transmit / receive system 10 as a first embodiment is shown. The transmit / receive system 10 includes a transmit device 101 and a receive device 102. The transmit device 101 and the receive device 102 are connected to each other via a transmission path 103, which includes a coaxial cable, optical fiber, etc. The transmission path 103 constitutes an IEC 60958 transmission path.

[0064] The transmitting device 101 includes a Sony Philips Digital Interface (SPDIF) transmitting circuit 110. The SPDIF transmitting circuit 110 is a circuit for transmitting IEC 60958 standard digital audio transmission signals (hereinafter appropriately referred to as "SPDIF signals"), and is a transmitting circuit compliant with the IEC 60958 standard.

[0065] SPDIF transmitting circuit 110 generates an SPDIF signal that simultaneously includes a linear PCM signal and a Musical Instrument Digital Interface (MIDI) signal, and transmits the SPDIF signal to receiving device 102 via transmission path 103. As a linear PCM signal, audio signals such as single-channel, 2-channel, 5.1-channel, 7.1-channel, 10.2-channel, and 22.2-channel signals are all conceivable, but a stereo 2-channel audio signal is considered here. Furthermore, as a MIDI signal, the MIDI signal proposed as MIDI 2.0 is considered.

[0066] Receiving device 102 includes an SPDIF receiving circuit 120. The SPDIF receiving circuit 120 is a circuit for receiving SPDIF signals (IEC 60958 standard digital audio transmission signals) and is a receiving circuit conforming to the IEC 60958 standard. The SPDIF receiving circuit 120 receives the SPDIF signal transmitted from transmitting device 101 via transmission path 103, and extracts and outputs the linear PCM signal and MIDI signal included in the SPDIF signal.

[0067] Messages in MIDI 2.0

[0068] In MIDI 2.0, universal MIDI data packets with multiple data packet lengths are defined. Data packet lengths include 32 bits, 64 bits, 96 bits, 128 bits, etc. For example... Figure 2 As shown, it is recommended to insert the message into the general MIDI data group.

[0069] The definition of "Practical Messages" is not publicly disclosed. In MIDI 1.0, "System Real-Time Messages" are valid messages for all units connected to the system, consisting only of status bytes and excluding data bytes, and can be sent between bytes of other messages. In MIDI 1.0, "System Common Messages" are valid messages for all units connected to the system.

[0070] In MIDI 1.0, "System-Specific Messages" are messages that can send any number of data bytes after the status byte. "MIDI 1.0 Channel Voice Messages" are messages that map up to three bytes of "Channel Voice Messages" in MIDI 1.0 to four bytes of "Universal MIDI Groups" in MIDI 2.0.

[0071] The definition of "data messages (including system-specific messages)" is not disclosed. "MIDI 2.0 channel voice information" is new information provided in MIDI 2.0 and has expanded data resolution. The definition of "data messages" is not disclosed.

[0072] For example, regarding the note-open message (MIDI 2.0 note-open message) in the message, it has been proposed that... Figure 3 The format shown is as follows. The note-open message block length is 64 bits (8 bytes).

[0073] The 4-bit field “mt” is new in MIDI 2.0 and indicates the message type; here, mt = 4. The 4-bit field “group” is also new in MIDI 2.0 and indicates a group. Each member in a group is independent, and each group has 16 MIDI channels. Therefore, a system's MIDI signal can have up to 256 channels.

[0074] The 4-bit field for "Channel" indicates the MIDI channel. A physical MIDI signal line is divided into 16 logical channels by the 4-bit channel number included in the MIDI channel message. The qualifier for the 1-bit field for "r" is not disclosed. The 7-bit field for "Note Number" indicates the keyboard number. This number uses values ​​from 0 to 127, and the number for "do" in the middle of an 88-key piano is 60.

[0075] The 8-bit field for "Attribute Type" is new in MIDI 2.0 and indicates the additional data type. Examples of such types include articulation, tuning details, etc. The 16-bit field for "Velocity" indicates the intensity of the keystrokes and is used to create differences in intensity between sounds. The 16-bit field for "Attribute" is also new in MIDI 2.0 and indicates the value of additional data for the type defined by "Attribute Type".

[0076] "SPDIF signal"

[0077] The SPDIF signal (IEC 60958 standard digital audio transmission signal) generated by the SPDIF transmitting circuit 110 will be described.

[0078] First, an overview of the IEC 60958 standard will be described. Figure 4 The frame configuration in the IEC 60958 standard is shown. Each frame consists of two subframes. In the case of stereo 2-channel audio, the left channel signal is included in the first subframe of the subframe, while the right channel signal is included in the second subframe of the subframe.

[0079] A preamble is provided at the beginning of each subframe, with "M" given as the preamble for the left channel signal and "W" given as the preamble for the right channel signal. However, "B," indicating the start of a block, is assigned to the preamble located at the beginning of every 192 frames. That is, a block consists of 192 frames. A block is the unit that constitutes the channel states, which will be described later.

[0080] Figure 5 The subframe configuration in the IEC 60958 standard is shown. A subframe consists of 32 time slots, from slot 0 to slot 31. Slots 0 through 3 indicate the preamble (synchronization preamble). As mentioned above, the preamble indicates any one of "M", "W", or "B" to indicate the distinction between the left and right channels and the start position of the block.

[0081] Slots 4 through 27 represent the main data field, and when using a 24-bit encoding range, all slots represent audio data. Alternatively, when using a 20-bit code range, slots 8 through 27 represent audio data (audio sample words). In the latter case, slots 4 through 7 can be used for additional information (auxiliary sample bits). The example shown illustrates the latter case.

[0082] The 28th time slot is the validity flag for the master data field. The 29th time slot represents one unit of user data. By accumulating the 29th time slot on a frame, a series of user data can be configured. Messages configuring user data are in units of 8-bit information units (IU), and a message includes 3 to 129 IU.

[0083] Information units may be separated by zero to eight bits of "0". The header of an information unit is identified by a start bit "1". The first seven information units in the message are reserved, and the user can set any information in the eighth and subsequent information units. Messages are separated by eight or more bits of "0".

[0084] The 30th slot represents a channel status bit. A series of channel statuses can be configured by accumulating the 30th slot of each block on the frame. Note that the block header position is indicated by the preamble "B" (slots 0 to 3) as described above.

[0085] The 31st time slot is the parity bit. This parity bit is provided so that the number of "0"s and "1"s in the 4th to 31st time slots is even.

[0086] In this embodiment, as described above, the SPDIF signal simultaneously includes a stereo 2-channel audio signal and a MIDI signal, which are linear PCM signals. Figure 6An example of the frame configuration for the SPDIF signal in this scenario is shown. The SPDIF signal is a continuous signal in units of subframes. One block consists of 192 frames, and multiple blocks are included consecutively.

[0087] Even-numbered subframes are the subframes where audio signals are inserted (the first subframe). The first subframe in a subframe contains the left channel audio signal, and the second subframe in a subframe contains the right channel audio signal. Furthermore, odd-numbered subframes are used as subframes where MIDI signals are inserted (the second subframe). That is, the SPDIF signal includes the signal from the first subframe containing the audio signal and the signal from the second subframe containing the MIDI signal.

[0088] Figure 7 The configuration of the second subframe, including the MIDI signal, is shown. In this case, the main data field for slots 4 through 27 is divided into a high 8-bit region and a low 16-bit region. The MIDI signal is inserted into the low 16-bit region, and the identification information is inserted into the high 8 bits.

[0089] As mentioned above, the common MIDI packet lengths for inserting MIDI 2.0 messages are 32 bits, 64 bits, 96 bits, 128 bits, etc. For this reason, the packet data is divided into multiple segments of 16 bits each, and each segment of data is byte-aligned and inserted into the lower 16-bit region (the region from bit 4 to bit 19) of the main data field in multiple second subframes.

[0090] The identification information in the high 8-bit region (bits 20 to 27) of the main data field inserted into the second subframe indicates whether the MIDI signal inserted into the low 16-bit region is at least the first segment or consecutive segments. For example, a 64-bit block of data is divided into four segments of 16 bits each, with the segment at the header being the first segment and the other three segments being consecutive segments.

[0091] As described above, identification information is inserted, so that the receiving side can properly identify whether the MIDI signal inserted into the lower 16-bit area is the beginning of a segment or a continuous segment by checking the identification information in the high 8-bit area, and the receiving side can correctly reconfigure and receive the group.

[0092] Here, the 8-bit identification information is set so that the volume (volume level) is less than or equal to a predetermined value even when the 24-bit data, including the 8-bit identification information on the high side and the 16-bit MIDI signal on the low side, is reproduced as audio data. Therefore, damage to the audio amplifier and speakers can be avoided even if the data is incorrectly reproduced as audio data at the receiving end.

[0093] For example, the 8-bit identification information consists of two bits in the 20th and 21st bits, and indicates the aforementioned partition data information—it indicates the start or continuation. That is, when the MIDI signal inserted into the lower 16-bit region is the start of partition data, the identification information inserted into the higher 8-bit region is set to "10000000", and it indicates that the MIDI signal is the start of partition data.

[0094] Furthermore, when the MIDI signal inserted into the lower 16-bit region is a continuous segment of data, the identification information inserted into the higher 8-bit region is set to "01000000", indicating that the MIDI signal is a continuous (continuous) segment of data. Conversely, when no MIDI signal is inserted into the lower 16-bit region, the identification information inserted into the higher 8-bit region is set to "00000000", indicating an idle state where no MIDI signal exists.

[0095] In this case, with the 24-bit data consisting of 8 bits of identification information on the high-side and 16 bits of MIDI signal on the low-side being audio data, 5 bits from 2SB to 6SB are "0", except for the MSB which is the sign bit. This ensures that even if the data is reproduced incorrectly, the volume will be less than or equal to -32dB and will not damage the audio amplifier and speakers.

[0096] Note that the combination of identification information values ​​inserted into the high 8-bit region is not limited to the examples above, and other combinations are also possible. For example, the combination of "10000001", "01000001", and "00000001" also has equivalent function and effect. Furthermore, when the group length is long and "01000001" is consecutive, "11000001" is newly introduced and switched to indicate the continuity of the data transmission itself, thereby indicating continuity. That is, the order of the identification signals is "10000001", "01000001", "11000001", "01000001", and "11000001".

[0097] Figure 8 This demonstrates sending the aforementioned MIDI 2.0 note open message (see [link]). Figure 3 Here is an example of a scenario where the note-open message data packet (general MIDI packet) has a packet length of 64 bits, and the data packet is divided into four segments of 16 bits each, which are then inserted into four second subframes.

[0098] Figure 8 (a) shows the frame configuration. One block consists of 192 frames, and multiple blocks are consecutively included. Figure 8 (b) shows that each frame consists of two subframes. Figure 8 (c) shows the subframe configuration (see Figure 7 ).

[0099] For example, in the case of inserting four segments of data obtained by opening the message by dividing notes from frame 1, the four segments of data are inserted into the first and second subframes of the subframe of frame 1 and the first and second subframes of the subframe of frame 3.

[0100] Figure 8 (d) shows the status of the main data fields in slots 4 through 27 of the first subframe in frame 1. The data of each field constituting the initial partition data, namely “mt”, “group”, “1001”, and “channel”, are sequentially inserted from the MSB side into the lower 16-bit region (the region from bit 4 to bit 19). In addition, the MIDI signal indicating that it is inserted into the lower 16-bit region is the identification information “10000000” of the initial partition data is inserted into the higher 8-bit region (the region from bit 20 to bit 27).

[0101] Figure 8 (e) shows the status of the main data fields in slots 4 through 27 of the second subframe within frame 1. The data for the corresponding fields “r,” “note number,” and “attribute type,” constituting the continuous first partition data, are sequentially inserted from the MSB side into the lower 16-bit region (the region from bit 4 to bit 19). Furthermore, identification information “0100 0000”, indicating that the MIDI signal inserted into the lower 16-bit region is continuous (continuous), is inserted in the higher 8-bit region (the region from bit 20 to bit 27).

[0102] Figure 8 (f) shows the status of the main data field in slots 4 through 27 of the first subframe in frame 3. The data of the "speed" field, which constitutes the continuous second partition data, is inserted into the lower 16-bit region (the region from bit 4 to bit 19). In addition, identification information "0100 0000" indicating that the MIDI signal inserted into the lower 16-bit region is continuous (continuous) partition data is inserted in the higher 8-bit region (the region from bit 20 to bit 27).

[0103] Figure 8 (g) shows the status of the main data field in slots 4 through 27 of the second subframe within frame 3. Data for the "attribute" field constituting the continuous third partition data is inserted into the lower 16-bit region (bits 4 through 19). Additionally, identification information "0100 0000" indicating that the MIDI signal inserted into the lower 16-bit region is continuous (continuous) partition data is inserted into the higher 8-bit region (bits 20 through 27).

[0104] Figure 8 (h) shows the status of the main data field in slots 4 through 27 of the first subframe in frame 5. The lower 16 bits (bits 4 through 19) are not used for MIDI signal insertion. Furthermore, the identification information “0000 0000” indicating an idle state where no MIDI signal exists in the lower 16 bits is inserted into the higher 8 bits (bits 20 through 27).

[0105] Note that, although not described in detail, other MIDI 2.0 message groups (general MIDI groups) are similarly divided into subframes (second subframes) into which MIDI signals are inserted and then inserted.

[0106] Figure 9 The format of the channel state is schematically illustrated when transmitting both linear PCM and MIDI signals simultaneously, as described above. As mentioned, the channel state is obtained by accumulating the 30th time slot in each subframe for each block. The entire channel state comprises bytes 0 through 23.

[0107] Bit 0, a = "0", indicates the channel status available to the consumer. Additionally, bit 1, b = "0", indicates transmission for linear PCM. Furthermore, bits 3 through 5, for example, set to "001", indicate transmission for multi-channel linear PCM.

[0108] Bits 49 through 52 are a field indicating the "Multi-channel Configuration Type". These four bits are set to, for example, "1110" to indicate simultaneous transmission of MIDI 2.0 MIDI signals and linear PCM signals. Additionally, when the four bits are "1110", the following eight bits from bits 53 to 60 are valid. These eight bits are a field indicating the "Configuration Value". These eight bits are set to, for example, "10000000" to indicate simultaneous transmission of stereo 2-channel audio signals and MIDI 2.0 MIDI signals.

[0109] "MIDI signal transmission in MIDI 1.0"

[0110] The above description has already illustrated an example of simultaneously transmitting linear PCM signals and MIDI 2.0 MIDI signals. Similarly, it is conceivable to simultaneously transmit linear PCM signals and MIDI 1.0 MIDI signals.

[0111] Figure 10(a) is a diagram illustrating the "bitstream method" for inserting MIDI signals as part of MIDI 1.0. In this method, the main data field of slots 4 through 27 of the subframe (second subframe) from which the MIDI signal is to be sent is divided into a high 8-bit (one byte) region and a low 16-bit (two bytes) region. Fixed data, such as "00000000", is inserted in the high 8-bit region.

[0112] The MIDI 1.0 MIDI signal is inserted bit-by-bit in the lower 16-bit "MIDI 1.0 Data Payload" region. In this case, the packets of data constituting the MIDI signal are inserted from any bit position in the lower 16-bit region of a certain subframe (the second subframe), and if not all packets can be inserted, the remaining packets are inserted starting from the first bit position (bit 4) in the lower 16-bit region of the next subframe (the second subframe). On the receiving side, the signal bitstream is concatenated across subframes, and the MIDI 1.0 MIDI signal is detected.

[0113] MIDI 1.0 signals are logically 8 bits, but are transmitted as a total of 10 bits by adding a start bit (logic 0) and a stop bit (logic 1). As described above, 10 bits of data are inserted at arbitrary bit positions in the lower 16-bit "MIDI 1.0 Data Payload" region of the subframe (second subframe). For each bit position in the region preceding the arbitrary bit position, a logic 1 bit is inserted to indicate an idle state where no data is present.

[0114] In the "bitstream method," packet data can be inserted into the lower 16 bits of the "MIDI 1.0 data payload" area of ​​the subframe (second subframe) from which the MIDI signal is to be sent, based on the timing of MIDI signal generation. However, in this case, the processing on the receiving side is bit-by-bit and can be complex.

[0115] Figure 10 (b) is a diagram illustrating the "byte alignment method" used to explain how MIDI signals are inserted as part of MIDI 1.0. In this method, the main data field of slots 4 through 27 of the subframe (second subframe) from which the MIDI signal is to be transmitted is divided into a high 8-bit (one byte) region, a middle 8-bit (one byte) region, and a low 8-bit (one byte) region. Fixed data, such as "00000000", is inserted in the high 8-bit and low 8-bit regions.

[0116] In MIDI 1.0, the MIDI signal is always inserted into the middle 8-bit region. In this case, no start bit (logic 0) and no stop bit (logic 1) are added. Note that it is also possible to imagine that the MIDI 1.0 signal is inserted into the lower 8-bit region instead of the middle 8-bit region.

[0117] In the case of MIDI 1.0 signals, since valid data is processed for each byte, the processing on the receiving side can be easily simplified when the byte positions of the MIDI signal are fixed as described above. In this case, the idle state of a MIDI signal without MIDI 1.0 can be indicated by the V (validity flag) bit. Alternatively, instead of a MIDI 1.0 signal, a proprietary end-of-time (EOX) message or a specific message can be provided and inserted to indicate the idle state of a MIDI signal without MIDI 1.0.

[0118] Figure 11 (a) is a diagram illustrating the "data expansion method" used to explain how to insert MIDI signals as part of MIDI 1.0. In this method, the main data field of slots 4 through 27 of the subframe (second subframe) from which the MIDI signal is to be transmitted is divided into a high 8-bit (one byte) region, a middle 8-bit (one byte) region, and a low 8-bit (one byte) region. Fixed data, such as "00000000", is inserted in the high 8-bit region.

[0119] In MIDI 1.0, the MIDI signal is fixedly inserted into the middle 8-bit region. Additionally, the lower 8 bits are used as extended bytes. Using extended bytes allows for unique extensions, such as higher resolution speeds, increased channel counts, etc. For example, regarding an increase in the number of channels, extended bytes can be used to indicate sub-channels. That is, in the case of MIDI 1.0, the number of channels identifiable by the channels included in the MIDI signal is 16; however, by using extended bytes to identify sub-channels of each channel, the number of channels can be specified more precisely. In this case, channel specification such as "the m-th sub-channel of the n-th channel" is performed.

[0120] Even in the case of the "data extension method," similar to the "byte alignment method" described above, it is possible to indicate the idle state of a MIDI signal that is not inserted into MIDI 1.0. Note that it is also conceivable to invert the 8-bit region of the MIDI signal inserted into MIDI 1.0 and the 8-bit region of the extended byte.

[0121] Note that in MIDI 1.0, the MSB of a MIDI signal is used to identify the Status Byte and the Data Byte, resulting in a resolution that is actually seven bits. For this reason, in Figure 11 In (a), the data length is shown as a total of 15 bits, including 7 bits of MIDI signal and 8 bits of extension.

[0122] However, considering compatibility with MIDI 1.0, it is also conceivable to set the effective data length for extensions to seven bits. In this case, the data length is a total of 14 bits, including 7 bits for the MIDI signal and 7 bits for extensions. Figure 11 (b) and Figure 11 (c) illustrates this situation. Figure 11 (b) illustrates the case where the bytes of a MIDI signal are status bytes, and Figure 11 (c) illustrates the case where the bytes of the MIDI signal are data bytes. For example, by setting the extended effective data length to seven bits as described above, it is expected that processing by software will be straightforward.

[0123] Note that when using multiple of the aforementioned "bitstream methods," "byte alignment methods," and "data expansion methods" as methods for inserting MIDI 1.0 signals, the "configuration value" in the area of ​​bits 53 to 60 of the channel status (see above) can be used. Figure 9 ( ) to identify the method.

[0124] Furthermore, in each of the methods described above where the MIDI 1.0 signal is inserted into the subframe (second subframe), the high 8 bits of the 24-bit area of ​​the main data field are "00000000". For this reason, even if the 24-bit data is incorrectly reproduced as audio data, the volume is low, and damage to the audio amplifier and speakers can be avoided.

[0125] "Multi-channel MIDI signals"

[0126] Note that the MIDI signal transmitted simultaneously with the linear PCM signal is not limited to one channel, but can have multiple channels. These multiple MIDI signal channels correspond to multiple virtual MIDI cables. For example, although the number of channels in a single channel in MIDI 1.0 is 16, the number of channels can be increased by providing multiple channels.

[0127] Figure 12 An example of the frame configuration for the SPDIF signal in this scenario is shown. This example indicates a MIDI signal with two channels, A and B, to be transmitted simultaneously with the linear PCM signal.

[0128] In this configuration, in even-numbered frames, the left channel audio signal is included in the first subframe (first subframe), and the right channel audio signal is included in the second subframe (first subframe). Furthermore, in odd-numbered frames, the first subframe (second subframe) includes the MIDI signal for channel A, and the second subframe (second subframe) includes the MIDI signal for channel B.

[0129] Note that, similarly, when multiple MIDI signal channels are provided, the method can be identified through, for example, the "configuration value" in the area from bit 53 to bit 60 of the channel status described above (see [link]). Figure 9 ).

[0130] As mentioned above, in Figure 1 In the transmitted / received system 10 shown, signals including subframes (first subframes) of audio signals (linear PCM signals) and subframes (second subframes) of MIDI signals are included in a continuous signal (SPDIF signal) transmitted from the transmitting device 101 to the receiving device 102 in units of subframes. Therefore, simultaneous transmission of audio signals and MIDI signals can be performed stably without delay.

[0131] Note that because the linear PCM signal and the MIDI signal are asynchronous, jitter occurs when the MIDI signal is placed on the transmission path at the sampling timing of the linear PCM signal. If the jitter is within acceptable limits, it can be ignored; however, it is also conceivable to suppress the jitter, for example, by using a jitter suppression system based on timestamps.

[0132] For example, when the original MIDI 1.0 transmission speed is 31.25kbps and the sampling frequency of the linear PCM signal is 48kHz, the MIDI signal accumulated in the buffer of the SPDIF transmission circuit 110 at the 31.25kbps timing is sent to the transmission path at the 48kHz timing, and jitter occurs. For example, when the MIDI signal is generated at 48kHz, no jitter occurs.

[0133] Furthermore, the above description already described an example where the audio signal to be transmitted simultaneously with the MIDI signal is a linear PCM signal. It is also conceivable that the audio signal to be transmitted simultaneously with the MIDI signal is not a linear PCM signal but a compressed audio signal. In this case, instead of the IEC 60958 interface format for processing the aforementioned linear PCM signals, the IEC 61937-1 interface format for processing compressed audio signals is used.

[0134] Figure 13 The IEC 61937-1 interface format is shown. Figure 13 (a) shows the frame configuration. One block consists of 192 frames, and multiple blocks are consecutively included. Figure 13 (b) shows that each frame consists of two subframes.

[0135] A preamble is provided at the header of the subframe, and a "B" indicating the start of the block is assigned to the preamble of the subframe at the header of the block. Then, "W" and "M" are alternately assigned to the preambles at the headers of each subsequent subframe.

[0136] Figure 13 (c) illustrates the subframe configuration. In cases where the SPDIF signal includes a predetermined number of channels for compressed audio signals, the bitstream of the compressed audio signals is divided and sequentially inserted into time slots 12 through 27 of each subframe. That is, the high 16 bits of the 24-bit audio data region in time slots 4 through 27 of each subframe are used for the transmission of the compressed audio signal.

[0137] "MIDI signal transmission only"

[0138] Furthermore, the above description has already described an example of transmitting both audio and MIDI signals simultaneously; however, it is conceivable that only MIDI signals could be transmitted. In this case, for example, the IEC61937-1 interface format, which processes the aforementioned compressed audio signals, could be used.

[0139] In this case, the MIDI signal is inserted into the subframe where the MIDI signal is to be inserted and is transmitted. For example, the subframe configuration in the case of transmitting a MIDI 2.0 MIDI signal can be as described above. Figure 7 The configuration shown. Furthermore, when transmitting MIDI 1.0 signals, the MIDI signal can be inserted using any of the methods described above, such as the "bitstream method," "byte alignment method," and "data expansion method" (see [link]). Figure 10 and Figure 11 ).

[0140] Furthermore, even when only MIDI signals are transmitted as described above, the MIDI signal channels are not limited to one channel, and multiple channels can be used.

[0141] Figure 14 An example of an SPDIF signal frame configuration for transmitting only MIDI signals is shown. This example illustrates the transmission of a 64-bit data packet of MIDI 2.0, such as a note-on message (see [link]). Figure 3 In this case, the packet data is divided into four segments, each 16 bits long, inserted into four consecutive subframes, and transmitted. In the illustrated example, the divided data is inserted into the four subframes of frame 1 and frame 2.

[0142] Figure 15 The format of the channel state is schematically illustrated in the case of transmitting only MIDI signals as described above. As mentioned above, the channel state is obtained by accumulating the 30th slot in the subframe for each block. The entire channel state comprises bytes 0 through 23.

[0143] Bit 0, a = "0", indicates the channel status available to the consumer. Additionally, bit 1, b = "1", indicates the transmission of compressed digital audio signals.

[0144] Bits 49 through 52 are a field indicating the "Multi-channel Configuration Type". These four bits are set to "1110", for example, to indicate identification information for the transmission of MIDI signals. Additionally, when all four bits are "1110", the following eight bits, from bit 53 to bit 60, are valid. These eight bits are a field indicating the "Configuration Value".

[0145] Here, "0000000" indicates the transmission of MIDI signals for MIDI 2.0. Additionally, "01000000" indicates the transmission of MIDI signals for MIDI 1.0 according to the "bitstream method" (see [link to bitstream method]). Figure 10 (a)). Furthermore, "11000000" indicates the transmission of MIDI signals for MIDI 1.0 according to the "byte alignment method" (see [link]). Figure 10 (b)). Furthermore, "00100000" indicates the transmission of MIDI signals for MIDI 1.0 according to the "Data Extension Method" (see [link]). Figure 11 (a)). In addition, "10100000" indicates the transmission of MIDI signals in both channels A and B.

[0146] Note that the IEC 61937-1 interface format for processing compressed audio signals has been described above as being suitable for transmitting only MIDI signals. Although detailed descriptions have been omitted, the use of the IEC 60958 interface format for processing the aforementioned linear PCM signals is also conceivable.

[0147] "Ability Query (MIDI CI)"

[0148] MIDI CI is a two-way communication mechanism in which devices pre-negotiate with each other and can perform changes in transmission rate (protocol), sending and receiving new messages in the system (profiles), and exchanging sound library information between connected devices (attributes), etc., within the range that the devices can handle.

[0149] The transmission path for mapping SPDIF or its protocol is bidirectional, thereby enabling MIDI CI. Alternatively, MIDI CI functionality can also be achieved by using bidirectional communication paths such as Ethernet and HDMI CEC, which exist in parallel with the interface.

[0150] It can also perform switching between MIDI 1.0 and MIDI 2.0 protocols, as well as confirm and switch support for extended protocols using MIDI 1.0, by extending the MIDI CI specification. Of course, manual settings by the user are also allowed.

[0151] <2. Second Implementation Method>

[0152] [Acoustic System Configuration Example]

[0153] Figure 16 An example configuration of the acoustic system 20 as a second embodiment is shown. The acoustic system 20 includes a MIDI keyboard 201 with microphone input and a MIDI sound source module 202. The MIDI keyboard 201 with microphone input and the MIDI sound source module 202 are connected to each other via a transmission path 203 including a coaxial cable, optical fiber, etc. The transmission path 203 constitutes an IEC 60958 transmission path.

[0154] The MIDI keyboard 201 with microphone input includes an A / D converter 210, a keyboard unit 211, and an SPDIF transmission circuit 212. The A / D converter 210 converts the analog audio signal obtained by the sound collected by the microphone 204 into a linear PCM signal and sends the linear PCM signal to the SPDIF transmission circuit 212. The keyboard unit 211 includes a MIDI detector (not shown), generates a MIDI signal with playing (MIDI 2.0 or MIDI 1.0 MIDI signal), and sends the MIDI signal to the SPDIF transmission circuit 212.

[0155] Similar to the SPDIF transmitting circuit 110 in the transmitting device 101 of the transmitting / receiving system 10 described above, the SPDIF transmitting circuit 212 is a circuit for transmitting SPDIF signals (IEC 60958 standard digital audio transmission signals), and is a transmitting circuit that conforms to the IEC 60958 standard.

[0156] Similar to SPDIF transmitting circuit 110, SPDIF transmitting circuit 212 generates an SPDIF signal that simultaneously includes a linear PCM signal from A / D converter 210 and a MIDI signal from keyboard unit 211, and transmits the SPDIF signal to MIDI sound source module 202 via transmission path 203.

[0157] The MIDI sound source module 202 includes an SPDIF receiving circuit 220, a MIDI sound source unit 221, an audio mixer 222, and a display unit 223. Similar to the SPDIF receiving circuit 120 in the receiving device 102 of the transmit / receive / receive system 10 described above, the SPDIF receiving circuit 220 is a circuit for receiving SPDIF signals and is a receiving circuit conforming to the IEC 60958 standard.

[0158] SPDIF receiving circuit 220 receives the SPDIF signal transmitted from MIDI keyboard 201 with microphone input via transmission path 203, and extracts and outputs the linear PCM signal and MIDI signal included in the SPDIF signal. Furthermore, SPDIF receiving circuit 220 outputs status information indicating the presence of a MIDI signal. This status information is sent to display unit 223, and the presence or absence of a MIDI signal is displayed on display unit 223.

[0159] The MIDI source unit 221 receives the MIDI signal output from the SPDIF receiving circuit 220, converts the MIDI signal into music data through the MIDI source, and outputs a linear PCM signal corresponding to the music data. The audio mixer 222 synthesizes the linear PCM signal output from the SPDIF receiving circuit 220 and the linear PCM signal output from the MIDI source unit 221, and outputs the synthesized linear PCM signal.

[0160] The synthesized linear PCM signal, as described above, is sent to the loudspeaker system 206 via amplifier 205. Therefore, an acoustic output based on the linear PCM signal is obtained from the loudspeaker system 206.

[0161] In the acoustic system 20, when the keyboard unit 211 is a piano keyboard unit and the microphone 204 collects the piano's playing sound, the MIDI sound source module 202 outputs a linear PCM signal of the string instrument sound accompanying the piano playing from the MIDI sound source unit 221, and can reproduce the sound obtained by synthesizing the string instrument sound and the piano sound. Furthermore, in the acoustic system 20, when the microphone 204 collects singing voice synchronized with the accompaniment performed by the keyboard unit 211, the MIDI sound source module 202 can reproduce the sound obtained by synthesizing the accompaniment sound and the singing voice.

[0162] As mentioned above, in Figure 16In the acoustic system 20 shown, the SPDIF signal (a continuous signal in subframes) sent from the MIDI keyboard 201 with microphone input to the MIDI sound source module 202 includes both linear PCM signals and MIDI signals. Therefore, the simultaneous transmission of linear PCM signals (audio signals) and MIDI signals can be performed stably without delay, and the generation and reproduction of synthesized sounds can be performed satisfactorily.

[0163] <3. Third Implementation Method>

[0164] [TV System Configuration Example]

[0165] Figure 17 An example configuration of an AV system 30 as a third embodiment is shown. The AV system 30 includes a television receiver 301 and an audio amplifier 302.

[0166] A receiving antenna 309, a MIDI file storage unit 307, an Internet connection 304, a MIDI keyboard 305, and a microphone 306 for television broadcasting are connected to a television receiver 301. Additionally, a speaker system 308 is connected to an audio amplifier 302.

[0167] The TV receiver 301 and the audio amplifier 302 are interconnected via an HDMI cable 303. Note that "HDMI" is a registered trademark. The TV receiver 301 is provided with an HDMI terminal 311, to which an HDMI receiving unit (HDMI RX) 312 and a high-speed bus interface 313 constituting the communication unit are connected. The audio amplifier 302 is provided with an HDMI terminal 351, to which an HDMI transmitting unit (HDMI TX) 352 and a high-speed bus interface 353 constituting the communication unit are connected. One end of the HDMI cable 303 is connected to the HDMI terminal 311 of the TV receiver 301, and the other end of the HDMI cable 303 is connected to the HDMI terminal 351 of the audio amplifier 302.

[0168] [TV receiver configuration]

[0169] The television receiver 301 includes an HDMI receiving unit 312, a high-speed bus interface 313, and an SPDIF transmitting circuit 314. Furthermore, the television receiver 301 includes a system controller 315, a user interface 316, a digital broadcast receiving circuit 317, a content playback circuit 318, an audio synthesis circuit 319, an A / D converter 320, an Ethernet interface 321, and a display 322. Note that "Ethernet" and "Ethernet" are registered trademarks. Additionally, in the example shown, each part of the image system has been appropriately omitted for simplicity.

[0170] The system controller 315 controls the operation of each unit of the television receiver 301. The user interface 316 is connected to the system controller 315. The user interface 316 constitutes an operating unit for users to perform various operations, and includes, for example, a remote control, a touch panel, a mouse, a keyboard, a gesture input unit that uses a camera device to detect command input, a voice input unit for executing command input by voice, etc.

[0171] Digital broadcast receiver circuit 317 processes the television broadcast signal input from receiving antenna 309 to obtain the video signal and linear PCM signal of the broadcast content, and also obtains MIDI files. Ethernet interface 321 communicates with an external server via Internet 304. Ethernet interface 321 obtains network content from the external server, and obtains the video signal and linear PCM signal, as well as MIDI files of additional network content.

[0172] The MIDI file storage unit 307 includes a removable memory, such as a USB memory, and stores MIDI files. For example, the MIDI file storage unit 307 may also store MIDI files pre-obtained via an Ethernet interface 321 or a digital broadcast receiving circuit 317.

[0173] The content playback circuit 318 outputs a MIDI signal based on a MIDI file obtained from the digital broadcast receiver circuit 317 or the Ethernet interface 321, or a MIDI file read from the MIDI file storage unit 307. Furthermore, the content playback circuit 318 extracts lyrics and sheet music information from the MIDI file and sends this information to the display 322. Therefore, the lyrics and sheet music are displayed on the display 322.

[0174] The A / D converter 320 converts the analog audio signal collected by the microphone 306 into a linear PCM signal. The audio synthesis circuit 319 receives the linear PCM signal obtained by the digital broadcast receiver circuit 317, the linear PCM signal obtained by the Ethernet interface 321, and another linear PCM signal obtained by the A / D converter 320, and selectively synthesizes and outputs the signal. The selection and synthesis in the audio synthesis circuit 319 are controlled by the system controller 315 according to user operation.

[0175] The HDMI receiver unit 312 receives image and audio data provided to the HDMI terminal 311 via the HDMI cable 303 through HDMI-compliant communication. The high-speed bus interface 313 is an interface using a bidirectional communication path configured with spare wires and hot-plug detection (HPD) lines constituting the HDMI cable 303. Note that details of the HDMI receiver unit 312 and the high-speed bus interface 313 will be described later.

[0176] Similar to the SPDIF transmitting circuit 110 in the transmitting device 101 of the transmitting / receiving system 10 described above, the SPDIF transmitting circuit 314 is a circuit for transmitting SPDIF signals (IEC 60958 standard digital audio transmission signals) and is a transmitting circuit that conforms to the IEC 60958 standard.

[0177] Similar to SPDIF transmitting circuit 110, SPDIF transmitting circuit 314 generates an SPDIF signal that simultaneously includes a linear PCM signal and a MIDI signal, and transmits the SPDIF signal to audio amplifier 302 via high-speed bus interface 313. Here, the linear PCM signal included in the SPDIF signal is the linear PCM signal output from audio synthesis circuit 319. Furthermore, the MIDI signal included in the SPDIF signal is a MIDI signal obtained by synthesizing the MIDI signal output from content playback circuit 318 and the MIDI signal output from MIDI keyboard 305.

[0178] "Audio Amplifier Configuration"

[0179] The audio amplifier 302 includes an HDMI transmitter unit 352, a high-speed bus interface 353, and an SPDIF receiver circuit 354. Additionally, the audio amplifier 302 includes a system controller 355, a MIDI sound source unit 356, an audio mixer 357, an amplifier 358, a display unit 359, and an Ethernet interface 360.

[0180] System controller 355 controls the operation of each unit of audio amplifier 302. HDMI transmitter unit 352 transmits image and audio data from HDMI terminal 351 to HDMI cable 303 via HDMI-compliant communication. High-speed bus interface 353 is an interface using a bidirectional communication path configured with spare wires and hot-plug detection (HPD) wires constituting HDMI cable 303. Ethernet interface 360 ​​communicates with an external server via the Internet. Note that details of HDMI transmitter unit 352 and high-speed bus interface 353 will be described later.

[0181] Similar to the SPDIF receiving circuit 120 in the receiving device 102 of the transmitting / receiving / receiving system 10 described above, the SPDIF receiving circuit 354 is a circuit for receiving SPDIF signals and is a receiving circuit conforming to the IEC 60958 standard.

[0182] The SPDIF receiving circuit 354 receives the SPDIF signal from the television receiver 301 via the high-speed bus interface 353, and extracts and outputs the linear PCM signal and MIDI signal contained in the SPDIF signal. Furthermore, the SPDIF receiving circuit 354 outputs status information indicating the presence of a MIDI signal. This status information is sent to the display unit 359, and the presence or absence of a MIDI signal is displayed on the display unit 359.

[0183] The MIDI source unit 356 receives the MIDI signal output from the SPDIF receiving circuit 354, converts the MIDI signal into music data through the MIDI source, and outputs a linear PCM signal corresponding to the music data. The audio mixer 357 synthesizes the linear PCM signal output from the SPDIF receiving circuit 354 and the linear PCM signal output from the MIDI source unit 356, and outputs the synthesized linear PCM signal.

[0184] Amplifier 358 amplifies the linear PCM signal obtained by audio mixer 357 and provides the amplified signal to speaker system 308. Therefore, an acoustic output based on the linear PCM signal is obtained from speaker system 308.

[0185] "Configuration Example of HDMI Transmit / Receive Unit"

[0186] Figure 18 It shows Figure 17 Configuration example of the HDMI receiving unit 312 of the TV receiver 301 and the HDMI transmitting unit 352 of the audio amplifier 302 in the AV system 30.

[0187] The HDMI transmitting unit 352 transmits baseband (uncompressed) differential signals for image data of a single frame to the HDMI receiving unit 312 via multiple channels in one direction during an effective image interval (hereinafter appropriately referred to as the "active video interval"). This effective image interval is obtained by subtracting the horizontal blanking period and the vertical blanking period from the interval between one vertical sync signal and the next vertical sync signal (hereinafter appropriately referred to as the "video field"). Furthermore, during the horizontal and vertical blanking periods, the HDMI transmitting unit 352 transmits differential signals corresponding to audio data, control packets, and other auxiliary data accompanying the image data to the HDMI receiving unit 312 via multiple channels in one direction.

[0188] The HDMI transmitting unit 352 includes a source signal processing unit 71 and an HDMI transmitter 72. Baseband uncompressed image (video) and audio (audio) data are provided to the source signal processing unit 71. The source signal processing unit 71 performs necessary processing on the provided image and audio data and provides the processed data to the HDMI transmitter 72. In addition, the source signal processing unit 71 exchanges control information, status notification information (control / status), etc., with the HDMI transmitter 72 as needed.

[0189] The HDMI transmitter 72 converts the image data provided by the source signal processing unit 71 into a corresponding differential signal, and sends the differential signal in one direction to the HDMI receiver 312 connected via the HDMI cable 303 through three TMDS channels #0, #1 and #2, which are multiple channels.

[0190] In addition, audio data, control packets and other auxiliary data, as well as control data such as vertical sync signal (VSYNC) and horizontal sync signal (HSYNC) accompanying the uncompressed image data provided from transmitter 72 and source signal processing unit 71, are converted into corresponding differential signals and transmitted in one direction to HDMI receiver unit 312 connected via HDMI cable 303 through three TMDS channels #0, #1 and #2.

[0191] In addition, the transmitter 72 transmits a pixel clock synchronized with the image data transmitted through the three TMDS channels #0, #1 and #2 to the HDMI receiver 312 connected via the HDMI cable 303 via the TMDS clock channel.

[0192] The HDMI receiving unit 312 receives differential signals corresponding to image data transmitted from the HDMI transmitting unit 352 in one direction through multiple channels during the active video interval, and receives differential signals corresponding to auxiliary data and control data transmitted from the HDMI transmitting unit 352 through multiple channels during the horizontal blanking period and the vertical blanking period.

[0193] The HDMI receiving unit 312 includes an HDMI receiver 81 and a destination signal processing unit 82. Similarly, the HDMI receiver 81 receives differential signals corresponding to image data and differential signals corresponding to auxiliary data and control data transmitted in one direction from the HDMI transmitting unit 352 via TMDS clock channels #0, #1, and #2, synchronized with the pixel clock transmitted from the HDMI transmitting unit 352 connected via the HDMI cable 303. Furthermore, the HDMI receiver 81 converts the differential signals into corresponding image data, auxiliary data, and control data, and provides the data to the destination signal processing unit 82 as needed.

[0194] The receiving signal processing unit 82 performs necessary processing on the data provided from the HDMI receiver 81 and outputs the data. In addition, the receiving signal processing unit 82 exchanges control information and status notification information (control / status) with the HDMI receiver 81 as needed.

[0195] In addition to the three TMDS channels #0, #1, and #2 used to continuously transmit image data, auxiliary data, and control data from the HDMI transmitting unit 352 to the HDMI receiving unit 312 in one direction in sync with the pixel clock, and the TMDS clock channel as a transmission channel for transmitting the pixel clock, the HDMI transmission channels also include a display data channel (DDC) 83, and another transmission channel called CEC line 84.

[0196] DDC 83 includes two lines (signal lines) (not shown) included in HDMI cable 303 and is used by the source device to read Enhanced Extended Display Identifier (E-EDID) from a destination device connected via HDMI cable 303. Specifically, the destination device includes EDIDROM 85. The source device reads the E-EDID stored in EDIDROM 85 from the destination device connected via HDMI cable 303 via DDC 83 and identifies the settings and performance of the destination device based on the E-EDID.

[0197] CEC line 84 includes a line (not shown) included in HDMI cable 303 and is used to perform bidirectional communication of control data between the source device and the destination device.

[0198] In addition, the HDMI cable 303 includes a line 86 connected to a pin known as Hot-Plug Detection (HPD). The source device can detect the connection of the destination device using line 86. Furthermore, the HDMI cable 303 includes a line 87 for supplying power from the source device to the destination device. Additionally, the HDMI cable 303 includes a spare line 88.

[0199] "Configuration Example of High-Speed ​​Bus Interface"

[0200] Figure 19 It shows Figure 17 Example configuration of the high-speed bus interface 313 of the television receiver 301 in the AV system 30. The Ethernet interface 321 performs local area network (LAN) communication, i.e., transmission and reception of Ethernet signals, by using a transmission path comprising pairs of wires, including spare wires and HPD wires, among the multiple wires constituting the HDMI cable 303. The SPDIF transmission circuit 314 transmits SPDIF signals by using the transmission path including the pairs of wires as described above.

[0201] The television receiver 301 includes a LAN signal transmitting circuit 441, a terminating resistor 442, AC coupling capacitors 443 and 444, a LAN signal receiving circuit 445, a subtraction circuit 446, an addition circuit 449 and 450, and an amplifier 451. These components constitute a high-speed bus interface 313. Furthermore, the television receiver 301 includes a choke coil 461, resistors 462 and 463 that constitute a pluggable connection transmitting circuit 460.

[0202] A series circuit of AC coupling capacitor 443, terminating resistor 442, and AC coupling capacitor 444 is connected between pin 14 (521) and pin 19 (522) of HDMI terminal 311. Furthermore, a series circuit of resistors 462 and 463 is connected between the power supply line (+5.0V) and ground. The connection point between resistors 462 and 463 is then connected via choke coil 461 to connection point Q4 between pin 19 (522) and AC coupling capacitor 444.

[0203] The connection point P3 between the AC coupling capacitor 443 and the terminating resistor 442 is connected to the output side of the adder circuit 449 and to the positive input side of the LAN signal receiving circuit 445. Furthermore, the connection point P4 between the AC coupling capacitor 443 and the terminating resistor 442 is connected to the output side of the adder circuit 450 and to the negative input side of the LAN signal receiving circuit 445.

[0204] One input of adder circuit 449 is connected to the positive output of LAN signal transmitting circuit 441, and the SPDIF signal output from SPDIF transmitting circuit 314 is provided to the other input of adder circuit 449 via amplifier 451. Furthermore, one input of adder circuit 450 is connected to the negative output of LAN signal transmitting circuit 441, and the SPDIF signal output from SPDIF transmitting circuit 314 is provided to the other input of adder circuit 450 via amplifier 451.

[0205] The transmit signal (transmit data) SG417 is provided from the Ethernet interface 321 to the input side of the LAN signal transmitting circuit 441. Furthermore, the output signal SG418 of the LAN signal receiving circuit 445 is provided to the positive terminal of the subtraction circuit 446, and the transmit signal SG417 is provided to the negative terminal of the subtraction circuit 446. In the subtraction circuit 446, the transmit signal SG417 is subtracted from the output signal SG418 of the LAN signal receiving circuit 445 to obtain the receive signal (receive data) SG419. When the LAN signal (Ethernet signal) is transmitted as a differential signal via the spare line and HPD line, the receive signal SG419 is the LAN signal. The receive signal SG419 is provided to the Ethernet interface 321.

[0206] Figure 20 It shows Figure 17 Example configuration of the high-speed bus interface 353 of the audio amplifier 302 in the AV system 30. The Ethernet interface 360 ​​performs local area network (LAN) communication, i.e., the transmission and reception of Ethernet signals, using a transmission path comprising pairs of wires, including spare wires and HPD wires, among the multiple wires constituting the HDMI cable 303. The SPDIF receiving circuit 354 receives SPDIF signals using a transmission path including the aforementioned pairs of wires.

[0207] Audio amplifier 302 includes a LAN signal transmitting circuit 411, a terminating resistor 412, AC coupling capacitors 413 and 414, a LAN signal receiving circuit 415, a subtraction circuit 416, an addition circuit 419, and an amplifier 420. These components constitute a high-speed bus interface 353. Furthermore, audio amplifier 302 includes a pull-down resistor 431, a resistor 432, a capacitor 433, and a comparator 434, which constitute a plug-in connection detection circuit 430. Here, resistor 432 and capacitor 433 form a low-pass filter.

[0208] The series circuit of AC coupling capacitor 413, terminating resistor 412, and AC coupling capacitor 414 is connected between pin 14 (511) and pin 19 (512) of HDMI terminal 351. The connection point P1 between AC coupling capacitor 413 and terminating resistor 412 is connected to the positive output side of LAN signal transmitting circuit 411 and to the positive input side of LAN signal receiving circuit 415.

[0209] The connection point P2 of AC coupling capacitor 414 and terminating resistor 412 is connected to the negative output side of LAN signal transmitting circuit 411 and to the negative input side of LAN signal receiving circuit 415. The transmit signal (transmit data) SG411 is provided from Ethernet interface 360 ​​to the input side of LAN signal transmitting circuit 411.

[0210] The output signal SG412 of the LAN signal receiving circuit 415 is provided to the positive terminal of the subtraction circuit 416, and the transmit signal (transmit data) SG411 is provided to the negative terminal of the subtraction circuit 416. In the subtraction circuit 416, the transmit signal SG411 is subtracted from the output signal SG412 of the LAN signal receiving circuit 415 to obtain the receive signal SG413. When the LAN signal (Ethernet signal) is transmitted as a differential signal via the spare line and HPD line, the receive signal SG413 is the LAN signal. The receive signal SG413 is provided to the Ethernet interface 360.

[0211] The connection point Q2 between AC coupling capacitor 414 and pin 19 terminal 512 is connected to ground via pull-down resistor 431 and further connected to ground via a series circuit of resistor 432 and capacitor 433. The output signal of the low-pass filter obtained at the connection point between resistor 432 and capacitor 433 is then provided to one input terminal of comparator 434. In comparator 434, the output signal of the low-pass filter is compared with a reference voltage Vref2 (+1.4V) provided to another input terminal. The output signal SG415 of comparator 434 is provided to the control unit (CPU) (not shown) of audio amplifier 302.

[0212] Furthermore, the connection point P1 between AC coupling capacitor 413 and terminating resistor 412 is connected to one input terminal of adder circuit 419. Additionally, the connection point P2 between AC coupling capacitor 414 and terminating resistor 412 is connected to another input terminal of adder circuit 419. The output signal of adder circuit 419 is provided to SPDIF receiving circuit 354 via amplifier 420. When the SPDIF signal is transmitted as an in-phase signal via the spare line and HPD line, the output signal of adder circuit 419 is an SPDIF signal.

[0213] exist Figure 17 In the AV system 30 shown, for example, consider the case where the content playback circuit 318 on the television receiver 301 side outputs a MIDI signal corresponding to the background music for karaoke. In this case, based on the information provided from the content playback circuit 318, the lyrics and sheet music are displayed on the display 322. In this state, it is assumed that the user sings towards the microphone 306 and performs an improvisation using the MIDI keyboard 305 in the interlude section.

[0214] In this case, the SPDIF transmitting circuit 314 generates an SPDIF signal that includes a linear PCM signal based on the user's singing and a MIDI signal (obtained by synthesizing a MIDI signal corresponding to the background performance and a MIDI signal corresponding to the improvisation using the MIDI keyboard 305), and sends the SPDIF signal to the audio amplifier 302 via the high-speed bus interface 313.

[0215] In this configuration, on the audio amplifier 302 side, in the SPDIF receiving circuit 354, the SPDIF signal is received from the television receiver 301 via the high-speed bus interface 353, and the linear PCM signal and MIDI signal included in the SPDIF are separated and extracted. Then, in the MIDI sound source unit 356, the linear PCM signal corresponding to the background performance and improvisational performance sounds is obtained based on the MIDI signal.

[0216] In the audio mixer 357, a linear PCM signal corresponding to the background and improvisational performance sounds and a linear PCM signal corresponding to the user's singing voice extracted by the SPDIF receiving circuit 354 are synthesized. The synthesized linear PCM signal is then amplified by amplifier 358 and provided to the speaker system 308. Thus, a reproduced sound is obtained from the speaker system 308, in which the background and improvisational performance sounds and the user's singing voice are synthesized.

[0217] As mentioned above, in Figure 17 In the illustrated AV system 30, the SPDIF signal (a continuous signal in subframe units) sent from the television receiver 301 to the audio amplifier 302 includes a linear PCM signal (audio signal) and a MIDI signal. Therefore, the simultaneous transmission of the linear PCM signal and the MIDI signal from the television receiver 301 to the audio amplifier 302 can be performed stably without delay, and the generation and reproduction of synthesized sound can be satisfactorily performed in the audio amplifier 302.

[0218] <4. Fourth Implementation Method>

[0219] [Game System Configuration Example]

[0220] Figure 21 An example configuration of a game system 60 as a fourth embodiment is shown. The game system 60 is a system that decodes game content and plays the game while sensing the movement of the game user.

[0221] Beyond controlling musical instrument sound sources, MIDI signals are also used for mixer control, lighting control, and machine control. For example, they can remotely control the value of a volume fader. That is, specific values ​​can be sent and received at arbitrary time points, and they can be used to send values ​​from various sensors, set the temperature of thermal imaging devices, and so on. Furthermore, they can be synthesized into low-frequency sounds in vibration actuators.

[0222] The gaming system 60 includes a head-mounted display 601 and a game console 602. A microphone 604 is connected to the head-mounted display 601. Additionally, the Internet 605 is connected to the game console 602.

[0223] The head-mounted display 601 and the game console 602 are interconnected via an HDMI cable 603. The head-mounted display 601 has an HDMI port 611, to which an HDMI receiver unit (HDMI RX) 612 and a high-speed bus interface 613, constituting a communication unit, are connected. The game console 602 has an HDMI port 651, to which an HDMI transmitter unit (HDMI TX) 652 and a high-speed bus interface 653, constituting a communication unit, are connected. One end of the HDMI cable 603 is connected to the HDMI port 611 of the head-mounted display 601, and the other end is connected to the HDMI port 651 of the game console 602.

[0224] "Head-mounted display configuration"

[0225] The head-mounted display 601 includes an HDMI receiving unit 612, a high-speed bus interface 613, and an SPDIF transmitting circuit 614. Furthermore, the head-mounted display 601 includes a system controller 615, an A / D converter 616, a left-eye display 617, a right-eye display 618, and stereo headphones 619. Additionally, the head-mounted display 601 includes a sensor unit 620, which includes a gyroscope sensor, an accelerometer, a heart rate sensor, a body temperature sensor, a pressure sensor, etc.; and a controlled unit 621, which includes a vibration actuator, a thermal imaging device, a force imaging device, etc.

[0226] The system controller 615 controls the operation of each unit of the head-mounted display 601. Similar to the high-speed bus interface 313 in the television receiver 301 of the AV system 30 described above, the high-speed bus interface 613 is an interface that uses a bidirectional communication path configured with a spare wire and a hot-plug detection (HPD) line constituting the HDMI cable 603.

[0227] The A / D converter 616 converts the analog audio signal related to the speech of the game user (the wearer of the head-mounted display 601) obtained by the sound collected by the microphone 604 into a linear PCM signal, and sends the linear PCM signal to the SPDIF transmission circuit 614.

[0228] Similar to the SPDIF transmitting circuit 110 in the transmitting device 101 of the transmitting / receiving system 10 described above, the SPDIF transmitting circuit 614 is a circuit for transmitting SPDIF signals (IEC 60958 standard digital audio transmission signals) and is a transmitting circuit that conforms to the IEC 60958 standard.

[0229] Similar to SPDIF transmitting circuit 110, SPDIF transmitting circuit 614 generates an SPDIF signal that simultaneously includes a linear PCM signal and a MIDI signal, and transmits the SPDIF signal to game console 602 via high-speed bus interface 613. Here, the linear PCM signal included in the SPDIF signal is a linear PCM signal related to the game user's speech, obtained by A / D converter 616. Furthermore, the MIDI signal included in the SPDIF signal is a MIDI signal with detection signals from various sensors, obtained by sensor unit 620.

[0230] Similar to the HDMI receiving unit 312 in the TV receiver 301 of the AV system 30 described above, the HDMI receiving unit 612 receives image and audio data provided to the HDMI terminal 611 via the HDMI cable 603 through HDMI-compliant communication. Here, the HDMI receiving unit 612 receives 3D video and audio signals and MIDI signals sent from the game console 602.

[0231] In this case, it includes stereo 2-channel audio signals (as linear PCM signals for audio signals) and SPDIF signals of MIDI signals (see...). Figure 6 The signal is mapped to audio sample groups and sent. In the HDMI receiver unit 612, stereo 2-channel audio signals and MIDI signals, which serve as control information, are extracted from the SPDIF signal.

[0232] The left-eye video signal obtained by the HDMI receiving unit 612 is sent to the left-eye display 617, and the left-eye image is displayed on the left-eye display 617. Similarly, the right-eye video signal obtained by the HDMI receiving unit 612 is sent to the right-eye display 618, and the right-eye image is displayed on the right-eye display 618. The user can perceive stereoscopic images related to the game content from the left-eye and right-eye images. Furthermore, the stereo 2-channel audio signal obtained by the HDMI receiving unit 612 is sent to stereo headphones 619, and stereo sound related to the game content is reproduced.

[0233] Furthermore, MIDI signals, which serve as control information obtained by the HDMI receiving unit 612, are sent to the controlled unit 621. In the controlled unit 621, actuators and devices are controlled based on the MIDI signals. Therefore, game users are given vibration, heat, force, and other sensations related to the game content.

[0234] Game console configuration

[0235] The game console 602 includes an HDMI transmitter 652, a high-speed bus interface 653, and an SPDIF receiver circuit 654. Additionally, the game console 602 includes a game control processing unit 655 and an Ethernet interface 656.

[0236] Similar to the high-speed bus interface 353 in the audio amplifier 302 of the AV system 30 described above, the high-speed bus interface 653 is an interface that uses a bidirectional communication path configured with a spare cable and a hot-plug detection (HPD) cable constituting the HDMI cable 603. The Ethernet interface 656 communicates with an external server (cloud server) via the Internet 605. For example, the Ethernet interface 656 streams game content from a cloud server providing game services.

[0237] Similar to the SPDIF receiving circuit 120 in the receiving device 102 of the transmitting / receiving / receiving system 10 described above, the SPDIF receiving circuit 654 is a circuit for receiving SPDIF signals and is a receiving circuit conforming to the IEC 60958 standard.

[0238] The SPDIF receiving circuit 654 receives the SPDIF signal from the television receiver 301 via the high-speed bus interface 653, and extracts and outputs the linear PCM signal and MIDI signal contained in the SPDIF signal. In this embodiment, the linear PCM signal is the linear PCM signal related to the game user's speech as described above. Furthermore, the MIDI signal is a MIDI signal incorporating the detection signals from the various sensors described above.

[0239] The game control processing unit 655 includes a CPU, DSP, GPU, etc. The game control processing unit 655 decodes the game content and generates 3D video and audio signals and MIDI signals by referencing the MIDI signal and linear PCM signal obtained by the SPDIF receiving circuit 354. Here, the 3D video and audio signals include a left-eye video signal, a right-eye video signal, and a stereo 2-channel audio signal (linear PCM signal). Furthermore, the MIDI signal is a MIDI signal with control signals for providing the game user with vibration, heat, force, etc., related to the game content.

[0240] Similar to the HDMI transmitter unit 352 in the audio amplifier 302 of the AV system 30 described above, the HDMI transmitter unit 652 transmits image and audio data from the HDMI terminal 651 to the HDMI cable 603 via HDMI-compliant communication. Here, it transmits 3D video and audio signals and MIDI signals generated by the game control processing unit 655 as described above. In this case, an SPDIF signal (see [link to SPDIF]) including a stereo 2-channel audio signal (a linear PCM signal as the audio signal) and a MIDI signal is generated. Figure 6), and maps the SPDIF signal to audio sample groups and sends them.

[0241] As mentioned above, in Figure 21 In the illustrated game system 60, the SPDIF signal (a continuous signal in subframes) sent from the head-mounted display 601 to the game console 602 includes a linear PCM signal related to the game user's speech and a MIDI signal containing detection signals from various sensors. Therefore, simultaneous transmission of the linear PCM signal and MIDI signal from the head-mounted display 601 to the game console 602 can be performed stably without delay, and the processing in the game control processing unit 655 can be satisfactorily executed within the game console 602.

[0242] In addition, Figure 21 In the game system 60 shown, the SPDIF signal (a continuous signal in subframes) sent from the game console 602 to the head-mounted display 601 includes a stereo 2-channel audio signal (a linear PCM signal as an audio signal) generated by the game control processing unit 655 and a MIDI signal having control signals for providing the game user with vibration, heat, force, etc., related to the game content. Therefore, the simultaneous transmission of the linear PCM signal and MIDI signal from the game console 602 to the head-mounted display 601 can be stably executed without delay, and the audio reproduction sound and the vibration, heat, force, etc., provided to the game user can be satisfactorily performed in the head-mounted display 601 in a synchronized state without delay.

[0243] <5. Modified Example>

[0244] Note that in the above embodiments, examples have been described where coaxial cables or optical fibers, as well as additional HDMI ARC or HDMI transmission paths, are used as IEC 60958 transmission paths; however, configurations using other IEC 60958 transmission paths are also conceivable. For example, examples of using IEC 61883-6 transmission paths, MHL transmission paths, DisplayPort transmission paths (DP transmission paths), etc., as IEC 60958 transmission paths are also conceivable. Similarly, in these cases, the SPDIF signal (IEC 60958 signal) is mapped to audio sample packets (audio sample packets) and transmitted in the same forward direction as the video transmission.

[0245] Furthermore, preferred embodiments of the present disclosure have been described in detail with reference to the accompanying drawings; however, the technical scope of the present disclosure is not limited to such examples. It is evident that those skilled in the art can conceive of various modifications or corrections within the scope of the technical concept described in the claims, and it should be understood that such modifications or corrections also fall within the technical scope of the present disclosure.

[0246] Furthermore, the effects described in this specification are illustrative or exemplary only, and not restrictive. That is, in conjunction with or in lieu of the effects described above, the technology based on this disclosure can exhibit other effects that will be apparent to those skilled in the art based on the description herein.

[0247] In addition, the technology can also have the following configurations.

[0248] (1) A transmitting device, comprising:

[0249] A transmitting unit transmits signals in predetermined units to a receiving side via a predetermined transmission path, wherein...

[0250] The signals that are continuous in the predetermined units include: a first predetermined unit of signals including audio signals and a second predetermined unit of signals including MIDI signals.

[0251] (2) The transmitting device according to (1), wherein,

[0252] The predetermined unit is the subframe unit.

[0253] (3) The transmitting device according to (1) or (2), wherein,

[0254] The audio signal is a linear PCM signal that constitutes a stereo 2-channel audio signal.

[0255] (4) The generating apparatus according to any one of (1) to (3), wherein,

[0256] The MIDI signal includes data packets of a predetermined length, and

[0257] The predetermined length of data packets is divided into multiple segments and transmitted by being included in multiple signals of the second predetermined unit.

[0258] (5) The transmitting device according to (4), wherein,

[0259] The predetermined length of the packet data is 32-bit, 64-bit, 96-bit, or 128-bit packet data, and is divided into multiple 16-bit packets.

[0260] (6) The transmitting device according to (4) or (5), wherein,

[0261] In the second predetermined unit of the signal including the MIDI signal, the MIDI signal is inserted on the low-order side, and identification information is inserted on the high-order side, the identification information identifying whether the MIDI signal inserted on the low-order side is at least the initial segmented data or the continuous segmented data.

[0262] (7) The transmitting device according to (6), wherein,

[0263] The identification information is configured such that even when a predetermined number of bits of data, including the MIDI signal on the low-bit side and the identification information on the high-bit side, are reproduced as audio data, the volume is less than or equal to a predetermined value.

[0264] (8) The generating apparatus according to any one of (1) to (3), wherein,

[0265] The packet data constituting the MIDI signal is inserted from any bit position in the data payload area of ​​the signal of the second predetermined unit, and if it is not possible to insert all of the packet data into the data payload area, the remaining part of the packet data is inserted from the first position in the data payload area of ​​the next second predetermined unit of the signal, and the packet data constituting the MIDI signal is sent.

[0266] (9) The generating apparatus according to any one of (1) to (3), wherein,

[0267] One byte of grouped data constituting the MIDI signal is inserted into one byte of the two-byte data payload area of ​​the signal in the second predetermined unit and transmitted.

[0268] (10) The generating apparatus according to any one of (1) to (3), wherein,

[0269] One byte of packet data constituting the MIDI signal is inserted into one byte of the two-byte data payload area in the signal of the second predetermined unit, and the other byte area is set as an extended byte area and sent.

[0270] (11) The generating apparatus according to any one of (1) to (10), wherein,

[0271] The signal of the second predetermined unit includes the MIDI signal from multiple channels.

[0272] (12) The transmitting device according to any one of (1) to (11) further comprises:

[0273] An information adding unit adds identification information to a signal that is continuous in the predetermined unit, the identification information identifying that the signal includes a first predetermined unit of signal including an audio signal and a second predetermined unit of signal including a MIDI signal.

[0274] (13) The transmitting device according to (12), wherein,

[0275] The information adding unit adds the identification information by using a pre-defined bit region of each block configured for each of the predetermined number of predetermined units.

[0276] (14) The generating apparatus according to any one of (1) to (13), wherein,

[0277] The predetermined transmission path is a coaxial cable, optical fiber, Ethernet (IEC 61883-6) cable, HDMI cable, MHL cable, or display port cable.

[0278] (15) A method of sending, comprising:

[0279] The process of transmitting signals in predetermined units to a receiving side via a predetermined transmission path, wherein...

[0280] The signals that are continuous in the predetermined units include: a first predetermined unit of signals including audio signals and a second predetermined unit of signals including MIDI signals.

[0281] (16) A receiving device, comprising:

[0282] A receiving unit receives signals in predetermined units from a transmitting side via a predetermined transmission path, wherein...

[0283] The signals that are continuous in the predetermined units include: a first predetermined unit of signals including audio signals and a second predetermined unit of signals including MIDI signals.

[0284] (17) The receiving device according to (16), wherein,

[0285] The audio signal is a linear PCM signal that constitutes a stereo 2-channel audio signal.

[0286] (18) The receiving device according to (16) or (17) further includes:

[0287] The processing unit uses the audio signal and the MIDI signal to perform processing.

[0288] (19) The receiving device according to (18), wherein,

[0289] The processing unit synthesizes the audio signal with an audio signal obtained from the MIDI signal using a MIDI sound source to obtain an output audio signal.

[0290] (20) A receiving method, comprising:

[0291] The process of receiving signals in predetermined units from the transmitting side via a predetermined transmission path, wherein...

[0292] The signals that are continuous in the predetermined units include: a first predetermined unit of signals including audio signals and a second predetermined unit of signals including MIDI signals.

[0293] List of reference numerals

[0294] 10 Transmit / Receive System

[0295] 101 Transmitting Device

[0296] 102 Receiving Device

[0297] 103 Transmission Path

[0298] 110 SPDIF Transmit Circuit

[0299] 120 SPDIF receiver circuit

[0300] 20 Acoustic Systems

[0301] 201 MIDI Keyboard with Microphone Input

[0302] 202 MIDI sound source module

[0303] 203 Transmission Path

[0304] 204 microphones

[0305] 205 Amplifier

[0306] 206 loudspeaker system

[0307] 210 A / D converter

[0308] 211 Keyboard Unit

[0309] 212 SPDIF Transmitting Circuit

[0310] 220 SPDIF receiver circuit

[0311] 221 MIDI sound source units

[0312] 222 Audio Mixer

[0313] 223 Display Unit

[0314] 30 AV system

[0315] 301 TV Receiver

[0316] 302 Audio Amplifier

[0317] 303 HDMI cable

[0318] 304 Internet

[0319] 305 MIDI Keyboard

[0320] 306 microphone

[0321] 307 MIDI file storage unit

[0322] 308 speaker system

[0323] 309 Receiving Antenna

[0324] 311 HDMI terminal

[0325] 312 HDMI receiver units

[0326] 313 High-speed bus interface

[0327] 314 SPDIF Transmit Circuit

[0328] 315 System Controller

[0329] 316 User Interface

[0330] 317 Digital Broadcast Receiver Circuit

[0331] 318 Content Reproduction Circuit

[0332] 319 Audio Synthesis Circuit

[0333] 320 A / D converter

[0334] 321 Ethernet interface

[0335] 322 monitor

[0336] 351 HDMI terminal

[0337] 352 HDMI Transmitter Units

[0338] 353 High-Speed ​​Bus Interface

[0339] 354 SPDIF Receiver Circuit

[0340] 355 System Controller

[0341] 356 MIDI sound source units

[0342] 357 Audio Mixer

[0343] 358 amplifier

[0344] 359 display units

[0345] 360 Ethernet interface

[0346] 60 Game System

[0347] 601 Head-mounted Display

[0348] 602 Game Console

[0349] 603 HDMI cable

[0350] 604 microphone

[0351] 605 Internet

[0352] 611 HDMI terminal

[0353] 612 HDMI receiver unit

[0354] 613 High-speed bus interface

[0355] 614 SPDIF Transmit Circuit

[0356] 615 System Controller

[0357] 616 A / D Converter

[0358] 617 Left-eye monitor

[0359] 618 Right-eye monitor

[0360] 619 Stereo Headphones

[0361] 620 sensor unit

[0362] 621 Controlled Unit

[0363] 651 HDMI terminal

[0364] 652 HDMI Transmitter Units

[0365] 653 High-Speed ​​Bus Interface

[0366] 654 SPDIF Receiver Circuit

[0367] 655 Game Control Processing Unit

[0368] 656 Ethernet interface

Claims

1. A transmitting device, comprising: A transmitting unit transmits signals in predetermined units to a receiving side via a predetermined transmission path, wherein... The signals in the predetermined units include: a first predetermined unit of signals comprising audio signals and a second predetermined unit of signals comprising MIDI signals. The predetermined unit is a subframe unit. In this configuration, even-numbered subframes are used to insert the audio signal, and odd-numbered subframes are used to insert the MIDI signal. The transmitting device further includes an information adding unit that adds identification information to signals that are continuous in predetermined units, the identification information identifying that the signals include a first predetermined unit of signals including audio signals and a second predetermined unit of signals including MIDI signals.

2. The transmitting device according to claim 1, wherein, The audio signal is a linear PCM signal that constitutes a stereo 2-channel audio signal.

3. The transmitting device according to claim 1, wherein, The MIDI signal includes data packets of a predetermined length, and The predetermined length of data packets is divided into multiple segments and transmitted by being included in multiple signals of the second predetermined unit.

4. The transmitting device according to claim 3, wherein, The predetermined length of the packet data is 32-bit, 64-bit, 96-bit, or 128-bit packet data, and is divided into multiple 16-bit packets.

5. The transmitting device according to claim 3, wherein, In the second predetermined unit of the signal including the MIDI signal, the MIDI signal is inserted on the low-order side, and identification information is inserted on the high-order side, the identification information identifying whether the MIDI signal inserted on the low-order side is at least the initial segmented data or the continuous segmented data.

6. The transmitting device according to claim 5, wherein, The identification information is configured such that even when a predetermined number of bits of data, including the MIDI signal on the low-bit side and the identification information on the high-bit side, are reproduced as audio data, the volume is less than or equal to a predetermined value.

7. The transmitting device according to claim 1, wherein, The packet data constituting the MIDI signal is inserted from any bit position in the data payload area of ​​the signal of the second predetermined unit, and if it is not possible to insert all of the packet data into the data payload area, the remaining part of the packet data is inserted from the first position in the data payload area of ​​the next second predetermined unit of the signal, and the packet data constituting the MIDI signal is sent.

8. The transmitting device according to claim 1, wherein, One byte of grouped data constituting the MIDI signal is inserted into one byte of the two-byte data payload area of ​​the signal in the second predetermined unit and transmitted.

9. The transmitting device according to claim 1, wherein, One byte of packet data constituting the MIDI signal is inserted into one byte region of the two-byte data payload area in the signal of the second predetermined unit, and the other byte region is set as an extended byte region and transmitted.

10. The transmitting device according to claim 1, wherein, The signal of the second predetermined unit includes the MIDI signal from multiple channels.

11. The transmitting device according to claim 1, wherein, The information adding unit adds the identification information by using a pre-defined bit region of each block configured for each of the predetermined number of predetermined units.

12. The transmitting device according to claim 1, wherein, The predetermined transmission path is a coaxial cable, optical fiber, Ethernet (IEC 61883-6) cable, HDMI cable, MHL cable, or display port cable.

13. A method of sending, comprising: The process of transmitting signals in predetermined units to a receiving side via a predetermined transmission path, wherein... The signals in the predetermined units include: a first predetermined unit of signals comprising audio signals and a second predetermined unit of signals comprising MIDI signals. The predetermined unit is a subframe unit. In this configuration, even-numbered subframes are used to insert the audio signal, and odd-numbered subframes are used to insert the MIDI signal. The transmission method further includes adding identification information to a signal that is continuous in the predetermined unit, wherein the identification information identifies that the signal includes a first predetermined unit of signal including an audio signal and a second predetermined unit of signal including a MIDI signal.

14. A receiving device, comprising: A receiving unit receives signals in predetermined units from a transmitting side via a predetermined transmission path, wherein... The signals in the predetermined units include: a first predetermined unit of signals comprising audio signals and a second predetermined unit of signals comprising MIDI signals. The predetermined unit is a subframe unit. In this configuration, even-numbered subframes are used to insert the audio signal, and odd-numbered subframes are used to insert the MIDI signal. The signals, which are continuous in predetermined units, are added with identification information, which identifies that the signals include a first predetermined unit of signals including audio signals and a second predetermined unit of signals including MIDI signals.

15. The receiving device according to claim 14, wherein, The audio signal is a linear PCM signal that constitutes a stereo 2-channel audio signal.

16. The receiving device according to claim 14, further comprising: The processing unit uses the audio signal and the MIDI signal to perform processing.

17. The receiving device according to claim 16, wherein, The processing unit synthesizes the audio signal with an audio signal obtained from the MIDI signal using a MIDI sound source to obtain an output audio signal.

18. A receiving method, comprising: The process of receiving signals in predetermined units from the transmitting side via a predetermined transmission path, wherein... The signals in the predetermined units include: a first predetermined unit of signals comprising audio signals and a second predetermined unit of signals comprising MIDI signals. The predetermined unit is a subframe unit. In this configuration, even-numbered subframes are used to insert the audio signal, and odd-numbered subframes are used to insert the MIDI signal. The signals, which are continuous in predetermined units, are added with identification information, which identifies that the signals include a first predetermined unit of signals including audio signals and a second predetermined unit of signals including MIDI signals.

19. A computer-readable medium having a program recorded thereon, the program causing the computer to perform a method when executed by the computer, the method comprising: The process of transmitting signals in predetermined units to a receiving side via a predetermined transmission path, wherein... The signals in the predetermined units include: a first predetermined unit of signals comprising audio signals and a second predetermined unit of signals comprising MIDI signals. The predetermined unit is a subframe unit. In this configuration, even-numbered subframes are used to insert the audio signal, and odd-numbered subframes are used to insert the MIDI signal. The method further includes: Identification information is added to signals that are continuous in predetermined units, the identification information identifying that the signals include a first predetermined unit of signals including audio signals and a second predetermined unit of signals including MIDI signals.

20. A computer-readable medium having a program recorded thereon, the program causing the computer to perform a method when executed by the computer, the method comprising: The process of receiving signals in predetermined units from the transmitting side via a predetermined transmission path, wherein... The signals in the predetermined units include: a first predetermined unit of signals comprising audio signals and a second predetermined unit of signals comprising MIDI signals. The predetermined unit is a subframe unit. In this configuration, even-numbered subframes are used to insert the audio signal, and odd-numbered subframes are used to insert the MIDI signal. The signals, which are continuous in predetermined units, are added with identification information, which identifies that the signals include a first predetermined unit of signals including audio signals and a second predetermined unit of signals including MIDI signals.

Images