Video signal processing device, video signal processing method, video signal output device, and multi-display system

Abstract

The present invention supplies an appropriate video stream that suits the type of multi-display display to each of a plurality of display devices.　Performance information pertaining to each of the plurality of display devices is received. Multi-stream information is generated, on the basis of the performance information pertaining to the plurality of display devices and information pertaining to the type of multi-display display realized using the plurality of display devices, and is transmitted to a video signal output device. A multi-stream is received from the video signal output device, the multi-stream including a video stream for each of the plurality of display devices, the video stream having been generated on the basis of the multi-stream information. A plurality of video streams are retrieved from the multi-stream, each of which is then transmitted to a corresponding display device among the plurality of display devices.

Description

[Technical Field]

[0001] The present technology relates to a video signal processing device, a video signal processing method, a video signal output device, and a multi-display system, and more particularly to a video signal processing device that extracts multiple video streams from a multi-stream and transmits each to a corresponding display device. [Background technology]

[0002] Conventionally, it has been known to perform multi-display display using multiple display devices. Patent Document 1 also discloses a control method for performing multi-display display using the multi-stream transmission function of DisplayPort. In this case, a multi-stream signal transmitted from a source device within the range defined by the DisplayPort standard is processed by a sink device using information such as resolution to achieve multi-display display. In other words, the sink device processes transmitted signals of a resolution that it can play back so as to display them, and outputs signals that are not supported to another device connected to the sink device as is. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2015-055845 Summary of the Invention [Problem to be solved by the invention]

[0004] An object of the present technology is to enable supplying an appropriate video stream to each of a plurality of display devices according to the type of multi-display display. [Means for solving the problem]

[0005] The concept of this technology is: an information receiving unit that receives performance information from each of the plurality of display devices; an information transmitting unit that generates multi-stream information based on performance information of the plurality of display devices and information on the type of multi-display realized by the plurality of display devices and transmits the multi-stream information to a video signal output device; a multi-stream receiving unit that receives, from the video signal output device, a multi-stream including video streams for each of the plurality of display devices that are generated based on the multi-stream information; a video stream transmitting unit that extracts the plurality of video streams from the multi-stream and transmits each of the plurality of video streams to a corresponding display device among the plurality of display devices; Located in a video signal processing device.

[0006] In the present technology, an information receiving unit receives performance information from each of a plurality of display devices. Then, an information transmitting unit generates multi-stream information based on the performance information of the plurality of display devices and information on the type of multi-display realized by the plurality of display devices, and transmits the multi-stream information to a video signal output device. For example, the type of multi-display display may include at least one of an arbitrary layout, a preset layout, a planar layout, a circumferential layout, and a spherical layout.

[0007] For example, the multi-stream information may include information on the number of display devices and information on the type of multi-display display, which enables the video signal output device to appropriately generate video streams for each of the multiple display devices according to the type of multi-display display.

[0008] In this case, for example, the multi-stream information may include stream identification information and arrangement position information corresponding to each of the plurality of display devices, which enables the video signal output device to generate video streams for each of the plurality of display devices according to their arrangement positions, and enables the video streams to appropriately include stream identification information indicating which display devices they correspond to.

[0009] For example, when the type of multi-display display is a planar arrangement, the multi-stream information may include information on the pixel position of the upper left corner of the screen for each of the multiple display devices. This allows the video signal output device to appropriately generate video streams for each of the multiple display devices in accordance with the arrangement and resolution of the multiple display devices when the type of multi-display display is a planar arrangement.

[0010] Furthermore, for example, when the type of multi-display display is a circular surface arrangement, the multi-stream information may include information on the screen center angle and information on the occupied viewing angle for each of the multiple display devices. This allows the video signal output device to appropriately generate video streams for each of the multiple display devices in accordance with the arrangement positions of the multiple display devices when the type of multi-display display is a circular surface arrangement.

[0011] Furthermore, for example, when the type of multi-display display is a spherical arrangement, the multi-stream information may include, for each of the multiple display devices, information on the horizontal central angle of the screen, information on the vertical central angle of the screen, and information on the horizontal or vertical occupied viewing angle. This enables the video signal output device to appropriately generate video streams for each of the multiple display devices in accordance with the arrangement positions of the multiple display devices when the type of multi-display display is a spherical arrangement.

[0012] Furthermore, for example, the multi-stream information may include information on video formats corresponding to each of a plurality of display devices, which enables the video signal output device to generate video streams for each of the plurality of display devices at resolutions and frame rates suited to each display device.

[0013] The multi-stream receiving unit receives from the video signal output device a multi-stream including video streams for each of the plurality of display devices generated based on the multi-stream information, and the video stream transmitting unit extracts the plurality of video streams from the multi-stream and transmits each of the video streams to a corresponding one of the plurality of display devices.

[0014] For example, each video stream included in the multi-stream may include stream identification information indicating which display device it corresponds to, making it easy to know which display device each video stream extracted from the multi-stream corresponds to.

[0015] As described above, the present technology receives performance information from each of a plurality of display devices, generates multi-stream information based on the performance information of the plurality of display devices and information on the type of multi-display display realized by the plurality of display devices, and transmits the generated multi-stream information to a video signal output device, receives a multi-stream from the video signal output device, which includes video streams for each of the plurality of display devices generated based on the multi-stream information, extracts the plurality of video streams from the multi-stream, and transmits each of the video streams to a corresponding display device among the plurality of display devices. As a result, it is possible to supply an appropriate video stream according to the type of multi-display display to each of the plurality of display devices.

[0016] Another concept of the present technology is receiving performance information from each of the plurality of display devices; generating multi-stream information based on performance information of the plurality of display devices and information on the type of multi-display realized by the plurality of display devices, and transmitting the multi-stream information to a video signal output device; receiving, from the video signal output device, a multi-stream including video streams for each of the plurality of display devices, generated based on the multi-stream information; a step of extracting the plurality of video streams from the multi-stream and transmitting each of the video streams to a corresponding one of the plurality of display devices; The present invention relates to a video signal processing method.

[0017] Another concept of the present technology is an information receiving unit that receives, from a video signal processing device to which a plurality of display devices are connected, multi-stream information generated based on performance information of the plurality of display devices and information on the type of multi-display realized by the plurality of display devices; a multi-stream transmission unit that generates a multi-stream including video streams for each of the plurality of display devices based on the multi-stream information and transmits the multi-stream to the video signal processing device; Located in the video signal output device.

[0018] Another concept of the present technology is an information receiving unit that receives performance information from each of the plurality of display devices; a video stream transmission unit that generates a video stream for each of the plurality of display devices based on performance information of the plurality of display devices and information on the type of multi-display realized by the plurality of display devices, and transmits each of the video streams to a corresponding display device among the plurality of display devices; Located in the video signal output device.

[0019] Another concept of the present technology is A video signal output device and a plurality of display devices are connected via a video signal processing device, The video signal processing device comprises: receiving performance information from each of the plurality of display devices; generating multi-stream information based on performance information of the plurality of display devices and information on the type of multi-display realized by the plurality of display devices, and transmitting the multi-stream information to the video signal output device; receiving, from the video signal output device, a multi-stream including video streams for each of the plurality of display devices generated based on the multi-stream information; extracting the plurality of video streams from the multi-stream and transmitting each of the plurality of video streams to a corresponding display device among the plurality of display devices; in a multi-display system. [Brief explanation of the drawings]

[0020] [Figure 1] FIG. 1 is a block diagram showing an example of the configuration of a multi-display system. [Figure 2] FIG. 1 is a diagram illustrating an example of the configuration of an HDMI system configured with a data transmitting section (HDMI transmitting section) of a source device and a data receiving section (HDMI receiving section) of a sink device. [Figure 3] FIG. 10 is a diagram illustrating an example of a link rate and the number of lanes corresponding to each link. [Figure 4] FIG. 10 is a diagram illustrating an example of the structure of an EDID extension block as a newly defined information block when EDID is used. [Figure 5] A figure showing an example of the structure of a newly defined SCDCS information block when SCDCS data is used. [Figure 6] FIG. 10 is a diagram illustrating an example of the structure of 10-byte "Monitor Location Info" information. [Figure 7] FIG. 10 is a diagram showing an example of the correspondence between the value of "Type" and the type of display on the multi-display. [Figure 8] FIG. 10 is a diagram showing an example of the structure of the information portions "Type," "ID," and "Params" in the 10-byte "Monitor Location Info" information when the multi-display display type is arbitrary arrangement. [Figure 9] FIG. 10 is a diagram showing an example of the structure of the information portions "Type," "ID," and "Params" in the 10-byte "Monitor Location Info" information when the multi-display display type is a preset arrangement. [Figure 10] FIG. 10 is a diagram showing an example of the correspondence between the value of "Type" and the type of preset arrangement. [Figure 11] FIG. 10 is a diagram for explaining types of preset arrangements. [Figure 12] FIG. 10 is a diagram for explaining types of preset arrangements. [Figure 13] FIG. 10 is a diagram showing an example of the structure of the information portions "Type," "ID," and "Params" in the 10-byte "Monitor Location Info" information when the multi-display display type is a flat layout. [Figure 14] FIG. 10 is a diagram showing a specific example of a planar arrangement. [Figure 15] FIG. 10 is a diagram showing information on X and Y positions for "ID" 1 to 3. [Figure 16] FIG. 10 is a diagram showing an example of the structure of the information portions "Type," "ID," and "Params" in the 10-byte "Monitor Location Info" information when the multi-display display type is a circular surface arrangement. [Figure 17] 10A and 10B are diagrams illustrating an example of the arrangement of display devices when the type of multi-display display is a circumferential surface arrangement. [Figure 18] 10A and 10B are diagrams illustrating an example of the arrangement of display devices when the type of multi-display display is a circumferential surface arrangement. [Figure 19] FIG. 10 is a diagram showing information on the screen center angle θ and the occupied viewing angle Δθ for “ID” 1 to 3. [Figure 20] FIG. 10 is a diagram showing an example of the structure of the information portions "Type," "ID," and "Params" in the 10-byte "Monitor Location Info" information when the multi-display display type is a spherical arrangement. [Figure 21] 10 is a diagram conceptually showing the horizontal central angle θ of the screen, the vertical central angle φ of the screen, and the horizontal occupied viewing angle Δθ when the display device is arranged on a spherical surface. [Figure 22] 10 is a diagram conceptually showing the horizontal central angle θ of the screen, the vertical central angle φ of the screen, and the horizontal occupied viewing angle Δθ when the display device is arranged on a spherical surface. [Figure 23]FIG. 10 is a diagram illustrating an example of the structure of an InfoFrame. [Figure 24] FIG. 10 is a diagram showing an operation sequence of the multi-display system. [Figure 25] 1 is a block diagram showing an example of the configuration of a video signal output device and a video signal processing device; [Figure 26] 1 is a block diagram showing an example of the configuration of a display device 200. FIG. [Figure 27] FIG. 10 is a diagram illustrating an example in which the type of multi-display display is a preset layout, and the type of preset layout is a "four-split screen" in which four display devices are arranged horizontally in a square shape. [Figure 28] 10 is a diagram for explaining "Monitor Location Info" information corresponding to each display device included in multi-stream information generated by a video signal processing device. FIG. [Figure 29] FIG. 10 is a diagram showing an example of the structure of an EDID extension block including "Monitor Location Info" information corresponding to four display devices 200. [Figure 30] FIG. 10 is a diagram showing an example of the structure of an InfoFrame inserted into a video stream for a display device (Sink 1) generated by a video signal output device. [Figure 31] FIG. 10 is a diagram showing an example of the structure of an InfoFrame inserted into a video stream for a display device (Sink 2) generated by a video signal output device. [Figure 32] FIG. 10 is a diagram showing an example of the structure of an InfoFrame inserted into a video stream for a display device (Sink 3) generated by a video signal output device. [Figure 33] FIG. 10 is a diagram showing an example of the structure of an InfoFrame inserted into a video stream for a display device (Sink 4) generated by a video signal output device. [Figure 34]FIG. 10 is a diagram showing an example of a use case in which processing is performed to associate audio with the position where the display device is placed, as audio processing in the video signal output device. [Figure 35] FIG. 10 is a diagram showing another example of a use case in which processing is performed in a video signal output device to associate audio with the position where the display device is placed. DETAILED DESCRIPTION OF THE INVENTION

[0021] Hereinafter, modes for carrying out the invention (hereinafter referred to as "embodiments") will be described. The description will be made in the following order. 1. Embodiment 2. Variations

[0022] <1. Embodiment> [Example of a multi-display system configuration] 1 shows an example of the configuration of a multi-display system 10. This multi-display system 10 includes a video signal output device (sink device) 100, a plurality of display devices (sink devices) 200, and a video signal processing device (converter device) 300 interposed between the video signal output device 100 and the sink device 200.

[0023] The video signal output device 100 and the video signal processing device 300 are connected via an HDMI (High-Definition Multimedia Interface) cable 400. The video signal processing device 300 and the plurality of display devices 200 are connected via HDMI cables 500, respectively. Here, the HDMI cables 400 and 500 each constitute a transmission path. Note that "HDMI" is a registered trademark.

[0024] The video signal output device 100 has one HDMI output terminal (HDMI terminal) 101. The video signal processing device 300 has one HDMI input terminal (HDMI terminal) 301 and a plurality of HDMI output terminals (HDMI terminals) 302-1 to 302-N. The display device 200 has one HDMI input terminal (HDMI terminal) 201.

[0025] The HDMI output terminal 101 of the video signal output device 100 is connected to the HDMI input terminal 301 of the video signal processing device 300 via an HDMI cable 400. Furthermore, the HDMI input terminals 201 of the plurality of display devices 200 are connected to the plurality of HDMI output terminals 302-1, 302-2, ... of the video signal processing device 300 via HDMI cables 500, respectively.

[0026] "HDMI system configuration example" FIG. 2 shows an example of the configuration of an HDMI system that is configured with a data transmitting section (HDMI transmitting section) 602 of a source device and a data receiving section (HDMI receiving section) 702 of a sink device.

[0027] The data transmitting unit 602 unidirectionally transmits differential signals corresponding to pixel data of an uncompressed image for one screen to the data receiving unit 702 over multiple channels in an effective image interval (hereinafter also referred to as an active video interval, where appropriate), which is the interval from one vertical synchronization signal to the next vertical synchronization signal, excluding the horizontal and vertical blanking intervals, and also unidirectionally transmits differential signals corresponding to at least audio data, control data, other auxiliary data, etc. accompanying the image to the data receiving unit 702 over multiple channels in the horizontal blanking interval or vertical blanking interval.

[0028] That is, the data transmitting unit 602 has an HDMI transmitter 621. The HDMI transmitter 621 converts, for example, pixel data of an uncompressed image into a corresponding differential signal, and transmits the signal serially in one direction over three TMDS channels #0, #1, and #2, which are multiple channels, to the data receiving unit 702 connected via an HDMI cable 800.

[0029] In addition, the HDMI transmitter 621 converts audio data accompanying the uncompressed images, as well as necessary control data and other auxiliary data, into corresponding differential signals and transmits them serially in one direction to the data receiving unit 702 connected via the HDMI cable 800 on three TMDS channels #0, #1, and #2.

[0030] Furthermore, the HDMI transmitter 621 transmits a pixel clock synchronized with the pixel data transmitted on the three TMDS channels #0, #1, and #2, on the TMDS clock channel to the data receiving unit 702 connected via the HDMI cable 800. Here, on one TMDS channel #i (i=0, 1, 2), 10 bits of pixel data are transmitted during one clock of the pixel clock.

[0031] TMDS coding is an 8-bit / 10-bit conversion coding that converts 8-bit data into 10-bit data, and by reducing the number of transition points compared with the previous data, it is a coding method that maintains DC balance while suppressing adverse effects such as unwanted radiation.As a result, the coding run length cannot be theoretically guaranteed, so DC coupling and separate clock transmission are essential.

[0032] The data receiving unit 702 receives differential signals corresponding to pixel data transmitted unidirectionally from the data transmitting unit 602 over multiple channels during the active video interval, and also receives differential signals corresponding to audio data or control data transmitted unidirectionally from the data transmitting unit 602 over multiple channels during the horizontal or vertical blanking interval.

[0033] That is, the data receiving unit 702 has an HDMI receiver 721. The HDMI receiver 721 receives differential signals corresponding to pixel data and differential signals corresponding to audio data and control data, which are transmitted unidirectionally on TMDS channels #0, #1, and #2 from the data transmitting unit 602 connected via an HDMI cable 800, in synchronization with a pixel clock also transmitted on the TMDS clock channel from the data transmitting unit 602.

[0034] In the above example, image data, audio data, and control data are transmitted over TMDS channels #0, #1, and #2, and the pixel clock is transmitted over the TMDS clock channel. This is compatible with HDMI 1.4 and earlier, as well as HDMI 2.0. In the case of HDMI 2.1, transmission is performed using FRL lanes #0, #1, #2, and #3. In this case, the TMDS clock channel in Figure 2 becomes FRL lane #3.

[0035] In this case, data is transmitted using a fixed rate link (FRL) packet using three lanes #0 to #2 or four lanes #0 to #3. Here, FRL character coding is a 16-bit / 18-bit conversion coding that converts 16-bit data into 18-bit data, maintains DC balance, and allows clock extraction.

[0036] Figure 3 shows an example of the link rate and the number of lanes corresponding to each link. Link rates identified by "1" (binary 0001) and "2" (binary 0010) use three lanes #0 to #2 out of four lanes #0 to #3. In this case, lane #3 is an inactive lane. An active lane is a lane that transmits data. Link rates identified by "3" (binary 0011), "4" (binary 0100), "5" (binary 0101), and "6" (binary 0110) use all four lanes #0 to #3.

[0037] In the illustrated example, the link rate identified by "1" (binary 0001) has a bit rate per lane of 3 Gbps. The link rates identified by "2" (binary 0010) and "3" (binary 0011) have a bit rate per lane of 6 Gbps. The link rate identified by "4" (binary 0100) has a bit rate per lane of 8 Gbps. The link rate identified by "5" (binary 0101) has a bit rate per lane of 10 Gbps. The link rate identified by "6" (binary 0110) has a bit rate per lane of 12 Gbps.

[0038] 2, the transmission channel of the HDMI system, which is made up of the data transmitter 602 of the source device and the data receiver 702 of the sink device, also includes a transmission channel called a Display Data Channel (DDC). This DDC is made up of two signal lines (not shown) included in the HDMI cable 800, and performs IIC (Inter-Integrated Circuit) communication between the data transmitter 602 and the data receiver 702.

[0039] That is, the data transmitting unit 602 has an IIC master block 622. Furthermore, the data receiving unit 702 has a memory unit 722. The memory unit 722 includes an EDID ROM (Extended Display Identification Data ROM) 731, an SCDC (Status and Control Data Channel) register unit 732, and the like.

[0040] EDID, which is information about the configuration and capabilities of the sink device, is set in the EDID ROM 731, and is read by the source device via DDC by the IIC master block 622. This allows the source device to recognize the configuration and capabilities of the sink device. EDID ROM 731 is implemented using rewritable memory such as EEPROM (Electrically Erasable Programmable Read-Only Memory) or flash memory, but it can also be implemented using RAM (Random Access Memory) or any other storage medium. The above EDID is also sometimes called Enhanced-EDID (E-EDID).

[0041] SCDC (Status and Control Data Channel) is a point-to-point communication protocol for exchanging data between a source device and a sink device. SCDC is defined in HDMI 2.0 and later. The SCDC register unit 732 consists of a group of registers that store the SCDCS (SCDC Structure).

[0042] The source device (data transmitter 602) can read and write SCDCS data stored in the SCDC register 732 via the DDC using the IIC master block 622. The SCDCS data includes data related to the current link status and data for controlling the operation of the source device.

[0043] Although not shown, the HDMI cable 800 also includes a CEC (Consumer Electronics Control) line, an HPD (Hot Plug Detect) line, a reserve line, a power line, etc. The CEC line is used for bidirectional communication of control data between a source device and a sink device. The HPD line is used by the source device to detect the connection of the sink device, etc.

[0044] 1, the plurality of display devices 200 connected to the video processing device 300 constitute a multi-display. In this case, the number of display devices 200 and their arrangement depend on the type of multi-display. The types of multi-display display include arbitrary arrangement, preset arrangement, planar arrangement, circumferential surface arrangement, and spherical arrangement.

[0045] Here, the term "arbitrary arrangement" refers to a case where the screens of the multiple display devices 200 are independent and unrelated to each other. The term "preset arrangement" refers to a case where the arrangement of screens made up of the multiple display devices 200 is a preset screen arrangement. The term "planar arrangement" refers to a case where a single flat screen is created by combining screens made up of the multiple display devices 200, and the components such as the size of each screen can be freely set. The term "circumferential surface arrangement" refers to a case where a panoramic screen is created by arranging the multiple display devices 200 on a circumferential surface. The term "spherical surface arrangement" refers to a case where a celestial spherical screen is created by arranging the multiple display devices 200 on a spherical surface.

[0046] The video signal processing device 300 also receives capability information from each of the multiple display devices 200. This capability information is sent from the display devices 200 to the video signal processing device 300 using EDID. This capability information also includes information such as resolution and frame rate.

[0047] The video signal processing device 300 then generates multi-stream information based on the performance information sent from the plurality of display devices 200 and information on the type of multi-display display realized by the plurality of display devices 200, and transmits the multi-stream information to the video signal output device 100. This multi-stream information includes information on the type of multi-display display, information on the HDMI output terminal of the video signal processing device 300 to which each of the plurality of display devices 200 is connected, information on the arrangement position of each of the display devices 200 in the multi-display display, and generation information of the video stream for each of the display devices 200.

[0048] Here, the type of multi-display display is set, for example, by a user operation. In this case, the user arranges the required number of display devices 200 in predetermined positions according to the type of multi-display display to be realized, connects each of them to the video signal processing device 300, and further sets the type of multi-display display in the video signal processing device 300. Note that if the video signal processing device 300 is compatible with a specific type of multi-display display, the type of multi-display display is uniquely determined.

[0049] The video signal processing device 300 has information on the correspondence between each HDMI output terminal to which the multiple display devices 200 are connected and the arrangement positions in the multi-display display of the display devices 200 connected to that HDMI output terminal. This correspondence is necessary when transmitting a video stream from the video signal processing device 300 to each of the multiple display devices 200, in order to correctly transmit to each display device 200 a video stream that corresponds to the arrangement position in the multi-display display of that display device 200. Although a detailed description of how this correspondence is set will be omitted, it is set, for example, by a user operation or by some other method.

[0050] The video signal processing device 300 sends the multi-stream information to the video signal output device 100 using EDID or SCDCS data.

[0051] Figure 4 shows an example of the structure of an EDID extension block, which is a newly defined information block when using EDID. The 0th byte (BP0) and the 1st byte form the header. The 2nd byte contains the 1-byte "Number of Monitors" information. This information indicates the number N of display devices 200 that make up the multi-display.

[0052] N*10 bytes of "MonitorLocInfo[]" information are placed from the third byte to the (3+N*10-1)th byte. This "MonitorLocInfo[]" information contains 10 bytes of "Monitor Location Info" information corresponding to each of the N display devices 200. This "Monitor Location Info" information includes information on the video format, information on the type of multi-display display, information on the placement position in the multi-display display, information on the connected HDMI output terminal, information for generating a video stream, etc.

[0053] Bytes (3+N*10) to 126 are set as "Reserved (=0)". Also, byte 127 contains one byte of "Checksum" information.

[0054] Figure 5 shows an example of the structure of a newly defined SCDCS information block when using SCDCS data. The byte at offset 0x5B contains one byte of "Number of Monitors" information. Additionally, the bytes from offset 0x5C to (0x5B + N * 10) contain N * 10 bytes of "MonitorLocInfo[]" information.

[0055] FIG. 6 shows an example of the structure of 10-byte "Monitor Location Info" information. The 0th byte contains 1-byte "VideoMode (VIC)" information. This information is, for example, a VIC (Video Identification Code) and indicates the video format, such as the resolution and frame rate, handled by the target display device 200. When generating a video stream for the target display device 200, the video signal output device 100 identifies the format of the video stream based on this information.

[0056] The first byte contains "Type" information, which indicates the type of multi-display display. Figure 7 shows an example of the correspondence between "Type" values ​​and types of multi-display display.

[0057] "0" indicates that the type of multi-display display is an arbitrary layout. "1 to 249" indicates that the type of multi-display display is a preset layout. In this case, the value of "Type" will differ depending on the type of preset layout.

[0058] Also, "250" indicates that the type of multi-display display is a planar arrangement, "252" indicates that the type of multi-display display is a circumferential surface arrangement, and "254" indicates that the type of multi-display display is a spherical surface arrangement.

[0059] Returning to Fig. 6, the second byte contains "ID" information. This information indicates the identifier of the layout position in the multi-display display of the target display device 200. Note that for each type of multi-display display, the correspondence between the layout positions of the multiple display devices 200 in the multi-display display and their identifiers is preset.

[0060] The "Params" information is placed in bytes 3 to 8. This information indicates information for generating a video stream for the target display device 200, and differs depending on the value of "Type," i.e., the type of multi-display display.

[0061] The ninth byte contains "StreamID" information. This information corresponds to the HDMI output terminal of the video signal processing device 300 to which the target display device 200 is connected, and indicates the identifier of the video stream for the target display device 200.

[0062] The 10-byte "Monitor Location Info" information for each type of multi-display display will be described in detail below. First, the case where the type of multi-display display is arbitrary arrangement will be described. As described above, this arbitrary arrangement means that the screens of the multiple display devices 200 are independent and unrelated to each other.

[0063] For example, it is possible to conceive of cases where images of different applications, images of different contents, or images of different channels are displayed on each screen of the plurality of display devices 200. Note that even when different images are displayed on each screen of the plurality of display devices 200, if it is desired to specify the display position of each image, this corresponds to a preset arrangement.

[0064] FIG. 8 shows an example of the structure of the information portions of "Type," "ID," and "Params" in the 10-byte "Monitor Location Info" information (see FIG. 6) when the type of multi-display display is arbitrary arrangement. The value of "Type" in the first byte is "0," indicating that the type of multi-display display is arbitrary arrangement. In addition, in this arbitrary arrangement, the positions of the multiple display devices 200 are arbitrary, and the information of "ID" in the second byte has no particular meaning, so it is set to, for example, "Reserved (=0)." In addition, the information portion of "Params" in the second to seventh bytes is set to "Reserved (=0)."

[0065] Next, a case where the type of multi-display display is a preset arrangement will be described. As described above, this preset arrangement refers to a case where the arrangement of a screen made up of a plurality of display devices 200 is a preset screen arrangement. For example, a typical planar arrangement pattern or a case where information for the right eye and left eye is transmitted in separate video streams to create a stereoscopic image can be considered.

[0066] FIG. 9 shows an example of the structure of the "Type," "ID," and "Params" information portions of the 10-byte "Monitor Location Info" information (see FIG. 6) when the type of multi-display display is a preset arrangement. The value of "Type" in the first byte is set to one of "1 to 249" depending on the type of preset arrangement. "ID" in the second byte indicates the arrangement position in the multi-display display of the target display device 200. Furthermore, the information portion of "Params" from the second byte to the seventh byte is set to "Reserved (=0)."

[0067] Fig. 10 shows an example of the correspondence between the "Type" value and the type of preset layout. "20" indicates that the type of preset layout is "two screens horizontal," in which two display devices 200 are arranged horizontally, each in a landscape orientation, as shown in Fig. 11(a). In this case, the identifier "ID" for the layout position of the two display devices 200 is defined as, for example, "1" for the left and "2" for the right, as shown in the figure.

[0068] Furthermore, "21" indicates that the type of preset layout is "two screens horizontal v" in which two display devices 200 are arranged side by side in a portrait orientation, as shown in FIG. 11(b). Here, "v" indicates that the display devices 200 are arranged vertically. This also applies hereinafter. In this case, the identifiers "ID" of the layout positions of the two display devices 200 are defined as, for example, "1" on the left and "2" on the right, as shown in the figure.

[0069] Furthermore, "22" indicates that the type of preset layout is "two screens vertical," in which two display devices 200 are arranged vertically, each in a horizontal position, as shown in Fig. 11(c). In this case, the identifiers "ID" of the layout positions of the two display devices 200 are defined as, for example, "1" for the bottom and "2" for the top, as shown in the figure.

[0070] Furthermore, "23" indicates that the type of preset layout is "two screens vertical v" in which two display devices 200 are arranged vertically, each in portrait orientation, as shown in Fig. 11(d). In this case, the identifiers "ID" of the layout positions of the two display devices 200 are defined as, for example, "1" for the bottom and "2" for the top, as shown in the figure.

[0071] Furthermore, "30" indicates that the type of preset layout is "3 screens horizontal," in which three display devices 200 are arranged horizontally, each in a landscape orientation, as shown in Fig. 11(e). In this case, the identifiers "ID" of the layout positions of the three display devices 200 are defined as, for example, "1" on the left, "2" in the center, and "3" on the right, as shown in the figure.

[0072] Furthermore, "31" indicates that the type of preset layout is "3 screens horizontal v" in which three display devices 200 are arranged horizontally in portrait orientation, as shown in Fig. 11(f). In this case, the identifiers "ID" of the layout positions of the three display devices 200 are defined as, for example, "1" for the left, "2" for the center, and "3" for the right, as shown in the figure.

[0073] Furthermore, "32" indicates that the type of preset layout is "3 screens vertical" in which three display devices 200 are arranged vertically in a horizontal position, as shown in Fig. 11(g). In this case, the identifiers "ID" of the layout positions of the three display devices 200 are defined as "1" for the bottom, "2" for the center, and "3" for the top, as shown in the figure, for example.

[0074] 12(a), the number "40" indicates that the type of preset layout is a "four-screen convex" layout in which four display devices 200 are each placed horizontally in a convex shape. In this case, the identifiers "ID" of the layout positions of the four display devices 200 are defined as, for example, "1" for the bottom center, "2" for the bottom right, "3" for the bottom left, and "4" for the top, as shown in the figure.

[0075] Furthermore, "41" indicates that the type of preset layout is a "four-screen convex v" in which four display devices 200 are arranged vertically in a convex shape, as shown in Fig. 12(b). In this case, the identifiers "ID" of the layout positions of the four display devices 200 are defined as, for example, "1" for the bottom center, "2" for the bottom right, "3" for the bottom left, and "4" for the top, as shown in the figure.

[0076] Furthermore, "42" indicates that the type of preset layout is a "four-split screen" in which four display devices 200 are horizontally placed and arranged in a square shape, as shown in Fig. 12(c). In this case, the identifiers "ID" of the layout positions of the four display devices 200 are defined as, for example, "1" for the top left, "2" for the top right, "3" for the bottom left, and "4" for the bottom right, as shown in the figure.

[0077] Furthermore, "43" indicates that the type of preset layout is a "four-split screen v" in which four display devices 200 are vertically placed and arranged in a square shape, as shown in Fig. 12(d). In this case, the identifiers "ID" of the layout positions of the four display devices 200 are defined as, for example, "1" for the top left, "2" for the top right, "3" for the bottom left, and "4" for the bottom right, as shown in the figure.

[0078] Furthermore, "100" indicates that the type of preset layout is "stereoscopic," in which two display devices 200, one for the left eye and one for the right eye, are placed horizontally side by side, as shown in Fig. 12(e). In this case, the identifiers "ID" of the layout positions of the two display devices 200 are defined as "1" for the left eye and "2" for the right eye.

[0079] Note that the example of the correspondence relationship in Figure 10 shows types of preset arrangements with up to four display devices 200, but the types of preset arrangements are not limited to this, and although detailed explanations are omitted, types of preset arrangements consisting of other numbers of display devices 200 are also possible.

[0080] Next, we will explain the case where the type of multi-display display is a planar arrangement. As mentioned above, this planar arrangement refers to a case where, when combining screens made up of multiple display devices 200 to create a single flat screen, the components such as the size of each screen can be freely set. In this case, the screen size and resolution of the multiple display devices 200 can be freely set, and this information is placed in the information section of "Params."

[0081] Figure 13 shows an example of the structure of the "Type," "ID," and "Params" information portion of the 10-byte "Monitor Location Info" information (see Figure 6) when the multi-display display type is flat layout. The value of the first byte, "Type," is set to "250," indicating that the multi-display display type is flat layout.

[0082] The second byte, "ID," indicates the placement position in the multi-display display of the target display device 200. In addition, in the "Params" information portion from the second byte to the seventh byte, X position information is placed in the second and third bytes, Y position information is placed in the fourth and fifth bytes, and the other bytes are "Reserved (=0)." Here, the X position and Y position indicate the pixel position at the top left corner of the screen, and are expressed in units of pixels.

[0083] Figure 14 shows a specific example of a flat screen layout. In this example, one 4K UHD screen is combined with two 2K ​​HD screens that are half the size of the 4K UHD screen to create a single flat screen. In this case, it is possible to simultaneously display main information and two sub-information items. For example, one possible use would be to display live sports footage on the main screen, footage from a different camera on one sub-screen, and player data information on the other sub-screen.

[0084] FIG. 15 shows information about the X and Y positions for "ID" 1 to 3 in the specific example of the planar layout in FIG. 14. In this case, the X and Y positions for "ID" 2 and 3 are calculated by shifting the position of the 4K video from the coordinate position at the top left of the screen for "ID" 1. Also, if there is a frame between each screen where no video is displayed, the number of pixels in that frame is added as an overlap. In FIG. 15, the numbers in parentheses indicate the X and Y positions when creating an overlap of UHD:200.HD:100 on the top, bottom, left, and right.

[0085] Next, a case where the type of multi-display display is a circumferential surface arrangement will be described. As described above, this circumferential surface arrangement means that a plurality of display devices 200 are arranged on a circumferential surface to create a panoramic screen.

[0086] Figure 16 shows an example of the structure of the "Type," "ID," and "Params" information portion of the 10-byte "Monitor Location Info" information (see Figure 6) when the multi-display display type is a circular surface layout. The value of the first byte, "Type," is "252," indicating that the multi-display display type is a circular surface layout.

[0087] The second byte, "ID," indicates the placement position in the multi-display display of the target display device 200. In addition, in the information portion of "Params" from the second byte to the seventh byte, information on the screen center angle θ is placed in the second and third bytes, information on the occupied viewing angle Δθ is placed in the fourth and fifth bytes, and the other bytes are set to "Reserved (=0)."

[0088] In the circular surface arrangement, a circular surface is created using multiple display devices 200 to produce a panoramic screen. The screen center angle θ at each display position 200 is the angle of deviation from the center screen of the screen formed by that display device 200. Furthermore, the occupied viewing angle Δθ of each display device 200 indicates the horizontal viewing angle of the screen formed by that display device.

[0089] 17 and 18 show examples of the arrangement of display devices 200 when the type of multi-display display is a circumferential surface arrangement. In this example, three display devices 200 are arranged along a circumferential surface. In this example, a 360-degree circumferential surface can be represented by nine display devices 200, and three display devices 200 are actually arranged along the circumferential surface. In this case, the screen formed by each display device 200 can represent a viewing angle of 40 degrees. FIG. 19 shows information on the screen center angle θ and the occupied viewing angle Δθ for "ID"s 1 to 3 in the circumferential surface arrangement examples of FIGS. 17 and 18.

[0090] This circular surface arrangement can be used in games that use a panoramic screen, such as racing games, etc. In this case, the display device 200 placed in the center displays a frontal image, and the two display devices 200 placed on the left and right each display an image of a field of view that is shifted left and right from the center.

[0091] Next, a description will be given of a case where the type of multi-display display is a spherical arrangement. As described above, this spherical arrangement means that a celestial sphere screen is created by arranging multiple display devices 200 on a spherical surface.

[0092] Figure 20 shows an example of the structure of the "Type," "ID," and "Params" information portion of the 10-byte "Monitor Location Info" information (see Figure 6) when the type of multi-display display is a spherical arrangement. The value of the first byte, "Type," is set to "254," indicating that the type of multi-display display is a spherical arrangement.

[0093] The second byte "ID" indicates the placement position in the multi-display display of the target display device 200. In addition, in the information portion of "Params" from the second byte to the seventh byte, information on the screen horizontal central angle θ is placed in the second and third bytes, information on the screen vertical central angle φ is placed in the fourth and fifth bytes, and information on the horizontal occupied viewing angle Δθ is placed in the sixth and seventh bytes.

[0094] Since the aspect ratio of the screen of display device 200 is 16:9, the vertical occupied viewing angle can be calculated by multiplying the horizontal occupied viewing angle Δθ by 9 / 16. It is also possible to include the vertical occupied viewing angle in place of the horizontal occupied viewing angle Δθ in the information portion of "Params" from the second byte to the seventh byte. Figures 21 and 22 conceptually show the screen horizontal central angle θ, screen vertical central angle φ, and horizontal occupied viewing angle Δθ when display device 200 is arranged on a spherical surface.

[0095] This spherical arrangement can be used, for example, in entertainment display systems that play video content in a celestial sphere.

[0096] 1, the video signal output device 100 generates a video stream for each of the plurality of display devices 200 based on the multi-stream information received from the video signal processing device 300. In this case, the video stream for each of the plurality of display devices 200 corresponds to the type of multi-display indicated in the multi-stream information, and is generated in a video format that can be handled by each of the display devices 200.

[0097] Then, the video signal output device 100 generates a multi-stream including video streams for each of the multiple display devices 200 and transmits it to the video signal processing device 300. In this case, the video signal output device 100 transmits this multi-stream to the video signal processing device 300 using, for example, a packet structure of an FRL (Fixed Rate Link). In this case, for example, an identifier required to identify the multiple video streams is newly defined. As a specific example, if a 4-bit identifier is defined in a reserved area of ​​the FRL map type, it becomes possible to multiplex a maximum of 16 streams.

[0098] Here, each video stream included in the multi-stream includes information indicating which display device 200 the video stream corresponds to. This information is inserted into the video stream using, for example, an InfoFrame or an EMP (Extended Metadata Packet).

[0099] Figure 23 shows an example of the structure of an InfoFrame. Bytes 1 to 3 are the header portion of the InfoFrame, and contain information such as the InfoFrame type, version number, and data byte length. Bytes 3 to 11 are the data byte portion of the InfoFrame, and contain 9 bytes of "Monitor Location Info" information.

[0100] The third byte contains "Type" information. The fourth byte contains "ID" information. The fifth to tenth bytes contain "Params" information. The eleventh byte contains "Stream ID" information. Although detailed explanations are omitted, each piece of information is the same as the information contained in the "Monitor Location Info" information (see FIG. 6) that constitutes the multi-stream information sent from the video signal processing device 300 to the video signal output device 100, as described above.

[0101] Here, as described above, the "StreamID" information corresponds to the HDMI output terminal of the video signal processing device 300 to which the target display device 200 is connected, and is information indicating which display device 200 the video stream containing this information corresponds to.

[0102] 1, the video signal processing device 300 extracts multiple video streams from the multi-stream sent from the video signal output device 100 and transmits each to a corresponding display device 200 among the multiple display devices 200. In this case, each video stream is transmitted to the corresponding display device 200 by being output to an HDMI output terminal corresponding to the "Stream ID" in the InfoFrame inserted in the video stream.

[0103] Each of the plurality of display devices 200 displays video based on the video stream sent from the video signal processing device 300. As a result, the plurality of display devices 200 perform a multi-display display of the type set by the video signal processing device 300.

[0104] FIG. 24 shows an operation sequence of the multi-display system 10 shown in FIG.

[0105] (1) First, the video signal processing device 300 acquires capability information from each of the multiple display devices 200. In this case, the video signal processing device 300 reads the EDID including the capability information through the DDC line as the HPD signal changes from low to high when the display device 200 is connected.

[0106] (2) Next, the video signal processing device 300 generates multi-stream information based on the performance information sent from the plurality of display devices 200 and information on the type of multi-display realized by the plurality of display devices 200. This multi-stream information is generated as EDID or SCDCS data. That is, an EDID extension block (see FIG. 4) containing the multi-stream information or an information block of SCDCS data (see FIG. 5) containing the multi-stream information is generated.

[0107] (3) Next, the video signal output device 100 acquires multi-stream information from the video signal processing device 300. When an EDID extension block including multi-stream information is generated by the video signal processing device 300, the video signal output device 100 reads the EDID extension block through the DDC line as the HPD signal changes from low to high after the EDID extension block is generated. On the other hand, when an information block of SCDCS data including multi-stream information is generated by the video signal processing device 300, the video signal output device 100 reads the information block of SCDCS data through the DDC line as a read request is issued from the video signal processing device 300 after the information block of SCDCS data is generated.

[0108] (4) Next, the video signal output device 100 generates a video stream for each of the plurality of display devices 200 based on the multi-stream information. In this case, the video stream for each of the plurality of display devices 200 corresponds to the type of multi-display indicated by the multi-stream information, and is generated in a video format that is handled by each display device 200. Information indicating which display device 200 the video stream corresponds to, such as "Stream ID" information, is inserted into each video stream. This information is inserted, for example, using an infoframe (see FIG. 23).

[0109] (5) Next, the video signal output device 100 generates a multi-stream including video streams for each of the plurality of display devices 200 and transmits the multi-stream to the video signal processing device 300. In this case, the video signal output device 100 transmits the multi-stream to the video signal processing device 300 using, for example, the FRL packet structure.

[0110] (6) Next, the video signal processing device 300 extracts video streams for each of the plurality of display devices 200 from the multi-stream.

[0111] (7) Next, the video signal processing device 300 transmits the multiple video streams extracted from the multi-stream to the corresponding display devices 200. In this case, each video stream is transmitted to the corresponding display device 200 by being output to an HDMI output terminal corresponding to the "Stream ID" in the infoframe, for example.

[0112] (8) Then, the plurality of display devices 200 each display video based on the video stream sent from the video signal processing device 300. As a result, the plurality of display devices 200 perform a multi-display display of the type set by the video signal processing device 300.

[0113] "Configuration examples of video signal output device, video signal processing device, and display device" 25 shows an example of the configuration of the video signal output device 100 and the video signal processing device 300. In this example, the video signal processing device 300 has four HDMI output terminals 302-1 to 302-4, each connected to a display device 200. Note that even if the device has four HDMI output terminals 302-1 to 302-4, not all of the terminals may be connected to the display device 200 depending on the type of multi-display.

[0114] The video signal processing device 100 includes an HDMI output terminal 101, an HDMI transmission unit (HDMI Tx) 102, a control unit 103, a signal source 104, a decoding unit 105, and an information transmission unit .

[0115] The video signal processing device 300 also has an HDMI input terminal 301, an HDMI receiving unit (HDMI Rx) 303, four HDMI output terminals 302-1 to 302-4, four HDMI transmitting units (HDMI Tx) 304-1 to 304-4, a control unit 305, a signal processing unit 306, and a selection unit 307.

[0116] The control unit 305 of the video signal processing device 300 generates multi-stream information based on the capability information and the type of multi-display display of each display device 200 acquired through the HDMI transmission units (HDMI Tx) 304-1 to 304-4, and generates an EDID extension block (see FIG. 4) containing this multi-stream information or an information block of SCDCS data (see FIG. 5) containing the multi-stream information.

[0117] The control unit 305 of the video signal output device 100 reads the EDID extension block or the information block of SCDCS data including the multi-stream information from the video signal processing device 300 via the HDMI transmission unit (HDMI Tx) 102, and acquires the multi-stream information.

[0118] Under the control of the control unit 103, the video signal output device 100 generates video streams for the four display devices 200 based on the multi-stream information, and transmits a multi-stream including these video streams to the video signal processing device 300 via the HDMI transmission unit (HDMI Tx) 102.

[0119] In this case, compressed data corresponding to the type of multi-display is read from signal source 104, and the compressed data is decoded by decoding unit 105 and supplied to information transmission unit 106. Information transmission unit 106 generates video streams for the four display devices 200 based on the multi-stream information. At this time, an infoframe including information indicating which display device 200 the video stream corresponds to, such as "Stream ID" information, is inserted into each video stream.

[0120] Then, the information transmitting unit 106 generates a multi-stream including video streams for the four display devices 200, and transmits this multi-stream to the video signal processing device 300 via the HDMI transmitting unit (HDMI Tx) 102.

[0121] Under the control of the control unit 305, the video signal processing device 300 extracts video streams for the four display devices 200 from the multi-stream received by the HDMI receiving unit 303, and transmits them to the corresponding display devices 200, respectively.

[0122] In this case, the multi-stream received by the HDMI receiving unit 303 is supplied to the signal processing unit 306, which extracts video streams for the four display devices 200 from the multi-stream. Each video stream extracted by the signal processing unit 306 is sent to the selection unit 307. The selection unit 307 outputs each video stream to an HDMI output terminal corresponding to the "Stream ID" in the info frame, and thus transmits it to the corresponding display device 200.

[0123] 26 shows an example of the configuration of a display device 200. The display device 200 includes an HDMI input terminal 201, an HDMI receiving unit (HDMI Rx) 202, a control unit 203, a signal processing unit 204, and a display unit 205.

[0124] The control unit 203 controls the operation of each unit of the display device 200. The video stream received by the HDMI receiving unit 202 from the video signal processing device 300 is sent to the signal processing unit 204. The signal processing unit 204 performs processing such as scaling and edge enhancement on the video stream to obtain a video signal for display. The display unit 205 displays video using the video signal for display obtained by the signal processing unit 204. The display unit 205 is configured, for example, with an LCD (Liquid Crystal Display), an organic EL (Electro Luminescence), or the like.

[0125] "Examples of multi-display display" Details of the multi-stream information and the like in a specific example of multi-display display will be described below. Here, as shown in Fig. 27(a), an example will be described in which the type of multi-display display is a preset arrangement, and the type of preset arrangement is a "four-split screen" (see Fig. 10) in which four display devices 200 are arranged horizontally in a cross-shaped configuration. Fig. 27(b) shows the values ​​of the identifiers ID of the respective arrangement positions of the four display devices 200 arranged in a cross-shaped configuration in a "four-split screen" preset arrangement.

[0126] In the example of Figure 27(a), a display device (Sink 1) 200 arranged at a position ID=3 is connected to output terminal 302-1 corresponding to output 1 of the video signal processing device 300, a display device (Sink 4) 200 arranged at a position ID=2 is connected to output terminal 302-2 corresponding to output 2 of the video signal processing device 300, a display device (Sink 2) 200 arranged at a position ID=1 is connected to output terminal 302-3 corresponding to output 3 of the video signal processing device 300, and a display device (Sink 3) 200 arranged at a position ID=4 is connected to output terminal 302-4 corresponding to output 4 of the video signal processing device 300.

[0127] In this case, the "Monitor Location Info" information corresponding to each display device 200 included in the multi-stream information generated by the video signal processing device 300 is as shown in FIG.

[0128] Here, "VideoMode = VIC118" is set for all display devices 200, indicating that they are compatible with the 4K 120Hz video format. Note that "VIC118" is just an example and is not limiting. Furthermore, "type = 42" is set for all display devices 200, indicating that the type of multi-display display is a "quad-split screen" in which four display devices 200 are arranged horizontally in a square shape.

[0129] Furthermore, for the display device (Sink 1) 200, "ID = 3" is set, indicating that the arrangement position of this display device (Sink 1) 200 is position "3" in the "4-split screen" multi-display display. Furthermore, for this display device (Sink 1) 200, "Stream ID = 1" is set, indicating that "1" is used as the "Stream ID" of the video stream for this display device (Sink 1) 200, and that this display device (Sink 1) 200 is connected to output terminal 302-1 corresponding to output 1 of video signal processing device 300.

[0130] Furthermore, for the display device (Sink 2) 200, "ID = 1" is set, indicating that the arrangement position of this display device (Sink 1) 200 is position "1" in the "4-split screen" multi-display display. Furthermore, for this display device (Sink 2) 200, "Stream ID = 3" is set, indicating that "3" is used as the "Stream ID" of the video stream for this display device (Sink 2) 200, and that this display device (Sink 2) 200 is connected to output terminal 302-3 corresponding to output 3 of the video signal processing device 300.

[0131] Furthermore, for the display device (Sink 3) 200, "ID = 4" is set, indicating that the arrangement position of this display device (Sink 1) 200 is position "4" in the "4-split screen" multi-display display. Furthermore, for this display device (Sink 3) 200, "Stream ID = 3" is set, indicating that "4" is used as the "Stream ID" of the video stream for this display device (Sink 3) 200, and that this display device (Sink 3) 200 is connected to output terminal 302-4 corresponding to output 4 of the video signal processing device 300.

[0132] Furthermore, for display device (Sink 4) 200, "ID = 2" is set, indicating that the arrangement position of this display device (Sink 1) 200 is position "2" in the "4-split screen" multi-display display. Furthermore, for this display device (Sink 4) 200, "Stream ID = 2" is set, indicating that "2" is used as the "Stream ID" of the video stream for this display device (Sink 4) 200, and that this display device (Sink 4) 200 is connected to output terminal 302-2 corresponding to output 2 of video signal processing device 300.

[0133] FIG. 29 shows an example of the structure of an EDID extension block that includes "Monitor Location Info" information corresponding to the four display devices 200 in FIG.

[0134] 30 shows an example of the structure of an InfoFrame to be inserted into a video stream generated by the video signal output device 100 and intended for the display device (Sink 1) 200. From the information "Stream ID = 1," the video signal processing device 300 can recognize that this video stream is intended for the display device (Sink 1) 200 connected to the HDMI output terminal 302-1 of output 1, and can easily output this video stream to the HDMI output terminal 302-1 and transmit it to the display device (Sink 1) 200. Furthermore, from the information "type = 42" and "ID = 3," the video signal processing device 300 can confirm that this video stream is intended for the display device 200 located at position "3" in a "quad-split screen" multi-display display.

[0135] 31 shows an example of the structure of an InfoFrame to be inserted into a video stream generated by the video signal output device 100 and intended for the display device (Sink 2) 200. From the information "Stream ID = 3," the video signal processing device 300 can recognize that this video stream is intended for the display device (Sink 2) 200 connected to the HDMI output terminal 302-3 of output 3, and can easily output this video stream to the HDMI output terminal 302-3 and transmit it to the display device (Sink 2) 200. Furthermore, from the information "type = 42" and "ID = 1," the video signal processing device 300 can confirm that this video stream is intended for the display device 200 located at position "1" in a "quad-split screen" multi-display display.

[0136] 32 shows an example of the structure of an InfoFrame to be inserted into a video stream generated by the video signal output device 100 and intended for the display device (Sink 3) 200. From the information "Stream ID = 4," the video signal processing device 300 can recognize that this video stream is intended for the display device (Sink 3) 200 connected to the HDMI output terminal 302-4 of output 4, and can easily output this video stream to the HDMI output terminal 302-4 and transmit it to the display device (Sink 3) 200. Furthermore, from the information "type = 42" and "ID = 4," the video signal processing device 300 can confirm that this video stream is intended for the display device 200 located at position "4" in a "quad-split screen" multi-display display.

[0137] 33 shows an example of the structure of an InfoFrame to be inserted into a video stream generated by the video signal output device 100 and intended for the display device (Sink 4) 200. From the information "Stream ID = 2," the video signal processing device 300 can recognize that this video stream is intended for the display device (Sink 4) 200 connected to the HDMI output terminal 302-2 of output 2, and can easily output this video stream to the HDMI output terminal 302-2 and transmit it to the display device (Sink 4) 200. Furthermore, from the information "type = 42" and "ID = 2," the video signal processing device 300 can confirm that this video stream is intended for the display device 200 located at position "2" in a "quad-split screen" multi-display display.

[0138] "Audio processing during multi-stream transmission" The following describes audio processing during multi-stream transmission. In this case, audio processing can be either (1) independent processing without any correlation to the location of the display device 200 that plays the audio, or (2) processing that correlates the audio with the location of the display device 200 that plays the audio, just like video.

[0139] In the case of independent processing without correlation and multiple audio signals are sent corresponding to each of multiple video streams, the audio is output by one display device 200 selected by the user from among the multiple display devices 200 constituting the multi-display system 10. In addition, in the case of independent processing without correlation and multiple audio signals are sent corresponding to only one of the multiple video streams, the display device 200 constituting the multi-display system 10 that receives the single audio signal outputs the audio.

[0140] On the other hand, in the case of processing to create correlation, each of the multiple display devices 200 constituting the multi-display system 10 outputs the audio sent together with the video stream from its own speaker. This makes it possible to realize a sense of realism, as if the audio (sound) generated by the object displayed on the screen of each display device 200 is coming from that object.

[0141] 34 shows an image diagram of a use case. In this case, nine display devices 200 are arranged in a grid pattern, and each display device 200 is equipped with a speaker 220 that outputs sound. In this use case, the display device 200 that displays the peak of a volcano outputs the sound of the volcano from the speaker 220 of that display device 200. Also, the display device 200 that displays the head of a dinosaur outputs the sound of the dinosaur from the speaker 220 of that display device 200.

[0142] Fig. 35 shows an image diagram of another use case. In this case, as in Fig. 34, nine display devices 200 are arranged in a grid pattern, and each display device 200 is equipped with a speaker 220 that outputs audio. In this use case, left-channel sound is output from the speakers 220 of the three display devices 200 on the left, and right-channel sound is output from the speakers 220 of the three display devices 200 on the right.

[0143] 1, the video signal processing device 300 receives performance information from each of the plurality of display devices 200, generates multi-stream information based on the performance information of the plurality of display devices 200 and information on the type of multi-display realized by the plurality of display devices 200, and transmits the multi-stream information to the video signal output device 100, receives from the video signal output device 100 a multi-stream including video streams for each of the plurality of display devices 200 generated based on the multi-stream information, extracts the plurality of video streams from the multi-stream, and transmits each to a corresponding display device 200 among the plurality of display devices 200. As a result, an appropriate video stream according to the type of multi-display can be supplied to each of the plurality of display devices 200, and a multi-display display according to the type of multi-display can be successfully realized.

[0144] <2. Modifications> In the above-described embodiment, an example of a multi-display system 10 is shown, which is configured from a video signal output device 100, a video signal processing device 300, and a plurality of display devices 200. However, it is also conceivable that a multi-display system capable of satisfactorily realizing a multi-display display according to the type of multi-display, similar to this multi-display system 10, can be configured from a video signal output device and a plurality of display devices.

[0145] In this case, a plurality of display devices (sink devices) are directly connected to a video signal output device (source device), and the video signal output device is configured to receive performance information from each of the plurality of display devices, generate a video stream for each of the plurality of display devices based on the performance information of the plurality of display devices and information on the type of multi-display realized by the plurality of display devices, and transmit each of the video streams to a corresponding display device among the plurality of display devices.

[0146] Furthermore, while the preferred embodiments of the present disclosure have been described in detail with reference to the accompanying drawings, the technical scope of the present disclosure is not limited to such examples. It is clear that a person skilled in the art of the present disclosure can conceive of various modified or altered examples within the scope of the technical ideas described in the claims, and it is understood that these also naturally fall within the technical scope of the present disclosure.

[0147] Furthermore, the effects described herein are merely descriptive or exemplary and are not limiting. In other words, the technology according to the present disclosure may achieve other effects that will be apparent to those skilled in the art from the description of this specification, in addition to or in place of the above-described effects.

[0148] The present technology can also be configured as follows. (1) an information receiving unit that receives performance information from each of a plurality of display devices; an information transmitting unit that generates multi-stream information based on performance information of the plurality of display devices and information on the type of multi-display realized by the plurality of display devices and transmits the multi-stream information to a video signal output device; a multi-stream receiving unit that receives, from the video signal output device, a multi-stream including video streams for each of the plurality of display devices that are generated based on the multi-stream information; a video stream transmitting unit that extracts the plurality of video streams from the multi-stream and transmits each of the plurality of video streams to a corresponding display device among the plurality of display devices; Video signal processing device. (2) The type of the multi-display display includes at least one of an arbitrary layout, a preset layout, a planar layout, a circumferential layout, and a spherical layout. The video signal processing device according to (1) above. (3) The multi-stream information includes information on the number of the plurality of display devices and information on the type of the multi-display display. The video signal processing device according to (1) or (2) above. (4) The multi-stream information includes stream identification information and arrangement position information corresponding to each of the plurality of display devices. The video signal processing device according to (3) above. (5) When the type of the multi-display display is a planar arrangement, the multi-stream information includes information on the pixel position at the top left corner of the screen for each of the plurality of display devices. The video signal processing device according to (3) or (4). (6) When the type of the multi-display display is a circumferential surface arrangement, the multi-stream information includes information on a screen center angle and information on an occupied viewing angle corresponding to each of the plurality of display devices. The video signal processing device according to (3) or (4). (7) When the type of the multi-display display is a spherical arrangement, the multi-stream information includes, for each of the plurality of display devices, information on a central angle of the screen in the horizontal direction, information on a central angle of the screen in the vertical direction, and information on an occupied viewing angle in the horizontal direction or the vertical direction. The video signal processing device according to (3) or (4). (8) The multi-stream information includes video format information corresponding to each of the plurality of display devices. The video signal processing device according to any one of (3) to (7). (9) Each video stream included in the multi-stream includes stream identification information indicating which display device it corresponds to. The video signal processing device according to any one of (1) to (8). (10) receiving performance information from each of the plurality of display devices; generating multi-stream information based on performance information of the plurality of display devices and information on the type of multi-display realized by the plurality of display devices, and transmitting the multi-stream information to a video signal output device; receiving, from the video signal output device, a multi-stream including video streams for each of the plurality of display devices, generated based on the multi-stream information; a step of extracting the plurality of video streams from the multi-stream and transmitting each of the video streams to a corresponding one of the plurality of display devices; Video signal processing method. (11) An information receiving unit that receives, from a video signal processing device to which a plurality of display devices are connected, multi-stream information generated based on performance information of the plurality of display devices and information on the type of multi-display realized by the plurality of display devices; a multi-stream transmission unit that generates a multi-stream including video streams for each of the plurality of display devices based on the multi-stream information and transmits the multi-stream to the video signal processing device; Video signal output device. (12) an information receiving unit that receives performance information from each of the plurality of display devices; a video stream transmission unit that generates a video stream for each of the plurality of display devices based on performance information of the plurality of display devices and information on the type of multi-display realized by the plurality of display devices, and transmits each of the video streams to a corresponding display device among the plurality of display devices; Video signal output device. (13) A video signal output device and a plurality of display devices are connected via a video signal processing device, The video signal processing device comprises: receiving performance information from each of the plurality of display devices; generating multi-stream information based on performance information of the plurality of display devices and information on the type of multi-display realized by the plurality of display devices, and transmitting the multi-stream information to the video signal output device; receiving, from the video signal output device, a multi-stream including video streams for each of the plurality of display devices generated based on the multi-stream information; extracting the plurality of video streams from the multi-stream and transmitting each of the plurality of video streams to a corresponding display device among the plurality of display devices; Multi-display system. [Explanation of symbols]

[0149] 10. Multi-display system 100 Video signal output device (source device) 101 HDMI output terminal 102 HDMI transmitter 103 Control unit 104...signal source 105 Decoding unit 106 Information transmission unit 200 Display device (sink device) 201 HDMI input terminal 202···HDMI receiver 203 Control unit 204 Signal processing section 205...Display section 300...Video signal processing device (converter device) 301 HDMI input terminal 302-1 to 302-N HDMI output terminal 303···HDMI receiver 304-1 to 304-4 HDMI transmitter 305 Control section 306 Signal processing section 307···Selection section 400,500···HDMI cable 602: Data transmission section of source device (HDMI transmission section) 621···HDMI Transmitter 622 IIC Master Block 702: Data receiving section of sink device (HDMI receiving section) 721···HDMI Receiver 722 Memory section 731···EDID ROM 732 SCDC register section 800···HDMI cable

Claims

1. an information receiving unit that receives performance information from each of the plurality of display devices; an information transmitting unit that generates multi-stream information based on performance information of the plurality of display devices and information on the type of multi-display realized by the plurality of display devices and transmits the multi-stream information to a video signal output device; a multi-stream receiving unit that receives, from the video signal output device, a multi-stream including video streams for each of the plurality of display devices that are generated based on the multi-stream information; a video stream transmitting unit that extracts a video stream for each of the plurality of display devices from the multi-stream and transmits each of the video streams to a corresponding display device among the plurality of display devices; Video signal processing device.

2. The type of multi-display display includes at least one of an arbitrary layout, a preset layout, a planar layout, a circumferential layout, and a spherical layout.

2. The video signal processing device according to claim 1.

3. The multi-stream information includes information on the number of the plurality of display devices and information on the type of the multi-display display.

2. The video signal processing device according to claim 1.

4. The multi-stream information includes stream identification information and arrangement position information corresponding to each of the plurality of display devices.

4. The video signal processing device according to claim 3.

5. When the type of the multi-display display is a planar arrangement, the multi-stream information includes information on the pixel position at the top left corner of the screen for each of the plurality of display devices.

4. The video signal processing device according to claim 3.

6. When the type of the multi-display display is a circumferential surface arrangement, the multi-stream information includes information on a screen center angle and information on an occupied viewing angle corresponding to each of the plurality of display devices.

4. The video signal processing device according to claim 3.

7. When the type of the multi-display display is a spherical arrangement, the multi-stream information includes, for each of the plurality of display devices, information on a central angle of the screen in the horizontal direction, information on a central angle of the screen in the vertical direction, and information on an occupied viewing angle in the horizontal direction or the vertical direction.

4. The video signal processing device according to claim 3.

8. The multi-stream information includes video format information corresponding to each of the plurality of display devices.

4. The video signal processing device according to claim 3.

9. Each video stream included in the multi-stream includes stream identification information indicating which display device it corresponds to.

2. The video signal processing device according to claim 1.

10. A procedure in which an information receiving unit receives performance information from each of a plurality of display devices; an information transmitting unit generating multi-stream information based on performance information of the plurality of display devices and information on the type of multi-display realized by the plurality of display devices, and transmitting the multi-stream information to a video signal output device; a multi-stream receiving unit receiving, from the video signal output device, a multi-stream including video streams for each of the plurality of display devices generated based on the multi-stream information; a video stream transmitting unit for extracting a video stream for each of the plurality of display devices from the multi-stream and transmitting each of the video streams to a corresponding display device among the plurality of display devices; Video signal processing method.

11. an information receiving unit that receives, from a video signal processing device to which a plurality of display devices are connected, multi-stream information generated based on performance information of the plurality of display devices and information on the type of multi-display realized by the plurality of display devices; a multi-stream transmission unit that generates a multi-stream including video streams for each of the plurality of display devices based on the multi-stream information and transmits the multi-stream to the video signal processing device; Video signal output device.

12. an information receiving unit that receives performance information from each of the plurality of display devices; a video stream transmission unit that generates a video stream for each of the plurality of display devices based on performance information of the plurality of display devices and information on the type of multi-display realized by the plurality of display devices, and transmits each of the video streams to a corresponding display device among the plurality of display devices; Video signal output device.

13. A video signal output device and a plurality of display devices are connected via a video signal processing device, The video signal processing device comprises: receiving performance information from each of the plurality of display devices; generating multi-stream information based on performance information of the plurality of display devices and information on the type of multi-display realized by the plurality of display devices, and transmitting the multi-stream information to the video signal output device; receiving, from the video signal output device, a multi-stream including video streams for each of the plurality of display devices generated based on the multi-stream information; extracting a video stream for each of the plurality of display devices from the multi-stream and transmitting each to a corresponding display device among the plurality of display devices; Multi-display system.

Images