Scaler integrated circuit applicable to multi-image processing in display device

Abstract

The present invention provides a scaler integrated circuit that can be used for multi-screen processing in a display device, comprising a plurality of terminals, a plurality of extended display capability identification data circuits and a control circuit. The control circuit receives a multi-stream transmission (MST) video stream from a video source device through a first video input terminal, analyzes the MST video stream to generate a first single-stream transmission (SST) video stream and a second SST video stream, transmits the second SST video stream through a video output terminal as a video output signal, and receives the video output signal through a second video input terminal, so as to allow the scaler integrated circuit to generate a combined picture according to the first SST video stream and the second SST video stream for display by a display output module in the display device.

Description

Technical Field

[0001] The present invention relates to display control, and more particularly to a scalar integrated circuit applicable to multi-picture processing in a display device. Background Art

[0002] According to the related art, when a user wants to use a monitor to display multiple images from different video source devices, the user typically needs to connect these video source devices to the monitor through two or more cables to allow the monitor to display the multiple images simultaneously in the multi-image processing mode. These video source devices can be replaced by the same video source device with multiple video output ports. In this case, when the user wants to use the monitor to display multiple images from the multiple video output ports, the user still needs to connect the multiple video output ports to the monitor through two or more cables to allow the monitor to display the multiple images simultaneously in the multi-image processing mode. However, some problems may occur. For example, the two or more cables may occupy limited space, which may cause inconvenience to the user. In addition, the monitor cannot automatically adjust the resolution in the multi-image processing mode, and the user may need to use the setting mechanism of the video source device (for example, a setting window of the operating system running on the video source device) to manually adjust the resolution to achieve the best screen ratio. In addition, when the multi-image processing mode is disabled, the multiple sets of image setting options corresponding to the multiple video output ports may still appear in the setting mechanism such as the setting window. Therefore, a novel method and related architecture are needed to implement a display device with reliable display control without side effects or with less possibility of side effects. Summary of the invention

[0003] An object of the present invention is to provide a scaler integrated circuit applicable to multi-image processing in a display device to solve the above-mentioned problem.

[0004] Another object of the present invention is to provide a scaler integrated circuit that can be used in a display device for performing multi-image processing to ensure the normal operation of a video source device and the display device.

[0005] At least one embodiment of the present invention provides an integrated circuit, which can be used for multi-screen processing in a display device. The scaler integrated circuit may include a control signal input terminal, a first video input terminal, a second video input terminal, a video output terminal, a first extended display capability identification data (Extended Display Identification Data, referred to as EDID) circuit, a second EDID circuit, and a control circuit coupled to the control signal input terminal, the first video input terminal, the second video input terminal, the video output terminal, the first EDID circuit, and the second EDID circuit. For example: the control signal input terminal can be used to receive a control signal from a user input device in the display device, wherein the control signal indicates whether the multi-screen processing is enabled; the first video input terminal can be used to receive a first video input signal; the second video input terminal can be used to receive a second video input signal; the video output terminal can be used to transmit a video output signal from the scaler integrated circuit; the first EDID circuit can be used to generate a first set of EDIDs for extended display capability identification through a first video input port of the display device; the second EDID circuit can be used to generate a second set of EDIDs for extended display capability identification through a second video input port of the display device; and the control circuit can be used to control the operation of the scaler integrated circuit. When the control signal indicates that the multi-screen processing is enabled, the control circuit can receive a multi-stream transport (MST) video stream from a video source device through the first video input port and the first video input terminal as the first video input signal, analyze the MST video stream to generate a first single stream transport (SST) video stream and a second SST video stream, transmit the second SST video stream through the video output terminal as the video output signal, and receive the video output signal through the second video input terminal as the second video input signal, so as to allow the scaler integrated circuit to generate a combined picture based on the first SST video stream and the second SST video stream for display by the display output module in the display device.

[0006] One of the benefits of the present invention is that, through a carefully designed display control mechanism, the scaler integrated circuit of the present invention can properly perform the multi-view processing when a single cable is connected between the video source device and the display device. Compared with the related art, the scaler integrated circuit of the present invention can realize a display device with reliable display control without side effects or with less possibility of side effects. BRIEF DESCRIPTION OF THE DRAWINGS

[0007] Figure 1 FIG. 4 is a schematic diagram of a scaler integrated circuit applicable to performing multi-image processing in a display device according to an embodiment of the present invention.

[0008] Figure 2 According to an embodiment of the present invention, a method for displaying a display device such as Figure 1 A first control scheme of a method for performing multi-image processing in a display device shown in FIG. Figure 1 The display device and the scaler integrated circuit therein are shown.

[0009] Figure 3 A second control scheme of the method is shown according to an embodiment of the present invention.

[0010] Figure 4 According to the embodiment of the present invention, Figure 1 Certain implementation details of the control circuit are shown.

[0011] Figure 5 According to the embodiment of the present invention, Figure 1 Some implementation details of the main circuit board are shown. DETAILED DESCRIPTION

[0012] Figure 1 The present invention is a schematic diagram of a scaler integrated circuit (IC) 100 that can be used for multi-image processing in a display device 10 according to an embodiment of the present invention, wherein the scaler IC 100 can be located in the display device 10, and in particular, can be mounted on a main circuit board 10B (e.g., a printed circuit board) of the display device 10, but the present invention is not limited thereto. In some embodiments, the main circuit board 10B can be replaced by another circuit board in the display device 10, such as any circuit board of one or more secondary circuit boards.

[0013] The display device 10 may include a display output module 10P (for example, a display panel such as a liquid crystal display (LCD) panel), a user input device 10U (which may include at least one button and / or an interface circuit), a main circuit board 10B together with a scaler IC 100 thereon, and a plurality of video input ports such as video input ports P_in(N) and P_in(N+1), and the scaler IC 100 may include a control signal input terminal CTRL_input, a first video input terminal such as a video input terminal DP_input(N), a second video input terminal such as a video input terminal DP_input(N+1), a video output terminal DP_out, a first extended display capability identification data (Extended Display Identification The scaler IC 100 may include a plurality of terminals such as the above terminals and a plurality of EDID circuits such as the above EDID circuits. In particular, the index values ​​N and (N+1) in the symbols of the related components, signals, etc. may be replaced by any two index values ​​of N_max index values ​​{1, ..., N_max}. For example, N_max may represent a positive integer greater than one.

[0014] exist Figure 1 In the illustrated architecture, the main circuit board 10B (e.g., the scaler IC 100 therein) may control the operations of the display device 10, and these operations may include:

[0015] (1) The display output module 10P displays one or more pictures;

[0016] (2) receiving one or more user inputs from a user of the display device 10 using the user input device 10U; and

[0017] (3) using the display output module 10P to perform an on-screen display (OSD) to guide the user to interact with the display device 10, for example, guiding the user to provide any one of the one or more user inputs through the user input device 10U;

[0018] However, the present invention is not limited thereto. For the scaler IC 100, the control circuit 100C may be used to control the operations of the scaler IC 100, and these operations may include:

[0019] (1) Perform image processing such as scaling, image adjustment, and multi-screen processing;

[0020] (2) performing display output control, for example, generating relevant display control signals to control the display output module 10P to perform display operations;

[0021] (3) performing video stream analysis, in particular, analyzing a multi-stream transport (MST) video stream to convert the MST video stream into multiple single stream transport (SST) video streams;

[0022] However, the present invention is not limited thereto. The scaler IC 100 may utilize its multiple terminals to perform signal input or output operations. For example, the control signal input terminal CTRL_input may be used to receive a control signal CTRL from the user input device 10U, wherein the control signal CTRL may indicate whether the multi-screen processing is enabled. The first video input terminal such as the video input terminal DP_input(N) may be used to receive a first video input signal, the second video input terminal such as the video input terminal DP_input(N+1) may be used to receive a second video input signal, and the video output terminal DP_out may be used to transmit a video output signal from the scaler IC 100. In addition, the scaler IC 100 may utilize its one or more EDID circuits to generate one or more sets of EDIDs for extended display capability identification. For example, the first EDID circuit such as EDID circuit EC(N) can be used to generate a first set of EDID EDID(N) for extended display capability identification through a first video input port of the display device 10 such as video input port P_in(N), and the second EDID circuit such as EDID circuit EC(N+1) can be used to generate a second set of EDID EDID(N+1) for extended display capability identification through a second video input port of the display device 10 such as video input port P_in(N+1).

[0023] For ease of understanding, the multi-screen processing may include one or both of Picture-in-Picture (PiP; also known as "Picture-in-Picture" in Chinese) processing and Picture-by-Picture (PbP; also known as "Picture-by-Picture" in Chinese) processing. The user of the display device 10 can enable or disable the multi-screen processing through the user input device 10U. According to some embodiments, the user can connect multiple video source devices (which can be referred to as video source devices #1, #2, etc. for ease of understanding) to multiple video input ports of the display device 10 such as video input ports P_in(N) and P_in(N+1) via two or more cables to allow the display device 10 to display multiple screens simultaneously in a multi-screen processing mode such as PiP / PbP mode, but the present invention is not limited to this. In some embodiments, the user can connect a single video source device (which may be referred to as video source device #0 for ease of understanding) to a video input port of the display device 10, such as the video input port P_in(N), via a single cable to allow the display device 10 to display multiple images simultaneously in the multi-screen processing mode, such as the PiP / PbP mode.

[0024] In the above embodiments, examples of video source devices #0, #1, #2, etc. may include (but are not limited to): personal computers such as desktop computers and laptop computers.

[0025] Figure 2 According to an embodiment of the present invention, a method for displaying a display device such as Figure 1 The first control scheme of the method for performing multi-image processing in the display device 10 shown in FIG. Figure 1 The display device 10 and the scaler IC 100 therein are shown. According to this embodiment, the user can connect the respective video output ports P_out(N) and P_out(N+1) of the video source devices #1 and #2 to the video input ports P_in(N) and P_in(N+1) of the display device 10 through the cables Cable(N) and Cable(N+1) to allow the display device 10 to simultaneously display multiple images such as partial images Video(N) and Video(N+1) in the multi-image processing mode (e.g., PbP / PbP mode).

[0026] For example, the control circuit 100C in the scaler IC 100 can declare support for SST through the video input ports P_in(N) and P_in(N+1), and control the EDID circuits EC(N) and EC(N+1) to transmit the first set of EDID EDID(N) and the second set of EDID EDID(N+1) to the video source devices #1 and #2 through the video input ports P_in(N) and P_in(N+1), respectively, for extended display capability identification. In addition, the control circuit 100C can receive a first SST video stream such as an SST video stream SST_VS(N) from a video output port P_out(N) of the video source device #1 through the cable Cable(N), the video input port P_in(N), and the video input terminal DP_input(N), and can receive a second SST video stream such as an SST video stream SST_VS(N+1) from a video output port P_out(N+1) of the video source device #2 through the cable Cable(N+1), the video input port P_in(N+1), and the video input terminal DP_input(N+1). Under the control of the scaler IC 100 (e.g., the control circuit 100C therein), the display device 10 simultaneously displays the partial images Video(N) and Video(N+1) corresponding to the SST video streams SST_VS(N) and SST_VS(N+1), respectively, in the multi-image processing mode (e.g., PbP / PbP mode).

[0027] Figure 3 According to an embodiment of the present invention, a second control scheme of the method is shown. According to this embodiment, the user can connect the video output port P_out(N) of the video source device #0 to the video input port P_in(N) of the display device 10 through a single cable Cable(N) to allow the display device 10 to simultaneously display multiple images such as the partial images Video(N) and Video(N+1) in the multi-image processing mode (e.g., PbP / PbP mode).

[0028] For example, when the control signal CTRL indicates that the multi-screen processing is enabled, the control circuit 100C in the scaler IC 100 can declare support for MST through the video input port P_in(N), and control the EDID circuit EC(N) to transmit multiple sets of EDIDs to the video source device #0 through the video input port P_in(N) for extended display capability identification, wherein the multiple sets of EDIDs may include the first set of EDID EDID(N) and the second set of EDID EDID(N+1). In addition, when the control signal CTRL indicates that the multi-screen processing is enabled, the control circuit 100C can receive the above-mentioned MST video stream such as the MST video stream MST_VS(N, N+1) as the first video input signal from the video output port P_out(N) of the video source device #0 through the single cable Cable(N), the video input port P_in(N) and the video input terminal DP_input(N), analyze the MST video stream to generate a first SST video stream such as the SST video stream SST_VS(N) and a second SST video stream such as the SST video stream SST_VS(N+1), transmit the second SST video stream such as the SST video stream SST_VS(N+1) through the video output terminal DP_out as the video output signal, and receive the video output signal as the second video input signal through the video input terminal DP_input(N+1) to allow the scaler IC 100 generates a combined picture according to the first SST video stream, such as SST video stream SST_VS(N) and the second SST video stream, such as SST video stream SST_VS(N+1), for display by the display output module 10P. Under the control of the scaler IC 100 (e.g., the control circuit 100C therein), the display device 10 simultaneously displays the partial pictures Video(N) and Video(N+1) corresponding to the SST video streams SST_VS(N) and SST_VS(N+1) respectively in the multi-picture processing mode (e.g., PbP / PbP mode), wherein the combined picture includes the partial pictures Video(N) and Video(N+1).

[0029] like Figure 3As shown, when the control signal CTRL indicates that the multi-screen processing is enabled, the video input terminal DP_input(N+1) is coupled to the video output terminal DP_out through the data path on the main circuit board 10B. Under the control of the scaler IC 100 (e.g., the control circuit 100C therein), the SST video streams SST_VS(N) and SST_VS(N+1) are respectively input to the video input terminals DP_input(N) and DP_input(N+1), so as to allow the display device 10 to be coupled to the video source device #0 via only a single cable Cable(N) (rather than multiple cables) to simultaneously display the partial images Video(N) and Video(N+1) using the display output module 10P. In addition, when the control signal CTRL indicates that the multi-screen processing is disabled, the control circuit 100C can declare support for SST through the video input port P_in(N), and control the EDID circuit EC(N) to transmit only the first set of EDID EDID(N) to the video source device #0 through the video input port P_in(N), but the present invention is not limited thereto. For example, when the video source device #0 replaces the MST video stream with the SST video stream, the control circuit 100C can control the EDID circuit EC(N) to transmit only the first set of EDID EDID(N) to the video source device #0 through the video input port P_in(N).

[0030] based on Figure 3 With the illustrated structure, the present invention can simultaneously avoid various problems of related technologies, such as the problem of multiple cables occupying limited space, the problem of requiring manual adjustment, the problem of multiple sets of picture setting options, etc.

[0031] exist Figure 2 and Figure 3 In any of the embodiments shown respectively, the partial pictures Video(N) and Video(N+1) may be shown as the left half picture and the right half picture of the whole picture to indicate that the multi-picture processing may be implemented as the PbP processing, but the present invention is not limited thereto. For example, the sizes of the partial pictures Video(N) and Video(N+1) may be changed. For another example, any one of the partial pictures Video(N) and Video(N+1) and another one of the partial pictures Video(N) and Video(N+1) may be shown as a main partial picture occupying most of the display area (e.g., the background area outside the sub-window in the whole picture) and a secondary partial picture occupying a small part of the display area (e.g., the sub-window) to indicate that the multi-picture processing may be implemented as the PiP processing.

[0032] According to some embodiments, the control circuit 100C can configure the multiple EDIDs to conform to a set of predetermined picture parameters (e.g., the size and resolution of the local pictures Video(N) and Video(N+1)) of the multi-picture processing, so as to guide the video source device #0 to generate the MST video stream carrying the picture data conforming to the set of predetermined picture parameters according to the multiple EDIDs, so that the local pictures Video(N) and Video(N+1) corresponding to the SST video streams SST_VS(N) and SST_VS(N+1) in the combined picture automatically conform to the set of predetermined picture parameters. Therefore, the user does not need to perform any manual adjustment.

[0033] Figure 4 According to the embodiment of the present invention, Figure 1 The control circuit 100C may include a plurality of sub-circuits such as an analysis circuit 110, an image processing circuit 120, and a display output control circuit 130, and the plurality of sub-circuits may be used to perform related operations, for example:

[0034] (1) using the image processing circuit 120 to perform the image processing, in particular, the multi-image processing;

[0035] (2) Using the display output control circuit 130 to perform the display output control;

[0036] (3) Utilizing the analysis circuit 110 to perform the video stream analysis, in particular, analyzing the above-mentioned MST video streams such as the MST video stream MST_VS(N, N+1) to convert the MST video stream into the multiple SST video streams such as the SST video streams SST_VS(N) and SST_VS(N+1), so as to provide the image processing circuit 120 with the image processing such as the multi-screen processing. For the sake of simplicity, the contents similar to those in the present embodiment are not repeated here.

[0037] Figure 5 According to the embodiment of the present invention, Figure 1Certain implementation details of the main circuit board 10B shown. The switching circuit SW1 is located on a plurality of data paths through the video output terminal DP_out, and can switch paths between these data paths, and these data paths may include a data path from the video output terminal DP_out to the outside of the main circuit board 10B (e.g., a video output port (not shown) of the display device 10), and a data path from the video output terminal DP_out to the switching circuit SW2. In addition, the switching circuit SW2 is located on a plurality of data paths through the video input terminal DP_input(N+1), and can switch paths between these data paths, and these data paths may include a data path from the switching circuit SW1 to the video input terminal DP_input(N+1), and a data path from the outside of the main circuit board 10B (e.g., a video input port P_in(N+1)) to the video input terminal DP_input(N+1)). In addition, the control circuit 100C can generate a plurality of control signals (not shown) to control a plurality of components of the main circuit board 10B, such as the switching circuits SW1 and SW2, so as to configure the switching circuits SW1 and SW2 to enable a data path starting from the video output terminal DP_out, passing through the switching circuits SW1 and SW2, and reaching the video input terminal DP_input(N+1). For the sake of simplicity, contents similar to those in the present embodiment are not repeated here.

[0038] One of the benefits of the present invention is that, through a carefully designed display control mechanism, the scaler IC 100 of the present invention can properly perform the multi-image processing when a single cable Cable (N) is connected between a video source device (e.g., the single video source device) and the display device 10. In addition, the scaler IC 100 of the present invention can configure the multiple sets of EDIDs according to the relevant information of the display output module 10P, such as the current resolution, so that the video source device provides the video stream required for the multi-image processing according to the multiple sets of EDIDs, so that the display device 10 automatically adjusts the resolution to achieve an optimized display ratio. In addition, when the control signal CTRL indicates that the multi-screen processing is disabled, the scaler IC 100 of the present invention can declare support for SST through the video input port P_in(N), and transmit only the first set of EDID EDID(N) to the video source device through the video input port P_in(N), so that only one set of screen setting options corresponding to the first video input signal (e.g., display properties of a single desktop) appears in the display setting mechanism of the video source device (e.g., a setting window of the operating system running on the video source device), instead of multiple sets of screen setting options (e.g., display properties of each of multiple desktops). Compared with the related art, the scaler IC of the present invention can realize a display device with reliable display control without side effects or with less possibility of side effects.

[0039] The above description is only a preferred embodiment of the present invention. All equivalent changes and modifications made according to the scope of the patent application of the present invention should fall within the scope of the present invention.

[0040] Explanation of symbols

[0041] 10: Display Devices

[0042] 10P: Display output module

[0043] 10U: User Input Devices

[0044] 10B: Main circuit board

[0045] 100: Scaler Integrated Circuit (IC)

[0046] 100C: Control circuit

[0047] CTRL: Control signal

[0048] CTRL_input: control signal input terminal

[0049] EC(N), EC(N+1): Extended Display Identification Data (EDID) circuit

[0050] EDID(N), EDID(N+1): Extended Display Identification Data (EDID)

[0051] DP_input(N), DP_input(N+1): Video input terminal

[0052] DP_out: Video output terminal

[0053] SW1, SW2: Switching circuit

[0054] P_in(N), P_in(N+1): Video input port

[0055] MST_VS(N, N+1): Multi-Stream Transport (MST) video streaming

[0056] SST_VS(N), SST_VS(N+1): Single Stream Transport (SST) video streaming

[0057] P_out(N), P_out(N+1): video output ports

[0058] Cable(N), Cable(N+1): Cable

[0059] Video(N), Video(N+1): Partial images

[0060] 110: Analyzing Circuits

[0061] 120: Image processing circuit

[0062] 130: Display output control circuit.

Claims

1. A scaler integrated circuit, which can be used for multi-image processing in a display device, the scaler integrated circuit comprising: A control signal input terminal, used to receive a control signal from a user input device in the display device, wherein the control signal indicates whether to enable the multi-image processing; A first video input terminal, used to receive a first video input signal; A second video input terminal, used to receive a second video input signal; a video output terminal for transmitting a video output signal from the scaler integrated circuit; a first extended display capability identification data (EDID) circuit for generating a first set of extended display capability identification data for extended display capability identification via a first video input port of the display device; a second extended display capability identification data circuit, used to generate a second set of extended display capability identification data for extended display capability identification via a second video input port of the display device; as well as a control circuit coupled to the control signal input terminal, the first video input terminal, the second video input terminal, the video output terminal, the first extended display capability identification data circuit, and the second extended display capability identification data circuit, for controlling the operation of the scaler integrated circuit; Wherein, when the control signal indicates that the multi-screen processing is enabled, the control circuit receives a multi-stream transmission video stream from a video source device through the first video input port and the first video input terminal as the first video input signal, analyzes the multi-stream transmission video stream to generate a first single-stream transmission video stream and a second single-stream transmission video stream, transmits the second single-stream transmission video stream through the video output terminal as the video output signal, and receives the video output signal through the second video input terminal as the second video input signal, so as to allow the scaler integrated circuit to generate a combined picture based on the first single-stream transmission video stream and the second single-stream transmission video stream for display by a display output module in the display device.

2. The scaler integrated circuit of claim 1 , wherein: When the control signal indicates that the multi-image processing is enabled, the control circuit controls the first extended display capability identification data circuit to transmit a plurality of sets of extended display capability identification data to the video source device through the first video input port for extended display capability identification. 3 . The scaler integrated circuit of claim 2 , wherein the plurality of sets of extended display capability identification data include the first set of extended display capability identification data and the second set of extended display capability identification data.

4. The scaler integrated circuit of claim 2 , wherein the control circuit configures the multiple sets of extended display capability identification data to comply with a set of predetermined picture parameters of the multi-picture processing, so as to guide the video source device to generate the multi-stream transmission video stream carrying picture data complying with the set of predetermined picture parameters according to the multiple sets of extended display capability identification data, so that the partial pictures in the combined picture corresponding to the first single-stream transmission video stream and the second single-stream transmission video stream respectively automatically comply with the set of predetermined picture parameters. 5 . The scaler integrated circuit of claim 1 , wherein the combined picture comprises a first partial picture and a second partial picture corresponding to the first single-stream video stream and the second single-stream video stream, respectively.

6. The scaler integrated circuit of claim 5, wherein: Under the control of the control circuit, the first single-stream transmission video stream and the second single-stream transmission video stream are input to the first video input terminal and the second video input terminal respectively, so as to allow the display device to be coupled to the video source device via only a single cable to simultaneously display the first partial picture and the second partial picture using the display output module. 7 . The scaler integrated circuit of claim 1 , wherein the multi-view processing comprises one or both of a picture-in-picture processing and a picture-by-picture processing.

8. The scaler integrated circuit of claim 1 , wherein: When the control signal indicates that the multi-image processing is enabled, the second video input terminal is coupled to the video output terminal through a data path on the main circuit board in the display device.

9. The scaler integrated circuit of claim 1 , wherein: When the control signal indicates disabling the multi-image processing, the control circuit declares support for single stream transmission through the first video input port, and controls the first extended display capability identification data circuit to transmit only the first set of extended display capability identification data to the video source device through the first video input port.

10. The scaler integrated circuit of claim 1, wherein: When the video source device replaces the multi-stream transmission video stream with a single-stream transmission video stream, the control circuit controls the first extended display capability identification data circuit to transmit only the first set of extended display capability identification data to the video source device through the first video input port.

Images