Display System

Abstract

The input image data is displayed in divided portions for each application program function. [Solution] A display system having an image processing device and a display device, wherein the image processing device comprises a first acquisition unit that acquires first image data from a first application program and a second acquisition unit that acquires second image data from a second application program, and the display device comprises a first communication unit to which the image processing device is connected via a wired connection, a second communication unit that is connected to a first information processing device via a wired or wireless connection, a reception unit that receives a first request to display multiple images side by side in a display area, and an image display unit that displays images in the display area, and when the image display unit displays the first image data and the second image data side by side in the display area, it displays in the display area an image of third image data generated based on the first image data and the second image data and transferred from the image processing device.

Description

[Technical Field]

[0001] The present disclosure relates to display systems. [Background technology]

[0002] The electronic whiteboard system described in Patent Document 1 consists of a projector, a streaming device connected to the projector via HDMI (a registered trademark, the same applies hereinafter), a terminal connected to the streaming device via Wi-Fi (a registered trademark), and a board that functions as a screen. The streaming device has a cast function and a mirroring function (see Patent Document 1). HDMI stands for High Definition Multimedia Interface.

[0003] Here, the cast function is a function that transfers videos being viewed on a smartphone, tablet, or personal computer to a streaming device, making the videos viewable on a large-screen television. The mirroring function allows you to project the content screen of a smartphone or tablet directly onto the board via a projector. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 2023-147131 Summary of the Invention [Problem to be solved by the invention]

[0005] However, with conventional technology, when considering a case where image data supplied from multiple input sources is split and displayed on the projection screen of a projector, even if a streaming device has multiple cast functions, it is not possible to split and display the image data input for each cast function on the projection screen of the projector. In other words, because the projector recognizes the streaming device as a single input source, it is possible to split and display, for example, image data input from the streaming device and image data input from a personal computer via a separate HDMI cable on the projector's projection screen, but it is not possible to split and display, on the projector's projection screen, image data input for each cast function of the streaming device. [Means for solving the problem]

[0006] In order to solve the above problem, one aspect is a display system having an image processing device and a display device, wherein the image processing device comprises a first acquisition unit that acquires first image data from a first application program and a second acquisition unit that acquires second image data from a second application program, and the display device comprises a first communication unit to which the image processing device is connected via a wired connection, a second communication unit that is connected to a first information processing device via a wired or wireless connection, a reception unit that accepts a first request to display multiple images side by side in a display area, and an image display unit that displays images in the display area, wherein the image display unit, when displaying the first image data and the second image data side by side in the display area, displays an image of third image data generated based on the first image data and the second image data and transferred from the image processing device in the display area, and when displaying the first image data and fourth image data acquired from the first information processing device side by side in the display area, displays an image of fifth image data generated based on the first image data transferred from the image processing device and the fourth image data transferred from the first information processing device in the display area. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of a display system according to an embodiment. [Figure 2] FIG. 1 is a diagram illustrating an example of the configuration of an image processing apparatus according to an embodiment. [Figure 3] 1 is a diagram illustrating an example of the configuration of a display device according to an embodiment. [Figure 4] 1 is a diagram illustrating a specific example of an image processing device, a display device, and a first information processing device according to an embodiment. [Figure 5] FIG. 4 is a diagram showing an example of a first setting screen according to the embodiment. [Figure 6] FIG. 10 is a diagram showing an example of a second setting screen according to the embodiment. [Figure 7] FIG. 10 is a diagram showing an example of a 2a setting screen according to the embodiment. [Figure 8] FIG. 2 is a diagram showing an example of a two-screen display image according to the embodiment. [Figure 9] FIG. 10 is a diagram showing another example of a dual-screen display image according to the embodiment. [Figure 10] FIG. 10 is a diagram showing an example of a processing sequence when an image of a first application program and an image of a second application program of a first communication unit according to the embodiment are displayed side by side. [Figure 11] 10 is a diagram showing an example of a processing sequence when an image of a first application program of a first communication unit and an image of a second communication unit are displayed side by side according to the embodiment. FIG. [Figure 12] FIG. 10 is a diagram showing an example of a processing sequence when an image of a first application program and an image of a second application program of a first communication unit according to an embodiment are displayed side by side, and when there is no signal from the first application program. [Figure 13] FIG. 10 is a diagram showing an example of a processing sequence when an image of a first application program of a first communication unit and an image of a second communication unit are displayed side by side in accordance with an embodiment, and when there is no signal from the first application program. [Figure 14]FIG. 2 is a diagram showing an example of the configuration of an a-th display system in which a first application program according to an embodiment is stored in an a-th image processing device 11a. [Figure 15] FIG. 10 is a diagram showing an example of a processing sequence when an image of a first application program and an image of a second application program of a first communication unit are displayed side by side in the a-th display system according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0008] Hereinafter, embodiments will be described with reference to the drawings.

[0009] An embodiment will be described. FIG. 1 is a diagram showing a schematic configuration example of a display system 1 according to an embodiment. The display system 1 includes an image processing device 11 and a display device 12. In this embodiment, the display system 1 includes a first information processing device 21, a second information processing device 22, and a third information processing device . In this embodiment, the display system 1 also includes a display area 31. The second information processing device 22 stores a first application program A1. The third information processing device 23 stores a second application program A2. The display area 31 is an area where an image is displayed by the display device 12.

[0010] The image processing device 11 and the display device 12 are connected via a first communication path B1 and also via a second communication path B2. Here, the first communication path B1 is a wired communication path. The second communication channel B2 is a wired or wireless communication channel. In this embodiment, the display device 12 and the image processing device 11 are separate entities, but as another example, they may be integrated into one unit.

[0011] The first information processing device 21 and the display device 12 are connected via a third communication path B3. Here, the third communication channel B3 is a wired or wireless communication channel. The second information processing device 22 and the image processing device 11 are connected via a fourth communication path B4. Here, the fourth communication channel B4 is a wired or wireless communication channel. The third information processing device 23 and the image processing device 11 are connected via a fifth communication path B5. Here, the fifth communication channel B5 is a wired or wireless communication channel.

[0012] Also shown in FIG. 1 is a user 51 . In this embodiment, a user 51 views an image displayed in the display area 31 . In this embodiment, the user 51 performs an operation on the display device 12. This operation may be performed based on a screen displayed in the display area 31, for example. The operation may be performed using a remote controller manually operated by the user 51, or may be performed using an operation unit provided on the display device 12, for example.

[0013] In the example of Figure 1, the display system 1 includes an image processing device 11, a display device 12, a first information processing device 21, a second information processing device 22, a third information processing device 23, a display area 31, and each communication path. As another example, the display system 1 may be understood as including the image processing device 11, the display device 12, the first communication path B1, and the second communication path B2, but not including any one or more other components. Furthermore, for example, if the second communication channel B2 or another communication channel is a wireless communication channel, the display system 1 may be considered not to include the wireless communication channel.

[0014] FIG. 2 is a diagram showing an example of the configuration of the image processing device 11 according to the embodiment. The image processing device 11 includes a first acquisition unit 111, a second acquisition unit 112, a third communication unit 113, a first storage unit 114, a first determination unit 115, and a first image processing unit . The third communication unit 113 includes a second image transfer unit 131 and a second signal communication unit 132. The first storage unit 114 stores the first predetermined image data C1.

[0015] The first acquisition unit 111 acquires the first image data from the first application program A1. Here, for example, it may be understood that the second information processing device 22 has the function of transmitting image data of the first application program A1, and the first acquisition unit 111 has the function of receiving the image of the first application program A1. The second acquisition unit 112 acquires the second image data from the second application program A2. Here, for example, it may be understood that the third information processing device 23 has the function of transmitting image data of the second application program A2, and the second acquisition unit 112 has the function of receiving the image of the second application program A2.

[0016] In addition, image data of an application program such as the first application program A1 or the second application program A2 may be obtained, for example, by mirroring the display screen of a device such as the second information processing device 22 or the third information processing device 23, or by receiving image data stored in the device such as the second information processing device 22 or the third information processing device 23 from that device. The mirroring function may be based on any standard, such as AirPlay (registered trademark), Miracast (registered trademark), which is a general-purpose standard, DLNA (registered trademark), or WiDi.

[0017] In this embodiment, the third communication unit 113 communicates with the display device 12. The second image transfer unit 131 transfers the image data to the display device 12. The second signal communication unit 132 communicates signals with the display device 12. Here, the second signal communication unit 132 may communicate a predetermined control signal. The control signal may include, for example, a control signal for notifying the image processing device 11 of an image to be displayed from the display device 12, and a control signal for notifying the display device 12 of the fact that the image to be displayed has not been acquired in the image processing device 11.

[0018] The first storage unit 114 stores various types of data. The first predetermined image data C1 is, for example, data of a monochrome image. The monochrome may be, for example, black, or may be another color.

[0019] The first determination unit 115 makes a predetermined determination. In this embodiment, the first determination unit 115 determines whether or not there is a signal from an application program such as the first application program A1 or the second application program A2. The first image processing unit 116 performs predetermined image processing. In this embodiment, the first image processing unit 116 may generate one image data by arranging two pieces of image data in parallel, for example. In this embodiment, the first image processing unit 116 generates one image data in which the image data of the first application program A1 and the image data of the second application program A2 are arranged in parallel. In addition, in this embodiment, when image data of the first application program A1 or the second application program A2 is not acquired, the first image processing unit 116 may use the first predetermined image data C1 instead of that image data.

[0020] FIG. 3 is a diagram showing an example of the configuration of the display device 12 according to the embodiment. The display device 12 includes a first communication unit 211, a second communication unit 212, a reception unit 213, a second storage unit 214, and an image display unit 215. The first communication unit 211 includes a first image transfer unit 231 and a first signal communication unit 232. The second storage section 214 includes first OSD data D1 and second predetermined image data D2. The image display unit 215 includes an OSD display unit 251 . The first communication unit 211 may be called, for example, a first input unit, and the second communication unit 212 may be called, for example, a second input unit.

[0021] In this embodiment, the first communication unit 211 communicates with the image processing device 11. The first image transfer unit 231 receives image data transferred from the image processing device 11. In this embodiment, this transfer is performed via the first communication path B1. The first signal communication unit 232 communicates signals with the image processing device 11. In this embodiment, this communication is performed via the second communication path B2.

[0022] Here, in this embodiment, image transfer is performed between the first image transfer unit 231 of the display device 12 and the second image transfer unit 131 of the image processing device 11, and signal communication is performed between the first signal communication unit 232 of the display device 12 and the second signal communication unit 132 of the image processing device 11.

[0023] In this embodiment, the second communication unit 212 communicates with the first information processing device 21. In this embodiment, this communication is performed via the third communication path B3. In this embodiment, the second communication unit 212 acquires image data from the first information processing device 21 by, for example, mirroring the display screen of the first information processing device 21.

[0024] The receiving unit 213 receives a predetermined request. In this embodiment, the receiving unit 213 receives a first request. The first request is a request to display a plurality of images side by side in the display area 31.

[0025] The second storage unit 214 stores various types of data. The first OSD data D1 is data of a predetermined OSD. In this embodiment, the first OSD data D1 includes, for example, data of a predetermined setting screen and data of "No Signal." The second predetermined image data D2 is, for example, data of a monochrome image. The monochrome may be, for example, black, or may be another color.

[0026] The image display unit 215 displays an image in the display area 31 . Here, the image display unit 215 may perform predetermined image processing. In this embodiment, the image display unit 215 may generate one image data by arranging two pieces of image data in parallel, for example. In this embodiment, the image display unit 215 generates one piece of image data by arranging the image data from the image processing device 11 and the image data from the first information processing device 21 in parallel, and displays the image data in the display area 31. Furthermore, in this embodiment, the image display unit 215 displays the image data from the image processing device 11 in the display area 31 when the image data from the image processing device 11 already contains two pieces of image data arranged in parallel. In addition, in this embodiment, when image data from the image processing device 11 or image data from the first information processing device 21 is not acquired, the image display unit 215 may use the second predetermined image data D2 instead of the image data.

[0027] Furthermore, the OSD display unit 251 performs control to display a predetermined OSD image in the display area 31 based on the first OSD data D1. In this embodiment, for the sake of convenience, the functions of the OSD display unit 251 of the image display unit 215 are shown separately, but for example, the functions of the OSD display unit 251 may be included in the functions of the image display unit 215 and may not be clearly distinguished.

[0028] FIG. 4 is a diagram showing a specific example of the image processing device 11, the display device 12, and the first information processing device 21 according to the embodiment. In this example, the image processing device 11 is configured as a smart stick 11A having an operating system (OS). The display device 12 is composed of a projector 12A. The first information processing device 21 is composed of a first computer 21A. Although not shown in the drawings, the second information processing device 22 is made up of a second computer, and the third information processing device 23 is made up of a third computer.

[0029] The first image transfer unit 231 of the display device 12 is configured from a first HDMI 231A that is an HDMI. The first signal communication unit 232 of the display device 12 is configured from a first USB 232A that is USB (a registered trademark, and the same applies hereinafter). Note that USB is an abbreviation for Universal Serial Bus. The second communication unit 212 of the display device 12 has the function of an image transfer unit, and is configured from a second HDMI 212A that is an HDMI.

[0030] In this example, the display area 31 is an area of ​​the screen onto which the image of the image data to be displayed is projected by the projector 12A. As another example, the display area 31 may be a display area of ​​a display screen that displays an image of image data to be displayed that is output from the projector 12A.

[0031] Here, for example, a configuration may be used in which the first HDMI 231A and the first USB 232A of the projector 12A are always connected to the smart stick 11A. Furthermore, in this embodiment, the projector 12A and the smart stick 11A are separate entities, but in another example, they may be configured as an integrated unit, and as a specific example, the smart stick 11A may be included inside the projector 12A.

[0032] FIG. 5 is a diagram showing an example of the first setting screen F1 according to the embodiment. In this embodiment, the first setting screen F1 is displayed in the display area 31 by the OSD display unit 251 of the display device 12. The user 51 can then perform predetermined operations while viewing the first setting screen F1 to configure various settings. In the display device 12, the OSD display unit 251 accepts the settings based on the operations performed by the user 51. The first setting screen F1 may be called, for example, a menu screen.

[0033] In the example of Figure 5, the first setting screen F1 displays the following items as a menu: "Keystone correction," "Dual screen display," "Volume," "HDMI link...," "Communication method α...," and "Lock settings...." Here, the communication method α may be, for example, Bluetooth (registered trademark).

[0034] FIG. 6 is a diagram showing an example of the second setting screen F2 according to the embodiment. In this embodiment, when the "two-screen display" setting is selected on the first setting screen F1 shown in FIG. 5, the second setting screen F2 is displayed. In this embodiment, the second setting screen F2 is displayed in the display area 31 by the OSD display unit 251 of the display device 12. The user 51 can then perform predetermined operations while viewing the second setting screen F2 to configure various settings. In the display device 12, the OSD display unit 251 accepts the settings based on the operations performed by the user 51. The second setting screen F2 may be called, for example, a source selection screen.

[0035] In the example of Figure 6, the source <1> For information on the selection of image area, <1> The message "Please select the source to display on..." is displayed, along with selectable items and an image of the virtual image area on the left and right screens. In the example of FIG. 6, the following items are displayed as selectable items: "HDMI1 Application Program A1," "HDMI1 Application Program A2," "HDMI2," and "USB."

[0036] In the image of the virtual image area of ​​the two screens, the image area on the left is <1> The image area on the right corresponds to <2> It corresponds to. In addition, in the image of the virtual image area on the left and right screens, <1> Source <1> A bold frame indicating that this is the scene where you select is displayed in the image area on the left.

[0037] In the example of Figure 6, "HDMI1" corresponds to the first HDMI 231A in the example of Figure 4, "HDMI2" corresponds to the second HDMI 212A in the example of Figure 4, and "USB" corresponds to the first USB 232A in the example of Figure 4. In the example of FIG. 6, "application program A1" corresponds to the first application program A1, and "application program A2" corresponds to the second application program A2.

[0038] FIG. 7 is a diagram showing an example of the 2a setting screen F2a according to the embodiment. Here, the 2a setting screen F2a is an example of a screen when the image area to be set on the second setting screen F2 shown in FIG. 6 has been changed. In other words, in the example in Figure 7, the source <2> Regarding the selection of the image area <2> Please select the source you want to view." is displayed. In the example of Figure 7, the image of the virtual image area on the left and right screens is <2> Source <2> A bold frame indicating that this is the scene where you select is displayed in the image area on the right.

[0039] FIG. 8 is a diagram showing an example of a dual-screen display image according to the embodiment. FIG. 8 shows an image A GA as an example of a dual-screen display image. The A-th image GA is an image that includes two images, a left image and a right image, and is configured by arranging an a-th image Ga on the left side and a b-th image Gb on the right side. In this embodiment, for the sake of convenience, the Ath image GA is considered to be an image having two screens, but for example, the Ath image GA may be considered to be an image of one screen in which these two screens are integrated.

[0040] For example, the a-th image Ga may be an image of the first application program A1, and the b-th image Gb may be an image of the second application program A2. Note that these images may be set in reverse order. As another example, the a-th image Ga may be an image from the first application program A1 or the second application program A2, and the b-th image Gb may be an image from the first information processing device 21. Note that these images may be set with the left and right reversed.

[0041] FIG. 9 is a diagram showing another example of a dual-screen display image according to the embodiment. FIG. 9 shows image B GB as another example of a dual-screen display image. The B-th image GB is an image including two images, a left image and a right image, and is configured by juxtaposing a c-th image Gc on the left side and a d-th image Gd on the right side. The c-th image Gc on the left side displays the first OSD information K1 near the center of the first predetermined color image H1 made of a predetermined color. The first OSD information K1 is text information that reads "No Signal," which indicates that no signal is detected. The absence of a signal detection may be referred to as, for example, non-detection.

[0042] For example, the c-th image Gc may be an image obtained when the signal of the first application program A1 is not detected, and the d-th image Gd may be an image obtained when the signal of the second application program A2 is not detected. Note that these images may be set in reverse. As another example, the c-th image Gc may be an image when a signal from the first information processing device 21 is not detected, and the d-th image Gd may be an image of the first application program A1 or the second application program A2. Note that these images may be set with the left and right reversed.

[0043] FIG. 10 is a diagram showing an example of a processing sequence when an image of the first application program A1 and an image of the second application program A2 of the first communication unit 211 according to the embodiment are displayed side by side.

[0044] In process T1, the display device 12 displays the first setting screen F1 shown in FIG. In process T2, the user 51 looks at the first setting screen F1 and instructs dual screen display. In process T3, the display device 12 displays the second setting screen F2 shown in FIG. 6 in the display area 31, and once the settings on that screen are completed, for example, displays the second setting screen F2a shown in FIG. 7 in the display area 31. In process T4, the user 51 views the second setting screen F2 and the second setting screen F2a and instructs the selection of a source. In process T5, the display device 12 stores source setting information including the selected content of each of the sources for the two screens. In this example, it is set that an image of the first application program A1 and an image of the second application program A2 are displayed side by side.

[0045] In process T11, the display device 12 instructs the image processing device 11 to perform dual screen display via the first signal communication unit 232, and also sends a signal to the image processing device 11 to select the source. <1> and sources <2> Instruct the following. In this example, for convenience of explanation, the two selected sources are referred to as sources <1> ,sauce <2> It is called.

[0046] In process T12, the image processing device 11 transmits the selected source to the second information processing device 22. <1> transmits a signal detection request. In process T13, the second information processing device 22 notifies the image processing device 11 of the selected source. <1> The signal detection response of the source <1> Image data corresponding to <1> The image processing device 11 receives these.

[0047] In process T14, the image processing device 11 notifies the third information processing device 23 of the selected source. <2> transmits a signal detection request. In process T15, the third information processing device 23 notifies the image processing device 11 of the selected source. <2> The signal detection response of the source <2> Image data corresponding to <2> The image processing device 11 receives these.

[0048] In process T16, the image processing device 11 performs the following steps: <1> and image data <2> From the image data <3> Generate. In process T17, the image processing device 11 transmits the image data to the display device 12 by the second image transfer unit 131. <3> Transfer. In process T18, the display device 12 <3> is displayed in the display area 31. Here, the image data <3> The display contents are, for example, dual-screen display contents as shown in FIG.

[0049] In the example of Figure 10, <1> Image data of <1> After processing to obtain the source <2> Image data of <2> However, as another example, the order of these processes may be reversed.

[0050] FIG. 11 is a diagram showing an example of a processing sequence when an image of the first application program A1 of the first communication unit 211 and an image of the second communication unit 212 are displayed side by side according to the embodiment.

[0051] Each of the processes T21 to T25 is similar to each of the processes T1 to T5 shown in FIG. In this example, it is set that the image of the first application program A1 and the image of the second communication unit 212 are displayed side by side.

[0052] In process T31, the display device 12 transmits the selected source to the image processing device 11 via the first signal communication unit 232. <1> Instruct the following. In this example, for convenience of explanation, the two selected sources are referred to as sources <1> ,sauce <2> It is called.

[0053] In process T32, the image processing device 11 transmits the selected source to the second information processing device 22. <1> transmits a signal detection request. In process T33, the second information processing device 22 notifies the image processing device 11 of the selected source. <1> The signal detection response of the source <1> Image data corresponding to <1> The image processing device 11 receives these. In process T34, the image processing device 11 transmits the image data to the display device 12 by the second image transfer unit 131. <1> Transfer.

[0054] In step T35, the display device 12 <2> As a result, the display device 12 detects the source <2> is provided from the first information processing device 21. In process T36, the display device 12 notifies the first information processing device 21 of the selected source through the second communication unit 212. <2> Instruct the following. In process T37, the first information processing device 21 notifies the display device 12 of the selected source. <2> Image data corresponding to <4> The display device 12 receives this.

[0055] In process T38, the display device 12 displays the acquired image data. <1> and image data <4> From the image data <5> Generate. In process T39, the display device 12 <5> is displayed in the display area 31. Here, the image data <5> The display contents are, for example, dual-screen display contents as shown in FIG.

[0056] In the example in Figure 11, <1> Image data of <1> After processing to obtain the source <2> Image data of <4> However, as another example, the order of these processes may be reversed.

[0057] Figure 12 is a diagram showing an example of a processing sequence when an image of a first application program A1 and an image of a second application program A2 of a first communication unit 211 according to an embodiment are displayed side by side, and when there is no signal from the first application program A1.

[0058] Each of the processes T41 to T45 is similar to each of the processes T1 to T5 shown in FIG. In this example, it is set that an image of the first application program A1 and an image of the second application program A2 are displayed side by side.

[0059] In process T51, the display device 12 instructs the image processing device 11 to perform dual screen display via the first signal communication unit 232, and also sends a signal to the image processing device 11 to select the source. <1> and sources <2> Instruct the following. In this example, for convenience of explanation, the two selected sources are referred to as sources <1> ,sauce <2> It is called.

[0060] In process T52, the image processing device 11 transmits the selected source to the second information processing device 22. <1> transmits a signal detection request. In process T53, the image processing device 11 receives a source image from the second information processing device 22 within a predetermined period. <1> If the signal detection response does not arrive, it is detected. In step T54, the image processing device 11 <1> Image data corresponding to <1> Then, image data of a black image is generated.

[0061] In this embodiment, the image processing device 11 generates image data of a black image using the first predetermined image data C1. The first predetermined image data C1 may be, for example, image data of a black image.

[0062] In process T55, the image processing device 11 notifies the third information processing device 23 of the selected source. <2> transmits a signal detection request. In process T56, the third information processing device 23 notifies the image processing device 11 of the selected source. <2> The signal detection response of the source <2> Image data corresponding to <2> The image processing device 11 receives these.

[0063] In process T57, the image processing device 11 <1> The image data of the black image generated as <2> From the image data <3> Generate. In process T58, the image processing device 11 transmits the image data to the display device 12 by the second image transfer unit 131. <3> Furthermore, the image processing device 11 transmits a signal including signal non-detection information to the display device 12 via the second signal communication unit 132. The signal not detected information is <1> This is information indicating that the signal has not been detected.

[0064] In process T59, the display device 12 receives the first OSD data D1 and the image data D2. <3> Based on the image data <6> Generate. In process T60, the display device 12 displays the generated image data. <6> is displayed in the display area 31. Here, the image data <6> The display contents are, for example, dual screen display contents as shown in FIG. 9, with a black image and predetermined OSD data displayed on one screen.

[0065] In the example of Figure 12, <1> Image data of <1> After processing to obtain the source <2> Image data of <2> However, as another example, the order of these processes may be reversed.

[0066] Figure 13 is a diagram showing an example of a processing sequence when an image of the first application program A1 of the first communication unit 211 in the embodiment and an image of the second communication unit 212 are displayed side by side, and when there is no signal from the first application program A1.

[0067] Each of the steps T81 to T85 is similar to each of the steps T1 to T5 shown in FIG. In this example, it is set that the image of the first application program A1 and the image of the second communication unit 212 are displayed side by side.

[0068] In process T91, the display device 12 transmits the selected source to the image processing device 11 via the first signal communication unit 232. <1> Instruct the following. In this example, for convenience of explanation, the two selected sources are referred to as sources <1> ,sauce <2> It is called.

[0069] In process T92, the image processing device 11 transmits the selected source to the second information processing device 22. <1> transmits a signal detection request. In process T93, the image processing device 11 receives a source image from the second information processing device 22 within a predetermined period. <1> If the signal detection response does not arrive, it is detected. In the process T94, the image processing device 11 <1> Image data corresponding to <1> Then, image data of a black image is generated.

[0070] In this embodiment, the image processing device 11 generates image data of a black image using the first predetermined image data C1. The first predetermined image data C1 may be, for example, image data of a black image.

[0071] In process T95, the image processing device 11 transmits the image data to the display device 12 by the second image transfer unit 131. <1> Transfer.

[0072] In step T96, the display device 12 <2> As a result, the display device 12 detects the source <2> is provided from the first information processing device 21. In process T97, the display device 12 notifies the first information processing device 21 of the selected source through the second communication unit 212. <2> Instruct the following. In process T98, the first information processing device 21 notifies the display device 12 of the selected source. <2> Image data corresponding to <4> The display device 12 receives this.

[0073] In process T99, the display device 12 receives the first OSD data D1, the image data D2, and the <1> and image data <4> Based on the image data <7> Generate. In process T100, the display device 12 displays the generated image data. <7> is displayed in the display area 31. Here, the image data <7> The display contents are, for example, dual screen display contents as shown in FIG. 9, with a black image and predetermined OSD data displayed on one screen.

[0074] In the example of Figure 13, <1> Image data of <1> After processing to obtain the source <2> Image data of <4> However, as another example, the order of these processes may be reversed.

[0075] FIG. 14 is a diagram showing an example of the configuration of an a-th display system 1a in which a first application program A1 according to the embodiment is stored in an a-th image processing device 11a.

[0076] Here, the a-th display system 1a shown in Figure 14 differs from the display system 1 shown in Figure 1 in that a first application program A1 is stored in the a-th image processing device 11a instead of the second information processing device 22 shown in Figure 1, but is similar in other respects. The a-th image processing device 11a may be one aspect of the image processing device 11 shown in Fig. 1. For example, the a-th image processing device 11a may be understood as the image processing device 11 shown in Fig. 1 with the first application program A1 installed therein. In the example of FIG. 14, the same components as those in the example of FIG. 1 are denoted by the same reference numerals.

[0077] In this embodiment, the a-th image processing device 11a starts the first application program A1 during a period in which an image of the first image data corresponding to the first application program A1 is displayed in the display area 31.

[0078] FIG. 15 is a diagram showing an example of a processing sequence when an image of the first application program A1 and an image of the second application program A2 of the first communication unit 211 are displayed side by side in the a-th display system 1a according to the embodiment.

[0079] Each of the processes T111 to T115 is similar to each of the processes T1 to T5 shown in FIG. In this example, it is set that an image of the first application program A1 and an image of the second application program A2 are displayed side by side.

[0080] In process T121, the display device 12 instructs the a-th image processing device 11a to perform dual screen display via the first signal communication unit 232, and also sends a signal to the a-th image processing device 11a indicating the source of the selected source. <1> and sources <2> Instruct the following. In this example, for convenience of explanation, the two selected sources are referred to as sources <1> ,sauce <2> It is called.

[0081] In process T122, the a-th image processing device 11a notifies the third information processing device 23 of the selected source. <2> transmits a signal detection request. In process T123, the third information processing device 23 transmits the selected source to the a-th image processing device 11a. <2> The signal detection response of the source <2> Image data corresponding to <2> The a-th image processing device 11a receives these.

[0082] In step T124, the a-th image processing device 11a <1> As a result, the a-th image processing device 11a detects the source <1> is provided by the first application program A1. In step T125, the a-th image processing device 11a <1> Image data corresponding to <1> Get. In process T126, the a-th image processing device 11a performs the following steps: <1> and image data <2> From the image data <3> Generate. In process T127, the a-th image processing device 11a transmits the image data to the display device 12 by the second image transfer unit 131. <3> Transfer. In process T128, the display device 12 <3> is displayed in the display area 31. Here, the image data <3> The display contents are, for example, dual-screen display contents as shown in FIG.

[0083] In the example of Figure 15, <2> Image data of <2> After processing to obtain the source <1> Image data of <1> However, as another example, the order of these processes may be reversed.

[0084] As described above, in the display system 1 according to this embodiment, when the image processing device 11 is able to acquire image data of two application programs, such as the first application program A1 and the second application program A2, the display device 12 can display images of these two sets of image data side by side. The display device 12 can also display an image of image data of one application program side by side with an image from the first information processing device 21, such as a computer.

[0085] Here, the technology according to this embodiment will be described using the configuration shown in FIG. 4 as an example. Recently, a configuration has been used in which a projector is combined with a smart stick with an OS as a peripheral device. The smart stick's output video is treated as one of the projector's external inputs via HDMI, and the projector and smart stick are also connected via USB for control purposes. On the other hand, the functionality of a smart stick includes a cast receiver function, and for example, there are cases where multiple standards for cast are implemented as application programs. Here, the projector has the function of displaying multiple external inputs on a multi-screen, but if you consider the cast application program inside the smart stick as a source, for example, it is not possible to create a multi-screen that includes this.

[0086] Therefore, in this embodiment, information for realizing the display of multiple combinations of images is communicated between the smart stick and the projector, and by switching to display a combination according to that information, it is possible to display, for example, any combination on a multi-screen. In this embodiment, for example, the projector can split and display an image of a first application program A1 and an image of a second application program A2 input via a smart stick. In other words, the projector can split and display images of image data of different application programs input from a single source.

[0087] In this embodiment, for example, a multi-screen display in which an external source and an application program of the OS of the smart stick are mixed can also be performed on the projector. Furthermore, in this embodiment, the OS of the smart stick and the projector cooperate with each other, and for example, it is possible to cooperate the multi-screen display of an application program of the OS of the smart stick with the multi-screen function of the projector. In this embodiment, the basic projection function of the projector is utilized, while the smart function is realized by the smart stick.

[0088] In this way, in this embodiment, it is possible to realize a multi-screen function for display by a projector, while, for example, making user operations the same or nearly the same, including the cast function realized on the smart stick side. Here, on the smart stick side, for example, in addition to the cast function, the functions of an application program realized in the smart stick may be used. For example, if the smart stick includes an interactive drawing application program, it is possible to draw pictures on two screens: the image of the drawing application program and an external input to the projector.

[0089] Examples of combinations of images to be displayed are shown below. One example is a combination of Cast with a signal and Cast without a signal. In this case, the OS of the smart stick displays two images from the Cast application program side by side, and the projector displays the two images side by side on a single screen. Another example is a combination of signal-enabled and signal-disabled casting. In this case, the smart stick's OS displays two images from the casting application program side by side, while the signal-disabled one displays a black screen. The projector displays the two images side by side on a single screen, and displays "No Signal" on the OSD in the black screen area.

[0090] Another example is a combination of an external input with a signal and a cast with a signal. In this case, the OS of the smart stick displays the image of the cast application program full screen, and the projector displays the external input and the cast on two screens. Here, the external input is, for example, an input from a computer other than the smart stick. Another example is a combination of an external input with a signal and a cast without a signal. In this case, the smart stick's OS displays the image of the cast's application program full screen, but because there is no signal, a black screen is displayed. The projector displays the external input and the cast on a dual screen, and displays "No Signal" on the OSD in the black screen area of ​​the cast. Here, the external input is, for example, an input from a computer other than the smart stick.

[0091] The smart stick and projector notify each other of changes in the signal status and the combination of the two screens, and by switching the display accordingly, various image combinations can be realized.

[0092] An example is a transition from a first state that is a combination of a cast with a signal and a cast without a signal to a second state that is a combination of a cast with a signal and a cast with a signal. In this case, in the first state, the smart stick's OS displays two images from the Cast application program side by side, but the one without a signal displays a black screen. The projector displays the two images side by side on a single screen, and displays the message "No Signal" on the OSD in the black screen area. In this case, when the Smart Stick connects to the "No Signal" Cast, it will display the images of both Cast's application programs as if they have a signal. This is a change in signal state from state 1 to state 2. The smart stick will notify the projector that the "No Signal" Cast member now has a signal. In response to receiving this notification, the projector will cancel the "No Signal" OSD.

[0093] As another example, when a signal-enabled external input is combined with a signal-disabled cast, the projector will set up a dual-screen configuration that selects the external input and the cast. In other words, the dual-screen function will set up a dual-screen configuration between the smart stick and the external input. The projector instructs the smart stick to display an application program for one cast. In response to this instruction, the smart stick displays an image of one of the cast application programs on the full screen.

[0094] 1 shows a configuration example according to the present embodiment. The display system 1 according to this embodiment includes an image processing device 11 and a display device 12. The image processing device 11 includes a first acquisition unit 111 that acquires first image data from a first application program A1, and a second acquisition unit 112 that acquires second image data from a second application program A2. The display device 12 includes a first communication unit 211 to which the image processing device 11 is connected via a wired connection, a second communication unit 212 to which the first information processing device 21 is connected via a wired or wireless connection, a reception unit 213 that receives a first request to display multiple images side by side in the display area 31, and an image display unit 215 that displays images in the display area 31. When the image display unit 215 displays the first image data and the second image data side by side in the display area 31, it displays in the display area 31 an image of the third image data generated based on the first image data and the second image data and transferred from the image processing device 11. When the image display unit 215 displays the first image data and the fourth image data acquired from the first information processing device 21 side by side in the display area 31, it displays in the display area 31 an image of the fifth image data generated based on the first image data transferred from the image processing device 11 and the fourth image data transferred from the first information processing device 21.

[0095] Therefore, in the display system 1 according to this embodiment, input image data can be displayed in a divided manner for each application program function. Here, as an example, the image processing device 11, the display device 12, the display area 31, and the first information processing device 21 may be a smart stick, a projector, a screen, or a computer, respectively. The computer may be, for example, a smartphone or a tablet.

[0096] The display system 1 according to this embodiment has the following configuration. The image processing device 11 stores the first predetermined image data C1. When the image display unit 215 displays the first image data and the second image data side by side in the display area 31 and the first acquisition unit 111 has not detected a signal related to the first application program A1, the image processing device 11 generates third image data based on the first predetermined image data C1 and the second image data. The image display unit 215 displays an image of sixth image data in the display area 31, which is generated based on the third image data and OSD data indicating that a signal related to the first application program A1 has not been detected.

[0097] Therefore, in the display system 1 of this embodiment, if a signal cannot be detected from one of multiple application programs, the OSD function of the display device 12 adds and displays predetermined OSD data, allowing the user 51 to determine, for example, whether the problem is with the display device 12 or whether a signal cannot be detected. Here, the predetermined OSD data may be, for example, message information such as "No Signal." The first predetermined image data C1 may be, for example, data of a monochrome image such as black, or may be data of another image. As an example, when the image processing device 11 acquires image data of two cast members, there may be cases where the signal of the image data of one of the cast members is not detected.

[0098] The display system 1 according to this embodiment has the following configuration. At least one of the image processing device 11 and the display device 12 stores second predetermined image data D2. When the image display unit 215 displays the first image data and the fourth image data side by side in the display area 31 and the first acquisition unit 111 does not detect a signal related to the first application program A1, the image display unit 215 displays an image of the seventh image data generated based on the second predetermined image data D2, OSD data indicating that a signal related to the first application program A1 has not been detected, and the fourth image data in the display area 31.

[0099] Therefore, in the display system 1 of this embodiment, if a signal from an application program specified by the user 51 cannot be detected, the OSD function of the display device 12 adds and displays specified OSD data, allowing the user 51 to determine, for example, whether the problem is with the display device 12 or whether the signal cannot be detected. Here, the predetermined OSD data may be, for example, message information such as "No Signal." The second predetermined image data D2 may be, for example, data of a monochrome image such as black, or may be data of another image. As an example, when the image processing device 11 acquires image data of one cast member, there are cases where the signal of the image data of that cast member is not detected.

[0100] The second predetermined image data D2 may be stored, for example, by the image processing device 11, or by the display device 12, or by both of them. When the image processing device 11 stores the second predetermined image data D2, for example, the image processing device 11 transfers the second predetermined image data D2 to the display device 12. On the other hand, when the display device 12 stores the second predetermined image data D2, for example, the display device 12 uses the second predetermined image data D2 as the first image data. In a configuration in which the image processing device 11 stores the first predetermined image data C1 and the second predetermined image data D2, for example, these data may be common data or may be separate data.

[0101] The display system 1 according to this embodiment has the following configuration. The first communication unit 211 includes a first image transfer unit 231 that transfers image data between the image processing device 11 and the display device 12, and a first signal communication unit 232 that communicates signals between the image processing device 11 and the display device 12.

[0102] Therefore, in the display system 1 according to this embodiment, the first communication unit 211 has the first signal communication unit 232, and thus can transmit, for example, from the image processing device 11 to the display device 12, that a signal has not been detected. Here, the first image transfer unit 231 may be configured with, for example, an HDMI. The first signal communication unit 232 may also be configured from, for example, a USB.

[0103] The a-th display system 1a according to this embodiment has the following configuration. The a-th image processing device 11a stores a first application program A1. The a-th image processing device 11a starts up the first application program A1 during the period in which the image of the first image data is displayed in the display area 31. The a-th display system 1a and the a-th image processing device 11a may be one embodiment of the display system 1 and the image processing device 11.

[0104] Therefore, in the display system 1 of this embodiment, if the first acquisition unit 111 is not selected as the input source, the processing load of the a-th image processing device 11a can be reduced by not starting the first application program A1. In the a-th image processing device 11a, for example, only when the display device 12 requests the display of an image of the first application program A1, the first application program A1 is started.

[0105] The display system 1 according to this embodiment has the following configuration. The display system 1 includes a second information processing device 22. The second information processing device 22 stores a first application program A1 and is connected to the image processing device 11 via a first acquisition unit 111. The signal relating to the first application program A1 is a signal of the first image data transferred from the second information processing device 22. The OSD data indicating that a signal related to the first application program A1 has not been detected is information indicating that image data has not been acquired.

[0106] Therefore, in the display system 1 of this embodiment, for example, the user 51 can determine based on the screen of the display area 31 whether the second information processing device 22 and the image processing device 11 are not connected, or whether an image cannot be transferred from the second information processing device 22 to the image processing device 11. Here, the OSD data may be, for example, data notifying that the second information processing device 22 and the image processing device 11 are connected but not mirrored.

[0107] A program for implementing the functions of any of the components of any of the above-described devices may be recorded on a computer-readable recording medium and loaded into a computer system for execution. Here, "computer system" includes hardware such as an operating system or peripheral devices. "Computer-readable recording medium" refers to portable media such as flexible disks, optical magnetic disks, ROMs (Read Only Memory), and CDs (Compact Discs)-ROMs, as well as storage devices such as hard disks built into computer systems. "Computer-readable recording medium" also includes devices that retain a program for a certain period of time, such as volatile memory within a computer system that acts as a server or client when a program is transmitted over a network such as the Internet or a communication line such as a telephone line. Such volatile memory may be RAM. The recording medium may also be non-transitory.

[0108] The above program may be transmitted from a computer system that stores the program in a storage device or the like to another computer system via a transmission medium or by transmission waves in the transmission medium. The "transmission medium" that transmits the program refers to a medium that has the function of transmitting information, such as a network such as the Internet or a communication line such as a telephone line. The above program may be for realizing some of the above functions. The above program may be a so-called differential file that can realize the above functions in combination with a program already recorded in a computer system. The differential file may also be called a differential program.

[0109] The functions of any of the components in any of the above-described devices may be implemented by a processor. Each process in the embodiments may be implemented by a processor operating based on information such as a program and a computer-readable recording medium storing information such as the program. The functions of each unit of the processor may be implemented by separate hardware, or may be implemented by integrated hardware. The processor includes hardware, and the hardware may include at least one of a circuit for processing digital signals and a circuit for processing analog signals. The processor may be configured using one or more circuit devices mounted on a circuit board, or one or both of one or more circuit elements. An integrated circuit (IC) or the like may be used as the circuit device, and a resistor or a capacitor may be used as the circuit element.

[0110] The processor may be a CPU. However, the processor is not limited to a CPU, and various types of processors such as a GPU (Graphics Processing Unit) or a DSP (Digital Signal Processor) may be used. The processor may be a hardware circuit using an ASIC (Application Specific Integrated Circuit). The processor may be configured with multiple CPUs, or may be configured with a hardware circuit using multiple ASICs. The processor may be configured with a combination of multiple CPUs and a hardware circuit using multiple ASICs. The processor may include one or more of an amplifier circuit or a filter circuit that processes analog signals.

[0111] Although the embodiments have been described above in detail with reference to the drawings, the specific configuration is not limited to this embodiment, and includes designs within the scope of the gist of this disclosure.

[0112] Summary of this disclosure A summary of this disclosure is provided below. (Appendix 1) A display system having an image processing device and a display device, The image processing device includes: a first acquisition unit that acquires first image data from a first application program; a second acquisition unit that acquires second image data from a second application program; Equipped with The display device includes: a first communication unit to which the image processing device is connected by wire; a second communication unit connected to the first information processing device by wire or wirelessly; a receiving unit that receives a first request to display a plurality of images side by side in a display area; an image display unit that displays an image in the display area; Equipped with The image display unit When the first image data and the second image data are displayed side by side in the display area, an image of third image data generated based on the first image data and the second image data and transferred from the image processing device is displayed in the display area; When the first image data and the fourth image data acquired from the first information processing device are displayed side by side in the display area, an image of fifth image data generated based on the first image data transferred from the image processing device and the fourth image data transferred from the first information processing device is displayed in the display area. Display system. This allows input image data to be displayed in separate parts for each application program function.

[0113] (Appendix 2) the image processing device stores first predetermined image data; When the image display unit displays the first image data and the second image data side by side in the display area and the first acquisition unit does not detect a signal related to the first application program, the image processing device generates the third image data based on the first predetermined image data and the second image data; the image display unit displays, in the display area, an image of sixth image data generated based on the third image data and OSD data indicating that a signal related to the first application program has not been detected. (Appendix 1) A display system as described in. This allows the user to determine, for example, whether the problem is with the display device itself or whether the signal cannot be detected, by using the OSD function of the display device to display additional, specified OSD data when a signal cannot be detected from one of multiple application programs.

[0114] (Appendix 3) At least one of the image processing device and the display device stores second predetermined image data; When the image display unit displays the first image data and the fourth image data side by side in the display area and the first acquisition unit does not detect a signal related to the first application program, the image display unit displays, in the display area, an image of seventh image data generated based on the second predetermined image data, OSD data indicating that a signal related to the first application program has not been detected, and the fourth image data. A display system according to (Appendix 1) or (Appendix 2). This allows the user to determine, for example, whether the problem is with the display device itself or whether the signal cannot be detected, by adding and displaying specified OSD data using the OSD function of the display device when the signal cannot be detected from the application program specified by the user.

[0115] (Appendix 4) the first communication unit includes an image transfer unit that transfers image data between the image processing device and the display device, and a signal communication unit that communicates signals between the image processing device and the display device; A display system according to any one of (Appendix 1) to (Appendix 3). As a result, since the first communication unit has the signal communication unit, it is possible to notify the display device that a signal has not been detected, for example, from the image processing device.

[0116] (Appendix 5) the image processing device stores the first application program; the image processing device launches the first application program during a period in which the image of the first image data is displayed in the display area; A display system according to any one of (Appendix 1) to (Appendix 4). As a result, if the first acquisition unit is not selected as the input source, the first application program is not started, thereby reducing the processing load on the image processing device.

[0117] (Appendix 6) a second information processing device; the second information processing device stores the first application program and is connected to the image processing device via the first acquisition unit; the signal related to the first application program is a signal of the first image data transferred from the second information processing device; The OSD data indicating that the signal related to the first application program has not been detected is information indicating that image data has not been acquired. A display system according to (Appendix 2) or (Appendix 3). This allows the user to determine, for example, based on the screen in the display area, whether the second information processing device and the image processing device are not connected, or whether images cannot be transferred from the second information processing device to the image processing device. [Explanation of symbols]

[0118] 1...display system, 1a...a-th display system, 11...image processing device, 11a...a-th image processing device, 11A...smart stick, 12...display device, 12A...projector, 21...first information processing device, 21A...first computer, 22...second information processing device, 23...third information processing device, 31...display area, 51...user, 111...first acquisition unit, 112...second acquisition unit, 113...third communication unit, 114...first storage unit, 115...first judgment unit, 116...first image processing unit, 131...second image transfer unit, 132...second signal communication unit, 211...first communication unit, 212...second communication unit, 212A...second HDMI, 213...reception unit, 214...second storage unit, 215...image image display unit, 231...first image transfer unit, 231A...first HDMI, 232...first signal communication unit, 232A...first USB, 251...OSD display unit, A1...first application program, A2...second application program, B1...first communication path, B2...second communication path, B3...third communication path, B4...fourth communication path, B5...fifth communication path, C1...first predetermined image data, D1...first OSD data, D2...second predetermined image data, F1...first setting screen, F2...second setting screen, F2a...seconda setting screen, GA...Ath image, GB...Bth image, Ga...ath image, Gb...bth image, Gc...cth image, Gd...dth image, H1...first predetermined color image, K1...first OSD information

Claims

1. A display system having an image processing device and a display device, The image processing device includes: a first acquisition unit that acquires first image data from a first application program; a second acquisition unit that acquires second image data from a second application program; Equipped with The display device includes: a first communication unit to which the image processing device is connected by wire; a second communication unit connected to the first information processing device by wire or wirelessly; a receiving unit that receives a first request to display a plurality of images side by side in a display area; an image display unit that displays an image in the display area; Equipped with The image display unit When the first image data and the second image data are displayed side by side in the display area, an image of third image data generated based on the first image data and the second image data and transferred from the image processing device is displayed in the display area; When the first image data and the fourth image data acquired from the first information processing device are displayed side by side in the display area, an image of fifth image data generated based on the first image data transferred from the image processing device and the fourth image data transferred from the first information processing device is displayed in the display area. Display system.

2. the image processing device stores first predetermined image data; When the image display unit displays the first image data and the second image data side by side in the display area and the first acquisition unit does not detect a signal related to the first application program, the image processing device generates the third image data based on the first predetermined image data and the second image data; the image display unit displays, in the display area, an image of sixth image data generated based on the third image data and OSD data indicating that a signal related to the first application program has not been detected. The display system of claim 1 .

3. At least one of the image processing device and the display device stores second predetermined image data; When the image display unit displays the first image data and the fourth image data side by side in the display area and the first acquisition unit does not detect a signal related to the first application program, the image display unit displays, in the display area, an image of seventh image data generated based on the second predetermined image data, OSD data indicating that a signal related to the first application program has not been detected, and the fourth image data. The display system of claim 1 .

4. the first communication unit includes an image transfer unit that transfers image data between the image processing device and the display device, and a signal communication unit that communicates signals between the image processing device and the display device; The display system of claim 1 .

5. the image processing device stores the first application program; the image processing device launches the first application program during a period in which the image of the first image data is displayed in the display area; The display system of claim 1 .

6. a second information processing device; the second information processing device stores the first application program and is connected to the image processing device via the first acquisition unit; the signal related to the first application program is a signal of the first image data transferred from the second information processing device, the OSD data indicating that a signal related to the first application program has not been detected is information indicating that image data has not been acquired; 4. The display system according to claim 2 or 3.

Images