Display system

Abstract

This mechanism suppresses audio interference when displaying image data from multiple application programs on a display device screen. [Solution] A display system comprising: an image processing device comprising a first acquisition unit for acquiring first image data from a first application program and a second acquisition unit for acquiring second image data from a second application program; a display device comprising: a first communication unit to which the image processing device is wired; a second communication unit to which the first information processing device is wired or wirelessly connected; a reception unit for receiving a first request to display a plurality of images side by side in a display area; a setting information acquisition unit for acquiring audio output setting information; an image display unit for displaying images in a display area; and an audio output unit for outputting audio; and when displaying the first image data and the second image data side by side in a display area, the image processing device outputs first audio data or second audio data to the display device based on the audio output setting information.

Description

Technical Field

[0001] The present disclosure relates to a display system.

Background Art

[0002] In the image and audio transmission system described in Patent Document 1, it is composed of an image generation device that generates an image and an image projection device that projects the images transmitted from a plurality of such image generation devices. The image generation device or the image projection device includes an audio reproduction device, and switches whether to reproduce audio with the image generation device or the image projection device according to the projection status of the image projection device (see Patent Document 1).

[0003] In the image and audio transmission system described in Patent Document 1, the screen displayed on the display of a PC is transmitted from the PC to a projector, and the screen received by the projector is projected onto a screen. At this time, the PC transmits an image signal and an audio signal to the projector.

[0004] Patent Document 1 describes that when one projector connects a plurality of PCs and switches the received images to display only the image from one PC, it is necessary to switch the audio. Further, when displaying the images from a plurality of PCs simultaneously, since the audio of the plurality of PCs interferes, it is necessary not to transmit audio from all the PCs or to select the PC that reproduces the audio.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0006] However, while conventional technology has been shown to prevent interference when displaying video from multiple PCs on a projector by selecting the PC that will play the audio, there was still a possibility of audio interference in the following situations. In other words, if the scenario is to send image data from multiple application programs from a streaming device connected to a projector, and the projector only has the function to select the PC that will play the audio, it is not possible to set which of the multiple application program image data supplied from the streaming device corresponds to the audio data that should be played. [Means for solving the problem]

[0007] To solve the above problems, one embodiment provides a display system having an image processing device and a display device, wherein the image processing device comprises a first acquisition unit for acquiring first image data from a first application program and a second acquisition unit for acquiring second image data from a second application program, and the display device comprises a first communication unit to which the image processing device is wired, a second communication unit to which the first information processing device is wired or wireless, a reception unit for receiving a first request to display a plurality of images in a display area, a setting information acquisition unit for acquiring audio output setting information, an image display unit for displaying an image in the display area, and an audio output unit for outputting audio, wherein the image display unit displays the first image data and the second image data. A display system in which, when displaying side by side in a display area, the image processing device outputs first audio data acquired from the first application program or second audio data acquired from the second application program to the display device based on the audio output setting information, the audio output unit outputs the first audio data or second audio data acquired from the image processing device, and when the image display unit displays the first image data and the fourth image data acquired from the first information processing device side by side in the display area, the audio output unit outputs the first audio data acquired from the image processing device or fourth audio data acquired from the first information processing device based on the audio output setting information. [Brief explanation of the drawing]

[0008] [Figure 1] This is a diagram showing an example configuration of the display system according to the embodiment. [Figure 2] This figure shows an example configuration of an image processing apparatus according to the embodiment. [Figure 3] This figure shows an example configuration of a display device according to the embodiment. [Figure 4] This figure shows specific examples of the image processing apparatus, display device, and first information processing apparatus according to the embodiment. [Figure 5] This figure shows an example of the first settings screen according to this embodiment. [Figure 6]This figure shows an example of a second settings screen according to this embodiment. [Figure 7] This figure shows an example of the seconda setting screen according to the embodiment. [Figure 8] This figure shows an example of a third settings screen according to this embodiment. [Figure 9] This figure shows an example of a two-screen display image according to the embodiment. [Figure 10] This figure shows another example of a two-screen display image according to the embodiment. [Figure 11] This figure shows an example of a voice setting notification screen according to the embodiment. [Figure 12] This figure shows an example of a processing sequence when displaying an image of the first application program and an image of the second application program of the first communication unit according to the embodiment. [Figure 13] This figure shows an example of a processing sequence when displaying an image of the first application program of the first communication unit and an image of the second communication unit side by side according to the embodiment. [Figure 14] This figure shows an example of a processing sequence when an image of the first application program and an image of the second application program of the first communication unit according to the embodiment are displayed side by side, and there is no signal from the first application program. [Figure 15] This figure shows an example of a processing sequence when an image of the first application program and an image of the second application program of the first communication unit according to the embodiment are displayed side by side, and there is no signal from the first application program. [Figure 16] This figure shows an example of a processing sequence when an image of the first application program and an image of the second application program of the first communication unit according to the embodiment are displayed side by side, and the first application program returns from a state where there is no signal. [Figure 17]This is a diagram showing an example of a processing sequence when images of a first application program of a first communication unit and an image of a second communication unit according to an embodiment are arranged and displayed, when there is no signal of the first application program. [Figure 18] This is a diagram showing a configuration example of a first display system in which a first application program according to an embodiment is stored in a first image processing device. [Figure 19] This is a diagram showing an example of a processing sequence when images of a first application program of a first communication unit and an image of a second application program are arranged and displayed in a first display system according to an embodiment.

Embodiments for Carrying Out the Invention

[0009] Hereinafter, embodiments will be described with reference to the drawings.

[0010] Embodiments will be described. FIG. 1 is a diagram showing a schematic configuration example of a display system 1 according to an embodiment. The display system 1 includes an image processing device 11 and a display device 12. In the present embodiment, the display system 1 includes a first information processing device 21, a second information processing device 22, and a third information processing device 23. Also, in the present embodiment, the display system 1 includes a display area 31. The second information processing device 22 stores a first application program A1. The third information processing device 2 stores a second application program A2. The display area 31 is an area in which an image is displayed by the display device 12.

[0011] The image processing device 11 and the display device 12 are connected via a first communication path B1 and are also connected via a second communication path B2. Here, the first communication path B1 is a wired communication path. The second communication path B2 is a wired or wireless communication path. In this embodiment, the display device 12 and the image processing device 11 are separate components, but in other examples, a configuration in which they are integrated may also be used.

[0012] The first information processing device 21 and the display device 12 are connected via the third communication channel B3. Here, the third communication channel B3 is either a wired or wireless communication channel. The second information processing device 22 and the image processing device 11 are connected via the fourth communication channel B4. Here, the fourth communication channel B4 is either a wired or wireless communication channel. The third information processing device 23 and the image processing device 11 are connected via the fifth communication channel B5. Here, the fifth communication channel B5 is either a wired or wireless communication channel.

[0013] User 51 is also shown in Figure 1. In this embodiment, user 51 views the image displayed in the display area 31. In this embodiment, user 51 performs operations on the display device 12. This operation may be performed, for example, based on the screen displayed in the display area 31. Furthermore, this operation may be performed, for example, using a remote controller operated manually by user 51, or using an operating unit provided on the display device 12.

[0014] In the example shown in Figure 1, the display system 1 includes an image processing device 11, a display device 12, a first information processing device 21, a second information processing device 22, a third information processing device 23, a display area 31, and each communication channel. As another example, the display system 1 may be considered to include an image processing device 11, a display device 12, a first communication channel B1, and a second communication channel B2, but not any one or more other components. Furthermore, for example, if the second communication channel B2 or other communication channels are wireless communication channels, it may be understood that the display system 1 does not include wireless communication channels.

[0015] Figure 2 shows an example of the configuration of the image processing apparatus 11 according to the embodiment. The image processing device 11 comprises a first acquisition unit 111, a second acquisition unit 112, a third communication unit 113, a first storage unit 114, a first determination unit 115, and a first image processing unit 116. The third communication unit 113 includes a second image transfer unit 131 and a second signal communication unit 132. The first storage unit 114 stores the first predetermined image data C1.

[0016] The first acquisition unit 111 acquires first image data from the first application program A1. Here, for example, it may be understood that the second information processing device 22 has the function of transmitting image data of the first application program A1, and the first acquisition unit 111 has the function of receiving said image data of the first application program A1. The second acquisition unit 112 acquires the second image data from the second application program A2. Here, for example, it may be understood that the third information processing device 23 has the function of transmitting image data of the second application program A2, and the second acquisition unit 112 has the function of receiving said image data of the second application program A2.

[0017] Furthermore, the acquisition of image data of application programs such as the first application program A1 or the second application program A2 may be performed, for example, by mirroring the display screen of a device such as the second information processing device 22 or the third information processing device 23, or by receiving image data stored in a device such as the second information processing device 22 or the third information processing device 23 from that device. Any standard may be used for the mirroring function, such as AirPlay®, the general-purpose standard Miracast®, DLNA®, or WiDi.

[0018] In this embodiment, the third communication unit 113 communicates with the display device 12. The second image transfer unit 131 transfers image data to the display device 12. In this embodiment, the second image transfer unit 131 also transfers audio data to the display device 12. The second signal communication unit 132 communicates signals with the display device 12. Here, the second signal communication unit 132 may communicate a predetermined control signal. This control signal may include, for example, a control signal for notifying the image processing device 11 of the image to be displayed from the display device 12, and a control signal for notifying the display device 12 if the image to be displayed has not been acquired by the image processing device 11.

[0019] The first storage unit 114 stores various types of data. The first predetermined image data C1 is, for example, data of a monochrome image. This monochrome color may be, for example, black, or it may be any other color.

[0020] The first determination unit 115 makes a predetermined determination. In this embodiment, the first determination unit 115 determines, for example, the presence or absence of a signal from an application program such as the first application program A1 or the second application program A2. The first image processing unit 116 performs predetermined image processing. In this embodiment, the first image processing unit 116 may, for example, generate a single image data by arranging two image data in parallel. In this embodiment, the first image processing unit 116 generates a single image data by arranging the image data from the first application program A1 and the image data from the second application program A2 in parallel. Furthermore, in this embodiment, if image data for the first application program A1 or the second application program A2 has not been acquired, the first predetermined image data C1 may be used instead of that image data.

[0021] Furthermore, for example, the image processing device 11 may have a function to automatically switch the audio data to be output to the display device 12 based on the result of determining the presence or absence of signals from application programs such as the first application program A1 or the second application program A2, so as to send the acquired audio data to the display device 12, even if the settings made by the user 51 are configured to output the other audio data. This switching may be temporary; that is, the image processing device 11 may have a function to automatically switch the audio data to be output back to the original settings so that the acquired audio data is sent to the display device 12 according to the original settings when the other audio data is acquired. Alternatively, for example, a configuration may be used in which the user 51 is asked whether or not to perform such a switch of audio data to be output, and the device follows the instructions from the user 51.

[0022] Figure 3 shows an example of the configuration of the display device 12 according to the embodiment. The display device 12 includes a first communication unit 211, a second communication unit 212, a reception unit 213, a second storage unit 214, an image display unit 215, an audio output unit 216, and a setting information acquisition unit 217. The first communication unit 211 includes a first image transfer unit 231 and a first signal communication unit 232. The second storage unit 214 includes first OSD data D1 and second predetermined image data D2. The image display unit 215 includes an OSD display unit 251. The first communication unit 211 may also be called, for example, the first input unit, and the second communication unit 212 may also be called, for example, the second input unit.

[0023] In this embodiment, the first communication unit 211 communicates with the image processing device 11. The first image transfer unit 231 receives image data transferred from the image processing device 11. In this embodiment, this transfer is performed via the first communication channel B1. In this embodiment, the first image transfer unit 231 also receives audio data transferred from the image processing device 11. The first signal communication unit 232 communicates signals with the image processing device 11. In this embodiment, this communication is performed via the second communication channel B2.

[0024] In this embodiment, image transfer occurs between the first image transfer unit 231 of the display device 12 and the second image transfer unit 131 of the image processing device 11, and signal communication occurs between the first signal communication unit 232 of the display device 12 and the second signal communication unit 132 of the image processing device 11.

[0025] In this embodiment, the second communication unit 212 communicates between the display device 12 and the first information processing device 21. In this embodiment, this communication is performed via the third communication channel B3. In this embodiment, the acquisition of image data from the first information processing device 21 by the second communication unit 212 is performed, for example, by mirroring the display screen of the first information processing device 21. Furthermore, in this embodiment, the second communication unit 212 also communicates voice data in addition to communicating image data.

[0026] The reception unit 213 receives a predetermined request. In this embodiment, the reception unit 213 receives a first request. This first request is a request to display multiple images side by side in the display area 31.

[0027] The second memory unit 214 stores various types of data. The first OSD data D1 is data from a predetermined OSD. In this embodiment, the first OSD data D1 includes, for example, data from a predetermined settings screen and data that says "No Signal". The second predetermined image data D2 is, for example, data of a monochrome image. This monochrome may be, for example, black, or it may be any other color.

[0028] The image display unit 215 displays an image in the display area 31. Here, the image display unit 215 may perform predetermined image processing. In this embodiment, the image display unit 215 may, for example, generate a single image data by arranging two image data in parallel. In this embodiment, the image display unit 215 generates a single image data by arranging the image data from the image processing device 11 and the image data from the first information processing device 21 in parallel, and displays it in the display area 31. Furthermore, in this embodiment, the image display unit 215 displays the image data from the image processing device 11 in the display area 31 when the image data from the image processing device 11 already contains two image data files arranged in parallel. Furthermore, in this embodiment, the image display unit 215 may use the second predetermined image data D2 instead of the image data obtained from the image processing device 11 or the first information processing device 21 if no image data has been obtained from the image processing device 11 or the first information processing device 21.

[0029] Furthermore, the OSD display unit 251 controls the display of a predetermined OSD image in the display area 31 based on the first OSD data D1. In this embodiment, for the sake of explanation, the functions of the OSD display unit 251 of the image display unit 215 are shown separately. However, for example, the functions of the OSD display unit 251 may be included in the functions of the image display unit 215 and do not need to be clearly distinguished.

[0030] The audio output unit 216 outputs audio when an image is displayed in the display area 31. Here, the audio output unit 216 may, for example, have the function of a speaker that outputs sound. For example, the display device 12 may perform the display of an image by the image display unit 215 and the output of sound by the sound output unit 216 in a synchronized manner.

[0031] The setting information acquisition unit 217 acquires predetermined setting information. In this embodiment, the setting information acquisition unit 217 acquires, for example, setting information related to audio output. As a specific example, the setting information acquisition unit 217 may acquire information to set which of the two casts handled by the image processing device 11 will output audio data. Such a setting may be made, for example, in response to instructions from the user 51.

[0032] For example, the display device 12 may have a function to automatically switch the audio data to be output to output only the acquired audio data, even if the user 51 has set the system to output the other audio data, based on the result of determining the presence or absence of signals from the first communication unit 211 and the second communication unit 212, if only one audio data has been acquired. This switch may be temporary; that is, the display device 12 may have a function to automatically switch the audio data to be output back to the original setting when the other audio data is acquired, so as to output the other audio data according to the original setting. Alternatively, for example, the display device 12 may be configured to ask the user 51 whether or not to perform such a switch of audio data to be output and to follow the user 51's instructions.

[0033] Figure 4 shows specific examples of the image processing apparatus 11, display device 12, and first information processing apparatus 21 according to the embodiment. In this example, the image processing device 11 consists of a smart stick 11A having an operating system (OS). The display device 12 consists of a projector 12A. The first information processing device 21 consists of the first computer 21A. Although not shown in the diagram, the second information processing device 22 is composed of a second computer, and the third information processing device 23 is composed of a third computer.

[0034] The first image transfer unit 231 of the display device 12 is composed of a first HDMI 231A, which is an HDMI (a registered trademark, and the same applies hereafter). HDMI stands for High Definition Multimedia Interface. The first signal communication unit 232 of the display device 12 consists of a first USB232A, which is a USB (a registered trademark; the same applies hereafter). USB stands for Universal Serial Bus. The second communication unit 212 of the display device 12 has the function of an image transfer unit and is composed of a second HDMI 212A, which is an HDMI.

[0035] In this example, the display area 31 is the area of ​​the screen onto which the image data to be displayed is projected by the projector 12A. As another example, the display area 31 may be the display area of ​​a display screen that displays the image of the image data to be displayed, output from the projector 12A.

[0036] Here, for example, a configuration may be used in which the first HDMI 231A and first USB 232A of the projector 12A and the smart stick 11A are always connected. Furthermore, in this embodiment, the projector 12A and the smart stick 11A are separate components, but in other examples, a configuration in which they are integrated may be used, and specifically, the smart stick 11A may be included inside the projector 12A.

[0037] The image processing device 11 may, for example, be a streaming device connected to the projector 12A via HDMI. Alternatively, a terminal device such as a smartphone may be connected to the streaming device via Wi-Fi® or the like. The streaming device may have at least one of the following: a casting function and a mirroring function.

[0038] In this context, the casting function is a feature that allows you to transfer videos being viewed on a smartphone, tablet, or personal computer to a streaming device, making those videos viewable on a large-screen TV or similar device. The mirroring function allows you to project content from a smartphone or tablet, for example, directly onto a screen via the projector 12A.

[0039] In this embodiment, assuming a case where image data supplied from multiple input sources is displayed separately on the projection screen of the projector 12A, if the streaming device has multiple casting functions, it is possible to display the input image data separately for each casting function. Furthermore, since the projector 12A recognizes the streaming device as one input source, it is possible to display, for example, image data input from the streaming device and image data input from a personal computer via a separate HDMI cable. In this embodiment, the projector 12A can also display image data input for each casting function of the streaming device separately.

[0040] Figure 5 shows an example of the first setting screen F1 according to this embodiment. In this embodiment, the first setting screen F1 is displayed in the display area 31 by the OSD display unit 251 of the display device 12. The user 51 can then perform various settings by performing predetermined operations while viewing the first setting screen F1. The OSD display unit 251 of the display device 12 receives the settings based on the operations performed by the user 51. The first settings screen F1 may also be called, for example, the menu screen.

[0041] In the example shown in Figure 5, the first settings screen F1 displays the following menu items: "Keystone Correction," "Dual Screen Display," "Volume," "HDMI Link," "Communication Method α," and "Lock Settings." Here, the communication method α may be, for example, Bluetooth®.

[0042] Figure 6 shows an example of the second settings screen F2 according to this embodiment. In this embodiment, when the "two-screen display" setting is selected on the first settings screen F1 shown in Figure 5, the second settings screen F2 is displayed. In this embodiment, the second setting screen F2 is displayed in the display area 31 by the OSD display unit 251 of the display device 12. The user 51 can then perform various settings by performing predetermined operations while viewing the second setting screen F2. The OSD display unit 251 of the display device 12 accepts the settings based on the operations performed by the user 51. The second settings screen, F2, may also be called, for example, the source selection screen.

[0043] In the example in Figure 6, in the second settings screen F2, the source <1> Information regarding the selection of "image area" <1> The message "Please select the source to display" is shown, along with the selectable items and images of the virtual image areas on the left and right screens. In the example shown in Figure 6, the selectable items displayed are "HDMI1 Application Program A1", "HDMI1 Application Program A2", "HDMI2", and "USB".

[0044] In the image of the two virtual image areas on the left and right, the left image area is <1> Corresponding to the image area on the right is <2> It supports this. Furthermore, in the image of the two virtual image areas on the left and right, the left image area <1> Source <1> A thick border is displayed in the left-hand image area to indicate that this is a selection screen.

[0045] In the example in Figure 6, "HDMI1" corresponds to the first HDMI231A in the example in Figure 4, and "HDMI2" corresponds to the second HDMI212A in the example in Figure 4. Furthermore, in the example in Figure 6, "Application Program A1" corresponds to the first application program A1, and "Application Program A2" corresponds to the second application program A2.

[0046] Figure 7 shows an example of the second a setting screen F2a according to the embodiment. Here, the second setting screen F2a is an example of a screen that appears when the image area to be set in the second setting screen F2 shown in Figure 6 changes. In other words, in the example in Figure 7, the source <2> Regarding the selection of "image area" <2> The message "Please select the source to display" is displayed. Furthermore, in the example in Figure 7, the image of the virtual image areas of the two screens, left and right, is the right image area <2> Source <2> A thick border is displayed in the image area on the right, indicating that this is a selection screen.

[0047] Figure 8 shows an example of the third setting screen F3 according to this embodiment. In this embodiment, the third setting screen F3 is displayed in the display area 31 by the OSD display unit 251 of the display device 12. The user 51 can then perform predetermined operations while viewing the third setting screen F3 to make predetermined settings. The OSD display unit 251 of the display device 12 accepts the settings based on the operations performed by the user 51. The third settings screen, F3, may also be called, for example, the audio output selection screen.

[0048] In the example shown in Figure 8, the third settings screen F3 displays the message "Please select the source from which to output audio," along with the selectable items, as information regarding the selection of audio output. In the example shown in Figure 8, the selectable items displayed are "HDMI1 Application Program A1" and "HDMI1 Application Program A2".

[0049] In the example in Figure 8, "HDMI1" corresponds to the first HDMI231A in the example in Figure 4. In addition, in the example in Figure 8, "Application Program A1" corresponds to the first application program A1, and "Application Program A2" corresponds to the second application program A2.

[0050] Here, the third settings screen F3 may be displayed, for example, when the settings of the second settings screen F2 shown in Figure 6 and the seconda settings screen F2a shown in Figure 7 have been completed. As another example, the third settings screen F3 may be displayed when the "Audio Output Selection" setting, which is not shown in the example of Figure 5, is selected in the first settings screen F1 shown in Figure 5. In this embodiment, the setting information acquisition unit 217 in the display device 12 acquires setting information related to voice via the third setting screen F3 in response to operations performed by the user 51.

[0051] Figure 9 shows an example of a two-screen display image according to the embodiment. Figure 9 shows image A GA as an example of a dual-screen display image. Image A, GA, is an image containing two images, left and right, consisting of image a (Ga) on the left and image b (Gb) on the right, placed side by side. In this embodiment, for the sake of explanation, the A image GA is considered to be an image having two screens, but for example, the A image GA may be considered as a single image in which these two screens are integrated.

[0052] For example, image a Ga may be an image of the first application program, and image b Gb may be an image of the second application program. Note that these images may also be set to be reversed left to right. As another example, image a Ga may be an image from the first or second application program, and image b Gb may be an image from the first information processing device 21. These images may also be set to be reversed left to right.

[0053] Figure 10 shows another example of a two-screen display image according to the embodiment. Figure 10 shows another example of a dual-screen display image, image B GB. Image B GB is an image that contains two images, one on the left and one on the right. It is composed of the left image c Gc and the right image d Gd placed side by side. The c-th image Gc on the left displays the first OSD information K1 near the center of the first predetermined color image H1, which consists of predetermined colors. The first OSD information K1 is the text "No Signal," which indicates that no signal has been detected. The fact that no signal has been detected may also be referred to as, for example, "not detected."

[0054] For example, the c-th image Gc may be the image when no signal is detected for the first application program, and the d-th image Gd may be the image for the second application program. These images may also be set with their left and right sides reversed. As another example, the c-th image Gc may be an image when no signal is detected from the first information processing device 21, and the d-th image Gd may be an image of the first application program A1 or the second application program. These images may also be set to be reversed left to right.

[0055] Figure 11 shows an example of the voice setting notification screen Ge according to the embodiment. Figure 11 shows the C image GC as an example of a two-screen display. The C image GC is an image containing two images, one on the left and one on the right. Similar to the example in Figure 9, it is composed of the left image a Ga and the right image b Gb placed side by side. Furthermore, the C image GC is constructed by overlaying the voice setting notification screen Ge on the upper side of the two-screen display image.

[0056] In this embodiment, the voice setting notification screen Ge is displayed in the display area 31 by the OSD display unit 251 of the display device 12. The user 51 can then perform predetermined operations while viewing the voice setting notification screen Ge to make predetermined settings. The OSD display unit 251 of the display device 12 receives the settings based on the operations performed by the user 51.

[0057] In the example shown in Figure 11, the audio settings notification screen Ge displays the message, "Video from 'HDMI1 Application Program A1' has been detected. Do you want to change the audio settings?" along with the selectable options. In the example in Figure 11, the selectable items are displayed as "Yes" and "No". In this embodiment, the display device 12, the setting information acquisition unit 217 acquires setting information related to voice via the voice setting notification screen Ge in response to operations performed by the user 51.

[0058] Figure 12 is a diagram showing an example of a processing sequence when displaying images of the first application program A1 and the second application program A2 of the first communication unit 211 according to the embodiment.

[0059] In process T1, the display device 12 displays the first setting screen F1 shown in Figure 5 in the display area 31. In process T2, user 51 looks at the first settings screen F1 and instructs the system to display two screens. In process T3, the display device 12 displays the second setting screen F2 shown in Figure 6 in the display area 31. For example, once the settings on that screen are completed, the second a setting screen F2a shown in Figure 7 is displayed in the display area 31. In process T4, user 51 looks at the second settings screen F2 and the seconda settings screen F2a and instructs to select a source. In process T5, the display device 12 stores source setting information, including the selected source for each of the two screens.

[0060] In process T6, the third setting screen F3 shown in Figure 8 is displayed in the display area 31. In process T7, user 51 looks at the third settings screen F3 and instructs to select a source for audio output. In process T8, the display device 12 stores audio output setting information, including the selection of the audio output source. In this example, the settings are configured to display the image from the first application program A1 and the image from the second application program A2 side by side. In this example, the audio output of the first application program A1 is configured.

[0061] In this embodiment, the display device 12 acquires setting information received from the user 51 via the first setting screen F1, setting information received from the user 51 via the second setting screen F2 and the second a setting screen F2a, and setting information received from the user 51 via the third setting screen F3, using the setting information acquisition unit 217.

[0062] In process T11, the display device 12, via the first signal communication unit 232, instructs the image processing device 11 to display two screens, and also selects the source <1> and source <2> Instruct, source <1> This instructs the system to output audio. Here, for the sake of explanation, in this example, we will refer to the two selected sources as sources <1> ,sauce <2> It is called the source. In this example, <1> This is the first application program A1, and the source <2> This is the second application program, A2.

[0063] In process T12, the image processing device 11 communicates the selected source to the second information processing device 22. <1> Sends a signal detection request. In process T13, the second information processing device 22 communicates the selected source to the image processing device 11. <1> The signal detection response and the source <1> Corresponding image data <1> and audio data <1> The image processing device 11 receives these.

[0064] In process T14, the image processing device 11 communicates the selected source to the third information processing device 23. <2> Sends a signal detection request. In process T15, the third information processing device 23 communicates the selected source to the image processing device 11. <2> The signal detection response and the source <2> Corresponding image data <2> and audio data <2> The image processing device 11 receives these.

[0065] In process T16, the image processing device 11 processes the acquired image data. <1> and image data <2> From, image data <3> Generates. In process T17, the image processing device 11 transmits image data to the display device 12 via the second image transfer unit 131. <3> Transferring audio data <1> Transfer it. In process T18, the display device 12 displays the image data. <3> The audio data is displayed in the display area 31. <1> Outputs. Here, image data <3> The displayed content will be, for example, the content of a two-screen display as shown in Figure 9.

[0066] Note that in the example in Figure 12, the source <1> Image data <1> and audio data <1> After performing the process to obtain the source <2> Image data <2> and audio data <2> The example shown illustrates the process of obtaining the data, but in other examples, the order of these processes can be reversed. Furthermore, while the example in Figure 12 shows a case where the audio of the first application program A1 is set to be output, another example is where the audio of the second application program A2 is set to be output. This can be roughly achieved by controlling the system to output the audio of the second application program A2 instead of the audio of the first application program A1, as in the example in Figure 12.

[0067] Figure 13 is a diagram showing an example of a processing sequence when displaying an image of the first application program A1 of the first communication unit 211 and an image of the second communication unit 212 side by side according to the embodiment.

[0068] Each of the processes T21 to T28 is the same as each of the processes T1 to T8 shown in Figure 12. In this example, the image from the first application program A1 and the image from the second communication unit 212 are set to be displayed side by side. In this example, the audio output of the first application program A1 is configured.

[0069] In process T31, the display device 12, via the first signal communication unit 232, instructs the image processing device 11 to display two screens, and the selected source <1> Instruct, source <1> This instructs the system to output audio. Here, for the sake of explanation, in this example, we will refer to the two selected sources as sources <1> ,sauce <2> It is called that.

[0070] In process T32, the image processing device 11 communicates the selected source to the second information processing device 22. <1> Sends a signal detection request. In processing T33, the second information processing device 22 communicates the selected source to the image processing device 11. <1> The signal detection response and the source <1> Corresponding image data <1> and audio data <1> The image processing device 11 receives these. In process T34, the image processing device 11 transmits image data to the display device 12 via the second image transfer unit 131. <1> and audio data <1> Transfer it.

[0071] In process T35, the display device 12 displays the selected source <2> The detection of the source is performed. As a result, the display device 12 will detect the source. <2> It is detected that the data is provided by the first information processing device 21. In process T36, the display device 12, via the second communication unit 212, communicates the selected source to the first information processing device 21. <2> Give instructions. In process T37, the first information processing device 21 tells the display device 12 the selected source <2> Corresponding image data <4> and audio data <4> The data is sent. The display device 12 receives it.

[0072] In process T38, the display device 12 displays the acquired image data. <1> and image data <4> From, image data <5> Generates. In processing T39, the display device 12 displays the image data. <5> The audio data is displayed in the display area 31. <1> Outputs. Here, image data <5> The displayed content will be, for example, the content of a two-screen display as shown in Figure 9.

[0073] Note that in the example in Figure 13, the source <1> Image data <1> and audio data <1> After performing the process to obtain the source <2> Image data <4> and audio data <4> The example shown illustrates the process of obtaining the data, but in other examples, the order of these processes can be reversed. Furthermore, while the example in Figure 13 shows a case where the audio of the first application program A1 is set to be output, another example is where the audio from the first information processing device 21 is set to be output. In general terms, this can be achieved by controlling the system to output audio from the first information processing device 21 instead of the audio of the first application program A1, as in the example in Figure 13.

[0074] Figure 14 is a diagram showing an example of a processing sequence when the image of the first application program A1 and the image of the second application program A2 of the first communication unit 211 according to the embodiment are displayed side by side, and there is no signal for the first application program A1.

[0075] Each of the processes T41 to T48 is the same as each of the processes T1 to T8 shown in Figure 12. In this example, the settings are configured to display the image from the first application program A1 and the image from the second application program A2 side by side. In this example, the audio output of the first application program A1 is configured.

[0076] In process T51, the display device 12, via the first signal communication unit 232, instructs the image processing device 11 to display two screens, and also selects the source <1> and source <2> Instruct, source <1> This instructs the system to output audio. Here, for the sake of explanation, in this example, we will refer to the two selected sources as sources <1> ,sauce <2> It is called the source. In this example, <1> This is the first application program A1, and the source <2> This is the second application program, A2.

[0077] In process T52, the image processing device 11 communicates the selected source to the second information processing device 22. <1> Sends a signal detection request. In process T53, the image processing device 11 receives source data from the second information processing device 22 within a predetermined period. <1> It detects that the signal detection response could not be received. In processing T54, the image processing device 11 processes the source <1> Corresponding image data <1> This generates image data of a black image.

[0078] In this embodiment, the image processing device 11 generates black image data using the first predetermined image data C1. The first predetermined image data C1 may be, for example, image data of a black image.

[0079] In processing T55, the image processing device 11 communicates the selected source to the third information processing device 23. <2> Sends a signal detection request. In process T56, the third information processing device 23 communicates the selected source to the image processing device 11. <2> The signal detection response and the source <2> Corresponding image data <2> and audio data <2> The image processing device 11 receives these.

[0080] In processing T57, the image processing device 11 processes the image data. <1> Image data of the black image generated and acquired image data <2> From, image data <3> Generates. In process T58, the image processing device 11 transmits image data to the display device 12 via the second image transfer unit 131. <3> The data is transferred. The image processing device 11 also transmits a signal containing signal detection information to the display device 12 via the second signal communication unit 132. The information regarding the failure to detect the signal is from the source. <1> or source <2> This information indicates that the signal is not detected, and here is the source <1> This information indicates that the signal has not been detected.

[0081] In processing T59, the display device 12 displays the first OSD data D1 and image data. <3> Based on, image data <6> Generates. In processing T60, the display device 12 displays the generated image data. <6> Display this in display area 31. Here, image data <6> The display content will be, for example, a two-screen display as shown in Figure 10, with a black image and predetermined OSD data displayed on one screen.

[0082] Note that in the example in Figure 14, the source <1> Image data <1> and audio data <1> After performing the process to obtain the source <2> Image data <2> and audio data <2> The example shown illustrates the process of obtaining the data, but in other examples, the order of these processes can be reversed. Furthermore, while the example in Figure 14 shows a case where the audio of the first application program A1 is set to be output, another example is where the audio of the second application program A2 is set to be output. This can be roughly achieved by controlling the system to output the audio of the second application program A2 instead of the audio of the first application program A1, as in the example in Figure 14.

[0083] Figure 15 is a diagram showing an example of a processing sequence when the image of the first application program A1 and the image of the second application program A2 of the first communication unit 211 according to the embodiment are displayed side by side, and there is no signal for the first application program A1.

[0084] Each of the processes T81 to T88 is the same as each of the processes T1 to T8 shown in Figure 12. In this example, the settings are configured to display the image from the first application program A1 and the image from the second application program A2 side by side. In this example, the audio output of the first application program A1 is configured.

[0085] In process T91, the display device 12, via the first signal communication unit 232, instructs the image processing device 11 to display two screens, and also selects the source <1> and source <2> Instruct, source <1> This instructs the system to output audio. Here, for the sake of explanation, in this example, we will refer to the two selected sources as sources <1> ,sauce <2> It is called the source. In this example, <1> This is the first application program A1, and the source <2> This is the second application program, A2.

[0086] In process T92, the image processing device 11 communicates the selected source to the second information processing device 22. <1> Sends a signal detection request. In process T93, the image processing device 11 receives source data from the second information processing device 22 within a predetermined period. <1> It detects that the signal detection response could not be received. In processing T94, the image processing device 11 processes the source <1> Corresponding image data <1> This generates image data of a black image.

[0087] In this embodiment, the image processing device 11 generates black image data using the first predetermined image data C1. The first predetermined image data C1 may be, for example, image data of a black image.

[0088] In process T95, the image processing device 11 communicates the selected source to the third information processing device 23. <2> Sends a signal detection request. In process T96, the third information processing device 23 tells the image processing device 11 the selected source <2> The signal detection response and the source <2> Corresponding image data <2> and audio data <2> The image processing device 11 receives these.

[0089] In processing T97, the image processing device 11 processes the image data. <1> Image data of the black image generated and acquired image data <2> From, image data <3> Generates. In process T98, the image processing device 11 transmits image data to the display device 12 via the second image transfer unit 131. <3> The data is transferred. The image processing device 11 also transmits a signal containing signal detection information to the display device 12 via the second signal communication unit 132. The information regarding the failure to detect the signal is from the source. <1> This information indicates that the signal has not been detected.

[0090] In process T99, the display device 12 updates the audio output setting information in response to receiving information that no signal was detected. In this example, the source <1> and source <2> Among them, the source where no signal was detected <1> The other side of the source <2> The setting is configured to output audio from the second application program A2.

[0091] In process T100, the display device 12, via the first signal communication unit 232, sends a source to the image processing device 11. <2> This instructs the system to output audio. In process T101, the image processing device 11 transmits audio data to the display device 12 via the second image transfer unit 131. <2> Transfer it.

[0092] In process T102, the display device 12 displays the first OSD data D1 and image data. <3> Based on, image data <6> Generates. In process T103, the display device 12 displays the generated image data. <6> The audio data is displayed in the display area 31. <2> Outputs. Here, image data <6> The display content will be, for example, a two-screen display as shown in Figure 10, with a black image and predetermined OSD data displayed on one screen.

[0093] Note that in the example in Figure 15, the source <1> Image data <1> and audio data <1> After performing the process to obtain the source <2> Image data <2> and audio data <2> The example shown illustrates the process of obtaining the data, but in other examples, the order of these processes can be reversed.

[0094] In the example shown in Figure 15, the image processing device 11 is a source for the display device 12. <1> This example illustrates a case where signal detection information is transmitted, and the display device 12 updates the audio output setting information upon receiving the signal detection information. This enables automatic selection of audio output by the image processing device 11 and the display device 12. As another example, the image processing device 11 is a source <1> If no signal detection response is received, automatically, other sources <2> Audio data <2> A configuration may be used in which the second image transfer unit 131 switches to transmitting the data to the display device 12, and the second signal communication unit 132 transmits notification of this switch to the display device 12. This enables the image processing device 11 to automatically select the audio output.

[0095] Figure 16 shows an example of a processing sequence when the image of the first application program A1 and the image of the second application program A2 of the first communication unit 211 according to the embodiment are displayed side by side, and the system returns from a state where no signal for the first application program A1 has been detected. Here, the processing flow shown in Figure 16 takes place after the processing flow shown in Figure 15. This example shows the case where the signal for the first application program A1 returns from a state where it was not detected to a state where it was detected.

[0096] In process T121, the image processing device 11 waits for a predetermined period of time to elapse. In process T122, the image processing device 11 communicates the selected source to the second information processing device 22. <1> Sends a signal detection request. In process T123, the second information processing device 22 communicates the selected source to the image processing device 11. <1> The signal detection response and the source <1> Corresponding image data <1> and audio data <1> The image processing device 11 receives these.

[0097] In process T124, the image processing device 11 processes the acquired image data. <1> and image data <2> From, image data <3> Generates. In process T125, the image processing device 11 transmits image data to the display device 12 via the second image transfer unit 131. <3> It transmits the signal detection information and the audio data. <2> Transfer it. Here, the signal detection information is the source <1> Audio data <1> This indicates that it has been restored and detected.

[0098] In process T126, the display device 12 displays OSD data and image data for audio switching. <3> Based on, image data <8> Generates. In process T127, the display device 12 displays the generated image data. <8> The audio data is displayed in the display area 31. <2> Outputs. Here, image data <8> The displayed content will be, for example, the content of a two-screen display as shown in Figure 11, and the voice setting notification screen Ge, which is OSD data for voice switching, will be displayed.

[0099] In process T128, user 51 looks at the voice settings notification screen Ge and the source <1> Audio data <1> The system will instruct the system to change the audio output settings to select the output option. In process T129, the display device 12 updates the audio output setting information in response to instructions from the user 51.

[0100] In process T130, the display device 12, via the first signal communication unit 232, sends a source to the image processing device 11. <1> This instructs the system to output audio. In process T131, the image processing device 11 transmits audio data to the display device 12 via the second image transfer unit 131. <1> Transfer it. In process T132, the display device 12 displays audio data <1> This outputs the audio data. <2> From audio data <1> It can be switched to.

[0101] In this embodiment, the display device 12 acquires setting information received from the user 51 via the voice setting notification screen Ge using the setting information acquisition unit 217.

[0102] In addition, while the examples in Figures 15 and 16 show the case where the image processing device 11 returns from a state where it has not acquired the audio of the first application program A1 to a state where it has acquired it, other examples may also be applied, such as when the image processing device 11 returns from a state where it has not acquired the audio of the second application program A2 to a state where it has acquired it. In general terms, compared to the examples in Figures 15 and 16, the image processing device 11 outputs the audio of the first application program A1 when it has not acquired the audio of the second application program A2, and when the image processing device 11 returns to a state where it has acquired the audio of the second application program A2, it queries the user 51 whether or not to output the audio of the second application program A2.

[0103] Figure 17 is a diagram showing an example of a processing sequence when the image of the first application program A1 of the first communication unit 211 and the image of the second communication unit 212 are displayed side by side according to the embodiment, and there is no signal from the first application program A1.

[0104] Each of the processes T141 to T148 is the same as each of the processes T1 to T8 shown in Figure 12. In this example, the image from the first application program A1 and the image from the second communication unit 212 are set to be displayed side by side. In this example, the audio output of the first application program A1 is configured.

[0105] In process T151, the display device 12, via the first signal communication unit 232, communicates the selected source to the image processing device 11. <1> Instruct, source <1> This instructs the system to output audio. Here, for the sake of explanation, in this example, we will refer to the two selected sources as sources <1> ,sauce <2> It is called that.

[0106] In process T152, the image processing device 11 communicates the selected source to the second information processing device 22. <1> Sends a signal detection request. In process T153, the image processing device 11 receives source data from the second information processing device 22 within a predetermined period. <1> It detects that the signal detection response could not be received. In process T154, the image processing device 11 processes the source <1> Corresponding image data <1> This generates image data of a black image.

[0107] In this embodiment, the image processing device 11 generates black image data using the first predetermined image data C1. The first predetermined image data C1 may be, for example, image data of a black image.

[0108] In process T155, the image processing device 11 transmits image data to the display device 12 via the second image transfer unit 131. <1> Transfer it.

[0109] In process T156, the display device 12 displays the selected source <2> The detection of the source is performed. As a result, the display device 12 will detect the source. <2> It is detected that the data is provided by the first information processing device 21. In process T157, the display device 12, via the second communication unit 212, communicates the selected source to the first information processing device 21. <2> Give instructions. In process T158, the first information processing device 21 tells the display device 12 the selected source <2> Corresponding image data <4> and audio data <4> The data is sent. The display device 12 receives it.

[0110] In process T159, the display device 12 displays the first OSD data D1 and image data. <1> and image data <4> Based on, image data <7> Generates. In process T160, the display device 12 displays the generated image data. <7> Display this in display area 31. Here, image data <7> The display content will be, for example, a two-screen display as shown in Figure 10, with a black image and predetermined OSD data displayed on one screen.

[0111] Note that in the example in Figure 17, the source <1> Image data <1> and audio data <1> After performing the process to obtain the source <2> Image data <4> and audio data <4> The example shown illustrates the process of obtaining the data, but in other examples, the order of these processes can be reversed. Furthermore, while the example in Figure 17 shows a case where the audio of the first application program A1 is set to be output, another example is where the audio from the first information processing device 21 is set to be output. This can be roughly achieved by controlling the system to output audio from the first information processing device 21 instead of the audio of the first application program A1, as in the example in Figure 17.

[0112] Figure 18 shows an example of the configuration of the a-th display system 1a in which the first application program A1 according to the embodiment is stored in the a-th image processing device 11a.

[0113] Here, the a-th display system 1a shown in Figure 18 differs from the display system 1 shown in Figure 1 in that the first application program A1 is stored in the a-th image processing device 11a instead of the second information processing device 22 shown in Figure 1, but is otherwise similar. The first image processing device 11a may be one embodiment of the image processing device 11 shown in Figure 1. For example, the first image processing device 11a may be considered to be the image processing device 11 shown in Figure 1 with the first application program A1 installed. In the example in Figure 18, the same reference numerals are used for components that are the same as those in the example in Figure 1.

[0114] In this embodiment, the first image processing device 11a starts the first application program A1 during the period in which an image of the first image data corresponding to the first application program A1 is displayed in the display area 31. Therefore, in the a-th display system 1a according to this embodiment, if the first acquisition unit 111 is not selected as the input source, the processing load of the a-th image processing device 11a can be reduced by not starting the first application program A1.

[0115] Figure 19 is a diagram showing an example of a processing sequence when displaying side by side an image of the first application program A1 and an image of the second application program A2 of the first communication unit 211 in the a-th display system 1a according to the embodiment.

[0116] Each of the processes T171 to T178 is the same as each of the processes T1 to T8 shown in Figure 12. In this example, the image from the first application program A1 and the image from the second communication unit 212 are set to be displayed side by side. In this example, the audio output of the first application program A1 is configured.

[0117] In process T181, the display device 12, via the first signal communication unit 232, instructs the a-th image processing device 11a to display two screens, and also selects the source <1> and source <2> Instruct, source <1> This instructs the system to output audio. Here, for the sake of explanation, in this example, we will refer to the two selected sources as sources <1> ,sauce <2> It is called the source. In this example, <1> This is the first application program A1, and the source <2> This is the second application program, A2.

[0118] In process T182, the first image processing device 11a communicates the selected source to the third information processing device 23. <2> Sends a signal detection request. In process T183, the third information processing device 23 provides the selected source to the a image processing device 11a. <2> The signal detection response and the source <2> Corresponding image data <2> and audio data <2> The first image processing device 11a receives these.

[0119] In process T184, the a-th image processing device 11a selects the source <1> The detection of the source is performed. As a result, the first image processing device 11a determines the source <1> It is detected that this is provided by the first application program A1. In process T185, the first image processing device 11a is the source <1> Corresponding image data <1> and audio data <1> Obtain it. In process T186, the a-th image processing device 11a processes the acquired image data. <1> and image data <2> From, image data <3> Generates. In process T187, the first image processing device 11a transmits image data to the display device 12 via the second image transfer unit 131. <3> and audio data <1> Transfer it. In process T188, the display device 12 displays the image data. <3> The audio data is displayed in the display area 31. <1> Outputs. Here, image data <3> The displayed content will be, for example, the content of a two-screen display as shown in Figure 9.

[0120] Note that in the example in Figure 19, the source <2> Image data <2> and audio data <2> After performing the process to obtain the source <1> Image data <1> and audio data <1> The example shown illustrates the process of obtaining the data, but in other examples, the order of these processes can be reversed. Furthermore, while the example in Figure 19 shows a case where the audio of the first application program A1 is set to be output, another example is where the audio of the second application program A2 is set to be output. This can be roughly achieved by controlling the system to output the audio of the second application program A2 instead of the audio of the first application program A1, as in the example in Figure 19.

[0121] As described above, in the display system 1 according to this embodiment, when the image processing device 11 can acquire image data of two application programs, such as a first application program A1 and a second application program A2, the display device 12 can display the images of these two image programs side by side. In this case, for example, by transmitting setting information regarding the output source of the audio data to be transferred from the image processing device 11 to the display device 12 from the display device 12, it is possible to switch between the audio corresponding to the image of the first application program A1 and the audio corresponding to the image of the second application program A2.

[0122] As a specific example, the display device 12 receives audio settings in response to user 51's operation, the display device 12 notifies the image processing device 11 of the setting information, the image processing device 11 selects one audio data based on the notification and sends it to the display device 12, and the display device 12 outputs the audio of that audio data.

[0123] Furthermore, in the display system 1 according to this embodiment, the display device 12 can display side by side an image of image data from an application program and an image from the first information processing device 21, such as a computer.

[0124] Here, the technology according to this embodiment will be explained using the configuration shown in Figure 4 as an example. Recently, projectors have been used in configurations that combine them with smart sticks equipped with an operating system as peripheral devices. The smart stick's output video is treated as one of the projector's external inputs via HDMI. The projector and smart stick are also connected via USB for control purposes. On the other hand, smart stick functionality includes a cast receiver function, and for example, casts for multiple standards may be implemented as separate application programs. While the ability to display multiple external inputs on multiple screens is a built-in feature of the projector, it is possible to configure a multi-screen setup that includes, for example, the casting application program inside a smart stick, if we consider it as the source. When configuring multiple screens in this way, it may be necessary to switch which source's audio is output from among the multiple screens.

[0125] For example, in this embodiment, information for realizing the display of multiple types of image combinations is exchanged between the smart stick and the projector via communication, and by switching to display the combination according to the information, it is possible to display any combination of images on multiple screens. In this embodiment, for example, a projector can display images from a first application program and images from a second application program, both input via a smart stick, in a split-screen view. In other words, the projector can display images from different application programs, input from a single source, in a split-screen view. In such cases, in this embodiment, the first application program and the second application program can be switched to output the appropriate application program's audio.

[0126] In this embodiment, for example, it is also possible to display multiple screens side-by-side in a projector, such as by arranging image data acquired from an external source and image data acquired from an application program of the smart stick's OS. Furthermore, in this embodiment, the smart stick's OS and the projector can work together, for example, by coordinating the multi-screen display of application programs on the smart stick's OS with the projector's multi-screen function. In this embodiment, the basic projection function of the projector is utilized, while smart functions are implemented using a smart stick.

[0127] Thus, in this embodiment, including the casting function implemented on the smart stick, it is possible to implement multi-screen functionality for display on the projector while keeping the user operation identical or nearly identical, and it is also possible to switch to output appropriate audio. In this case, on the smart stick side, for example, functions of the application program implemented on the smart stick may be used in addition to the casting function. For example, if a smart stick includes an interactive drawing application program, it is possible to draw pictures or other images on two screens: the image from the drawing application program and the external input to the projector.

[0128] Here are some examples of image combinations to display. One example is a combination of two casts that have detected a signal. In this case, the Smart Stick's OS displays two images from the cast's application program side by side, and the projector displays these two images side by side as a single screen. In this case, the projector notifies the smart stick of the audio selected by the user, and the smart stick outputs the audio of the specified cast application program to the projector.

[0129] Another example involves a combination of a cast that detected a signal and a cast that did not. In this case, the Smart Stick's OS displays the two application program images from the cast side-by-side, but the cast that did not detect a signal displays a black screen. The projector displays the combined image of the two images on a single screen and displays "No Signal" information in the OSD area of ​​the black screen. In this case, if the audio of a cast for which no signal was detected is specified, the smart stick will not output any audio because no audio will be acquired for any of the casts.

[0130] Another example involves a combination of an external input that detects a signal and a cast that also detects a signal. In this case, the smart stick's OS displays the image from the cast's application program in full screen, while the projector displays two screens using the external input and the cast. Here, the external input could be, for example, an input from a computer other than the smart stick. In this case, the projector outputs the audio selected by the user on the projector side.

[0131] Another example involves a combination of an external input that detects a signal and a cast that does not. In this case, the smart stick's OS displays the cast's application program image in full screen, but since no signal was detected, it displays a black screen. The projector displays two screens, one from the external input and one from the cast, and displays "No Signal" information in the OSD area of ​​the cast's black screen. Here, the external input could be, for example, from a computer other than the smart stick. In this case, the projector may, for example, output the audio from the external input. As another example, the projector may output audio selected by the user on the projector side, and may not output any audio if no such audio is available.

[0132] The smart stick and projector notify each other of changes in signal status and the combination of the two screens, and switch to the appropriate display accordingly, thereby enabling various image combinations and appropriate audio output.

[0133] One example is the transition from a first state, which is a combination of a cast where a signal was detected and a cast where no signal was detected, to a second state, which is a combination of a cast where a signal was detected and another cast where a signal was detected. In this case, in the first state, the Smart Stick's OS displays two images from the cast application program side by side, but the cast that did not detect a signal displays a black screen. The projector displays the two images side by side as a single screen and displays "No Signal" information in the OSD area of ​​the black screen. In this case, when the smart stick connects to the cast with "No Signal," it displays images of the application programs of both casts with a signal. This represents a change in the signal state from the first state to the second state. The smart stick notifies the projector that a signal has been detected from the "No Signal" cast. Upon receiving this notification, the projector will disable the "No Signal" OSD. If, in the first state, the projector was outputting the audio of a cast whose signal was detected, then, for example, when transitioning from the first state to the second state, the projector will ask the user whether to switch to outputting the audio of a cast that has recovered from a state where no signal was detected to a state where a signal was detected. If the user responds by switching to outputting the audio of the recovered cast, the projector notifies the smart stick of the audio output source selected by the user. The smart stick sends the audio of the notified source to the projector. As a result, the audio of the application program of the selected cast is output.

[0134] As another example, in the case of a combination of an external input where a signal was detected and a cast where no signal was detected, the projector will perform a dual-screen setup selecting the external input and the cast. In other words, the dual-screen function will set up a dual-screen setup using the smart stick and the external input. The projector instructs the smart stick to display one cast application program. The smart stick, in response to this instruction, will display the image of one cast application program in full screen. In this case, since the projector does not detect the signal from the casting application program on the smart stick, it may output, for example, audio from an external input. Alternatively, the projector may output audio selected by the user on the projector side, and may not output such audio if it is not acquired.

[0135] An example configuration according to this embodiment is shown. The display system 1 according to this embodiment includes an image processing device 11 and a display device 12. The image processing device 11 includes a first acquisition unit 111 that acquires first image data from a first application program A1, and a second acquisition unit 112 that acquires second image data from a second application program A2. The display device 12 includes a first communication unit 211 to which the image processing device 11 is connected by wire, a second communication unit 212 to which the first information processing device 21 is connected by wire or wireless, a reception unit 213 that receives a first request to display multiple images side by side in the display area 31, a setting information acquisition unit 217 that acquires audio output setting information, an image display unit 215 that displays images in the display area 31, and an audio output unit 216 that outputs audio. When the image display unit 215 displays the first image data and the second image data side by side in the display area 31, the image processing device 11 outputs the first audio data acquired from the first application program A1 or the second audio data acquired from the second application program A2 to the display device 12 based on the audio output setting information, and the audio output unit 216 outputs the first audio data or the second audio data acquired from the image processing device 11. When the image display unit 215 displays the first image data and the fourth image data acquired from the first information processing device 21 side by side in the display area 31, the audio output unit 216 outputs either the first audio data acquired from the image processing device 11 or the fourth audio data acquired from the first information processing device 21, based on the audio output setting information.

[0136] Therefore, in the display system 1 according to this embodiment, when image data of multiple application programs is transferred from the image processing device 11 connected to the display device 12 to the display device 12, and these image data images are displayed in a divided manner on the screen of the display device 12, interference from audio data can be suppressed. Thus, in the display system 1 according to this embodiment, when the input image data is divided and displayed for each application program function, interference with audio data is suppressed and appropriate audio data can be output.

[0137] Here, for example, the first acquisition unit 111 may acquire first image data and first audio data from the first application program A1. Furthermore, for example, the second acquisition unit 112 may acquire second image data and second audio data from the second application program A2. Furthermore, for example, the first communication unit 211 may acquire image data and audio data from the image processing device 11. The image data may be, for example, image data in which the first image data and the second image data are arranged side by side. The audio data may be, for example, either the first audio data or the second audio data. Furthermore, for example, the second communication unit 212 may acquire the fourth image data and the fourth audio data from the first information processing device 21.

[0138] As a specific example, when the image display unit 215 displays the first image data and the second image data side by side in the display area 31, and the output of the first audio data of the first application program A1 is set in the audio output setting information, the image processing device 11 outputs the first audio data to the display device 12, and the audio output unit 216 outputs the first audio data acquired from the image processing device 11. On the other hand, when the image display unit 215 displays the first image data and the second image data side by side in the display area 31, and the output of the second audio data of the second application program A2 is set in the audio output setting information, the image processing device 11 outputs the second audio data to the display device 12, and the audio output unit 216 outputs the second audio data acquired from the image processing device 11.

[0139] As a specific example, when the image display unit 215 displays the first image data and the fourth image data side by side in the display area 31, and the output of the first audio data of the first application program A1 is set in the audio output setting information, the image processing device 11 outputs the first audio data to the display device 12, and the audio output unit 216 outputs the first audio data acquired from the image processing device 11. On the other hand, when the image display unit 215 displays the first image data and the fourth image data side by side in the display area 31, if the output of the fourth audio data is set in the audio output setting information, the audio output unit 216 outputs the fourth audio data acquired from the first information processing device 21.

[0140] Here, as an example, the image processing device 11, display device 12, display area 31, and first information processing device 21 may be a smart stick, projector, screen or display, or computer, respectively. The computer may be, for example, a smartphone or tablet.

[0141] The display system 1 according to this embodiment has the following configuration. When the image display unit 215 displays the first image data and the second image data side by side in the display area 31, the image processing device 11 acquires audio output setting information from the display device 12, determines whether there is a signal related to the first application program, and determines whether there is a signal related to the second application program. The image processing device 11 detects a signal related to the second application program, and if it does not detect a signal related to the first application program, it outputs the second audio data to the display device 12.

[0142] Therefore, in the display system 1 according to this embodiment, for example, the image processing device 11 can determine whether or not to accept signals from each application program, thereby preventing the selection of audio output from application programs for which signals cannot be detected.

[0143] In this example, for example, even when the audio output setting information is set to output the first audio data of the first application program A1, or when the audio output setting information is set to output the second audio data of the second application program A2, the image processing device 11 may detect a signal related to the second application program, and if it does not detect a signal related to the first application program, it may output the second audio data to the display device 12.

[0144] As another example, when the audio output setting information is set to output the first audio data of the first application program A1, the image processing device 11 may detect a signal related to the second application program, and if it does not detect a signal related to the first application program, it may not output the audio data to the display device 12, or the display device 12 may inquire with the user 51 about the audio data to be output.

[0145] The display system 1 according to this embodiment has the following configuration. When the image display unit 215 displays the first image data and the second image data side by side in the display area 31, the image processing device 11 determines whether there is a signal related to the first application program A1 and whether there is a signal related to the second application program A2. If the image processing device 11 detects a signal related to the second application program A2 but does not detect a signal related to the first application program A1, the image display unit 215 notifies that a signal related to the first application program A1 cannot be detected in the first image display area of ​​the first image data.

[0146] Therefore, in the display system 1 according to this embodiment, the image processing device 11 determines whether or not signals from each application program can be input, and notifies the user in the display area of ​​the application program for which a signal cannot be detected. As a result, the display system 1 can, for example, guide the user 51 not to select audio data from an application program for which a signal cannot be detected.

[0147] Here, one possible method for notifying the system of no signal detection on the screen is to display information from predetermined OSD data. The predetermined OSD data may be, for example, message information such as "No Signal". Alternatively, instead of the image where no signal is detected, the first predetermined image data C1 may be used. The first predetermined image data C1 may be, for example, data of a monochrome image such as black, or data of another image. The OSD data indicating that no signal related to the first application program A1 has been detected is, for example, information indicating that no image data has been acquired. For example, the OSD data may be data indicating that the second information processing device 22 and the image processing device 11 are connected but not mirroring.

[0148] The display system 1 according to this embodiment has the following configuration. When the image display unit 215 displays the first image data and the fourth image data side by side in the display area 31, the display device 12 acquires the presence or absence of a signal related to the first application program A1 determined by the image processing device 11, and determines the presence or absence of the fourth image data. If the display device 12 acquires the fourth image data and the image processing device 11 has not detected any signals related to the first application program A1, the image display unit 215 notifies that no signals related to the first application program A1 can be detected in the first image display area of ​​the first image data.

[0149] Therefore, in the display system 1 according to this embodiment, the image processing device 11 determines whether or not signals from each application program can be input, and notifies the user in the display area of ​​the application program for which a signal cannot be detected. As a result, the display system 1 can, for example, guide the user 51 not to select audio data from an application program for which a signal cannot be detected. The first image display area is, for example, a display area within the display area 31 that is allocated for displaying the first image data.

[0150] Here, one possible method for notifying the system of no signal detection on the screen is to display information from predetermined OSD data. The predetermined OSD data may be, for example, message information such as "No Signal". Alternatively, instead of the image where no signal is detected, the first predetermined image data C1 may be used. The first predetermined image data C1 may be, for example, data of a monochrome image such as black, or data of another image. The OSD data indicating that no signal related to the first application program A1 has been detected is, for example, information indicating that no image data has been acquired. For example, the OSD data may be data indicating that the second information processing device 22 and the image processing device 11 are connected but not mirroring.

[0151] The display system 1 according to this embodiment has the following configuration. When the image display unit 215 displays the first image data and the second image data side by side in the display area 31, the image processing device 11 acquires audio output setting information from the display device 12, determines whether there is a signal related to the first application program A1, and determines whether there is a signal related to the second application program A2. When the image processing device 11 detects a signal related to the second application program A2 and does not detect a signal related to the first application program A1, and the second audio data is set as audio output setting information, if the image display unit 215 detects a signal related to the first application program A1, it notifies the user whether or not to change the audio output setting information.

[0152] Therefore, in the display system 1 according to this embodiment, for example, when a signal related to the first application program A1 is restored, information indicating that the signal has been detected is notified to the user 51, thereby guiding the user 51 to select the audio data of the application program they wish to select. Here, such notifications may be made, for example, by the voice setting notification screen Ge, which is OSD data for voice switching shown in Figure 11.

[0153] As another example, in the display system 1, when the second audio data is set as audio output setting information and a signal related to the first application program A1 is restored, the system may switch from a state in which the second audio data is being output to a state in which the first audio data of the first application program A1 is being output, without contacting the user 51.

[0154] Furthermore, an example configuration according to this embodiment is shown. The display system 1 according to this embodiment may have the following configuration. The image processing device 11 stores the first predetermined image data C1. When the image display unit 215 displays the first image data and the second image data side by side in the display area 31, and the first acquisition unit 111 has not detected any signals related to the first application program A1, the image processing device 11 generates a third image data based on the first predetermined image data C1 and the second image data. The image display unit 215 displays the image of the sixth image data generated based on the third image data and OSD data indicating that no signals related to the first application program have been detected in the display area 31.

[0155] In this case, if the output of the first audio data of the first application program A1 is set, for example, a configuration may be used in which the audio output unit 216 does not output audio data because the first audio data has not been acquired by the first acquisition unit 111, or a configuration may be used in which the audio output unit 216 outputs the second audio data because the second audio data has been acquired by the second acquisition unit 112, even though the first audio data has not been acquired by the first acquisition unit 111. On the other hand, if the output of the second audio data of the second application program A2 is configured, for example, since the second audio data has been acquired by the second acquisition unit 112, the audio output unit 216 outputs the second audio data.

[0156] Therefore, in the display system 1 according to this embodiment, if a signal cannot be detected from one of the multiple application programs, the OSD function of the display device 12 adds and displays predetermined OSD data, allowing the user 51 to determine, for example, whether the display device 12 is faulty or whether the signal has not been detected. Furthermore, in such cases, the display system 1 according to this embodiment can be controlled to output appropriate audio data.

[0157] Here, the specified OSD data may be, for example, message information such as "No Signal". Furthermore, the first predetermined image data C1 may be, for example, data of a monochrome image such as black, or data of another image. For example, when the image processing device 11 acquires image data of two casts, there may be cases where the signal for the image data of one of the casts is not detected.

[0158] The display system 1 according to this embodiment may have the following configuration. At least one of the image processing device 11 or the display device 12 stores a second predetermined image data D2. When the image display unit 215 displays the first image data and the fourth image data side by side in the display area 31, and the first acquisition unit 111 has not detected any signals related to the first application program, the image display unit 215 displays an image of the seventh image data generated based on the second predetermined image data D2, OSD data indicating that no signals related to the first application program have been detected, and the fourth image data in the display area 31.

[0159] In this case, if the output of the first audio data of the first application program A1 is set, for example, a configuration may be used in which the audio output unit 216 does not output audio data because the first audio data has not been acquired by the first acquisition unit 111, or a configuration may be used in which the audio output unit 216 outputs the fourth audio data because the fourth audio data has been acquired by the second communication unit 212, even though the first audio data has not been acquired by the first acquisition unit 111. On the other hand, if the system is configured to output the fourth audio data, for example, since the fourth audio data has been acquired by the second communication unit 212, the audio output unit 216 outputs the fourth audio data.

[0160] Therefore, in the display system 1 according to this embodiment, if a signal from the application program specified by the user 51 cannot be detected, the OSD function of the display device 12 adds and displays predetermined OSD data, allowing the user 51 to determine, for example, whether the display device 12 is malfunctioning or whether the signal has not been detected. Furthermore, in such cases, the display system 1 according to this embodiment can be controlled to output appropriate audio data.

[0161] Here, the specified OSD data may be, for example, message information such as "No Signal". Furthermore, the second predetermined image data D2 may be, for example, data of a monochrome image such as black, or data of another image. For example, when the image processing device 11 acquires image data of a single cast, there may be cases where the signal for the image data of that cast is not detected.

[0162] The second predetermined image data D2 may be stored, for example, by the image processing device 11, or by the display device 12, or by both. When the image processing device 11 stores the second predetermined image data D2, for example, the image processing device 11 transfers the second predetermined image data D2 to the display device 12. On the other hand, when the display device 12 stores the second predetermined image data D2, for example, the display device 12 uses the second predetermined image data D2 as the first image data. In a configuration where the image processing device 11 stores a first predetermined image data C1 and a second predetermined image data D2, for example, these data may be common data or they may be separate data.

[0163] The display system 1 according to this embodiment may have the following configuration. The first communication unit 211 includes a first image transfer unit 231 that transfers image data between the image processing device 11 and the display device 12, and a first signal communication unit 232 that communicates signals between the image processing device 11 and the display device 12.

[0164] Therefore, in the display system 1 according to this embodiment, the first communication unit 211 has a first signal communication unit 232, which allows, for example, the image processing device 11 to transmit to the display device 12 that no signal has been detected. Furthermore, in the display system 1 according to this embodiment, the first signal communication unit 232 can notify the image processing device 11 of setting information related to audio output from the display device 12. Here, the first image transfer unit 231 may be composed of, for example, HDMI. The first image transfer unit 231 may, for example, transfer audio data along with image data. Furthermore, the first signal communication unit 232 may be composed of, for example, a USB.

[0165] The display system 1a according to this embodiment has the following configuration. The first image processing device 11a stores the first application program A1. The first image processing device 11a starts the first application program A1 during the period in which the image of the first image data is displayed in the display area 31. Note that the a-th display system 1a and the a-th image processing device 11a may be any embodiment of the display system 1 and the image processing device 11.

[0166] Therefore, in the display system 1 according to this embodiment, if the first acquisition unit 111 is not selected as the input source, the processing load on the a-th image processing device 11a can be reduced by not starting the first application program A1. The first image processing device 11a starts the first application program A1 only when, for example, the display device 12 requests the display of an image from the first application program A1.

[0167] The display system 1 according to this embodiment has the following configuration. The display system 1 includes a second information processing device 22. The second information processing device 22 stores the first application program A1 and is connected to the image processing device 11 via the first acquisition unit 111. The signals related to the first application program A1 are the signals of the first image data and the first audio data transferred from the second information processing device 22. OSD data indicating that no signal related to the first application program A1 has been detected indicates that no image data has been acquired.

[0168] Therefore, in the display system 1 according to this embodiment, for example, user 51 can determine, based on the screen of the display area 31, whether the second information processing device 22 and the image processing device 11 are not connected, or whether an image has not been transferred from the second information processing device 22 to the image processing device 11. Here, the OSD data may, for example, be data indicating that the second information processing device 22 and the image processing device 11 are connected but not mirroring.

[0169] A program for realizing the function of any component in any of the devices described above may be recorded on a computer-readable recording medium, and the program may be loaded into a computer system and executed. Here, "computer system" includes the operating system and hardware such as peripheral devices. "Computer-readable recording medium" refers to portable media such as flexible disks, magneto-optical disks, ROM (Read Only Memory), CD (Compact Disc)-ROMs, and storage devices such as hard disks built into the computer system. "Computer-readable recording medium" also includes volatile memory within a computer system that acts as a server or client when a program is transmitted via a network such as the Internet or a communication line such as a telephone line, which retains the program for a certain period of time. Such volatile memory may be RAM. The recording medium may also be a non-temporary recording medium.

[0170] The above program may be transmitted from a computer system that stores this program in a memory device or the like to another computer system via a transmission medium, or by transmission waves within the transmission medium. The "transmission medium" used to transmit the program refers to a medium that has the function of transmitting information, such as a network like the Internet or a communication line like a telephone line. The above program may be intended to implement some of the functions described above. The above program may also be a so-called differential file, capable of implementing the aforementioned functions in combination with programs already recorded in the computer system. A differential file may also be called a differential program.

[0171] The functions of any component in any device described above may be implemented by a processor. Each process in the embodiment may be implemented by a processor that operates based on information such as a program, and a computer-readable recording medium that stores information such as a program. The functions of each part of the processor may be implemented by separate hardware, or the functions of each part may be implemented by integrated hardware. The processor includes hardware, and the hardware may include at least one of a circuit that processes digital signals and a circuit that processes analog signals. The processor may be configured using one or more circuit devices or one or both of one or more circuit elements mounted on a circuit board. ICs (Integrated Circuits) may be used as circuit devices, and resistors or capacitors may be used as circuit elements.

[0172] The processor may be a CPU. However, the processor is not limited to a CPU; various types of processors such as a GPU (Graphics Processing Unit) or a DSP (Digital Signal Processor) may be used. The processor may be a hardware circuit using an ASIC (Application Specific Integrated Circuit). The processor may consist of multiple CPUs, or it may consist of hardware circuits using multiple ASICs. The processor may consist of a combination of multiple CPUs and hardware circuits using multiple ASICs. The processor may include one or more amplifier circuits or filter circuits that process analog signals.

[0173] Although embodiments have been described in detail above with reference to the drawings, the specific configuration is not limited to these embodiments and includes designs and the like that do not depart from the gist of this disclosure.

[0174] [Summary of this disclosure] A summary of this disclosure is provided below. (Note 1) A display system comprising an image processing device and a display device, The aforementioned image processing device is A first acquisition unit that acquires first image data from a first application program, A second acquisition unit that acquires second image data from a second application program, Equipped with, The aforementioned display device is The image processing device is connected by a wire to a first communication unit, A second communication unit connected to the first information processing device by wire or wireless, A reception unit that receives a first request to display multiple images side by side in the display area, A setting information acquisition unit that acquires audio output setting information, An image display unit that displays an image in the aforementioned display area, Audio output section that outputs sound, Equipped with, When the image display unit displays the first image data and the second image data side by side in the display area, the image processing device outputs the first audio data acquired from the first application program or the second audio data acquired from the second application program to the display device based on the audio output setting information, and the audio output unit outputs the first audio data or the second audio data acquired from the image processing device. When the image display unit displays the first image data and the fourth image data acquired from the first information processing device side by side in the display area, the audio output unit outputs the first audio data acquired from the image processing device or the fourth audio data acquired from the first information processing device based on the audio output setting information. Display system. This makes it possible to suppress interference from audio data when transferring image data from multiple application programs from an image processing device connected to a display device to the display device, and when displaying these image data images in a split view on the display device's screen.

[0175] (Note 2) When the image display unit displays the first image data and the second image data side by side in the display area, The aforementioned image processing device is The aforementioned audio output setting information is obtained from the display device, Determine whether or not there is a signal related to the first application program, Determine whether or not there is a signal related to the second application program, The system detects a signal related to the second application program, and if no signal related to the first application program is detected, it outputs the second audio data to the display device. The display system described in (Appendix 1). This allows, for example, the image processing device to determine whether or not it can receive signals from each application program, thereby preventing it from selecting audio output from application programs that cannot detect a signal.

[0176] (Note 3) When the image display unit displays the first image data and the second image data side by side in the display area, The image processing device determines whether there is a signal related to the first application program, and determines whether there is a signal related to the second application program. If the image processing device detects a signal related to the second application program but does not detect a signal related to the first application program, the image display unit notifies that a signal related to the first application program cannot be detected in the first image display area of ​​the first image data. The display system described in (Appendix 1) or (Appendix 2). This allows the image processing device to determine whether or not signals can be input from each application program, and to notify the user in the display area of ​​application programs for which signals cannot be detected. This allows, for example, the user to be guided not to select audio data from application programs for which signals cannot be detected.

[0177] (Note 4) When the image display unit displays the first image data and the fourth image data side by side in the display area, The display device acquires the presence or absence of a signal related to the first application program determined by the image processing device, and determines the presence or absence of the fourth image data. If the display device acquires the fourth image data and the image processing device does not detect a signal related to the first application program, the image display unit notifies that a signal related to the first application program cannot be detected in the first image display area of ​​the first image data. The display system described in any one of the following (Appendix 1) to (Appendix 3). This allows the image processing device to determine whether or not signals can be input from each application program, and to notify the user in the display area of ​​application programs for which signals cannot be detected. This allows, for example, the user to be guided not to select audio data from application programs for which signals cannot be detected.

[0178] (Note 5) When the image display unit displays the first image data and the second image data side by side in the display area, The image processing device acquires the audio output setting information from the display device, determines whether there is a signal related to the first application program, and determines whether there is a signal related to the second application program. When the image processing apparatus detects a signal related to the second application program and does not detect a signal related to the first application program, and when a signal related to the first application program is detected in a situation where the second audio data is set as the audio output setting information, the image display unit notifies information indicating whether to change the audio output setting information. The display system according to any one of (Appendix 1) to (Appendix 4). Thereby, for example, by notifying the user of information indicating that a returned signal has been detected, the user can be guided to select the audio data of the application program to be selected.

Explanation of Signs

[0179] 1…Display system, 1a…Display system a…Display system a…Image processing device, 11a…Image processing device a…Smart stick, 12…Display device, 12A…Projector, 21…First information processing device, 21A…First computer, 22…Second information processing device, 23…Third information processing device, 31…Display area, 51…User, 111…First acquisition unit, 112…Second acquisition unit, 113…Third communication unit, 114…First storage unit, 115…First judgment unit, 116…First image processing unit, 131…Second image transfer unit, 132…Second signal communication unit, 211…First communication unit, 212…Second communication unit, 212A…Second HDMI, 213…Reception unit, 214…Second storage unit, 215…Image display unit, 216…Audio output unit, 217…Setting information acquisition unit ,231...First image transfer unit, 231A...First HDMI, 232...First signal communication unit, 232A...First USB, 251...OSD display unit, A1...First application program, A2...Second application program, B1...First communication channel, B2...Second communication channel, B3...Third communication channel, B4...Fourth communication channel, B5...Fifth communication channel, C1...First predetermined image data, D1...First OSD data, D2...Second predetermined image data, F1...First setting screen, F2...Second setting screen, F2a...Second a setting screen, F3...Third setting screen, GA...A image, GB...B image, GC...C image, Ga...A image, Gb...B image, Gc...C image, Gd...D image, Ge...Voice setting notification screen, H1...First predetermined color image, K1...First OSD information

Claims

1. A display system comprising an image processing device and a display device, The aforementioned image processing device is A first acquisition unit that acquires first image data from a first application program, A second acquisition unit that acquires second image data from a second application program, Equipped with, The aforementioned display device is The image processing device is connected by a wire to a first communication unit, A second communication unit connected to the first information processing device by wire or wireless means, A reception unit that receives a first request to display multiple images side by side in the display area, A setting information acquisition unit that acquires audio output setting information, An image display unit that displays an image in the aforementioned display area, Audio output section that outputs sound, Equipped with, When the image display unit displays the first image data and the second image data side by side in the display area, the image processing device outputs the first audio data obtained from the first application program or the second audio data obtained from the second application program to the display device based on the audio output setting information, and the audio output unit outputs the first audio data or the second audio data obtained from the image processing device. When the image display unit displays the first image data and the fourth image data acquired from the first information processing device side by side in the display area, the audio output unit outputs the first audio data acquired from the image processing device or the fourth audio data acquired from the first information processing device based on the audio output setting information. Display system.

2. When the image display unit displays the first image data and the second image data side by side in the display area, The aforementioned image processing device is The aforementioned audio output setting information is obtained from the display device, Determine whether or not there is a signal related to the first application program, Determine whether or not there is a signal related to the second application program, The system detects a signal related to the second application program, and if no signal related to the first application program is detected, it outputs the second audio data to the display device. The display system according to claim 1.

3. When the image display unit displays the first image data and the second image data side by side in the display area, The image processing device determines whether there is a signal related to the first application program, and determines whether there is a signal related to the second application program. If the image processing device detects a signal related to the second application program but does not detect a signal related to the first application program, the image display unit notifies that a signal related to the first application program cannot be detected in the first image display area of ​​the first image data. The display system according to claim 1.

4. When the image display unit displays the first image data and the fourth image data side by side in the display area, The display device acquires the presence or absence of a signal related to the first application program determined by the image processing device, and determines the presence or absence of the fourth image data. If the display device acquires the fourth image data and the image processing device does not detect a signal related to the first application program, the image display unit notifies that a signal related to the first application program cannot be detected in the first image display area of ​​the first image data. The display system according to claim 1.

5. When the image display unit displays the first image data and the second image data side by side in the display area, The image processing device acquires the audio output setting information from the display device, determines whether there is a signal related to the first application program, and determines whether there is a signal related to the second application program. When the image processing device detects a signal relating to the second application program and does not detect a signal relating to the first application program, and the second audio data is set as the audio output setting information, if the image display unit detects a signal relating to the first application program, the image display unit notifies information indicating whether or not to change the audio output setting information. The display system according to claim 1.

Images