Video processing apparatus and control method of video processing apparatus

The video processing device dynamically adjusts display sizes and positions of multiple regions on separate devices, addressing the need for prior size determination in conventional systems and enhancing visibility.

JP2026030310APending Publication Date: 2026-02-20SHARP KK
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2024133207
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-08-08
Publication Date
2026-02-20

AI Technical Summary

Technical Problem

Conventional video processing technologies require determining the display size of each area in advance when displaying multiple regions of a screen on separate display devices.

Method used

A video processing device that includes a detection unit to identify multiple regions from an input video and a video output control unit to control the output of these regions to different display devices, allowing for dynamic adjustment of display sizes without prior determination.

Benefits of technology

Enables the display of each region on a separate display device without pre-determining its size, improving visibility by optimizing the display size and position of each area based on the screen characteristics of the respective device.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2026030310000001_ABST
    Figure 2026030310000001_ABST
Patent Text Reader

Abstract

To provide a video processing apparatus for displaying respective areas separated from an input video image on separate display devices without the need for determining the display size of each area in advance.SOLUTION: A video processing device includes a detection unit that detects a plurality of regions from an input video, and a video output control unit that performs control to output videos of the plurality of detected regions to different display devices.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present disclosure relates to a video processing device and the like. [Background technology]

[0002] When displaying video on a display device, there has been a conventional technique for displaying multiple regions of a screen displayed on a single display device on separate display devices. For example, Patent Document 1 discloses a multi-monitor display that receives video data configured for a single N×M video display, separates the video data into multiple N×M parts, and transmits the multiple parts to corresponding multiple displays. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Special Publication No. 2012-515367 Summary of the Invention [Problem to be solved by the invention]

[0004] Conventionally, this type of technology involves dividing a screen into multiple areas, determining the display size of each area, and then displaying each area on a separate display device. Therefore, with conventional technology, it was necessary to determine the display size of each area in advance.

[0005] The problem to be solved by the present disclosure is to provide a video processing device that displays each region separated from an input video on a separate display device without the need to determine in advance the display size of each region. [Means for solving the problem]

[0006] The present disclosure provides a video processing device including a detection unit that detects multiple regions from an input video, and a video output control unit that controls the output of the detected images of the multiple regions to different display devices.

[0007] The present disclosure also provides a control method for a video processing device that performs video analysis on an input video to detect a plurality of regions, and synthesizes an output video in which the arrangement of the detected plurality of regions is changed from the input video. [Effects of the Invention]

[0008] According to the present disclosure, it is possible to provide a video processing device that displays each area separated from an input video on a separate display device without the need to determine the display size of each area in advance. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a schematic diagram for explaining a video display system according to a first embodiment of the present disclosure. [Figure 2] 1 is a functional block diagram of a video division device according to a first embodiment of the present disclosure. [Figure 3] FIG. 2 is a diagram for explaining the software configuration of the video dividing device according to the first embodiment of the present disclosure. [Figure 4] 4 is a flowchart for explaining the operation of the video division device according to the first embodiment of the present disclosure. [Figure 5] FIG. 2 is a schematic diagram for explaining video division by the video division device according to the first embodiment of the present disclosure. [Figure 6] FIG. 10 is a schematic diagram for explaining a video display system according to a second embodiment of the present disclosure. [Figure 7] FIG. 10 is a functional block diagram of a video division device according to a second embodiment of the present disclosure. [Figure 8] FIG. 10 is a diagram for explaining the software configuration of a video dividing device according to a second embodiment of the present disclosure. [Figure 9] 10 is a flowchart for explaining the operation of the video division device according to the second embodiment of the present disclosure. [Figure 10] FIG. 10 is a schematic diagram for explaining video division by a video division device according to a second embodiment of the present disclosure. [Figure 11] FIG. 11 is a schematic diagram for explaining division of a video by a video division device according to a third embodiment of the present disclosure. [Figure 12] 10 is a flowchart for explaining the operation of the video division device according to the fourth embodiment of the present disclosure. [Figure 13] FIG. 10 is a schematic diagram for explaining division of a video by a video division device according to a fourth embodiment of the present disclosure. [Figure 14] 13 is a flowchart for explaining the operation (first half) of the video dividing device according to the fifth embodiment of the present disclosure. [Figure 15] 13 is a flowchart for explaining the operation (second half) of the video dividing device according to the fifth embodiment of the present disclosure. [Figure 16] FIG. 13 is a schematic diagram for explaining video output by a video division device according to a fifth embodiment of the present disclosure. [Figure 17] FIG. 13 is a schematic diagram for explaining division of a video by a video division device according to a fifth embodiment of the present disclosure. [Figure 18] FIG. 10 is a schematic diagram for explaining a video display system according to a sixth embodiment of the present disclosure. [Figure 19] FIG. 13 is a functional block diagram of a video output device according to a sixth embodiment of the present disclosure. [Figure 20] FIG. 13 is a functional block diagram of a mobile terminal according to a sixth embodiment of the present disclosure. [Figure 21] FIG. 13 is a diagram for explaining the software configuration of a mobile terminal according to a sixth embodiment of the present disclosure. [Figure 22] 13 is a flowchart for explaining the operation (second half) of the mobile terminal according to the sixth embodiment of the present disclosure. [Figure 23] FIG. 13 is a schematic diagram for explaining video output by a mobile terminal according to a sixth embodiment of the present disclosure. [Figure 24] FIG. 13 is a diagram for explaining the software configuration of a video dividing device according to a seventh embodiment of the present disclosure. [Figure 25] 13 is a flowchart for explaining the operation of the video division device according to the seventh embodiment of the present disclosure. [Figure 26] FIG. 20 is a schematic diagram for explaining an operation of distinguishing between area 1 and area 2 from an image in a video division device according to a seventh embodiment of the present disclosure. [Figure 27] FIG. 20 is a schematic diagram for explaining the operation when the range of area 1 and the range of the video are changed in the video dividing device according to the seventh embodiment of the present disclosure. [Figure 28] 28(a) is a schematic diagram illustrating the operation of a video division device according to the seventh embodiment of the present disclosure when the range of region 1 and the range of the video are not changed, where FIG. 28(a) is a diagram showing the state in which the input video is divided into region 1 and region 2, FIG. 28(b) is a diagram showing the state in which region 1 and region 2 are divided into unit regions, and FIG. 28(c) is a diagram showing the video output as region 1 and region 2. DETAILED DESCRIPTION OF THE INVENTION

[0010] [1. First embodiment] [1.1 Overall structure] 1 is a schematic diagram for explaining a video display system 1 according to a first embodiment of the present disclosure. The video display system 1 includes a video output device 3, a video division device 5, and display devices 7 and 9.

[0011] The video output device 3 is a device that outputs still images or moving images. In the first embodiment, the video output device 3 is a video game device. The video splitting device 5 is a video processing device that detects two areas from the video input from the video output device 3 and outputs the images of the two areas to the display devices 7 and 9, respectively. The display devices 7 and 9 are display devices. There are no limitations on the method by which the display devices 7 and 8 display images. The display devices 7 and 9 may be, for example, a liquid crystal display device, an organic EL (Electro-Luminescence) device, or a CRT (Cathode Ray Tube).

[0012] 2 is a functional block diagram of a video division device 5 according to the first embodiment of the present disclosure. The video division device 5 includes a control unit 11, a storage unit 13, an input unit 15, a first output unit 17, and a second output unit 19.

[0013] The control unit 11 controls the entire video splitting device 5. The control unit 11 realizes various functions by reading and executing various programs stored in the storage unit 13. The control unit 11 may be realized by one or more control devices / arithmetic units (CPU (Central Processing Unit), SoC (System on a Chip)). The control unit 11 may also be configured by a control circuit.

[0014] The storage unit 13 is a storage device that stores various programs and various data necessary for the operation of the video splitting device 5. The storage unit 13 includes one or more recording devices capable of temporary storage, such as a dynamic random access memory (DRAM), and non-temporary recording devices, such as a solid state drive (SSD) configured with semiconductor memory or a hard disk drive (HDD) configured with a magnetic disk. For convenience of explanation, the storage unit 13 is shown as a single unit, but it may also be configured as separate devices for each purpose, such as an area used for executing programs (main storage area), an area for saving programs and data (auxiliary storage area), an area used for caching, etc.

[0015] The input unit 15 is an interface for connecting the video splitting device 5 to the video output device 3 and inputting video from the video output device 3. For example, the input unit 15 is an HDMI (High-Definition Multimedia Interface, registered trademark). Alternatively, the input unit 15 may be another interface, such as a DVI (Digital Visual Interface), a DisplayPort, or a USB (Universal Serial Bus).

[0016] The first output unit 17 is an interface for connecting the video splitting device 5 to the display device 7 and outputting a video signal to the display device 7. The second output unit 19 is an interface for connecting the video splitting device 5 to the display device 9 and outputting a video signal to the display device 9. For example, the first output unit 17 and the second output unit 19 are HDMI, DVI, DisplayPort, or USB.

[0017] [1.2 Software Configuration] 3 is a diagram for explaining the software configuration of the video division device 5 according to the first embodiment of the present disclosure. The control unit 11 reads and executes programs stored in advance in the storage unit 13, thereby operating as a video input unit 31, a detection unit 33, an analysis unit 35, a comparison unit 37, a scaling unit 39, and a video output control unit 41.

[0018] The video input unit 31 receives video from the video output device 3 using the input unit 15 and stores it in an input buffer 51 (described later). The detection unit 33 detects, from the received video, an area 1 corresponding to the screen to be displayed on the display device 7 and an area 2 corresponding to the screen to be displayed on the display device 9. The analysis unit 35 analyzes area 1 and area 2 and extracts their respective luminance and RGB values. The comparison unit 37 determines whether there is a difference between area 1 and area 2 based on the luminance and RGB values ​​extracted by the analysis unit 35. The scaling unit 39 enlarges or reduces the video of area 1 based on the first output setting and stores it in an output buffer 53 (described later). The first output setting is setting information related to the video to be output from the first output unit 17. The first output setting includes, for example, the number of pixels in both the vertical and horizontal directions of the screen of the display device 7, the screen size, and the aspect ratio. The scaling unit 39 also enlarges or reduces the video of area 2 based on the second output setting and stores it in an output buffer 53 (described later). The second output setting is setting information related to the video to be output from the second output unit 19. The second output setting includes, for example, the number of pixels in both the vertical and horizontal directions of the screen of the display device 9, the screen size, the aspect ratio, etc. The video output control unit 41 outputs the video related to area 1 stored in the output buffer 53 to the display device 7 using the first output unit 17. In addition, the video output control unit 41 outputs the video related to area 2 stored in the output buffer 53 to the display device 9 using the second output unit 19.

[0019] The storage unit 13 stores a program executed by the control unit 11. The storage unit 13 also has an input buffer 51, an output buffer 53, a first output setting storage unit 55, and a second output setting storage unit 57 as storage areas. The input buffer 51 stores video received by the video input unit 31. The output buffer 53 stores video of areas 1 and 2 scaled by the scaling unit 39. The first output setting storage unit 55 stores the first output setting. The second output setting storage unit 57 stores the second output setting.

[0020] [1.3 Operation] The operation of the video display system 1 will be described, focusing on the video division device 5. Fig. 4 is a flowchart for explaining the operation of the video division device 5 according to the first embodiment of the present disclosure.

[0021] The control unit 11 waits for video to be input from the video output device 3 via the input unit 15 (step S1, No), and when video is input (step S1, Yes), the control unit 11 divides the video into a grid and stores it in the input buffer 51 (step S3). The grid can be formed by arranging unit cells vertically and horizontally, the number of which corresponds to the aspect ratio of the video input from the input unit 15. For example, if the aspect ratio of the video input from the input unit 15 is 16:9, the video is divided into unit cells of 16 squares horizontally and 9 squares vertically.

[0022] Next, the control unit 11 performs video analysis on the video stored in the input buffer 51, extracts brightness and RGB values, and distinguishes between region 1 and region 2 based on the extracted brightness and RGB values ​​(step S5). Region 1 is the center of the video (hereinafter referred to as the center video), and region 2 is the peripheral portion of the video (hereinafter referred to as the peripheral video). Region 1 is also referred to as the first region, and region 2 is also referred to as the second region. The peripheral video is a region outside the center video, such as the region below the center video, but it may also be a region above, to the right, or to the left, etc., of the center video. In this embodiment, the video output device 3 is a video game device. Generally, in video games, main information about the video game is displayed in the center video, and additional information is often displayed in the peripheral video. For this reason, in this embodiment, the center video and the peripheral video are referred to as regions 1 and 2, respectively.

[0023] Next, the control unit 11 analyzes the image of region 1 to extract brightness and RGB values ​​(step S7). Similarly, the control unit 11 analyzes the image of region 2 to extract brightness and RGB values ​​(step S9). The image analysis in step S5 targets the entire screen and is performed to divide the entire screen into regions 1 and 2, whereas the image analysis in step S11 targets regions 1 and 2 individually and is performed to determine the difference between the regions in the subsequent step S11. It is preferable that the algorithms used for the image analysis in steps S5 and S11 are different. Next, the control unit 11 determines whether there is a difference between region 1 and region 2 based on the analysis results in steps S7 and S9 (step S11). If there is no difference between regions 1 and 2 (step S11, No), the control unit 11 returns to step S1.

[0024] If there is a difference between areas 1 and 2 (step S11, Yes), control unit 11 cuts out the image of the central area image (area 1), scales the cut-out image, and then places it in output buffer 53 (step S13). Here, when scaling the central area image, control unit 11 preferably scales it so that the central area image is displayed at its maximum size on the screen of display device 7, based on the number of vertical and horizontal pixels of the screen of display device 7 stored in first output setting storage unit 55.

[0025] Similarly, the control unit 11 cuts out the image of the peripheral image (area 2), scales the cut-out image so that it is displayed at its maximum on the screen of the display device 9 based on the number of vertical and horizontal pixels of the screen of the display device 9 stored in the second output setting memory unit 57, and then places it in the output buffer 53 (step S15).

[0026] Next, the control unit 11 outputs the scaled central image placed in the output buffer 53 to the display device 7 using the first output unit 17. The control unit 11 also outputs the scaled peripheral image placed in the output buffer 53 to the display device 9 using the second output unit 19 (step S17).

[0027] [1.4 Video division] FIG. 5 is a schematic diagram for explaining video division by the video division device according to the first embodiment of the present disclosure. In step S1, a video 61 is input from the video output device 3 to the input unit 15. The video 61 is a moving image.

[0028] In step S3, control unit 11 divides the image into lattice-shaped unit areas, arranges them in storage unit 13, and distinguishes between area 1 and area 2 as shown in image 63. Image 63 is divided into 7 x 7 unit areas. Area 63A is area 1 (center image), and area 63B is area 2 (periphery image).

[0029] In step S13, control unit 11 cuts out area 63A, which is the central image, scales it according to the screen size of display device 7 stored in the first output setting, and stores it in output buffer 53. The image stored in output buffer 53 at this time is shown as image 65. In this case, since the aspect ratio of area 63A and the aspect ratio of the screen of display device 7 match, image 65 is the same as that of area 63A with the same height and width.

[0030] In step S15, control unit 11 cuts out area 63B, which is the peripheral image, scales it according to the screen size of display device 9 stored in the second output setting, and stores it in output buffer 53. The image stored in output buffer 53 at this time is shown as image 67. In image 67, area 67A, which corresponds to area 63B, is positioned at the center of the screen. This allows the peripheral image to be displayed at the center of the screen on display device 9, thereby improving the visibility of the peripheral image.

[0031] [1.5 Effects] According to the first embodiment, the video splitting device 5 analyzes the input video, extracts the central video and the peripheral video, scales these videos to fit the screen sizes of the display devices 7 and 9, and displays the central video and the peripheral video at the center of each screen. Therefore, according to the first embodiment, it is not necessary to determine in advance how to split the input video.

[0032] Furthermore, according to the first embodiment, since area 1 and area 2 are displayed on separate screens, the visibility of each area can be improved. In this case, the visibility of area 1 can be improved by enlarging area 1 in accordance with the screen size and aspect ratio of the output display device. Furthermore, the visibility of area 2 can be improved by displaying area 2 at the center of the screen, whereas area 2 was located at the bottom of the screen in the input video.

[0033] [2. Second Embodiment] A second embodiment will now be described. In the first embodiment, the video splitting device 5 splits the input video into two parts, a central video and a peripheral video, and scales and displays them on separate display devices 7 and 9. In contrast, in the second embodiment, the input video is split into three parts, one above the other, and each part is displayed on a separate display device. Note that the same reference numerals are used for components common to the first embodiment, and descriptions thereof will be omitted.

[0034] 6 is a schematic diagram for explaining a video display system 1A according to a second embodiment of the present disclosure. The video display system 1A includes a video output device 3, a video division device 5A, and display devices 7, 9, and 75.

[0035] 7 is a functional block diagram of a video splitting device 5A according to the second embodiment of the present disclosure. The video splitting device 5A has a storage unit 13A instead of the storage unit 13. As will be described later, the storage unit 13A differs from the storage unit 13 in that it has a third output setting storage unit 91.

[0036] Furthermore, the video splitting device 5A has a third output unit 81 in addition to the configuration of the video splitting device 5. The third output unit 81 is an interface for outputting a video signal, similar to the first output unit 17 and the second output unit 19 described above. The third output unit 81 connects the video splitting device 5 to the display device 71 and outputs a video signal to the display device 71. For example, the third output unit 81 is HDMI, DVI, DisplayPort, or USB.

[0037] The display device 75 is a display device. There are no limitations on the method by which the display device 75 displays an image. The display device 75 may be, for example, a liquid crystal display device, an organic EL (Electro-Luminescence) device, or a CRT (Cathode Ray Tube).

[0038] 8 is a diagram for explaining the software configuration of a video splitting device 5A according to a second embodiment of the present disclosure. Compared to the software configuration of the video splitting device 5 according to the first embodiment, it differs in that the storage unit 13A includes a third output setting storage unit 91. The third output setting storage unit 91 stores the third output setting as setting information. The third output setting is setting information related to the video to be output from the third output unit 81. The third output setting includes, for example, the number of pixels in both the vertical and horizontal directions of the screen of the display device 71, the screen size, the aspect ratio, etc.

[0039] FIG. 9 is a flowchart for explaining the operation of the video division device according to the second embodiment of the present disclosure. Steps S31 and S33 are the same as steps S1 and S3, respectively. Next, the control unit 11 performs video analysis on the video stored in the input buffer 51, extracts luminance and RGB values, and distinguishes regions 1, 2, and 3 based on the extracted luminance and RGB values ​​(step S35). Region 1 is the upper part of the video (hereinafter referred to as the upper video), region 2 is the center part of the video (hereinafter referred to as the center video), and region 3 is the lower part of the video (hereinafter referred to as the lower video). Next, the control unit 11 analyzes the video of regions 1, 2, and 3, respectively, and extracts luminance and RGB values ​​(steps S37 to S41). Regions 1, 2, and 3 are also referred to as the upper region, center region, and lower region, respectively.

[0040] Next, control unit 11 determines whether or not there is a difference between regions 1, 2, and 3 based on the analysis results of steps S37 to S41 (step S41). The video analysis of step S35 targets the entire screen and is performed to divide the entire screen into regions 1, 2, and 3, whereas the video analysis of steps S37, S39, and S41 targets regions 1, 2, and 3 individually and is performed to determine the difference between the regions in the subsequent step S43. It is preferable that the video analysis of step S35 and the video analysis of steps S37, S39, and S41 use different algorithms.

[0041] If there is no difference between areas 1, 2, and 3 (step S43, No), control unit 11 returns to step S31. If there is a difference between areas 1, 2, and 3 (step S43, Yes), control unit 11 cuts out the upper image (area 1), scales the cut-out upper image, and then places it in output buffer 53 (step S45). Here, when scaling the upper image, control unit 11 preferably scales it so that the central image is displayed at its maximum on the screen of display device 7, based on the number of vertical and horizontal pixels of the screen of display device 7 stored in first output setting storage unit 55.

[0042] In addition, the control unit 11 cuts out the central image (area 2), scales the cut-out central image so that it is displayed at its maximum size on the screen of the display device 9 based on the number of vertical and horizontal pixels of the screen of the display device 9 stored in the second output setting memory unit 57, and then places it in the output buffer 53 (step S47).

[0043] Furthermore, the control unit 11 cuts out the lower image (area 3), scales the cut-out lower image so that it is displayed at its maximum on the screen of the display device 71 based on the number of vertical and horizontal pixels of the screen of the display device 71 stored in the third output setting memory unit 91, and then places it in the output buffer 53 (step S49).

[0044] Next, the control unit 11 outputs the scaled upper video placed in the output buffer 53 to the display device 7 using the first output unit 17. The control unit 11 also outputs the scaled center video placed in the output buffer 53 to the display device 9 using the second output unit 19. Furthermore, the control unit 11 outputs the scaled lower video placed in the output buffer 53 to the display device 71 using the third output unit 81 (step S51).

[0045] FIG. 10 is a schematic diagram for explaining video division by a video division device 5A according to the second embodiment of the present disclosure. In step S31, input unit 15 receives video 111 from video output device 3. In step S35, control unit 11 performs video analysis on video 111 to distinguish between upper video 111A, central video 111B, and lower video 111C. As shown in the figure, if upper video 111A, central video 111B, and lower video 111C are different, in step S45, control unit 11 cuts out upper video 111A, scales it based on the first output setting, and places it in output buffer 53.

[0046] In image 111, upper image 111A is arranged at the top, but upper image 113A corresponding to upper image 111A is arranged at the center of the screen in image 113. Control unit 11 outputs upper image 113A to display device 7 via first output unit 17. As a result, upper image 119 is displayed on display device 7.

[0047] Since the aspect ratio of central part image 111B is the same as the aspect ratio of the screen of display device 9, control unit 11 outputs image 115, which is central part image 111B enlarged to the same size both vertically and horizontally, to display device 9 via second output unit 19. As a result, image 121 corresponding to central part image 111B is displayed using the entire screen of display device 9.

[0048] In image 111, lower image 111C is arranged at the bottom, but lower image 117A corresponding to lower image 111C is arranged at the center of the screen in image 117. Control unit 11 outputs lower image 117A to display device 71 via third output unit 81. As a result, lower image 123 is displayed on display device 71.

[0049] As described above, according to the second embodiment, the video splitting device 5A analyzes the input video, extracts the upper video, the central video, and the lower video, scales these videos to fit the screen sizes of the display devices 7, 9, and 71, and displays the central video and the peripheral video at the center of each screen. Therefore, according to the second embodiment, it is not necessary to determine in advance how to split the input video.

[0050] Furthermore, according to the second embodiment, the upper image, the center image, and the lower image are displayed on separate screens, thereby improving the visibility of each area. At this time, the center image is enlarged according to the screen size and aspect ratio of the output display device, which also improves the visibility of the center image. Furthermore, the upper image / lower image, which were positioned at the top / bottom of the screen in the input image, are displayed at the center of the screen of each display device, which also improves the visibility.

[0051] 3. Third Embodiment A third embodiment will be described. In the third embodiment, an image including three thumbnail images is used as an input image. The hardware configuration, software configuration, and operation are the same as those of the second embodiment.

[0052] 11 is a schematic diagram for explaining video division by a video division device 5A according to a third embodiment of the present disclosure. Video 131 is an input video, and thumbnail videos 131A, 131B, and 131C are arranged horizontally. The aspect ratios of the thumbnail videos 131A, 131B, and 131C are the same as the aspect ratios of the screens of the display devices 7, 9, and 71.

[0053] When the input unit 15 receives the video 131 from the video output device 3 in step S31, the control unit 11 determines in step S35 that the thumbnail images 131A, 131B, and 131C are areas 1, 2, and 3 through video analysis.

[0054] In step S45, the control unit 11 cuts out the thumbnail image 131A, and places the image 133 obtained by scaling the thumbnail image 131A based on the first output setting in the output buffer 53. In step S47, the control unit 11 cuts out the thumbnail image 131B, and places the image 135 obtained by scaling the thumbnail image 131B based on the second output setting in the output buffer 53. Furthermore, in step S47, the control unit 11 cuts out the thumbnail image 131C, and places the image 137 obtained by scaling the thumbnail image 131C based on the third output setting in the output buffer 53.

[0055] Next, control unit 11 outputs video 133 to display device 7 using first output unit 17, outputs video 135 to display device 9 using second output unit 19, and outputs video 137 to display device 9 using third output unit 81. As a result, display device 7 displays video 139 corresponding to video 133, display device 9 displays video 141 corresponding to video 135, and display device 71 displays video 143 corresponding to video 137.

[0056] As described above, according to the third embodiment, the video splitting device 5A analyzes the input video, extracts three thumbnail images, scales these thumbnail images to fit the screen sizes of the display devices 7, 9, and 71, and displays them on the respective screens. Therefore, according to the third embodiment, it is not necessary to determine in advance how to split the input video.

[0057] Furthermore, according to the third embodiment, the three thumbnail images are displayed on separate screens, thereby improving the visibility of each thumbnail image. At this time, the thumbnail images are each enlarged according to the screen size and aspect ratio of the display device to which they are output, thereby improving visibility.

[0058] [4. Fourth Embodiment] A fourth embodiment will be described. In the fourth embodiment, a single screen image including two screen images is used as an input image, and the two screen images are displayed on separate display devices. The fourth embodiment has the same hardware and software configuration as the first embodiment. For this reason, the fourth embodiment will be described using the image display system 1 shown in Figs. 1 to 3.

[0059] 12 is a flowchart for explaining the operation of the video division device 5 according to the fourth embodiment of the present disclosure. Steps S71 and S73 are similar to steps S1 and S3, respectively. The control unit 11 performs video analysis on the unit areas arranged in the storage unit 13 in step S73 to extract the luminance and RGB values ​​of each unit area, and distinguishes between moving images 1 and 2 based on the extracted luminance and RGB values ​​(step S75).

[0060] Next, control unit 11 performs video analysis on video 1 to extract the luminance and RGB values ​​of video 1, and analyzes video 1 based on the extracted luminance and RGB values ​​(step S77). Similarly, control unit 11 performs video analysis on video 2 to extract the luminance and RGB values ​​of video 2, and analyzes video 2 based on the extracted luminance and RGB values ​​(step S79). Next, control unit 11 determines whether there is a difference between video 1 and video 2 based on the analysis results of steps S77 and S79 (step S81). If there is no difference (step S81, No), control unit 11 returns to step S71.

[0061] If there is a difference (step S81, Yes), control unit 11 cuts out video 1, scales the cut-out video 1, and then places it in output buffer 53 (step S83). When scaling video 1, control unit 11 performs scaling based on the number of vertical and horizontal pixels of the screen of display device 7 stored in first output setting storage unit 55. Control unit 11 also cuts out video 2, scales the cut-out video 2, and then places it in output buffer 53 (step S85). When scaling video 2, control unit 11 performs scaling based on the number of vertical and horizontal pixels of the screen of display device 9 stored in second output setting storage unit 57.

[0062] Next, the control unit 11 outputs the scaled video 1 placed in the output buffer 53 to the display device 7 using the first output unit 17. The control unit 11 also outputs the scaled video 2 placed in the output buffer 53 to the display device 9 using the second output unit 19 (step S87).

[0063] FIG. 13 is a schematic diagram for explaining video division by the video division device 5 according to the fourth embodiment of the present disclosure. Video 151 is an input video and includes a left video 151A and a right video 151B. The left video 151A and the right video 151B are separate videos independent of each other. In step S83, the control unit 11 extracts the left video 151A from the video 151, enlarges the left video 151A to fit the screen size of the display device 7, and places the resulting video 153 in the output buffer 53. In step S85, the control unit 11 extracts the right video 151B from the video 151, enlarges the right video 151B to fit the screen size of the display device 9, and places the resulting video 155 in the output buffer 53. In step S87, the control unit 11 outputs the video 153 to the display device 7 and the video 159 to the display device 9. As a result, the display device 7 displays an image 157 corresponding to the left image 151A, and the display device 9 displays an image 159 corresponding to the right image 151B.

[0064] As described above, according to the fourth embodiment, the video splitting device 5 analyzes the input video, extracts two moving images, scales these moving images to fit the screen sizes of the display devices 7 and 9, and displays them on the respective screens. Therefore, according to the fourth embodiment, it is not necessary to determine in advance how to split the input video.

[0065] Furthermore, according to the fourth embodiment, the visibility of each moving image can be improved because the two moving images are displayed on separate display devices. At this time, the visibility can also be improved in that the moving images are enlarged according to the screen size and aspect ratio of the display device to which they are output.

[0066] [5. Fifth Embodiment] A fifth embodiment will be described. In the fifth embodiment, the video display system 1A of the second embodiment shown in FIGS. 6 to 8 is used. However, in the fifth embodiment, the detection unit 33 performs edge determination on the input video to identify multiple areas from the input video to be output to separate display devices. In the edge determination, for example, circular or rectangular areas are extracted.

[0067] Fig. 14 is a flowchart for explaining the operation (first half) of the video division device 5A according to the fifth embodiment of the present disclosure. Fig. 15 is a flowchart for explaining the operation (second half) of the video division device 5A according to the fifth embodiment of the present disclosure.

[0068] The control unit 11 determines whether or not an input video is being input from the video output device 3 to the input unit 15 (step S71). If no input video has been input, the control unit 11 waits for input (step S71, No). If input video has been input (step S71, Yes), the control unit 11 places the input video in the input buffer 51, performs edge detection on the input video placed in the input buffer 51, extracts areas to be output to separate display devices, and calculates the number N of these areas (N is a natural number) (step S73). In this embodiment, N is 3 or less.

[0069] If the number of regions N is 0 or 1 (step S75, No), that is, if there is no region extracted by edge determination, or if there is only one region extracted, the control unit 11 places the image placed in the input buffer 51 directly in the output buffer 53 (step S77), outputs it to the display device 7 using the first output unit 17 (step S79), and returns to step S71.

[0070] On the other hand, if the number of regions N is 2 or more (step S75, Yes), control unit 11 extracts N regions in order. The extracted regions are referred to here as region 1, region 2, ..., region N. At this time, control unit 11 analyzes the video of region 1 (step S91) and places it in output buffer 53 as the video to be output from first output unit 17 (step S93).

[0071] Next, the control unit 11 executes a loop of steps S97 to S107, sequentially targeting areas 2 to N. The control unit 11 analyzes the video of area k (k is an integer between 2 and N) (step S97), and compares area k with areas 1 to k-1 based on the analysis results of the area k and the analysis results of areas 1 to k-1 that have already been analyzed (step S101).

[0072] If region k is different from any of regions 1 to k-1 (step S103, Yes), control unit 11 cuts out region k and places it in output buffer 53 as a video to be output from the kth output unit (step S105). Note that the kth output unit refers to second output unit 19 or third output unit 81.

[0073] On the other hand, if the region k is the same as any one of the regions 1 to k-1 (step S103, No), the control unit 11 skips the region k (step S107).

[0074] After executing steps S97 to S107 for each of areas 2 to N, control unit 11 outputs each area placed in output buffer 53 to display devices 7, 9, and 71 using first output unit 17, second output unit 19, and third output unit 81. By the above operations, when the number of areas N calculated in step S73 is 1, the image is displayed only on display device 7; when the number of areas N is 2, the image is displayed on display devices 7 and 9; and when the number of areas N is 3, the image is displayed on display devices 7, 9, and 71.

[0075] 16 is a schematic diagram for explaining video output by a video division device 5A according to a fifth embodiment of the present disclosure. FIG. 16 illustrates a case where one region is extracted from an input video. Video 163 is the input video, and in step S73, control unit 11 extracts a circular region 163A by performing edge determination on video 163 arranged in input buffer 51. In this case, the number of regions is one, so in step S77, video 163 is arranged as is in output buffer 53 as video 165 and displayed on display device 7 as video 167.

[0076] 17 is a schematic diagram for explaining video division by a video division device 5A according to a fifth embodiment of the present disclosure. In Fig. 17, a video 173 that is an input video includes a circular area 173A and a rectangular area 173B.

[0077] When video 173 is input from video output device 3, control unit 11 places video 173 in input buffer 51, performs edge determination, and extracts regions 173A and 173B. Control unit 11 analyzes region 173A (step S91), and places video 175, which includes region 175A obtained by scaling region 173A based on the first output setting, in output buffer 53 (step S93). By scaling, region 173A is expanded to the full height of video 175.

[0078] Furthermore, control unit 11 analyzes region 173B (step S97). Control unit 11 compares the analysis result of region 173A generated in step S91 with the analysis result of region 173B generated in step S97 to determine whether or not there is a difference between regions 173A and 173B (steps S101 and S103). In this case, region 173A is a circular region and region 173B is a rectangular region, and there is a difference between the two, so control unit 11 proceeds to "Yes" in step S103 and places video 177 including region 177A obtained by scaling region 173B based on the second output setting in output buffer 53 (step S105).

[0079] In the above description, the fifth embodiment has been described with the number of regions N being 3 or less, but the limit on the number of displayable regions comes from the number of display devices (display devices 7, 9, 71) of video display system 1A, the number of output units (first output unit 17, second output unit 19, third output unit 81) of video splitting device 5A, and the number of output setting storage units (first output setting storage unit 55, second output setting storage unit 57, third output setting storage unit 91). Therefore, by increasing the number of these display devices, output units, and output setting storage units, the number of displayable regions in the video display system can be increased.

[0080] Furthermore, although the above description of the fifth embodiment does not mention a case where the number of video regions changes in real time over time, it is preferable to take this into consideration. For example, if the number of video regions for video V0 at time t0 is n0, the number of video regions for video V1 at the next time t1 is n1, and the number of video regions for video V2 at the next time t2 is n2, it is possible to address the change in the number of video regions over time as follows. When the number of video regions changes (n0 ≠ n1) from time t0 to time t1, video V1 at time t1 is stored in a video buffer. When the number of video regions for video V2 at the next time t2 matches the number of video regions for video V1 at time t1, the number of output destinations is increased or decreased from the number of video regions n0 to the number of video regions n1 (= n2), and the video is output to a number of monitors corresponding to the number of video regions n1 (= n2). In this way, when the number of video regions changes over time and the changed number of video regions is maintained for the next video, the video can be output from a number of output destinations corresponding to the changed number of video regions.

[0081] As described above, according to the fifth embodiment, regions are extracted from the input video by edge determination, and the number of display devices to which the video is output is increased or decreased depending on the number of extracted regions. Therefore, according to the fifth embodiment, it is not necessary to determine in advance how to divide the input video.

[0082] Furthermore, according to the fifth embodiment, the extracted areas are displayed on separate display devices, thereby improving the visibility of the image of each area. At this time, the image of each area is enlarged according to the screen size and aspect ratio of the display device to which it is output, thereby improving the visibility.

[0083] [6. Sixth Embodiment] A sixth embodiment will now be described. In the fifth embodiment, regions extracted from an input video were output to separate display devices, but in the sixth embodiment, regions extracted from an input video are combined with a video in which the regions are arranged in positions different from the input video, and the combined video is output to a single display device. For example, regions that were arranged horizontally in the input video are output as an output video in which they are arranged vertically.

[0084] FIG. 18 is a schematic diagram for explaining a video display system 201 according to a sixth embodiment of the present disclosure. The video display system 201 includes a video output device 203 and a mobile terminal 205. The video output device 203 is a device that outputs still images or moving images. The video output device 203 is preferably a video game device. The mobile terminal 205 is an information processing device that can receive a video signal from the video output device 203 via wireless communication and display the video signal. The mobile terminal 205 preferably has a portrait-oriented screen. The mobile terminal 205 is preferably a smartphone, a tablet, a PDA (Personal Data / Digital Assistant), or a portable video game device.

[0085] 19 is a functional block diagram of a video output device 203 according to the sixth embodiment of the present disclosure. The video output device 203 includes a control unit 211, a storage unit 213, an operation unit 215, a video output unit 217, and a wireless connection unit 219.

[0086] The control unit 211 controls the entire video output device 203. The control unit 211 realizes various functions by reading and executing various programs stored in the storage unit 213. The control unit 211 may be realized by one or more control devices / arithmetic units (CPUs (Central Processing Units), SoCs (System on a Chip)). The control unit 211 may also be configured by a control circuit.

[0087] The storage unit 213 is a storage device that stores various programs and various data required for the operation of the video output device 203. The storage unit 213 includes one or more recording devices capable of temporary storage, such as a dynamic random access memory (DRAM), and non-temporary recording devices, such as a solid state drive (SSD) configured with semiconductor memory or a hard disk drive (HDD) configured with a magnetic disk. For convenience of explanation, the storage unit 213 is shown as a single configuration, but it may also be configured as separate devices for each purpose, such as an area used for executing programs (main storage area), an area for saving programs and data (auxiliary storage area), an area used for caching, etc.

[0088] The operation unit 215 receives operation input from the user. For example, the operation unit 215 is a game pad, a keyboard, or a mouse. The operation unit 215 may be configured with hardware keys and / or software keys.

[0089] The video output unit 217 is an interface for connecting the video output device 203 to an external display device by wire and outputting a video signal. For example, the video output unit 217 is an HDMI, DVI, DisplayPort, or USB.

[0090] The wireless connection unit 219 is an interface for wirelessly connecting the video output device 203 to an external device. The wireless connection unit 219 can transmit a video signal to a wirelessly connectable display device in place of the video output unit 217.

[0091] 20 is a functional block diagram of a mobile terminal 205 according to the sixth embodiment of the present disclosure. The mobile terminal 205 includes a control unit 231, a storage unit 233, an operation unit 235, a display unit 237, a communication unit 239, and a wireless connection unit 241.

[0092] The control unit 231 controls the entire video output device 203. The control unit 231 realizes various functions by reading and executing various programs stored in the storage unit 233. The control unit 231 may be realized by one or more control devices / arithmetic units (CPUs (Central Processing Units), SoCs (System on a Chip)). The control unit 231 may also be configured by a control circuit.

[0093] The storage unit 233 is a storage device that stores various programs and various data necessary for the operation of the video output device 203. The storage unit 233 includes one or more recording devices capable of temporary storage, such as a dynamic random access memory (DRAM), and non-temporary recording devices, such as a solid state drive (SSD) configured with semiconductor memory or a hard disk drive (HDD) configured with a magnetic disk. For convenience of explanation, the storage unit 233 is shown as a single configuration, but it may also be configured as separate devices for each purpose, such as an area used for executing programs (main storage area), an area for saving programs and data (auxiliary storage area), an area used for caching, etc.

[0094] The operation unit 235 accepts operation input from the user. The display unit 237 is a display device that displays images and characters. The display unit 237 is configured, for example, by a liquid crystal display (LCD) or an organic EL (Electro-Luminescence) panel. The display unit 237 may be a standalone display device or may further include an externally connected display device. The operation unit 235 and the display unit 237 may be configured integrally as a touch panel. It is preferable that the display unit 237 has a vertically long screen.

[0095] The communication unit 239 is a wireless communication device that performs data communication via a mobile communication network. The type of the mobile communication network is not particularly limited, but may be, for example, a 3G, 4G, or 5G network.

[0096] The wireless connection unit 241 is an interface for wirelessly connecting the mobile terminal 205 to an external device. In particular, the wireless connection unit 241 is wirelessly connected to the wireless connection unit 219 and receives a video signal from the video output device 203.

[0097] 21 is a diagram illustrating a software configuration of the mobile terminal 205 according to the sixth embodiment of the present disclosure. The control unit 231 reads and executes programs stored in advance in the storage unit 233, thereby operating as a video input unit 231A, a detection unit 231B, a synthesis unit 231C, and a video output control unit 231D.

[0098] The video input unit 231A receives video from the video output device 203 using the wireless connection unit 241 and stores it in an input buffer 233A, which will be described later. The detection unit 231B extracts regions by performing edge detection on the received video. The synthesis unit 231C synthesizes a video in which the detected regions are arranged vertically. The video output control unit 231D displays the synthesized video on the display unit 237.

[0099] The storage unit 233 stores a program executed by the control unit 231. The storage unit 233 also has an input buffer 233A, an output buffer 233B, and an output setting storage unit 233C as storage areas. The input buffer 233A stores video received by the wireless connection unit 241. The output buffer 233 stores video synthesized by the synthesis unit 231C. The output setting storage unit 233C stores output settings related to the display unit 237.

[0100] The operation of the mobile terminal 205 will now be described. The first half of the operation of the mobile terminal 205 is the same as that of the video splitting device 5A of the fifth embodiment, so the first half of the operation will first be described with reference to Fig. 14, and then the second half of the operation will be described with reference to Fig. 22.

[0101] 14, control unit 231 determines whether or not input video is being input from video output device 203 to wireless connection unit 241 (step S71). If no video is being input, control unit 231 waits for input (step S71, No). If video is being input (step S71, Yes), control unit 231 places the input video in input buffer 233A, performs edge detection on the input video placed in input buffer 233A, extracts individual regions, and calculates the number N of these regions (N is a natural number) (step S73).

[0102] If the number of regions N is 0 or 1 (step S75, No), that is, if there is no region extracted by edge determination, or if there is only one region extracted, the control unit 231 places the image placed in the input buffer 233A directly in the output buffer 233B (step S77), displays it on the display unit 237 (step S79), and returns to step S71.

[0103] Next, the second half of the operation will be described with reference to Fig. 22. Fig. 22 is a flowchart for describing the operation (second half) of the mobile terminal 205 according to the sixth embodiment of the present disclosure. Based on the video of each area arranged in the output buffer 233B, the control unit 231 synthesizes an image in which these areas are arranged vertically (step S91), and displays the synthesized image using the display unit 237 (step S93).

[0104] FIG. 23 is a schematic diagram for explaining video output by the mobile terminal 205 according to the sixth embodiment of the present disclosure. Video output device 203 transmits video 261 to mobile terminal 205 using wireless connection unit 219. Video 261 includes areas 261A and 261B. Area 261A is a circular area, and area 261B is a rectangular area. In video 261, areas 261A and 261B are arranged side by side.

[0105] In mobile terminal 205, when video 261 is received via wireless connection unit 241, control unit 231 places it in input buffer 233A as video 263. Video 263 includes areas 263A and 263B corresponding to areas 261A and 261B, respectively. Therefore, in step S73, control unit 231 extracts areas 263A and 263B, calculates the number of areas N=2, and proceeds to "Yes" in step S75. Control unit 231 generates two videos 265 and 267 based on extracted areas 263A and 263B. Video 265 has area 265A corresponding to area 263A, and video 267 has area 267A corresponding to area 263B. Control unit 231 generates video 269, in which video 265 and video 267 are arranged vertically, places it in output buffer 233B, and displays it on display unit 237 as video 271.

[0106] As a result of this operation, circular area 261A and rectangular area 261B, which were arranged side by side in input image 261, are converted and displayed on the screen of display unit 237 of mobile terminal 205 as a vertically arranged image in which area 271A corresponding to circular area 261A is arranged on top and area 271B corresponding to rectangular area 261B is arranged on the bottom.

[0107] As described above, according to the sixth embodiment, in the video output from the video output device 203, areas that were arranged horizontally are rearranged vertically and displayed on the display unit 237 of the mobile terminal 205. Therefore, according to the sixth embodiment, particularly when the screen of the display unit 237 of the mobile terminal 205 is vertically long, the display area of ​​each area on the screen can be increased, thereby improving the visibility of each area.

[0108] [7. Seventh Embodiment] A seventh embodiment will now be described. The video splitting device 5 of the first embodiment separates an input video into two parts, a central video and a peripheral video, and scales and displays them on separate display devices 7 and 9. In contrast, the video splitting device 5A of the seventh embodiment classifies unit areas and determines whether or not there are identical areas in areas 1 and 2. If there are identical areas, the ranges of areas 1 and 2 are changed based on the determination result. Note that the same reference symbols are used for components common to the first embodiment, and descriptions thereof will be omitted.

[0109] The video division device 5A is used in place of the video division device 5 in the video display system 1 of Fig. 1. Like the video division device 5 of the first embodiment, the video division device 5A is represented by a functional block diagram as shown in Fig. 2, but uses a control unit 11A, which will be described next, instead of the control unit 11.

[0110] 24 is a diagram for explaining the software configuration of a video segmentation device according to the seventh embodiment of the present disclosure. The control unit 11A includes a video input unit 281, an area determination unit 283, an area segmentation unit 285, an image detection unit 287, an area comparison unit 289, and an area change unit 291. The storage unit 13 is the same as in the first embodiment.

[0111] The video input unit 281 receives video from the video output device 3 using the input unit 15 and stores it in an input buffer 51 (described later). The area determination unit 283 detects, from the received video, an area 1 corresponding to a screen to be displayed on the display device 7 and an area 2 corresponding to a screen to be displayed on the display device 9. The area division unit 285 divides each of the areas 1 and 2 into unit areas having a predetermined size. The image detection unit 287 identifies objects depicted in the unit areas. The area comparison unit 289 compares adjacent unit areas to determine whether the same object is depicted in each of the area. The area change unit 291 changes the area to which the unit area belongs according to the comparison result of the area comparison unit 289. The video output unit 293 outputs video from the first output unit 17 and the second output unit 19.

[0112] 25 is a flowchart for explaining the operation of the video division device according to the seventh embodiment of the present disclosure. The video input unit 31 determines whether or not a video has been input from the input unit 15 (step S101). If no video has been input (step S101, No), the video input unit 31 waits for input. If a video has been input (step S101, Yes), the area discrimination unit 281 stores the input video in the input buffer 51, performs video analysis, and discriminates between area 1 and area 2 (step S103). Next, the area division unit 285 divides each of area 1 and area 2 into unit areas (step S105). Next, the image detection unit 287 identifies objects drawn in each unit area (step S107). Next, the area comparison unit 289 compares the object identified in step S107 in the unit area of ​​area 1 with the unit area of ​​area 2 adjacent to that unit area. If the same object is identified in both unit areas, the area comparison unit 289 determines that the two unit areas are the same area (step S109). If an identical area exists (step S109, Yes), the area modification unit 291 modifies the unit areas constituting area 1 and area 2 based on the determination result. In other words, the input video was partitioned into area 1 and area 2 in step S103, but in step S110, the input video is repartitioned so that unit areas in which the same object is depicted belong to the same area. If an identical area does not exist in step S109, step S110 is skipped. Next, the video output unit 293 places areas 1 and 2 in the output buffer 53 (step S113) and outputs them from the first output unit 17 and the second output unit 19 (step S115). The video output unit 293 enlarges or reduces the video images in the areas 1 and 2 in accordance with the first output setting and the second output setting stored in the first output setting storage unit 55 and the second output setting storage unit 57.

[0113] 26 is a schematic diagram for explaining the operation of distinguishing between area 1 and area 2 from an image in a video segmentation device according to a seventh embodiment of the present disclosure. Assume that an image 301 is input to the image segmentation device 5A in step S1. The image 301 is a scene from an FPS (First-Person Shooter) type video game set in outer space, with the player's ship as the player's spaceship. The image 301 includes a background (outer space) 301A, a player's ship 301B controlled by the user (player), and an enemy ship 301C that the spaceship 301B is attacking.

[0114] In step S5, the detection unit 33 detects the own device 301B from the video 301, and divides the video 301 into an area 1 (303A) that does not include the own device 301B, and an area 2 (303B) that includes the own device 301B.

[0115] FIG. 27 is a schematic diagram for explaining the operation when the range of the area 1 and the range of the video are changed in the video segmentation device according to the seventh embodiment of the present disclosure.

[0116] Image 321 is the state after 301 is divided into area 1 (303A) and area 2 (303B) in step S103. Image 321 includes backgrounds 321A and 321B, the player's aircraft 321C, and an enemy aircraft 321D. Background 321A and enemy aircraft 321D belong to area 1, and background 321B and the player's aircraft 321C belong to area 2.

[0117] Image 323 shows the state after area 1 and area 2 have been divided into unit areas in step S105. Image 323 includes enemy aircraft 323A and background 323C, which belong to area 1, and player's aircraft 323B and background 323D, which belong to area 2.

[0118] Video 325 shows a state in which the identical area was detected in step S109. Video 325 includes enemy aircraft 325A and backgrounds 325C, 325C1, and 325C2, each belonging to area 1, and player's aircraft 325B and backgrounds 325D1 and 325D3, each belonging to area 2. Because background 325C1 of area 1 and background 325D1 of area 2 are both background objects, area comparison unit 289 determines that backgrounds 325C1 and 325D1 are the same area in which the same object is depicted. Similarly, because background 325C2 of area 1 and background 325D3 of area 2 are both background objects, area comparison unit 289 determines that backgrounds 325C2 and 325D3 are the same area in which the same object is depicted.

[0119] Image 327 shows the state after regions 1 and 2 have been reviewed in step S110. Because regions 1 and 2 have been re-divided based on the determination result that there are identical regions, the areas corresponding to backgrounds 325D1 and 325D3, which belonged to region 2 in image 325, now belong to region 1 in image 327.

[0120] Image 329 is the image output from first output unit 17 as area 1 in step S115. Image 329 includes enemy plane 329A, background 329C, and area 329E. Area 329E is an area that corresponds to area 2 after the revision. Area 329E may simply be a blank area. Alternatively, control unit 11A may generate a continuous background image based on background 329C and apply it to area 329E.

[0121] Video 331 is the video output from second output unit 19 as area 2 in step S115. Video 331 includes player's aircraft 331B and background 331D. Compared to area 2 of video 327, video 331 is enlarged. This is because video output unit 293 enlarged area 2 of video 327 based on the second output setting when outputting video 331.

[0122] Fig. 28 is a schematic diagram for explaining the operation of a video segmentation device according to a seventh embodiment of the present disclosure when the range of area 1 and the range of the video are not changed. Fig. 28 is a video of a car driving simulation game, depicting the view from a driver sitting in the driver's seat.

[0123] FIG. 28(a) is a diagram showing the state in which the input video has been divided into region 1 and region 2. In step S103, video 341 was divided into region 1 (341A) and region 2 (341B). Region 1 (341A) mainly depicts the scenery seen by the driver through the windshield of the car, and vehicles 341E and 341F are other vehicles traveling in front of the car driven by the driver. Region 2 (341B) mainly depicts the dashboard or instrument panel of the car driven by the driver. Various meters including a speedometer 341C are depicted on the dashboard. Reference numeral 341D denotes a front pillar or A-pillar.

[0124] 28(b) is a diagram showing the state in which area 1 and area 2 have been divided into unit areas. Video 343 has been divided into area 1 (343A) and area 2 (343B). Furthermore, in step S105, each area has been divided into unit areas as shown by the dotted lines in the figure. When step S109 is executed for video 343, there are no identical areas in video 343, so the process proceeds to "No" in step S109 and step S110 is skipped.

[0125] 28(c) is a diagram showing the images output as area 1 and area 2. Image 345 is divided into area 1 (345A) and area 2 (345B). Because step S110 was skipped, area 1 (345A) and area 2 (345B) of image 345 remain unchanged from area 1 and area 2 in images 341 and 343.

[0126] As described above, according to the seventh embodiment, after dividing the image into areas 1 and 2, it is determined whether adjacent unit areas are the same area, and the initially roughly divided areas 1 and 2 are redivided according to the determination result. Therefore, according to the seventh embodiment, area 2 can be enlarged and displayed.

[0127] [8. Variations] The present disclosure is not limited to the above-described embodiments and variations, and various modifications are possible. In other words, embodiments obtained by combining appropriately modified technical means within the scope of the gist of the present disclosure are also included in the technical scope of the present disclosure.

[0128] In the above-described embodiment, the video output devices 3, 203 are basically described as video game devices, but the video output devices 3, 203 may be any device that outputs video, such as a video game device, a DVD (Digital Versatile Disc) player, a Blu-ray player, a personal computer, etc.

[0129] The programs that run on each device in the embodiments are programs that control the CPU, etc. (programs that make a computer function) so as to realize the functions of the above-described embodiments. Information handled by these devices is temporarily stored in a temporary storage device (e.g., RAM) during processing, and then stored in various storage devices such as ROMs (Read Only Memories) and HDDs, and is read, modified, and written by the CPU as needed.

[0130] Here, the recording medium for storing the program may be any of semiconductor media (e.g., ROM, non-volatile memory card, etc.), optical recording media / magneto-optical recording media (e.g., DVD (Digital Versatile Disc), MO (Magneto Optical Disc), MD (Mini Disc), CD (Compact Disc), BD (Blu-ray (registered trademark) Disc), etc.), magnetic recording media (e.g., magnetic tape, flexible disk, etc.), etc. Furthermore, not only are the functions of the above-described embodiments realized by executing the loaded program, but the functions of the present disclosure may also be realized by processing in cooperation with an operating system or other application programs, etc., based on instructions from the program.

[0131] Furthermore, when distributing the program on the market, the program can be stored in a portable recording medium and distributed, or transferred to a server computer connected via a network such as the Internet. In this case, the storage device of the server computer is also included in the present disclosure. [Explanation of symbols]

[0132] 1, 1A, 201 Video display system 3, 203 Video output device 5, 5A Video splitter (video processing device) 7, 9, 71 Display device 11, 211 Control unit 13, 13A, 213 Storage section 15 Input section 17 First output section 19 Second output section 31, 231A, 281 Video input section 33, 231B Detector 35, 231C analysis section 37, 231D comparison section 39 Scaling section 41, 231F Video output control section 51, 233A Input Buffer 53, 233B output buffer 55 First output setting memory unit 57 Second output setting memory section 61, 63, 65, 67, 111, 113, 115, 117, 119, 121, 123, 131, 133, 135, 137, 139, 141, 143, 151, 153, 155, 157, 159, 161, 163, 165, 167, 171, 173, 175, 177, 179, 181, 183, 261, 263, 265, 267, 269, 271, 301, 303, 321, 323, 325, 327, 329, 331 Video 63A, 63B area 81 Third output section 91 Third output setting memory section 111A upper image 111B, 163A, 165A, 167A central image 111C Lower Image 131A, 131B, 131C thumbnail images 151A, 261A, 263A, 265A, 269A Left image 151B, 261B, 261B, 263B, 267A, 269B Right image 163B, 165B, 167B background video 173A, 175A, 179A, 179A, 183A circular area 173B, 173B, 177A, 181A, 183B rectangular area 205 Mobile Devices 215 Operation section 217 Output section 219 Wireless connection part 231E Synthesis Department 233C Output setting memory section 283 Area discrimination part 285 Area division part 287 Image detection unit 289 Area comparison section 291 Area Change Section 293 Video output section 301A, 321A, 321B, 321A, 321B, 323C, 325C, 325C1, 325C2, 325D1, 325D3, 327C, 329C, 331D Background (Outer Space) 301B, 321C, 323B, 325B, 327B, 331B (Automatic) Enemy aircraft: 301C, 321D, 321D, 323A, 325A, 327A, 329A 303A Domain 1 303B Domain 2

Claims

1. a detection unit that detects a plurality of regions from an input video; a video output control unit that controls output of the detected images of the plurality of regions to different display devices; A video processing device comprising:

2. The image processing device according to claim 1 , wherein the detection unit detects the plurality of regions by performing image analysis on an input image.

3. the detection unit detects, from the input video, a first region including a center of the input video and a second region not including the center of the input video. The video processing device according to claim 1 .

4. the input image has a rectangular shape; the detection unit detects, from the input video, a central region including a center of the input video, an upper region that is a region along an upper side of the rectangle of the input video, and a lower region that is a region along a lower side of the rectangle of the input video. The video processing device according to claim 1 .

5. The image processing device according to claim 1 , wherein the detection unit detects a plurality of rectangular areas from the input image.

6. The image processing device according to claim 1 , wherein, when the plurality of regions are different from one another, the image output control unit performs control to output the images of the detected plurality of regions to different display devices, respectively.

7. further comprising a region changing unit; The area change unit Dividing the input image into a plurality of unit areas each having the same size; classifying each of the plurality of unit areas by performing video analysis on each of the plurality of unit areas; changing the ranges of the plurality of regions based on the classification of the plurality of unit regions; The video processing device according to claim 1 .

8. Detect multiple regions from the input video, and performing control to output the detected images of the plurality of regions to different display devices. A method for controlling a video processing device.

9. a detection unit that performs video analysis on an input video to detect a plurality of regions; a synthesis unit that synthesizes an output image obtained by changing the layout of the detected plurality of regions from the input image; A video processing device comprising:

10. The image processing device according to claim 7 , wherein the input image is an image to be displayed on a horizontally long screen, and the output image is an image to be displayed on a vertically long screen.

11. Analyzes the input video to detect multiple areas, synthesizing an output image obtained by changing the arrangement of the detected plurality of regions from the input image; A method for controlling a video processing device.

Citation Information

Patent Citations

  • Multi-monitor display

    JP2012515367A