Video image processing system, display system, video processing method, and video processing program

Abstract

To provide a video image processing system, a display system, a video processing method, and a video processing program, capable of reducing a processing time that generates a plurality of division video image data for displaying a high resolution image.SOLUTION: An image output device 10 comprises: a decode processing part 121; a video image division processing part 122; an encode processing part 123; and a storage processing part 124. The decode processing part 121 decodes a first video image data. The video image division processing part 122 divides decoded first video image data in a predetermined region, and generates a plurality of divided video image data. The encode processing part 123 executes a processing for encoding each of the plurality of division video image data in parallel. The storage processing part 124 stores a second video image data containing a plurality of encoded division video image data.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present disclosure relates to a technique for generating a plurality of video data for displaying a high-resolution image.

Background Art

[0002] Conventionally, a system for displaying a high-resolution image on a display device compatible with a low resolution is known. For example, a system is known that divides a high-resolution image (video content) into regions of a certain size and outputs it to a display device (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] For example, in the conventional method, a cut-out position is specified in high-resolution video data, and while decoding (decrypting) the video data, encoding is performed with respect to the cut-out position to generate one data, and this generation process is executed the number of times corresponding to the number of divisions. For example, when dividing video data of 7680×4320 pixels (8K) into 16 parts, it is necessary to execute the generation process 16 times. Therefore, in the conventional method, there is a problem that the processing time for generating a plurality of divided video data from high-resolution video data becomes long.

[0005] An object of the present disclosure is to provide a video processing system, a display system, a video processing method, and a video processing program capable of shortening the processing time for generating a plurality of divided video data for displaying a high-resolution image.

Means for Solving the Problems

[0006] A video processing system according to one aspect of the present disclosure is a system that generates second video data including a plurality of low-resolution divided video data from high-resolution first video data. The video processing system includes a decoding processing unit, a video division processing unit, an encoding processing unit, and a storage processing unit. The decoding processing unit decodes the first video data. The video division processing unit divides the decoded first video data in a preset area to generate the plurality of divided video data. The encoding processing unit encodes each of the plurality of divided video data. The storage processing unit stores the second video data including the plurality of encoded divided video data.

[0007] A display system according to another aspect of the present disclosure is a system that causes a display device capable of displaying a first image with a first resolution and an image with a second resolution lower than the first resolution to display the first image based on the second video data generated by the video processing system. The display system includes an acquisition processing unit that acquires a display range specified by a user for the entire first image corresponding to the first video data, and a display processing unit that identifies a plurality of first divided images among the plurality of divided images included in the second video data, all or part of which overlaps with the display range, and causes the display device to display an image with the second resolution corresponding to the display range based on the plurality of first divided images.

[0008] A video processing method according to another aspect of the present disclosure is a method for generating second video data including a plurality of low-resolution divided video data from high-resolution first video data. In the video processing method, one or more processors execute decoding the first video data, dividing the decoded first video data in a preset area to generate the plurality of divided video data, encoding each of the plurality of divided video data, and storing the second video data including the plurality of encoded divided video data.

[0009] A video processing program according to another aspect of the present disclosure is a program for generating second video data including a plurality of low-resolution divided video data from high-resolution first video data. The video processing program includes decoding the first video data, dividing the decoded first video data in a preset area to generate the plurality of divided video data, encoding each of the plurality of divided video data, and storing the second video data including the encoded plurality of divided video data, and is a program for causing one or more processors to execute.

Advantages of the Invention

[0010] According to the present disclosure, it is possible to provide a video processing system, a display system, a video processing method, and a video processing program capable of shortening the processing time for generating a plurality of divided video data for displaying a high-resolution image.

Brief Description of the Drawings

[0011]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Figure 22

Figure 23

Figure 24A

Figure 24B

Figure 24C

Figure 24D

Figure 24E

Figure 24F

Figure 24G

Figure 24H

Figure 25

Figure 26

Figure 27

Figure 28

Figure 29

Figure 30

Figure 31

Figure 32

Embodiments for Carrying Out the Invention

[0012] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. Note that the following embodiments are merely examples embodying the present disclosure and do not have the character of limiting the technical scope of the present disclosure.

[0013] [First Embodiment] FIG. 1 is a diagram showing a schematic configuration of a display system 100 according to the first embodiment of the present disclosure.

[0014] The display system 100 includes an image output device 10 and a display device 20. The image output device 10 is composed of, for example, a personal computer (PC), a network server, a network hard disk, an image playback device, etc. The image output device 10 outputs an image (video content) to be displayed on the display device 20 as an image signal (video signal). The display device 20 displays an image corresponding to the image signal input from the image output device 10. The display device 20 may be a liquid crystal display device, an organic EL display device, or other types of display devices. Also, the display device 20 may be a personal computer (e.g., a notebook PC).

[0015] The image output device 10 can output a high-resolution image signal (high-resolution image). The display device 20 is a display corresponding to low resolution. That is, the display device 20 is a display corresponding to a lower resolution than the resolution of the image signal output by the image output device 10. The display system 100 causes the display device 20 to display video content using the image signal output from the image output device 10. For example, the display system 100 displays high-resolution video content on the low-resolution display device 20. Hereinafter, as an example of high resolution, 3840×2160 pixels (4K) is cited, and as an example of low resolution, 1920×1080 pixels (2K (FHD)) is cited. Note that the high resolution may be 7680×4320 pixels (8K), and the low resolution may be 3840×2160 pixels (4K) or 1920×1080 pixels (2K).

[0016] The image output device 10 is provided with an output terminal (output port), and the display device 20 is provided with an input terminal (input port) for connecting a signal line. The input terminal is an HDMI (High-Definition Multimedia Interface, HDMI: registered trademark) terminal, a DP (DisplayPort) terminal, a DVI (Digital Visual Interface) terminal, or the like. The image output device 10 and the display device 20 are connected by a signal line (cable). The image signal (video signal) output from the image output device 10 is input to the display device 20 via the signal line. As another embodiment, the image output device 10 and the display device 20 may be connected by wireless communication via a network (for example, the Internet), or may be connected by wired communication.

[0017] [Image output device 10] FIG. 2 shows a functional block diagram of the image output device 10. The image output device 10 includes a control unit 11, a storage unit 12, an output unit 13, and the like.

[0018] The storage unit 12 is a non-volatile storage unit such as a flash memory, an HDD (Hard Disk Drive), or an SSD (Solid State Drive) that stores various types of information. The storage unit 12 stores control programs such as a display control program for causing the control unit 11 to execute display control processing (see FIG. 22) described later. For example, the display control program is non-temporarily recorded on a computer-readable recording medium such as a USB, a CD, or a DVD, and is read by a reading device (not shown) provided in the image output device 10 and stored in the storage unit 12.

[0019] In addition, the storage unit 12 stores a high-resolution image P1 and a plurality of divided images P2 obtained by dividing the high-resolution image P1. The control unit 11 divides the high-resolution image P1 into a plurality of divided images P2 by video division processing described later and stores them in the storage unit 12. Note that a plurality of high-resolution images P1 may be stored in the storage unit 12. When a plurality of high-resolution images P1 are stored in the storage unit 12, a plurality of divided images P2 are stored in association with each high-resolution image P1.

[0020] The output unit 15 is connected to the output terminal and outputs an image signal to the signal line according to the command of the control unit 11.

[0021] The control unit 11 includes control devices such as a CPU, a ROM, and a RAM. The CPU is a processor that executes various arithmetic processes. The ROM stores in advance control programs such as BIOS and OS for causing the CPU to execute various processes. The RAM stores various information and is used as a temporary storage memory (working area) for various processes executed by the CPU. Then, the control unit 11 controls the image output device 10 by causing the CPU to execute various control programs stored in advance in the ROM or the storage unit 12.

[0022] Specifically, the control unit 11 includes various processing units such as a display processing unit 111, a division processing unit 112, and an acquisition processing unit 113. Note that the control unit 11 functions as the various processing units by causing the CPU to execute various processes according to the control program. Also, some or all of the processing units included in the control unit 11 may be configured by electronic circuits. Note that the display control program may be a program for causing a plurality of processors to function as the various processing units.

[0023] The display processing unit 111 causes an image corresponding to video content to be displayed on the display device 20. Specifically, the display processing unit 111 outputs an image signal to the display device 20 via the output unit 13, and causes an image corresponding to the image signal to be displayed on the display unit 24 of the display device 20.

[0024] For example, as shown in FIG. 3, the display processing unit 111 converts a high-resolution 4K image (high-resolution image P1) corresponding to video content into a low-resolution (2K (FHD)) image P11 and outputs it to the display device 20. When the display device 20 acquires the image P11 from the image output device 10, it displays the entire image P11. When the high-resolution image P1 is converted to a low resolution and the entire image is displayed on the display device 20, the image quality deteriorates, but the user can grasp the entire original image corresponding to the video content. As another embodiment, the display device 20 may acquire the high-resolution image P1 from the image output device 10, convert it into a low-resolution image P11, and display it.

[0025] The division processing unit 112 executes a division process (division processing) of dividing an image (high-resolution image P1) (first image of the present disclosure) with a high resolution (first resolution of the present disclosure) corresponding to video content (video data, video file) into a plurality of divided images P2 (second images of the present disclosure) with a lower resolution (second resolution of the present disclosure) than the high-resolution image P1.

[0026] For example, as shown in FIG. 4, the division processing unit 112 divides a high-resolution image P1 of 3840×2160 pixels into 64 divided images P2 of 8×8. In this case, one divided image P2 is 480×270 pixels. FIG. 5 shows a specific example of the high-resolution image P1 and the positions (divided image regions) of the respective divided images P2 with respect to the high-resolution image P1. The divided image P2 corresponds to a partial region of the high-resolution image P1, and when all (here, 64) divided images P2 are combined (connected), one high-resolution image P1 is obtained. Position information in the high-resolution image P1 is associated with each divided image P2. In the example shown in FIG. 4, "p11" to "p88" correspond to the position information of each divided image P2. Hereinafter, for convenience, the "divided image P2" may be represented by a name corresponding to the position (for example, "divided image p11", "divided image p88", etc.).

[0027] When the division processing unit 112 generates a plurality of divided images P2, it stores the high-resolution image P1 and the corresponding plurality of divided images P2 in association with each other in the storage unit 12 (see FIG. 2).

[0028] [Generation process of segmented image (video segmentation process)] Here, the specific configuration for generating the segmented image will be described below.

[0029] The segmentation processing unit 112 according to this embodiment executes a video segmentation process for generating second video data including a plurality of low-resolution segmented video data (segmented image P2) from high-resolution first video data (high-resolution image P1).

[0030] As shown in FIG. 2, the segmentation processing unit 112 includes a decoding processing unit 121, a video segmentation processing unit 122, an encoding processing unit 123, and a storage processing unit 124.

[0031] The decoding processing unit 121 executes a decoding process for decoding (decrypting) the first video data corresponding to the video data (video content) input to the image output device 10. Note that the decoding process is an example of a preparation process for performing video display on the display device 20. Further, the decoding processing unit 121 generates a stream of the first video data. For example, when the video data is an 8K video of 60 seconds, the decoding processing unit 121 generates a plurality of 8K streams at predetermined time intervals (predetermined number of frames). One 8K stream is composed of a plurality of frames. In this way, the decoding processing unit 121 decodes the first video data to generate a stream.

[0032] The video segmentation processing unit 122 divides the decoded first video data in a preset area to generate a plurality of segmented video data. Specifically, the video segmentation processing unit 122 cuts out frame data of a predetermined number of frames from the first video data, and generates a plurality of segmented video data based on the cut-out frame data.

[0033] For example, the video segmentation processing unit 122 generates 16 FHD streams corresponding to the segmentation positions (segmentation coordinates) from an 8K stream. FIG. 6 shows the positions (coordinates) of the FHD videos with respect to the 8K video. The video segmentation processing unit 122 generates FHD streams of FHD videos corresponding to 16 positions (coordinates) based on the 8K stream. As shown in FIG. 7, in an example where 8K streams of a predetermined number of frames (frame groups F1, F2, … Fn) are generated for a 60-second 8K video, the video segmentation processing unit 122 repeatedly processes the 8K stream for each frame group to generate a total of 16 FHD streams for 60 seconds.

[0034] The encoding processing unit 123 executes a process of encoding (encoding) each of the plurality of segmented video data. Specifically, the encoding processing unit 123 executes the process of encoding each of the plurality of segmented video data corresponding to the frame data of the predetermined number of frames described above in parallel or serially.

[0035] For example, the encoding processing unit 123 executes the process of encoding each of the generated 16 FHD streams in parallel (see FIG. 10 described later). Also, for example, the encoding processing unit 123 executes the first FHD stream processing to the 16th stream processing of the generated 16 FHD streams in a time-division pseudo-parallel manner (see FIG. 11 described later).

[0036] The storage processing unit 124 stores the second video data including the plurality of encoded segmented video data. For example, the storage processing unit 124 stores the data encoded based on the 16 FHD streams in the storage unit 12 as video data (segmented image P2).

[0037] Also, when the video segmentation processing unit 122 generates 8 FHD streams at a time, the storage processing unit 124 first stores the data encoded based on the 8 FHD streams in the storage unit 12 as video data, and then stores the data encoded based on the subsequent 8 FHD streams in the storage unit 12 as video data.

[0038] In this way, the video segmentation processing unit 122 extracts frame data of a predetermined number of frames from the first video data, generates a plurality of segmented video data based on the extracted frame data, and the encoding processing unit 123 encodes each of the plurality of segmented video data corresponding to the frame data. Also, the video segmentation processing unit 122 repeatedly executes the process of extracting frame data from the first video data to generate a plurality of segmented video data until all the frames of the first video data are reached. The encoding processing unit 123 executes the encoding process for each frame data, and the storage processing unit 124 stores the second video data including the plurality of segmented video data encoded for each frame data.

[0039] In particular, when performing streaming processing on the first video data, the video segmentation processing unit 122 extracts a video stream of a predetermined number of frames from the first video data, generates a plurality of low-resolution segmented video streams from the extracted video stream, and the encoding processing unit 123 encodes each of the plurality of segmented video streams. For example, when the processing capacity of the image output device 10 is low, that is, when it does not have the ability to generate a plurality of segmented video data by decoding all the frames of the first video data at once, the encoding processing unit 123 executes the encoding process for a part of the plurality of segmented video streams, and after the encoding process of the part of the segmented video streams is completed, executes the encoding process of the remaining segmented video streams.

[0040] FIG. 8 shows an example of the procedure of the segmented image generation process (video segmentation process) executed in the display system 100.

[0041] Note that the present disclosure can be regarded as a disclosure of a split image generation method (the video processing method of the present disclosure) that executes one or more steps included in the split image generation process. Also, one or more steps included in the split image generation process described here may be appropriately omitted or divided. Further, the execution order of each step in the split image generation process may be different as long as the same operational effects are produced. Furthermore, here, the case where the control unit 11 (one processor) of the image output device 10 executes each step in the split image generation process is taken as an example for explanation. However, in other embodiments, a plurality of processors may execute each step in the split image generation process in a distributed manner.

[0042] Here, the video input to the image output device 10 is 8K video data (moving image data) of 60 seconds, and the process of splitting the 8K video into 16 pieces of FHD video data is taken as an example for explanation.

[0043] First, in step S101, the control unit 11 (split processing unit 112) reads the 8K video data.

[0044] Next, in step S102, the control unit 11 decodes the 8K video data to generate a stream. Note that a well-known method can be adopted for generating a stream from video data.

[0045] Next, in step S103, the control unit 11 holds a stream of a predetermined number of frames as an 8K stream. For example, the control unit 11 cuts out an 8K stream of a predetermined number of frames (frame group F1) from the 8K stream of 8K video data of 60 seconds.

[0046] Next, in step S104, the control unit 11 generates 16 FHD streams based on the acquired 8K stream of a predetermined number of frames. Specifically, the control unit 11 generates 16 FHD streams based on the position information (coordinate information) shown in FIG. 6.

[0047] Next, in step S105, the control unit 11 determines the processing capacity of the image output device 10. If the image output device 10 has a predetermined processing capacity (S105: Yes), the control unit 11 transfers the processing to step S106. On the other hand, if the image output device 10 does not have a predetermined processing capacity (S105: No), the control unit 11 transfers the processing to step S108. The predetermined processing capacity is, for example, the ability to encode 16 FHD streams in parallel.

[0048] In step S106, the control unit 11 encodes 16 FHD streams in parallel. Also, the control unit 11 can execute the encoding process in step S106 in parallel with the streaming process in step S102.

[0049] Next, in step S107, the control unit 11 records the encoded video data. As a result, 16 FHD video data of the frame group F1 are stored in the storage unit 12. After step S107, the control unit 11 transfers the processing to step S111.

[0050] On the other hand, if the image output device 10 does not have a predetermined processing capacity (S105: No), in step S108, the control unit 11 encodes some of the 16 FHD streams in parallel. For example, the control unit 11 encodes 8 FHD streams in parallel. Also, the control unit 11 can execute the encoding process in step S108 in parallel with the streaming process in step S102.

[0051] Next, in step S109, the control unit 11 records the encoded video data. As a result, 8 FHD video data of the frame group F1 are stored in the storage unit 12.

[0052] Next, in step S110, the control unit 11 determines whether or not the encoding of all 16 FHD streams has been completed. If the control unit 11 determines that the encoding of all 16 FHD streams has been completed (S110: Yes), the process proceeds to step S111. On the other hand, if the control unit 11 determines that the encoding of all 16 FHD streams has not been completed (S110: No), the process returns to step S108.

[0053] When returning to step S108, the control unit 11 encodes the remaining FHD streams in parallel. For example, the control unit 11 encodes the remaining 8 FHD streams in parallel. The control unit 11 repeatedly executes the processes of steps S108 and S109 until the encoding of all FHD streams is completed. As a result, the 16 FHD video data of the frame group F1 is stored in the storage unit 12.

[0054] In step S111, the control unit 11 determines whether or not the split image generation process (video splitting process) for the 8K video data read in step S101 has been completed. If the control unit 11 determines that the video splitting process has been completed (S111: Yes), the process ends. On the other hand, if the control unit 11 determines that the video splitting process has not been completed (S111: No), the process returns to step S103.

[0055] When returning to step S103, the control unit 11 holds the stream of the next predetermined number of frames (frame group F2 in FIG. 7) of the generated 8K video data stream as an 8K stream. The control unit 11 executes the above-described processes (steps S104 to S110) for the 8K stream of the frame group F2. The control unit 11 repeatedly executes the above-described processes until the processing of all frames (F1 to Fn) of the read 8K video data is completed.

[0056] When the control unit 11 completes the split image generation process (video split process) for the read 8K video data, it stores 16 pieces of FHD video data (split image P2) in the storage unit 12 in association with the 8K video data (high-resolution image P1).

[0057] In the example shown in FIG. 8, the control unit 11 generates 16 FHD streams based on the 8K stream (S103), and controls the number of FHD streams that can execute the encoding process in parallel based on the processing capacity of the image output device 10 (S105). As another embodiment, the control unit 11 may control the number of FHD streams that can be generated from the 8K stream based on the processing capacity of the image output device 10. FIG. 9 shows an example of the procedure of the split image generation process corresponding to the above configuration.

[0058] In step S201, the control unit 11 (split processing unit 112) reads the 8K video data, and in step S202, the control unit 11 decodes the 8K video data to generate a stream.

[0059] Next, in step S203, the control unit 11 holds a stream of a predetermined number of frames as an 8K stream. For example, the control unit 11 cuts out an 8K stream of a predetermined number of frames (frame group F1) from the 8K stream of 8K video data for 60 seconds.

[0060] Next, in step S204, the control unit 11 determines the processing capacity of the image output device 10. If the image output device 10 has a predetermined processing capacity (S204: Yes), the control unit 11 transfers the process to step S205. On the other hand, if the image output device 10 does not have a predetermined processing capacity (S204: No), the control unit 11 transfers the process to step S208. The predetermined processing capacity is, for example, the ability to generate 16 FHD streams.

[0061] In step S205, the control unit 11 generates 16 FHD streams based on the generated stream. Specifically, the control unit 11 generates 16 FHD streams based on the position information (coordinate information) shown in FIG. 6.

[0062] Next, in step S206, the control unit 11 executes the encoding process for the 16 FHD streams.

[0063] Next, in step S207, the control unit 11 records the encoded video data. As a result, the 16 FHD video data of the frame group F1 are stored in the storage unit 12. After step S207, the control unit 11 transfers the process to step S212.

[0064] On the other hand, when the image output device 10 does not have a predetermined processing ability (S204: No), in step S208, the control unit 11 generates M FHD streams.

[0065] Next, in step S209, the control unit 11 executes the encoding process for the M FHD streams.

[0066] Next, in step S210, the control unit 11 records the encoded video data. As a result, the M FHD video data of the frame group F1 are stored in the storage unit 12.

[0067] Next, in step S211, the control unit 11 determines whether or not all the encodings of the 16 FHD streams have been completed. If the control unit 11 determines that all the encodings of the 16 FHD streams have been completed (S211: Yes), the process is transferred to step S212. On the other hand, if the control unit 11 determines that not all the encodings of the 16 FHD streams have been completed (S211: No), the process returns to step S208.

[0068] When returning to step S208, the control unit 11 generates the next M FHD streams. The control unit 11 repeatedly executes the processes of steps S208 to S210 until the encoding of all FHD streams is completed. As a result, 16 FHD video data of the frame group F1 are stored in the storage unit 12.

[0069] In step S212, the control unit 11 determines whether the split image generation process (video splitting process) for the 8K video data read in step S201 has been completed. When the control unit 11 determines that the video splitting process has been completed (S212: Yes), it ends the process. On the other hand, when the control unit 11 determines that the video splitting process has not been completed (S212: No), it returns the process to step S203.

[0070] When returning to step S203, the control unit 11 holds the stream of the next predetermined number of frames (frame group F2 in FIG. 7) among the generated 8K video data streams as an 8K stream. The control unit 11 executes the above-described process (steps S204 to S211) for the 8K stream of the frame group F2. The control unit 11 repeatedly executes the above-described process until the processing of all frames (F1 to Fn) of the read 8K video data is completed.

[0071] When the control unit 11 completes the split image generation process (video splitting process) for the read 8K video data, it stores 16 FHD video data (split image P2) in the storage unit 12 in association with the 8K video data (high-resolution image P1).

[0072] In this way, the control unit 11 may cut out video data at predetermined time intervals in the time direction and execute the video splitting process in order for each cut-out video data. When the processing capacity of the image output device 10 is high, the control unit 11 may also decode the entire video data to create a stream, hold the entire stream, and execute the encoding of a plurality of FHD streams in parallel.

[0073] For example, the control unit 11 may generate a number of divided video data (divided streams) according to the processing capacity of the image output device 10. When the processing capacity of the image output device 10 is high, the control unit 11 generates 16 FHD streams. When the processing capacity of the image output device 10 is low, the video division processing unit 122 may first generate 8 FHD streams and then generate the remaining 8 FHD streams. When the processing capacity of the image output device 10 is even lower, the video division processing unit 122 may generate FHD streams in units of 4 while temporally shifting them.

[0074] Here, a specific example of the encoding process will be described. FIG. 10 shows a first configuration example in which the encoding process is executed in parallel, and FIG. 11 shows a second configuration example in which the encoding process is executed serially.

[0075] As shown in FIG. 10, when the control unit 11 generates, for example, 16 FHD streams (S301), it encodes each FHD stream in parallel (S302). The control unit 11 records the encoded video data. The control unit 11 ends the encoding process when all the video data is recorded (S303).

[0076] Also, as shown in FIG. 11, when the control unit 11 generates, for example, 16 FHD streams (S401), it executes the encoding process for the Nth stream among the 16 FHD streams (S402) and records the encoded video data (S403). Subsequently, the control unit 11 executes the encoding process for the next Nth stream (S402) and records the encoded video data (S403). The control unit 11 encodes the FHD streams in order until the encoding process for all the FHD streams is completed (S404).

[0077] FIG. 12 and FIG. 13 are conceptual diagrams comparing the conventional video segmentation process and the video segmentation process of the present embodiment. In the conventional video segmentation process, as shown in FIG. 12, for example, when generating 16 pieces of FHD video data from 8K video data, after decoding the entire 8K video data, the process of cutting out and encoding the FHD stream corresponding to the first position (coordinate) is repeated 16 times. For this reason, the processing time becomes long.

[0078] On the other hand, in the video segmentation process according to the present embodiment, as shown in FIG. 13, for example, when generating 16 pieces of FHD video data from 8K video data, the 8K video data is decoded once, and 16 FHD streams are encoded in parallel. That is, the decoding of the 8K video data is completed in one time. Also, it is possible to encode a plurality of FHD streams in parallel. For this reason, the processing time can be shortened compared with the conventional method.

[0079] In the above-described embodiment, an example of generating FHD video data from 8K video data is shown, but the present disclosure is not limited to this. For example, FHD video data may be generated from 4K video data. Also, in the above-described embodiment, video data of a moving image is given as an example of the target data for the video segmentation process, but the target data for the video segmentation process may be a still image (for example, an 8K still image).

[0080] [Display Processing of Divided Image] A specific configuration for displaying the divided image generated by the above-described configuration on the display device 20 will be described below. In the following, the case where FHD video data (2K image, divided image P2) is generated from 4K video data (4K image, high-resolution image P1) will be described as an example.

[0081] The acquisition processing unit 113 acquires the display range specified by the user for the image P11 obtained by converting the high-resolution image P1 to a low resolution. For example, as shown in FIG. 14, the display processing unit 111 causes the display device 20 to display the image P11 obtained by converting (reducing) the entire high-resolution image P1 to a low resolution. When the image P11 is being displayed on the display device 20, the user designates a desired display range A1 on the display screen. The user may designate the display range A1 by touching the display screen with a finger, or may also designate the display range A1 by means of a mouse operation. Here, the size of the display range A1 is set to, for example, 1 / 2 of the resolution of the display device 20 (here, 960×540 pixels). The user designates the display range A1 by moving a rectangular frame of a preset size on the display screen. In this way, the user designates the range in which they want to view a detailed (high-quality) image among the entire image.

[0082] Further, the control unit 11 may set the size of the display range A1 according to the ratio between the resolution of the high-resolution image P1 and the resolution of the display device 20. For example, when the ratio between the resolution of the high-resolution image P1 (4K) and the resolution of the display device 20 (2K) is 2:1, the control unit 11 sets the size of the display range A1 to a resolution of 1 / 2 of the resolution of the display device 20 (2K) (1K). Also, for example, when the ratio between the resolution of the high-resolution image P1 (8K) and the resolution of the display device 20 (2K) is 4:1, the control unit 11 sets the size of the display range A1 to 1 / 4 (0.5K) of the resolution of the display device 20 (2K).

[0083] The acquisition processing unit 113 acquires information on the display range A1 designated by the user for the entire image (image P11) on the display device 20.

[0084] When the display processing unit 111 acquires the display range A1, it identifies a plurality of divided images P2 among which all or a part overlaps with the display range A1, and based on the identified plurality of divided images P2, causes the display device 20 to display an image (high-resolution image) corresponding to the display range A1.

[0085] For example, as shown in FIG. 15, the display processing unit 111 enlarges the acquired display range A1 according to the ratio between the resolution of the high-resolution image P1 (4K) and the resolution of the display device 20 (2K) (here, it is enlarged by a factor of 2) and associates it with the high-resolution image P1. Here, the position of the boundary of the display range A1 coincides with the division position of the high-resolution image P1. Therefore, among the 64 divided images P2, each of the divided images p33, p34, p35, p36, p43, p44, p45, p46, p53, p54, p55, p56, p63, p64, p65, p66 overlaps the display range A1, and the other divided images P2 do not overlap the display range A1.

[0086] In this case, the display processing unit 111 causes the display device 20 to display an image corresponding to the display range A1 based on the divided images P2 (divided images p33 to p36, p43 to p46, p53 to p56, p63 to p66) that all overlap the display range A1 among the plurality of divided images P2. For example, as shown in FIG. 16, the display processing unit 111 generates a 2K (1920×1080 pixels) image P3 by combining the divided images p33 to p36, p43 to p46, p53 to p56, p63 to p66, and outputs and displays the image P3 on the display device 20.

[0087] FIG. 17 shows a display range A2 associated with the high-resolution image P1 when the user designates a display range at a position different from the display range A1 (see FIG. 11) for the image P11 displayed on the display device 20. Also in the example shown in FIG. 17, the position of the boundary of the display range A2 coincides with the division position of the high-resolution image P1. Here, among the 64 divided images P2, each of the divided images p22 to p25, p32 to p35, p42 to p45, p52 to p55 overlaps the display range A2, and the other divided images P2 do not overlap the display range A2.

[0088] In this case, the display processing unit 111 causes the display device 20 to display an image corresponding to the display range A2 based on the divided images P2 (divided images p22 to p25, p32 to p35, p42 to p45, p52 to p55) that all overlap the display range A2 among the plurality of divided images P2. For example, as shown in FIG. 18, the display processing unit 111 generates a 2K (1920×1080 pixels) image P3 by combining the divided images p22 to p25, p32 to p35, p42 to p45, p52 to p55, and outputs and displays the image P3 on the display device 20.

[0089] In this way, when the position of the boundary of the display range coincides with the division position of the high-resolution image P1, the display processing unit 111 causes the display device 20 to display an image P3 obtained by combining a plurality of divided images P2 that all overlap the display range among the plurality of divided images P2.

[0090] As another embodiment, the display processing unit 111 may output each of the 16 divided images P2 of 480×270 pixels to the display device 20, and cause the display device 20 to generate (combine) and display a 2K (1920×1080 pixels) image P3. That is, when the position of the boundary of the display range coincides with the division position of the high-resolution image P1, the display processing unit 111 causes the display device 20 to output a plurality of divided images P2 that all overlap the display range among the plurality of divided images P2 from the image output device 10, and cause the display device 20 to display an image P3 obtained by combining the plurality of divided images P2.

[0091] FIG. 19 shows a display range A3 associated with a high-resolution image P1 when the user designates a display range at a position different from the display range A1 in the overall image displayed on the display device 20. In the example shown in FIG. 19, the position of the boundary of the display range A3 does not coincide with the division position of the high-resolution image P1. In this case, focusing on the divided image p22 (see FIG. 20), only a part of the entire rectangular area of the divided image P2 overlaps with the display range A3. Similarly, for each of the divided images p23 to p26, p32, p36, p42, p46, p52, p56, p62 to p66, only a part overlaps with the display range A3. Also, for each of the divided images p33 to p35, p43 to p45, p53 to p55, the entire rectangular area overlaps with the display range A3.

[0092] In this case, the display processing unit 111 causes the display device 20 to display an image corresponding to the display range A3 based on the divided images P2 (divided images p22 to p26, p32 to p36, p42 to p46, p52 to p56, p62 to p66) among the plurality of divided images P2 that entirely or partially overlap with the display range A1. For example, as shown in FIG. 20, the display processing unit 111 causes the display device 20 to display the portion included in the display range A3 in the image P3 obtained by combining the divided images p22 to p26, p32 to p36, p42 to p46, p52 to p56, p62 to p66. For example, as shown in FIG. 21, the display processing unit 111 outputs the image P3 obtained by combining the divided images p22 to p26, p32 to p36, p42 to p46, p52 to p56, p62 to p66 to the display device 20, and the display device 20 displays the portion included in the display range A3 in the image P3.

[0093] In this way, when the position of the boundary of the display range A3 does not coincide with the division position of the high-resolution image P1, the display processing unit 111 causes the display device 20 to display the portion included in the display range A3 in the image P3 obtained by combining a plurality of divided images among the plurality of divided images P2 that entirely or partially overlap with the display range A3. That is, when the position of the boundary of the display range designated by the user does not coincide with the division position of the high-resolution image P1, the display processing unit 111 uses a plurality of divided images P2 corresponding to a range wider than the designated display range for display on the display device 20.

[0094] As another embodiment, when the position of the boundary of the display range A3 does not coincide with the division position of the high-resolution image P1, the display processing unit 111 outputs to the display device 20 a plurality of divided images P2 in which all or part of the plurality of divided images P2 overlap the display range A3. In the display device 20, the plurality of divided images P2 may be combined, and a portion of the combined image P3 that is included in the display range A3 may be displayed. That is, the combining process of the plurality of divided images P2 may be executed by the image output device 10 or the display device 20. Further, as another embodiment, the display device 20 may display the entire combined image P3 after reducing it.

[0095] The display processing unit 111 is an example of the first display processing unit and the second display processing unit of the present disclosure.

[0096] In the first embodiment, the smaller the number of divisions of the high-resolution image P1, the smaller the total capacity of the image data sent to the network. Instead, however, a load is imposed on the image drawing process for combining and displaying the divided images. For example, when the image output device 10 is configured by a PC, the load on the image output device 10 increases, and when the display device 20 is configured by a PC, the load on the display device 20 increases. Also, when the divided images become larger, the capacity of the image data sent to the network increases, so a load is imposed on the communication cable. Instead, however, the load on the image drawing process becomes smaller. The division processing unit 112 may determine the size of the divided images in consideration of these advantages and disadvantages.

[0097] [Display device 20] FIG. 2 shows a functional block diagram of the display device 20. The display device 20 includes a control unit 21, a storage unit 22, an operation unit 23, a display unit 24, an input unit 25, and the like. The display device 20 may have a well-known configuration.

[0098] The operation unit 23 is a mouse, keyboard, touch panel, or the like that accepts operations by the user who uses the display device 20. The display unit 24 is a display panel such as a liquid crystal display or an organic EL display that displays various types of information. The operation unit 23 and the display unit 24 may be an integrally formed user interface. When the display device 20 is configured as a monitor, for example, a remote control is included in the operation unit 23. Further, when the image output device 10 is configured as a PC and the display device 20 is configured as a monitor, for example, the storage unit (including the control program) and the operation unit are omitted from the display device 20 and included in the image output device 10. Further, when the image output device 10 is configured as a PC or a server and the display device 20 is configured as a PC, for example, the operation unit is included in the display device 20.

[0099] The storage unit 22 is a non-volatile storage unit such as a flash memory, HDD, or SSD that stores various types of information. A control program for causing the control unit 21 to execute various processes is stored in the storage unit 22. For example, the control program is non-temporarily recorded on a computer-readable recording medium such as a USB, CD, or DVD, and is read by a reading device (not shown) provided in the display device 20 and stored in the storage unit 22.

[0100] The input unit 25 is connected to an input terminal and receives an image signal output from the image output device 10.

[0101] The control unit 21 includes control devices such as a CPU, ROM, and RAM. The CPU is a processor that executes various arithmetic processes. The ROM stores in advance control programs such as BIOS and OS for causing the CPU to execute various processes. The RAM stores various types of information and is used as a temporary storage memory (working area) for various processes executed by the CPU. Then, the control unit 11 controls the display device 20 by causing the CPU to execute various control programs stored in advance in the ROM or the storage unit 22.

[0102] Specifically, the control unit 21 includes various processing units such as an acquisition processing unit 211 and a display processing unit 212. Note that the control unit 21 functions as the various processing units by executing various processes according to the control program using the CPU. Also, some or all of the processing units included in the control unit 21 may be configured by electronic circuits. Note that the control program may be a program for causing a plurality of processors to function as the various processing units.

[0103] The acquisition processing unit 211 acquires an image corresponding to the image signal input from the image output device 10. The display processing unit 212 causes the display unit 24 to display the image acquired from the image output device 10.

[0104] Specifically, the acquisition processing unit 211 acquires from the image output device 10 an image P11 obtained by converting the high-resolution image P1 to a low resolution corresponding to the resolution of the display device 20 (2K: 1920×1080 pixels). The display processing unit 111 causes the display unit 24 to display the image P11 (entire image) acquired by the acquisition processing unit 211 (see FIG. 3).

[0105] Also, when the user designates a display range for the image P11 displayed on the display unit 24, the acquisition processing unit 211 acquires an image P3 (see FIGS. 16, 18, and 21) generated based on a plurality of divided images P2 from the image output device 10, and the display processing unit 212 causes the display unit 24 to display the image P3.

[0106] Note that when the acquisition processing unit 211 acquires from the image output device 10 an image P3 obtained by combining a plurality of divided images P2 corresponding to a range wider than the display range designated by the user (see FIG. 19), the display processing unit 212 may cause the display unit 24 to display a portion of the image P3 included in the display range A3. Also, as another embodiment, the display processing unit 212 may convert (reduce) the image P3 to the size of the resolution (2K: 1920×1080 pixels) and display it.

[0107] [Display Control Processing] Next, with reference to FIG. 22, an example of the procedure of the display control process executed in the display system 100 will be described.

[0108] Note that the present disclosure can be regarded as a disclosure of a display control method (the display method of the present disclosure) for executing one or more steps included in the display control process. Also, one or more steps included in the display control process described herein may be appropriately omitted or divided. Further, the execution order of each step in the display control process may be different within a range that produces the same operational effects. Furthermore, here, the case where the control unit 11 (one processor) of the image output device 10 executes each step in the display control process will be described as an example, but in other embodiments, a plurality of processors may execute each step in the display control process in a distributed manner.

[0109] First, in step S1, the control unit 11 outputs an image P11 obtained by converting the high-resolution image P1 to a low resolution to the display device 20. Specifically, the control unit 11 converts the high-resolution image P1 (4K: 3840×2160 pixels) to an image P11 with a low resolution (2K: 1920×1080 pixels) and outputs it to the display device 20. When the display device 20 acquires the image P11 from the image output device 10, it is displayed on the display unit 24 (see FIG. 3).

[0110] Next, in step S2, the control unit 11 executes a process (division process) of dividing the high-resolution image P1 into a plurality of divided images P2. For example, when displaying a high-resolution image P1 of 3840×2160 pixels on a display device 20 corresponding to 1920×1080 pixels, the control unit 11 divides the high-resolution image P1 into 64 divided images P2 each having 480×270 pixels (see FIG. 4).

[0111] Note that the control unit 11 may individually execute the processes of steps S1 and S2 in advance. For example, the control unit 11 may output an image P11 obtained by converting the high-resolution image P1 to a low resolution to the display device 20 in advance. Also, the control unit 11 may generate a plurality of divided images P2 in advance and store them in the storage unit 12.

[0112] Next, in step S3, the control unit 11 determines whether it has acquired the display range from the display device 20. For example, the user designates a range for viewing a detailed (high-quality) image or a range for magnified display of the image in the image P11 displayed on the display device 20 (see FIG. 14 and the like). When the user designates a range or magnified display, the control unit 11 acquires the display range corresponding to the range or magnified display designated by the user. When the control unit 11 acquires the display range from the display device 20 (S3: Yes), the process proceeds to step S4. On the other hand, when the control unit 11 does not acquire the display range from the display device 20 (S3: No), the process proceeds to step S6.

[0113] In step S4, the control unit 11 determines whether the position of the boundary of the acquired display range matches the division position of the high-resolution image P1. When the position of the boundary of the acquired display range matches the division position of the high-resolution image P1 (S4: Yes), the process proceeds to step S5. On the other hand, when the position of the boundary of the acquired display range does not match the division position of the high-resolution image P1 (S4: No), the process proceeds to step S41.

[0114] In the example shown in FIG. 15, when the acquired display range A1 is enlarged (here, enlarged by a factor of 2) according to the ratio between the resolution of the high-resolution image P1 (4K) and the resolution of the display device 20 (2K) and associated with the high-resolution image P1, the position of the boundary of the display range A1 matches the division position of the high-resolution image P1. In this case, the control unit 11 proceeds to step S5.

[0115] In contrast, in the example shown in FIG. 20, when the acquired display range A3 is enlarged (enlarged by a factor of 2) according to the ratio between the resolution of the high-resolution image P1 (4K) and the resolution of the display device 20 (2K) and associated with the high-resolution image P1, the position of the boundary of the display range A3 does not match the division position of the high-resolution image P1. In this case, the control unit 11 proceeds to step S41.

[0116] In step S5, the control unit 11 causes the display device 20 to display using the divided images P2 among the plurality of divided images P2 that all overlap with the display range.

[0117] In the example shown in FIG. 15, the control unit 11 causes the display device 20 to display an image corresponding to the display range A1 based on the divided images p33 to p36, p43 to p46, p53 to p56, p63 to p66 that all overlap with the display range A1. For example, as shown in FIG. 16, the control unit 11 generates a 2K (1920×1080 pixels) image P3 by combining the divided images p33 to p36, p43 to p46, p53 to p56, p63 to p66, and outputs and displays the generated image P3 on the display device 20. After step S5, the control unit 11 shifts the process to step S6.

[0118] In contrast, in step S41, the control unit 11 causes the display device 20 to display using the divided images P2 among the plurality of divided images P2 that all or partially overlap with the display range.

[0119] In the example shown in FIG. 20, the control unit 11 causes the display device 20 to display an image corresponding to the display range A3 based on the divided images p22 to p26, p32, p36, p42, p46, p52, p56, p62 to p66 that only partially overlap with the display range A3 and the divided images p33 to p35, p43 to p45, p53 to p55 that all overlap with the display range A1. For example, as shown in FIG. 21, the control unit 11 generates an image P3 by combining the divided images p22 to p26, p32 to p36, p42 to p46, p52 to p56, p62 to p66, outputs the generated image P3 to the display device 20, and causes the display device 20 to display the portion of the image P3 that is included in the display range A3. After step S41, the control unit 11 shifts the process to step S6.

[0120] In step S6, the control unit 11 determines whether to end the display process. When the user performs an end operation of the display process on the display device 20 (S6: Yes), the control unit 11 ends the display control process. When the user does not perform an end operation of the display process on the display device 20 (S6: No), the control unit 11 returns the process to step S3 and repeats the above-described process. For example, when returning to step S3 and the user moves the display range or enlarges the image in the display range, the control unit 11 acquires a new display range and executes the above-described process again. The control unit 11 repeatedly executes the above-described process until the display process ends.

[0121] As described above, the display system 100 according to the first embodiment is a system that causes a display device capable of displaying a first image with a first resolution (for example, 3840×2160 pixels) to display an image with a second resolution (for example, 1920×1080 pixels) that is lower than the first resolution. Further, the display system 100 divides the first image into a plurality of divided images with a third resolution (for example, 480×270 pixels) that is lower than the second resolution, acquires a display range designated by the user with respect to the entire first image, and specifies a plurality of first divided images in which all or part of the display range overlaps among the plurality of divided images. Based on the specified plurality of first divided images, an image with the second resolution corresponding to the display range is displayed on the display device 20.

[0122] According to the above configuration, the display range designated by the user can be displayed with high-quality image quality. Further, since the image output device 10 transmits the divided images of the display range designated by the user to the display device 20, in a configuration in which the image output device 10 and the display device 20 are connected by wireless communication via a network (for example, the Internet), the load on the network can be suppressed.

[0123] Further, the display system 100 according to the first embodiment causes a display device 20 capable of displaying an image with a second resolution lower than the first resolution to display a first image with the first resolution based on second video data (divided image) generated by the image output device 10. Specifically, the display system 100 acquires a display range specified by the user for the entire first image corresponding to the first video data, identifies a plurality of first divided images among the plurality of divided images included in the second video data, all or part of which overlaps with the display range, and based on the plurality of first divided images, causes the display device 20 to display an image with the second resolution corresponding to the display range. Thereby, it is possible to shorten the processing time for generating a plurality of divided video data for displaying a high-resolution image, and to suppress the load on the network when displaying a high-resolution image.

[0124] [Second Embodiment] The display system 200 according to the second embodiment of the present disclosure will be described. Note that the same components as those of the display system 100 according to the first embodiment are denoted by the same reference numerals, and the description thereof will be omitted.

[0125] FIG. 23 is a functional block diagram of the display system 200 according to the second embodiment. In the image output device 10 according to the second embodiment, in addition to the high-resolution image P1, a partial image Q1 is stored in the storage unit 12. The control unit 11 generates a plurality of partial images Q1 based on the high-resolution image P1 by a generation process described later and stores them in the storage unit 12. When a plurality of high-resolution images P1 are stored in the storage unit 12, a plurality of partial images Q1 are stored in association with each high-resolution image P1.

[0126] The control unit 11 includes various processing units such as a display processing unit 111, a generation processing unit 114, and an acquisition processing unit 113.

[0127] The generation processing unit 114 generates a plurality of partial images Q1 with a lower resolution than the high-resolution image P1 based on the high-resolution image P1, and each of the partial images Q1 overlaps (overlaps) with at least a part of another partial image Q1. Note that the partial image Q1 is an image of a part of the area in the high-resolution image P1.

[0128] Figures 24A to 24H show an example of a plurality of partial images Q1 generated for one high-resolution image P1. For example, as shown in Figure 24A, the generation processing unit 114 generates a partial image Q11 of 1920×1080 (2K) in the upper left part of a high-resolution image P1 of 3840×2160 pixels (4K). Also, as shown in Figure 24B, the generation processing unit 114 generates a partial image Q12 obtained by shifting the partial image Q11 480×270 pixels to the right. Also, as shown in Figure 24C, the generation processing unit 114 generates a partial image Q13 obtained by shifting the partial image Q12 480×270 pixels to the right. Also, as shown in Figure 24D, the generation processing unit 114 generates a partial image Q14 obtained by shifting the partial image Q13 480×270 pixels to the right. Also, as shown in Figure 24E, the generation processing unit 114 generates a partial image Q15 obtained by shifting the partial image Q14 480×270 pixels to the right.

[0129] Also, as shown in Figure 24F, the generation processing unit 114 generates a partial image Q21 obtained by shifting the partial image Q11 480×270 pixels downward. Similarly, the generation processing unit 114 shifts the partial image Q21 480×270 pixels to the right each time to generate partial images Q22 to Q25.

[0130] Also, the generation processing unit 114 generates a partial image Q31 obtained by shifting the partial image Q21 480×270 pixels downward, and shifts the partial image Q31 480×270 pixels to the right each time to generate partial images Q32 to Q35.

[0131] Further, the generation processing unit 114 generates a partial image Q41 by shifting the partial image Q31 downward by 480×270 pixels, and generates partial images Q42 to Q45 by shifting the partial image Q41 to the right by 480×270 pixels each.

[0132] Also, as shown in FIG. 24G, the generation processing unit 114 generates a partial image Q51 by shifting the partial image Q41 downward by 480×270 pixels, and generates partial images Q52 to Q55 (see FIG. 24H) by shifting the partial image Q51 to the right by 480×270 pixels each.

[0133] In this way, the generation processing unit 114 generates 25 partial images Q1 (partial images Q11 to Q15, Q21 to Q25, Q31 to Q35, Q41 to Q45, Q51 to Q55), each of which overlaps with a part of another partial image Q1, based on a single high-resolution image P1.

[0134] When the generation processing unit 114 generates a plurality of partial images Q1, it associates the high-resolution image P1 and the corresponding plurality of partial images Q1 with each other and stores them in the storage unit 12 (see FIG. 23).

[0135] Note that the generation processing unit 114 can generate the partial image Q1 from the high-resolution image P1 based on the video segmentation processing shown in the first embodiment. That is, as shown in FIG. 23, the generation processing unit 114 may include a decoding processing unit 121, a video segmentation processing unit 122, an encoding processing unit 123, and a storage processing unit 124.

[0136] For example, when the video data is a 4K 60-second video, 25 FHD streams are generated and encoding processing is executed in parallel to generate 25 FHD video data (partial images Q1).

[0137] The acquisition processing unit 113 acquires the display range specified by the user for the image P11 obtained by converting the high-resolution image P1 into a low-resolution image. For example, as shown in FIG. 25, the display processing unit 111 causes the display device 20 to display the image P11 obtained by converting (reducing) the entire high-resolution image P1 into a low-resolution image. When the image P11 is being displayed on the display device 20, the user designates a desired display range A5 on the display screen. Note that the display range A5 is set to a size corresponding to the ratio between the resolution of the high-resolution image P1 and the resolution of the display device 20 and the resolution of the partial image Q1 (here, half the resolution of the partial image Q1 (960×540 pixels)).

[0138] The acquisition processing unit 113 acquires information on the display range A5 specified by the user for the image P11 on the display device 20.

[0139] When the display processing unit 111 acquires the display range A5, it identifies the partial image Q1 corresponding to the display range A5 among the plurality of partial images Q1, and causes the identified partial image Q1 to be displayed on the display device 20.

[0140] For example, as shown in FIG. 25, the display processing unit 111 enlarges (here, enlarges by a factor of 2) the acquired display range A5 according to the ratio between the resolution of the high-resolution image P1 (4K) and the resolution of the display device 20 (2K), and associates it with the high-resolution image P1. Here, since the position of the display range A5 coincides with the partial image Q33 (see FIG. 26), the display processing unit 111 identifies the partial image Q33 corresponding to the display range A5. As shown in FIG. 27, the display processing unit 111 outputs the identified partial image Q33 to the display device 20 for display.

[0141] FIG. 28 shows an example in which the user designates a display range A6 at a position different from the display range A5 (see FIG. 25) for the image P11 displayed on the display device 20. Here, since the position of the display range A6 coincides with the partial image Q22 (see FIG. 29), the display processing unit 111 identifies the partial image Q22 corresponding to the display range A6. As shown in FIG. 30, the display processing unit 111 outputs the identified partial image Q22 to the display device 20 for display.

[0142] In this way, the display processing unit 111 identifies a partial image Q1 corresponding to the display range specified by the user among the plurality of pre-generated partial images Q1, and outputs the identified partial image Q1 to the display device 20 for display.

[0143] Note that the number of partial images Q1 for the high-resolution image P1 is not limited. For example, the generation processing unit 114 may determine the shift amount or overlap amount (overlap amount) between the partial images Q1 according to the minimum unit (scroll pitch) of the movement amount when the user moves the display range on the display device 20. For example, when the scroll pitch on the display device 20 is 240×135 pixels, the generation processing unit 114 sets the shift amount between the partial images Q1 to 480×270 pixels as shown in FIGS. 24A to 24H. Also, for example, when the scroll pitch on the display device 20 is 120×67 pixels, the generation processing unit 114 sets the shift amount between the partial images Q1 to 240×135 pixels. In this way, the generation processing unit 114 may generate a plurality of partial images Q1 that are each shifted from each other by the pitch of the screen scroll on the display device 20. While reducing the shift amount between the partial images Q1 has the advantage that the user can move the display range finely to display the image, it has the disadvantage of increasing the data amount of the partial images Q1. Therefore, the shift amount may be determined in consideration of the advantages and disadvantages.

[0144] [Display Control Processing] Hereinafter, an example of the procedure of the display control processing executed in the display system 200 will be described with reference to FIG. 31.

[0145] First, in step S11, the control unit 11 outputs an image P11 obtained by converting the high-resolution image P1 to a low resolution to the display device 20. Specifically, the control unit 11 converts the high-resolution image P1 (4K: 3840×2160 pixels) to an image P11 with a low resolution (2K: 1920×1080 pixels) and outputs it to the display device 20. When the display device 20 acquires the image P11 from the image output device 10, it is displayed on the display unit 24 (see FIG. 3).

[0146] Next, in step S12, the control unit 11 executes a process (generation process) of generating a plurality of partial images Q1 based on the high-resolution image P1. For example, when displaying a high-resolution image P1 of 3840×2160 pixels on a display device 20 corresponding to 1920×1080 pixels, the control unit 11 generates 25 partial images Q1 each of 1920×1080 pixels based on the high-resolution image P1 (see FIGS. 24A to 24H).

[0147] Note that the control unit 11 may execute each of the processes in steps S11 and S12 individually in advance. For example, the control unit 11 outputs an image P11 obtained by converting the high-resolution image P1 to a low resolution to the display device 20 in advance. Further, the control unit 11 generates a plurality of partial images Q1 in advance and stores them in the storage unit 12.

[0148] Next, in step S13, the control unit 11 determines whether it has acquired a display range from the display device 20. For example, the user designates a range where a detailed (high-quality) image is desired to be viewed or a magnification display of the image in the image P11 displayed on the display device 20 (see FIG. 25 and the like). When the user designates a range or a magnification display, the control unit 11 acquires a display range corresponding to the range or the magnification display designated by the user. When the control unit 11 acquires the display range from the display device 20 (S13: Yes), the process proceeds to step S14. On the other hand, when the control unit 11 does not acquire the display range from the display device 20 (S13: No), the process proceeds to step S15.

[0149] In step S14, the control unit 11 specifies a partial image Q1 corresponding to the acquired display range among the plurality of partial images Q1, and causes the display device 20 to display the specified partial image Q1. In the example shown in FIG. 25, the control unit 11 causes the display device 20 to display a partial image Q33 corresponding to the display range A5 designated by the user, and in the example shown in FIG. 28, the control unit 11 causes the display device 20 to display a partial image Q22 corresponding to the display range A6 designated by the user.

[0150] In step S15, the control unit 11 determines whether to end the display process. When the user performs an end operation of the display process on the display device 20 (S15: Yes), the control unit 11 ends the display control process. When the user does not perform an end operation of the display process on the display device 20 (S15: No), the control unit 11 returns the process to step S13 and repeats the above-described process. The control unit 11 repeatedly executes the above-described process until the display process ends.

[0151] As described above, the display system 200 according to the second embodiment is a system that causes a display device capable of displaying a first image with a first resolution (for example, 3840 × 2160 pixels) to display an image with a second resolution (for example, 1920 × 1080 pixels) that is lower than the first resolution. Further, based on the first image, the display system 200 generates a plurality of partial images with the second resolution, each of which overlaps a part of at least one other partial image, obtains a display range specified by the user for the entire first image, and causes the display device 20 to display a first partial image corresponding to the display range among the plurality of partial images.

[0152] According to the above configuration, the display range specified by the user can be displayed with high-quality image quality. Further, since the image output device 10 transmits the partial image of the display range specified by the user to the display device 20, the load on the network can be suppressed.

[0153] [Other Embodiments] Other embodiments of the present disclosure will be described. For example, in the display system 100 according to the first embodiment, when the display device 20 receives an operation for designating a display range from a user, the display device 20 enlarges the image P11 by internal processing and displays an enlarged image of a portion of the image P11 corresponding to the display range. Thereafter, when the display processing unit 111 receives an operation for determining the display range from the user, the display processing unit 111 switches the enlarged image displayed on the display device 20 to an image (high-definition image) based on a plurality of divided images P2. For example, as shown in FIG. 32, when the user designates (or moves) the display range A1 in the image P11 displayed on the display device 20, the display processing unit 212 of the display device 20 enlarges and displays a portion of the image P11 corresponding to the display range A1. Thereafter, when the user determines the display range by pressing a confirmation button or a switching button (not shown) on the display screen of the display device 20, the display processing unit 111 of the image output device 10 replaces the image P11 (enlarged image) of the display device 20 with an image P3 obtained by combining a plurality of divided images P2 corresponding to the display range A1.

[0154] According to the above configuration, until a high-definition image corresponding to the display range is input from the image output device 10, an enlarged image can be displayed on the display device 20. Therefore, for example, the user can repeatedly designate or move the display range in the entire image or the enlarged image displayed on the display device 20. Further, even when the user repeatedly performs an operation of designating or moving the display range, it is possible to visually recognize the image in the designated range without the display being interrupted. Further, the user can visually recognize a high-definition image in the designated range.

[0155] The above configuration can be similarly applied to the display system 200 according to the second embodiment. Specifically, when the display device 20 receives an operation for designating a display range from the user, it displays an enlarged image (image P11) obtained by enlarging the portion of the high-resolution image P1 corresponding to the display range. Then, when the display processing unit 111 receives an operation for determining the display range from the user, it switches the enlarged image displayed on the display device 20 to the partial image Q1 corresponding to the determined display range among the plurality of partial images Q1.

[0156] As another embodiment of the present disclosure, in the display system 100 according to the first embodiment, the display device 20 may display each of the plurality of divided images in the order in which the reading of each is completed. For example, in the example shown in FIG. 14, when the display processing unit 111 identifies the divided images p33 to p36, p43 to p46, p53 to p56, and p63 to p66 as the divided images P2 corresponding to the display range A1 among the plurality of divided images P2, it outputs the image data of each of these divided images to the display device 20. The display processing unit 212 of the display device 20 causes the display unit 24 to display each of the plurality of divided images in the order in which the reading of each is completed. Thereby, the user can grasp the reading status of the image from the image output device 10.

[0157] Note that the display processing unit 111 of the image output device 10 may output each of the plurality of divided images to the display device 20 in a predetermined order. Further, the display processing unit 212 of the image output device 10 may cause the display unit 24 to display the current reading status. For example, the display processing unit 212 displays information (e.g., "N / 16") that can identify the order N of the divided image currently being displayed among the total number of divided images (here, 16).

[0158] [Supplementary Note 1 of the Disclosure] Hereinafter, the outline of the disclosure extracted from the above-described embodiment (video division processing) will be appended. Note that each configuration and each processing function described in the following supplementary note can be arbitrarily combined by selection.

[0159] [Supplementary Note 1] A video processing system that generates second video data including a plurality of low-resolution divided video data from high-resolution first video data, a decoding processing unit that decodes the first video data, a video division processing unit that divides the decoded first video data in a preset area to generate the plurality of divided video data, an encoding processing unit that encodes each of the plurality of divided video data, a storage processing unit that stores the second video data including the plurality of encoded divided video data, and a video processing system comprising the same.

[0160] <Appendix 2> The video division processing unit generates a number of divided video data corresponding to the processing capacity of the video processing system. The video processing system according to Appendix 1.

[0161] <Appendix 3> The video division processing unit cuts out frame data of a predetermined number of frames from the first video data, and generates the plurality of divided video data based on the cut-out frame data. The encoding processing unit encodes each of the plurality of divided video data corresponding to the frame data in parallel or serially. The video processing system according to Appendix 1 or 2.

[0162] <Appendix 4> The video division processing unit repeatedly executes the process of cutting out the frame data from the first video data to generate the plurality of divided video data until all frames of the first video data are reached. The encoding processing unit executes an encoding process for each frame data. The storage processing unit records the plurality of divided video data encoded for each frame data to generate the second video data. The video processing system according to Appendix 3.

[0163] <Supplementary Note 5> The video segmentation processing unit cuts out a video stream of a predetermined number of frames from the first video data, and generates a plurality of low-resolution segmented video streams from the cut-out video stream. The encoding processing unit executes the process of encoding each of the plurality of segmented video streams in parallel. The video processing system according to any one of Supplementary Notes 1 to 4.

[0164] <Supplementary Note 6> When the encoding processing unit does not have the processing ability to generate and encode the plurality of segmented video streams, the encoding processing unit executes the encoding process for a part of the plurality of segmented video streams, and after the encoding process for the part of the segmented video streams is completed, executes the encoding process for the remaining segmented video streams. The video processing system according to Supplementary Note 5.

[0165] <Supplementary Note 7> A display system that displays a first image with a first resolution on a display device capable of displaying an image with a second resolution lower than the first resolution based on the second video data generated by the video processing system according to any one of Supplementary Notes 1 to 6, An acquisition processing unit that acquires a display range specified by a user for the entire first image corresponding to the first video data; A display processing unit that identifies a plurality of first segmented images among the plurality of segmented images included in the second video data, all or part of which overlaps with the display range, and displays an image with the second resolution corresponding to the display range on the display device based on the plurality of first segmented images; A display system comprising:

[0166] [Supplementary Note 2 of the Disclosure] Hereinafter, a summary of the disclosure extracted from the above-described embodiment (segmented image display processing) will be appended. Note that each configuration and each processing function described in the following appendices can be arbitrarily selected and combined as appropriate.

[0167] <Appendix 1> A display system for causing a display device capable of displaying an image with a second resolution lower than the first resolution to display a first image with the first resolution, comprising: a division processing unit that divides the first image into a plurality of divided images with a third resolution lower than the second resolution; an acquisition processing unit that acquires a display range specified by a user with respect to the entire first image; a first display processing unit that identifies a plurality of first divided images among the plurality of divided images that entirely or partially overlap with the display range, and based on the plurality of first divided images, causes the display device to display an image with the second resolution corresponding to the display range; A display system comprising the above components.

[0168] <Appendix 2> When the position of the boundary of the display range coincides with the division position of the first image, the first display processing unit causes the display device to display an image obtained by combining a plurality of first divided images among the plurality of divided images that entirely overlap with the display range. The display system according to Appendix 1.

[0169] <Appendix 3> When the position of the boundary of the display range coincides with the division position of the first image, the first display processing unit causes an image output device to output a plurality of first divided images among the plurality of divided images that entirely overlap with the display range to the display device, and causes the display device to display an image obtained by combining the plurality of first divided images. The display system according to Appendix 1 or 2.

[0170] <Appendix 4> When the position of the boundary of the display range does not coincide with the division position of the first image, the first display processing unit causes the display device to display a portion of an image obtained by combining a plurality of first divided images among the plurality of divided images that entirely or partially overlap with the display range and that is included in the display range. The display system according to any one of Appendices 1 to 3.

[0171] <Appendix 5> When the position of the boundary of the display range does not match the division position of the first image, the first display processing unit causes the image output device to output a plurality of first divided images in which all or part of the plurality of divided images overlap the display range to the display device, and in the display device, combines the plurality of first divided images and displays a portion of the combined image that is included in the display range. The display system according to any one of Appendices 1 to 4.

[0172] <Appendix 6> Further comprising a second display processing unit that causes the display device to display a second image obtained by converting the entire first image to the second resolution. The acquisition processing unit acquires, as the display range, a range specified by the user with respect to the second image displayed on the display device. The display system according to any one of Appendices 1 to 5.

[0173] <Appendix 7> When the display device receives an operation for specifying the display range from the user in the second image, the display device displays an enlarged image obtained by enlarging a portion of the second image corresponding to the display range. When the first display processing unit receives an operation for determining the display range from the user, the first display processing unit switches the enlarged image displayed on the display device to the image based on the plurality of first divided images. The display system according to Appendix 6.

[0174] <Appendix 8> The display device displays each of the plurality of first divided images in the order in which the reading of each is completed. The display system according to any one of Appendices 1 to 7.

[0175] <Appendix 9> A display system for displaying a first image with a first resolution on a display device capable of displaying an image with a second resolution that is lower than the first resolution. Based on the first image, a generation processing unit that generates a plurality of partial images with the second resolution, each of which overlaps with at least a part of another partial image. An acquisition processing unit that acquires a display range specified by a user for the entire first image. A first display processing unit that causes the display device to display a first partial image corresponding to the display range among the plurality of partial images. A display system comprising the above.

[0176] <Appendix 10> The generation processing unit generates the plurality of partial images that are each shifted from each other by the pitch of screen scrolling in the display device. The display system according to Appendix 9.

[0177] <Appendix 11> The display system further comprises a second display processing unit that causes the display device to display a second image obtained by converting the entire first image to the second resolution. The acquisition processing unit acquires, as the display range, a range specified by the user for the second image displayed on the display device. The display system according to Appendix 9 or 10.

[0178] <Appendix 12> When the display device receives an operation for specifying the display range from the user in the second image, the display device displays an enlarged image obtained by enlarging a portion corresponding to the display range in the second image. When the first display processing unit receives an operation for determining the display range from the user, the first display processing unit switches the enlarged image displayed on the display device to the first partial image corresponding to the display range whose position has been determined among the plurality of partial images. The display system according to Appendix 11.

Explanation of Reference Numerals

[0179] 100: Display system 200: Display system 10: Image output device 11: Control Unit 12: Memory Unit 13: Output Unit 15: Output Unit 111: Display Processing Unit 112: Segmentation Processing Unit 113: Acquisition Processing Unit 114: Generation Processing Unit 121: Decoding Processing Unit 122: Video Segmentation Processing Unit 123: Encoding Processing Unit 124: Saving Processing Unit 20: Display Device 21: Control Unit 22: Memory Unit 23: Operation Unit 24: Display Unit 25: Input Unit 211: Acquisition Processing Unit 212: Display Processing Unit

Claims

1. A video processing system that generates second video data including a plurality of low-resolution divided video data from first video data having a high resolution, a decoding processor that decodes the first video data; a video division processing unit that divides the decoded first video data into predetermined regions to generate the plurality of divided video data; an encoding processing unit that encodes each of the plurality of divided video data; a storage processing unit that stores the second video data including the encoded divided video data; A video processing system comprising:

2. the video division processing unit generates a number of divided video data according to the processing capacity of the video processing system. The video processing system according to claim 1 .

3. the video division processing unit extracts a predetermined number of frame data from the first video data, and generates the plurality of divided video data based on the extracted frame data; the encoding processing unit encodes each of the plurality of divided video data corresponding to the frame data in parallel or in series; The video processing system according to claim 1 .

4. the video division processing unit repeatedly executes a process of extracting the frame data from the first video data to generate the plurality of divided video data until all frames of the first video data are extracted; The encoding processing unit encodes each of the frame data, the storage processing unit records the plurality of divided video data encoded for each frame data to generate the second video data. The video processing system according to claim 3 .

5. the video segmentation processing unit extracts a video stream of a predetermined number of frames from the first video data, and generates a plurality of low-resolution segmented video streams from the extracted video stream; The encoding processing unit encodes each of the plurality of divided video streams. The video processing system according to claim 1 .

6. when the encoding processing unit does not have a processing capability for generating and encoding the plurality of divided video streams, the encoding processing unit performs an encoding process on a portion of the plurality of divided video streams, and after the encoding process on the portion of the divided video streams is completed, performs an encoding process on the remaining divided video streams. The video processing system according to claim 5 .

7. A display system for displaying a first image having a first resolution on a display device capable of displaying an image having a second resolution lower than the first resolution, based on the second video data generated by the video processing system according to claim 1, an acquisition processing unit that acquires a display range designated by a user with respect to the entirety of the first image corresponding to the first video data; a display processing unit that identifies a plurality of first divided images, all or a portion of which overlaps with the display range, among a plurality of divided images included in the second video data, and causes the display device to display an image having the second resolution corresponding to the display range based on the plurality of first divided images; A display system comprising:

8. 1. A video processing method for generating second video data including a plurality of low-resolution divided video data from first video data having a high resolution, comprising: Decoding the first video data; Dividing the decoded first video data into predetermined regions to generate the plurality of divided video data; encoding each of the plurality of divided video data; storing the second video data including the encoded divided video data; A video processing method executed by one or more processors.

9. A video processing program for generating second video data including a plurality of low-resolution divided video data from first video data having a high resolution, Decoding the first video data; Dividing the decoded first video data into predetermined regions to generate the plurality of divided video data; encoding each of the plurality of divided video data; storing the second video data including the encoded divided video data; A video processing program for causing one or more processors to execute the above.

Images