Encoding device, streaming system, decoding device, encoding method, decoding method, and program

Abstract

Reduces resource load when multiple areas within a video are enlarged. [Solution] The encoding device of the embodiment includes a processing unit that receives a plurality of requests for cropping zoom, and when the first regions specified in each of the plurality of requests for cropping zoom overlap, sets the region to be cropped from the video to a single second region that includes the plurality of first regions, and generates encoded data by encoding the single second region cropped from the video, and outputs the encoded data.

Description

Technical Field

[0006] , , ,

[0001] Embodiments of the present invention relate to an encoding device, a streaming system, a decoding device, an encoding method, a decoding method, and a program.

Background Art

[0002] For example, in a macro perspective aerial view video or the like, a technique for enlarging a partial area within the video by performing a cut-out zoom on the partial area within the video has been conventionally known.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the conventional technology, it has been difficult to reduce the resource load when a plurality of regions included in a video are enlarged.

Means for Solving the Problems

[0005] The encoding device according to the embodiment receives a plurality of cut-out zoom requests, and when the first regions specified by each of the plurality of cut-out zoom requests overlap, sets the region to be cut out from the video to a single second region including the plurality of first regions, and generates encoded data by encoding the single second region cut out from the video, and includes a processing unit that outputs the encoded data.

Brief Description of the Drawings

[0006] [Figure 1] A diagram showing an example of the device configuration of the streaming system according to the embodiment. [Figure 2]A diagram showing an example of the device configuration of the encoding device according to the embodiment. [Figure 3] A diagram showing an example of cropping and zooming in on two regions of the embodiment. [Figure 4A] A figure showing example 1 of the adjustment process for the cut-out area of ​​the embodiment. [Figure 4B] This figure shows an example 2 of the adjustment process for the cut-out area of ​​the embodiment. [Figure 4C] This figure shows an example where the adjustment process for the cut-out area of ​​the embodiment is not performed. [Figure 4D] This figure shows example 3 of the adjustment process for the cut-out area of ​​the embodiment. [Figure 4E] A figure showing example 4 of the adjustment process for the cut-out area of ​​the embodiment. [Figure 5] A diagram showing an example of the device configuration of the decoding device according to the embodiment. [Figure 6A] A figure showing example 1 of the process for determining the playback region in the embodiment. [Figure 6B] A figure showing example 2 of the process for determining the regeneration region in the embodiment. [Figure 6C] A figure showing example 3 of the process for determining the regeneration area in the embodiment. [Figure 7] A flowchart illustrating an example of an encoding method for an embodiment. [Figure 8] A flowchart showing an example of a decoding method for the embodiment. [Figure 9] A diagram showing an example of the device configuration of the encoding device according to a modified example of the embodiment 1. [Figure 10] A diagram showing an example of the device configuration of a decoding device according to a modified example of the embodiment 2. [Figure 11] A diagram showing an example of the hardware configuration of the encoding device and decoding device according to the embodiment. [Modes for carrying out the invention]

[0007] Embodiments of the encoding device, streaming system, decoding device, encoding method, decoding method, and program will be described in detail below with reference to the attached drawings.

[0008] [Example of Device Configuration] FIG. 1 is a diagram showing an example of the device configuration of the streaming system 100 according to an embodiment. The streaming system 100 according to the embodiment includes an encoding device 1 and a decoding device 2.

[0009] The encoding device 1 generates encoded data by encoding video, and transmits the encoded data to the decoding device 2 via a network (e.g., the Internet, etc.).

[0010] When the decoding device 2 receives the encoded data from the encoding device 1, it outputs the video to a display device by decoding the encoded data. Further, the decoding device 2 performs enlarged display of the video by transmitting a request for cut-out zoom of the video to the encoding device 1.

[0011] Note that the request for cut-out zoom may be transmitted from an information processing device operated by a user or the like to the encoding device 1. Also, the communication between the encoding device 1 and the decoding device 2 may be performed directly, or may be performed via another device such as a relay device.

[0012] [Example of Functional Configuration of Encoding Device] FIG. 2 is a diagram showing an example of the device configuration of the encoding device 1 according to an embodiment. The encoding device 1 according to the embodiment includes a processing unit 10.

[0013] The processing unit 10 is realized by at least one processing device and executes the processing of the encoding device 1. This processing device includes, for example, a control device and an arithmetic device, and is realized by an analog or digital circuit or the like. The processing device may be a central processing unit (CPU), a general-purpose processor, a microprocessor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or a combination thereof.

[0014] The processing unit 10 includes an input unit 101, an adjustment unit 102, a control unit 103, a clipping unit 104, an encoding unit 105, and an output unit 106.

[0015] The input unit 101 receives the input of video taken by a photographing device or the like. For example, the video is an aerial view video with a 4K resolution (3,840 × 2,160 pixels).

[0016] When the adjustment unit 102 receives a request for video clipping zoom from the decoding device 2, it adjusts the area to be clipped from the video.

[0017] FIG. 3 is a diagram showing an example of clipping zoom of two areas in the embodiment. The example of FIG. 3 shows the case of enlarged display by partial clipping of a 4K camera video. If the camera for shooting the video has a 4K resolution, for example, as shown in FIG. 3, by clipping a video with an HD resolution, an effect similar to that of an enlarged zoom can be obtained.

[0018] The clipping zoom is implemented, for example, by interactive zooming that receives a dynamic specification of the clipping position from the decoding device 2. In interactive zooming or the like, it is required to suppress the load under resource constraints such as the performance of the computers realizing the encoding device 1 and the decoding device 2, and the communication bandwidth.

[0019] For example, when there are requests for clipping zoom of different areas from each of a plurality of users, if separate areas are clipped, encoded, and distributed according to the requests of each user, loads such as video compression processing and transmission data volume will be imposed.

[0020] Also, for example, when there are requests for clipping zoom of a plurality of different areas from a single user, similarly, loads such as video compression processing and transmission data volume will be imposed.

[0021] Alternatively, it is possible to generate encoded data in advance by extracting and encoding multiple regions, and then distribute this encoded data upon request. However, this requires a high-performance computer, and if there are limitations on the load of video compression processing, the number of regions that can be processed in advance will also be limited, meaning that it may not always be possible to extract a region that matches the user's requirements.

[0022] Therefore, when the adjustment unit 102 of this embodiment receives requests for cropping and zooming of multiple different regions, it adjusts the region to be cropped from the image. Details of the cropping region adjustment process will be described later.

[0023] Returning to Figure 2, the control unit 103 controls the cutting process of the cutting area adjusted by the adjustment unit.

[0024] The cropping unit 104, following the control of the control unit 103, crops a region from the video and inputs the cropped region to the encoding unit 105. If the control unit 103 does not instruct the cropping unit 104 to crop a region, the cropping unit 104 inputs the video input from the input unit 101 directly to the encoding unit 105.

[0025] The encoding unit 105 generates encoded data by encoding the video or a region extracted from the video. The encoding unit 105 inputs the encoded data to the output unit 106.

[0026] The output unit 106 outputs the encoded data input from the encoding unit 105. The encoded data output from the output unit 106 is received by the decoding device 2 via the network.

[0027] Figure 4A shows an example 1 of the adjustment process for the cropping area of ​​the embodiment. When multiple cropping areas (first area) specified by the user overlap, the adjustment unit 102 adjusts the cropping area so that, for example as shown in Figure 4A, the cropping zoomed areas 3a and 3b are unified and a single cropping area 4 (second area) is cropped.

[0028] Figure 4B shows an example 2 of the adjustment process for the cropping area of ​​the embodiment. When multiple cropping areas (first area) specified by the user overlap, the adjustment unit 102 adjusts the cropping area so that, for example as shown in Figure 4B, the cropping zoomed areas 3a and 3b are unified and a single cropping area 4 (second area) is cropped.

[0029] In other words, in the examples of Figures 4A and 4B, the adjustment unit 102 adjusts the aspect ratio of the second region so that it includes multiple first regions and the size of the second region becomes smaller.

[0030] Figure 4C shows an example where the adjustment process for the cropping area of ​​the embodiment is not performed. The adjustment unit 102 does not perform the adjustment to unify the cropping zoomed areas 3a and 3b if the multiple cropping areas 3a and 3b specified by the user do not overlap.

[0031] Figures 4D and 4E show examples 3 and 4 of the adjustment process for the cropping area of ​​the embodiment. When multiple cropping areas (first area) specified by the user overlap, the adjustment unit 102 adjusts the cropping area so as to unify the cropping zoomed areas 3a and 3b and crop a single cropping area 4 (second area), as shown in Figures 4D and 4E.

[0032] In the examples of Figures 4D and 4E, the difference from the cases of Figures 4A and 4B described above is that the cropped area 4 is set to a predetermined aspect ratio. If arbitrary areas 3a and 3b are unified as in Figures 4A and 4B described above, it may result in an unusual or uncommon aspect ratio. For example, the predetermined aspect ratio is an aspect ratio used by general encoding devices 1 and decoding devices 2. Specifically, the predetermined aspect ratio is an aspect ratio standardized by MPEG (Moving Picture Experts Group), etc.

[0033] In the examples shown in Figures 4D and 4E, the adjustment unit 102 adjusts the cropped and zoomed regions 3a and 3b to a predetermined aspect ratio when unifying them, thereby enabling even a typical encoding device 1 and decoding device 2 to easily process the unified region 4 without requiring any special treatment.

[0034] In other words, in the examples of Figures 4D and 4E, the adjustment unit 102 adjusts the aspect ratio of the second region so that it includes a plurality of first regions and the size of the second region has a predetermined aspect ratio.

[0035] In the examples of Figures 4D and 4E, the unified region 4 is expanded until it reaches a predetermined aspect ratio, so the size of the unified region 4 is larger compared to the cases of Figures 4A and 4B described above. Therefore, from the standpoint of reducing the amount of data, the cases of Figures 4A and 4B are superior to the cases of Figures 4D and 4E.

[0036] For example, it may be possible to change, through a setting, whether or not to expand the unified region 4 until it reaches a predetermined aspect ratio.

[0037] Alternatively, for example, it may be possible to change the setting whether or not to reduce (resize) the unified region 4. In the process of reducing the unified region 4, for example, the resolution may be reduced to 720p.

[0038] Note that while the examples in Figures 4A to 4E above illustrate the case where the user specifies two extraction regions, the adjustment process when the user specifies three or more extraction regions is the same as the adjustment process described above using Figures 4A to 4E.

[0039] [Example of a decoding device's functional configuration] Figure 5 shows an example of the device configuration of the decoding device 2 of the embodiment. The decoding device 2 of the embodiment includes a processing unit 20.

[0040] The processing unit 20 is implemented by at least one processing unit and executes the processing of the decoding unit 2. The description of this processing unit is the same as that of the processing unit 10 of the encoding unit 1 (Figure 2), so the description is omitted.

[0041] The processing unit 20 comprises an input unit 201, a determination unit 202, a decoding unit 203, and an output unit 205. Note that the functional configuration of the processing unit 20 is an example and may be modified as appropriate. In the modified embodiment 2 described later, a configuration (Figure 10) is described in which a display control unit 204 is provided instead of the determination unit 202.

[0042] The input unit 201 receives encoded data transmitted from the encoding device 1 via the network.

[0043] The determination unit 202 sends multiple cropping and zooming requests to the video based on the encoded data transmitted from the encoding device 1. Furthermore, when the determination unit 202 receives a response from the decoding device 2 in response to the video cropping and zooming requests, it determines the region to be played back. Details of the process for determining the region to be played back will be described later.

[0044] The decoding unit 203 generates video by decoding the video or a region extracted from the video. The decoding unit 203 inputs the decoded video to the output unit 106.

[0045] The output unit 205 outputs the video input from the decoding unit 203. The video output from the output unit 106 is displayed on the display device.

[0046] Figure 6A shows an example 1 of the process for determining the playback region in the embodiment. For example, the determination unit 202 decides to play back region 4 (second region) set by the adjustment process described above by the encoding device 1, instead of regions 3a and 3b (two first regions) specified in the two cropping zoom requests.

[0047] Figures 6B and 6C show examples 2 and 3 of the process for determining the playback area in the embodiment. For example, the determination unit 202 decides to play back areas 3a and 3b (two first areas) specified by two cropping zoom requests separately, in response to an operation input specifying the area to be played back. Figures 6B and 6C show examples of playback areas when playing back area 3b specified by a cropping zoom request.

[0048] The determination unit 202 may also determine the playback region according to the specifications from the encoding unit 105 of the encoding device 1. For example, the input unit 201 receives the input of encoded video data including the second region described above. The determination unit 202 determines the decode region for outputting the video of the second region specified by the encoding device 1. The decode unit 203 performs decoding of the decode region determined by the determination unit 202. Then, the output unit 205 outputs the video of the second region.

[0049] [Example of encoding method] Figure 7 is a flowchart showing an example of an encoding method according to the embodiment. First, the input unit 101 receives video (image) input captured by a camera or the like (step S1).

[0050] Next, the adjustment unit 102 receives a request from the decoding device 2 to zoom in on the image, thereby accepting the specification of the cropping area (step S2). Next, the adjustment unit 102 adjusts the area to be cropped from the image by the adjustment process described above (step S3).

[0051] Next, the extraction unit 104 extracts the extraction region adjusted in step S3 from the video according to the control unit 103 (step S4). Next, the encoding unit 105 encodes the region extracted from the video by the processing in step S4 (step S5). Next, the output unit 106 outputs the encoded data in step S5 (step S6).

[0052] [Example of decoding method] Figure 8 is a flowchart showing an example of a decoding method according to the embodiment. First, the input unit 201 receives the encoded data transmitted from the encoding device 1 via the network as a response to a request for cropping and zooming of the video (step S11).

[0053] Next, the determination unit 202 determines the decode region by the determination process described above (step S12). Next, the decoding unit 203 decodes the decode region determined in step S12 (step S13).

[0054] Next, the output unit 205 outputs the video (image) decoded in step S13 to the display device, thereby displaying the video (image) (step S14).

[0055] As described above, in the encoding device 1 of this embodiment, the input unit 101 receives multiple cropping zoom requests. The adjustment unit 102, if the first regions specified in each of the multiple cropping zoom requests overlap, sets the region to be cropped from the video to a single second region containing the multiple first regions. The encoding unit 105 generates encoded data by encoding the single second region cropped from the video. The output unit 106 then outputs the encoded data.

[0056] Furthermore, in the decoding device 2 of this embodiment, the determination unit 202 transmits multiple cropping zoom requests to the video based on the encoded data transmitted from the encoding device 1. The input unit 201 accepts the input of encoded data for one second region containing the multiple first regions if the first regions specified in each of the multiple cropping zoom requests overlap. The decoding unit 203 and the output unit 205 then output the video generated by decoding the encoded data.

[0057] According to the streaming system 100 of this embodiment, the resource load can be reduced when multiple regions included in the video are expanded.

[0058] (Modification of Embodiment 1) Next, a modified example 1 of the embodiment will be described. In the description of modified example 1, explanations similar to those of the embodiment will be omitted, and only the differences from the embodiment will be described.

[0059] [Example of encoding device functional configuration] Figure 9 shows an example of the device configuration of encoding device 1-2 in modified embodiment 1. Encoding device 1-2 in modified embodiment 1 includes a processing unit 10 and an imaging unit 11. In modified embodiment 1, an imaging unit 11 is added to the configuration of the above-described embodiment (Figure 2).

[0060] The shooting unit 11 is, for example, a camera that captures 4K video (images). As shown in Figure 9, the encoding device 1-2 may also include the shooting unit 11.

[0061] (Modified embodiment 2) Next, a modified example 2 of the embodiment will be described. In the description of modified example 2, explanations similar to those of the embodiment will be omitted, and only the differences from the embodiment will be described.

[0062] [Example of a decoding device's functional configuration] Figure 10 shows an example of the device configuration of the decoding device 2-2 of the modified embodiment 2. The decoding device 2-2 of the modified embodiment 2 includes a processing unit 20.

[0063] The processing unit 20 includes an input unit 201, a decoding unit 203, a display control unit 204, and an output unit 205. In other words, in the modified example 2, the display control unit 204 is provided instead of the determination unit 202.

[0064] The input unit 201 receives encoded video data including the second region described above, and specification information specifying the region to be played back (i.e., information specifying the second region). The second region includes multiple first regions and is generated by the encoding device 1 when the first regions specified in each of the multiple cropping zoom requests overlap.

[0065] The decoding unit 203 generates video by decoding the encoded data.

[0066] The display control unit 204 controls the output unit 205 to output the video from the second region specified by the specified information, which is generated by decoding the encoded data.

[0067] (Modification of Embodiment 3) Next, a third modified example of the embodiment will be described. In the description of the third modified example, explanations similar to those of the embodiment will be omitted, and only the differences from the embodiment will be described.

[0068] The example of the functional configuration of the encoding device 3 in Modification Example 3 is the same as the functional configuration of the encoding device 1 in the embodiment, so it will be explained using Figure 2.

[0069] In Modification 3, the cropping unit 104 crops a plurality of predetermined third regions from the video. That is, in Modification 3, instead of dynamically determining the second region in response to multiple cropping zoom requests, one of the predetermined third regions is selected.

[0070] Furthermore, the encoding unit 105 is set to a state where it can start the process of generating encoded data for multiple third regions included in the video. Specifically, parameters used for the encoding process (for example, specifying the position and size of each of the multiple third regions, and specifying the encoding method) are set in advance so that the encoding process can be started immediately.

[0071] When the encoding unit 105 receives multiple cropping zoom requests from the decoding device 2, if the first regions specified in each of the multiple cropping zoom requests overlap, it generates encoded data by starting the process of generating encoded data for a single third region that includes the multiple first regions. Then, the output unit 106 outputs the encoded data for the third region.

[0072] As shown in the modified example 3 of the embodiment, multiple third regions may be pre-extracted and each third region may be prepared to begin encoding. If the first regions specified in each of the multiple cropping zoom requests overlap, one third region containing multiple first regions may be used as the processing target.

[0073] Finally, an example of the hardware configuration of the encoding device 1 and decoding device 2 of the embodiment will be described.

[0074] [Example hardware configuration] Figure 11 shows an example of the hardware configuration of the encoding device 1 and decoding device 2 of the embodiment. The encoding device 1 and decoding device 2 of the embodiment include a processor 301, a main memory 302, an auxiliary storage device 303, a display device 304, an input device 305, and a communication device 306. The processor 301, main memory 302, auxiliary storage device 303, display device 304, input device 305, and communication device 306 are connected via a bus 310.

[0075] Note that the encoding device 1 and the decoding device 2 do not necessarily need to be equipped with some of the above-described components. For example, if the encoding device 1 and the decoding device 2 can utilize the input and display functions of an external device, the encoding device 1 and the decoding device 2 do not need to be equipped with a display device 304 and an input device 305.

[0076] The processor 301 executes the program read from the auxiliary storage device 303 into the main memory device 302. The main memory device 302 is memory such as ROM and RAM. The auxiliary storage device 303 is such as an HDD (Hard Disk Drive) and a memory card.

[0077] The display device 304 is, for example, a liquid crystal display. The input device 305 is an interface for operating the encoding device 1 and the decoding device 2. The display device 304 and the input device 305 may be implemented by a touch panel or the like that has both display and input functions. The communication device 306 is an interface for communicating with other devices.

[0078] For example, the programs executed by the encoding device 1 and the decoding device 2 are provided as computer program products, recorded in installable or executable file format on computer-readable storage media such as memory cards, hard disks, CD-RWs, CD-ROMs, CD-Rs, DVD-RAMs, and DVD-Rs.

[0079] Alternatively, for example, the programs executed by the encoding device 1 and the decoding device 2 may be stored on a computer connected to a network such as the Internet, and provided by allowing users to download them via the network.

[0080] Alternatively, for example, the system may be configured to provide the programs executed by the encoding device 1 and the decoding device 2 via a network such as the Internet without requiring downloads. Specifically, the system may be configured to execute processing using a so-called ASP (Application Service Provider) type service, where the server computer does not transfer the program, but only issues execution instructions and retrieves the results.

[0081] Alternatively, for example, the programs for the encoding device 1 and the decoding device 2 may be pre-installed and provided in ROM or the like.

[0082] The programs executed by the encoding device 1 and the decoding device 2 are configured as modules that include functions that can also be implemented by the program, as described above. In actual hardware terms, each of these functions is loaded onto the main memory 302 by the processor 301 reading and executing a program from the storage medium. In other words, each of these function blocks is generated on the main memory 302.

[0083] Furthermore, some or all of the above-mentioned functions may be implemented using hardware such as ICs (Integrated Circuits) instead of software.

[0084] Alternatively, each function may be implemented using multiple processors 301. In this case, each processor 301 may implement one of the functions, or it may implement two or more of the functions.

[0085] While several embodiments of the present invention have been described, these embodiments are presented as examples only and are not intended to limit the scope of the invention. These novel embodiments can be carried out in a variety of other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the claims of the invention and its equivalents.

[0086] (Note) Furthermore, the above embodiments can be summarized in the following technical proposal.

[0087] Technical proposal 1 Accepting multiple cropping and zooming requests, If the first regions specified in each of the multiple cropping zoom requests overlap, the region to be cropped from the video is set to a single second region containing the multiple first regions. Encoded data is generated by encoding the one second region extracted from the aforementioned video. The processing unit that outputs the encoded data, An encoding device equipped with the following features. Technical proposal 2 The processing unit includes a plurality of first regions and adjusts the aspect ratio of the second region so that the size of the second region becomes smaller. The encoding device described in Technical Proposal 1. Technical proposal 3 The processing unit includes a plurality of the first regions and adjusts the aspect ratio of the second region so that the size of the second region has a predetermined aspect ratio. The encoding device described in Technical Proposal 1. Technical proposal 4 The processing unit is set to a state in which it can start the process of generating encoded data for multiple third regions included in the video. Upon receiving the aforementioned multiple cropping and zooming requests, If the first regions specified in each of the multiple cropping zoom requests overlap, the process of generating encoded data for a single third region containing the multiple first regions is started, and the encoded data for the third region is output. An encoding device as described in any one of Technical Proposals 1 to 3. Technical proposal 5 The camera unit that takes the aforementioned video, An encoding device according to any one of the technical proposals 1 to 4, further comprising the above. Technical plan 6 An encoding device described in any one of Technical Proposals 1 to 5, A decoding device is provided, The decoding device is A processing unit that receives the encoded data transmitted from the encoding device, either directly or via another device, and outputs a video generated by decoding the encoded data. A streaming system equipped with the following features. Technical proposal 7 Based on the encoded data transmitted from the encoding device, multiple cropping and zooming requests are sent to the video. If the first regions specified in each of the multiple cropping zoom requests overlap, the system accepts input of encoded data for a single second region containing the multiple first regions. A processing unit that outputs the video generated by decoding the aforementioned encoded data. A decoding device equipped with the following features. Technical proposal 8 The processing unit outputs the video of the second region. A decoding device as described in Technical Proposal 7. Technical proposal 9 The processing unit determines one of the multiple first regions included in the second region as the playback region and outputs the video of the playback region. A decoding device as described in Technical Proposal 7 or 8. Technical proposal 10 The processing unit receives input of video encoding data including the second region and specification information for specifying the second region. The video generated by decoding the encoded data outputs the video of the second region specified by the specified information. A decoding device as described in any one of Technical Proposals 7 to 9. Technical proposal 11 The encoding device accepts multiple cropping and zooming requests. If the encoding device finds that the first regions specified in each of the multiple cropping zoom requests overlap, it sets the region to be cropped from the video to a single second region that includes the multiple first regions. The encoding device generates encoded data by encoding the one second region extracted from the video. The encoding device outputs the encoded data. Encoding method. Technical proposal 12 The decoding device sends multiple cropping and zooming requests to the video based on the encoded data transmitted from the encoding device. If the decoding device receives an input of encoded data for a single second region containing the multiple first regions when the first regions specified in each of the multiple cropping zoom requests overlap, The decoding device outputs the video generated by decoding the encoded data. Decoding method. Technical proposal 13 On the computer, Accept multiple cropping and zooming requests, If the first regions specified in each of the aforementioned multiple cropping zoom requests overlap, the region to be cropped from the video is set to a single second region containing the multiple aforementioned first regions. By encoding the one second region extracted from the aforementioned video, encoded data is generated. To output the aforementioned encoded data, program. Technical proposal 14 On the computer, The encoding device sends multiple cropping and zooming requests to the video based on the encoded data transmitted from the encoding device. If the first regions specified in each of the multiple cropping zoom requests overlap, the system accepts input of encoded data for a single second region containing the multiple first regions. The video generated by decoding the aforementioned encoded data is output. program. [Explanation of Symbols]

[0088] 1. Encoding device 2 Decoder 10 Processing Unit 11. Photography Department 20 Processing Units 100 Streaming Systems 101 Input Section 102 Adjustment section 103 Control Unit 104 Cutting section 105 Encoding section 106 Output section 201 Input section 202 Decision Section 203 Decoding section 204 Display Control Unit 205 Output section 301 Processor 302 Main storage 303 Auxiliary storage device 304 Display device 305 Input device 306 Communication equipment 310 Bus

Claims

1. Accepting multiple cropping and zooming requests, If the first regions specified in each of the multiple cropping zoom requests overlap, the region to be cropped from the image is set to a single second region that includes the multiple first regions. Encoded data is generated by encoding the one second region extracted from the aforementioned video. The processing unit that outputs the encoded data, An encoding device equipped with the following features.

2. The processing unit includes a plurality of the first regions and adjusts the aspect ratio of the second region so that the size of the second region becomes smaller. The encoding device according to claim 1.

3. The processing unit includes a plurality of the first regions and adjusts the aspect ratio of the second region so that the size of the second region has a predetermined aspect ratio. The encoding device according to claim 1.

4. The processing unit is set to a state in which it can start the process of generating encoded data for multiple third regions included in the video. Upon receiving the aforementioned multiple cropping and zooming requests, If the first regions specified in each of the multiple cropping zoom requests overlap, the process of generating encoded data for a single third region containing the multiple first regions is started, and the encoded data for the third region is output. The encoding device according to claim 1.

5. The camera unit that takes the aforementioned video, The encoding device according to claim 1, further comprising:

6. An encoding device according to any one of claims 1 to 5, A decoding device is provided, The decoding device is A processing unit that receives the encoded data transmitted from the encoding device, either directly or via another device, and outputs a video generated by decoding the encoded data. A streaming system equipped with the following features.

7. Based on the encoded data transmitted from the encoding device, multiple cropping and zooming requests are sent to the video. If the first regions specified in each of the multiple cropping zoom requests overlap, the system accepts input of encoded data for a single second region containing the multiple first regions. A processing unit that outputs the video generated by decoding the aforementioned encoded data. A decoding device equipped with the following features.

8. The processing unit outputs the video of the second region. The decoding device according to claim 7.

9. The processing unit determines one of the plurality of first regions included in the second region as the playback region and outputs the video of the playback region. The decoding device according to claim 7.

10. The processing unit receives input of video encoding data including the second region and specification information for specifying the second region. The video generated by decoding the encoded data is output from the video of the second region specified by the specified information. The decoding device according to claim 7.

11. The encoding device accepts multiple cropping and zooming requests. If the encoding device finds that the first regions specified in each of the multiple cropping zoom requests overlap, it sets the region to be cropped from the video to a single second region that includes the multiple first regions. The encoding device generates encoded data by encoding the one second region extracted from the video. The encoding device outputs the encoded data. Encoding method.

12. The decoding device sends multiple cropping and zooming requests to the video based on the encoded data transmitted from the encoding device. If the decoding device receives an input of encoded data for a single second region containing the multiple first regions when the first regions specified in each of the multiple cropping zoom requests overlap, The decoding device outputs the video generated by decoding the encoded data. Decoding method.

13. On the computer, Accept multiple cropping and zooming requests, If the first regions specified in each of the multiple cropping zoom requests overlap, the region to be cropped from the image is set to a single second region containing the multiple first regions. By encoding the one second region extracted from the aforementioned video, encoded data is generated. To output the aforementioned encoded data, program.

14. On the computer, The encoding device sends multiple cropping and zooming requests to the video based on the encoded data transmitted from the encoding device. If the first regions specified in each of the multiple cropping zoom requests overlap, the system accepts input of encoded data for a single second region containing the multiple first regions. The video generated by decoding the aforementioned encoded data is output. program.

Images