Video processing system, compression device, video processing method and program

Abstract

This video processing system comprises: a compression unit configured to implement compression and packetization of a video signal with respect to each of at least one first range that is subject to a change and at least one second range other than the first range separately in a video; a video processing unit configured to execute processing for said change using packet groups related to the first range as the object of processing; and a decoding unit configured to implement decoding with respect to a packet group related to the first range and a packet group related to the second range separately among the packet groups that have been processed by the video processing unit. Thus, the video processing system enables a change in a portion of compressed video.

Description

[Technical Field]

[0001] The present invention relates to a video processing system, a compression device, a video processing method, and a program. Regarding. [Background technology]

[0002] For live video streaming, services that require ultra-low latency are emerging, but general video compression technology causes a certain amount of delay and also generates overhead in video editing.

[0003] In recent years, there have been protocols for transmitting uncompressed video or lightly compressed video that is close to uncompressed, such as ST2110. These protocols are highly compatible with video production, but require a large amount of bandwidth.

[0004] Meanwhile, advances in network technology are expected to make it possible to deliver bit rates close to those of lightly compressed formats to users in the future. In that case, protocols such as ST2110, which have been used exclusively for video production until now, can be applied to video distribution, enabling end-to-end ultra-low latency distribution.

[0005] Furthermore, in recent years, a technology has been proposed that processes the ST2110 video transmission protocol on a packet basis without decoding, thereby replacing video (Non-Patent Document 1). Most of these technologies are targeted at uncompressed video, but they are also now compatible with lightly compressed video if the processing is done on a frame-by-frame basis (Non-Patent Document 2). [Prior art documents] [Non-patent literature]

[0006] [Non-Patent Document 1] Paul Briscoe,"Efficient Carriage of Sub-Rasters With ST 2110-20" [Non-patent document 2] Tetsuya Hayashida, "Study on a mixed 8K 60Hz and 120Hz system using IP interfaces," NHK STRL R&D, Fall 2020, Report 02, pp. 22-29 Summary of the Invention [Problem to be solved by the invention]

[0007] Lightly compressed video is compressed on a frame-by-frame basis, so unlike uncompressed video, if some packets in a frame are changed, the entire frame cannot be decoded, resulting in video loss. Therefore, while lightly compressed video can handle frame-by-frame switching (switching the video of the entire frame), it cannot handle processes that change only part of a frame, such as wipes, zooming in, or zooming out.

[0008] Therefore, when performing video processing within a frame, it is necessary to use uncompressed video, but this consumes a lot of bandwidth, making it difficult to apply to large-scale distribution.

[0009] The present invention has been made in view of the above points, and has as its object to make it possible to change a part of a compressed video. [Means for solving the problem]

[0010] In order to solve the above problem, the video processing system is , in the video A first range of 1 or more 、 Outside the first range In the video The video signal processing system includes a compression unit configured to compress and packetize the video signal individually for each of the first and one or more second ranges, a video processing unit configured to perform processing for the change on a group of packets relating to the first range as the processing target, and a decoding unit configured to individually decode the group of packets relating to the first range and the group of packets relating to the second range among the group of packets processed by the video processing unit. [Effects of the Invention]

[0011] It may be possible to modify parts of the compressed video. [Brief explanation of the drawings]

[0012] [Figure 1] 1 is a diagram illustrating an example of the configuration of a video processing system 1 according to a first embodiment. [Figure 2] 1 is a diagram illustrating an example of a hardware configuration of a compression device 10 according to a first embodiment. [Figure 3] 4 is a flowchart illustrating an example of a processing procedure executed in the video processing system 1 according to the first embodiment. [Figure 4] 1 is a diagram for explaining a specific example of a video source and video processing in the present embodiment. [Figure 5] FIG. 10 is a diagram showing an example of video source information. [Figure 6] FIG. 10 is a diagram illustrating an example of parameters constituting a control request. [Figure 7] 10 is a flowchart illustrating an example of a processing procedure of a control algorithm. [Figure 8] 10 is a flowchart illustrating an example of a processing procedure executed in a video processing system 1 according to a second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0013] Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a diagram showing an example of the configuration of a video processing system 1 according to a first embodiment. In FIG. 1, the video processing system 1 includes a compression device 10, a video processing device 20, a decoding device 30, and a control device 40. The compression device 10, the video processing device 20, the decoding device 30, and the control device 40 are, for example, computers belonging to a telecommunications carrier. The compression device 10, the video processing device 20, and the decoding device 30 are connected to the control device 40 via a network within the telecommunications carrier. The compression device 10 is further connected to the video processing device 20 via the network. The video processing device 20 is further connected to the decoding device 30 via the network. The control device 40 is further connected to a content provider 50 via the network. The content provider 50 is one or more computers that function as a source of video sources and a source of control requests related to the video sources. The supplied video sources may be live video or archived video. In the case of live video, the video source may be input to the control device 40 from a television camera or the like. The compression device 10 is further connected to a content provider 50 via a video transmission path such as HDMI (registered trademark) or SDI. The decoder 31 is further connected to a client terminal 60 such as a television via a video transmission path such as HDMI (registered trademark) or SDI. The client terminal 60 is, for example, a television terminal used by a viewer of the video.

[0014] The compression device 10 has an encoder 11. The encoder 11 is realized by a process executed by a CPU of the compression device 10 under the control of a program installed in the compression device 10. The encoder 11 receives a video signal conforming to a standard such as HDMI (registered trademark) or SDI from a content provider 50. The encoder 11 lightly compresses (hereinafter simply referred to as "compression") the video represented by the video signal and converts the compressed video into IP packets. Hereinafter, the video information stored in the IP packets will be referred to as video data. The encoder 11 transmits a group of IP packets containing the video data to the video processing device 20.

[0015] The video processing device 20 has a video processing unit 21. The video processing unit 21 is realized by processing that a program installed in the video processing device 20 causes the CPU of the video processing device 20 to execute. The video processing unit 21 executes video processing on the IP packets received from the encoder 11 in accordance with the video processing content notified by the control device 40. The video processing unit 21 transmits the IP packets obtained as a result of the video processing to the decoding device 30. In other words, the video processing unit 21 executes video processing on a packet basis.

[0016] The decoding device 30 has a decoder 31. The decoder 31 is realized by a process that a program installed in the decoding device 30 causes the CPU of the decoding device 30 to execute. The decoder 31 generates a video signal by decoding lightly compressed video data stored in the IP packets received from the video processing unit 21, and sends the video signal to the client terminal 60.

[0017] The control device 40 has a control request receiving unit 41, a compression range control unit 42, and a video processing control unit 43. Each of these units is realized by processing that is executed by the CPU of the control device 40 by one or more programs installed in the control device 40.

[0018] The control request receiving unit 41 receives a control request for a video source from the content provider 50 or the client terminal 60. A control request is a request for reducing the size of a video, changing part of a video, or the like.

[0019] The compression range control unit 42 determines the layout of the compression range of the video source based on the control request, and notifies the encoder 11 and decoder 31 of information indicating the layout (hereinafter referred to as "layout information"). The compression range refers to the divided range to be processed in one compression. The compression range control unit 42 determines each of the one or more ranges (ranges within a video frame) to be changed by video processing and one or more ranges (ranges within a video frame) other than the above ranges as one compression range so that these ranges are each divided (i.e., so that each range is compressed and packetized separately). The encoder 11 performs compression and packetization separately for each compression range.

[0020] The video processing control unit 43 determines the video processing content based on the control request. The video processing control unit 43 notifies the encoder 11, the video processing unit 21, and the decoder 31 of control information including the compression range determined by the compression range control unit 42 and the video processing content.

[0021] Note that there may be a plurality of encoders 11, video processors 21, and decoders 31, and they may be installed in an appropriate location (for example, a location with low costs) depending on the location of the content provider 50 and the location of the client terminal 60, or those installed in the appropriate location may be used. On the other hand, from the perspective of the video source, there is only one encoder 11, and each client terminal 60 has only one decoder 31. It is also possible that video data sent from one encoder 11 is delivered to multiple client terminals 60 via multiple video processors 21 and multiple decoders 31 using a technique such as multicast. The decoder 31 may be installed in the same location (e.g., in a home) as the client terminal 60, rather than within the network of the network operator. In this case, the decoder 31 may be installed in an STB (Set Top Box), the client terminal 60, or the like.

[0022] Fig. 2 is a diagram illustrating an example of the hardware configuration of the compression device 10 according to the first embodiment. The compression device 10 in Fig. 2 includes a drive device 100, an auxiliary storage device 102, a memory device 103, a CPU 104, and an interface device 105, which are all interconnected via a bus B.

[0023] A program that realizes the processing in the compression device 10 is provided by a recording medium 101 such as a CD-ROM. When the recording medium 101 storing the program is set in the drive device 100, the program is installed from the recording medium 101 to the auxiliary storage device 102 via the drive device 100. However, the program does not necessarily have to be installed from the recording medium 101, but may be downloaded from another computer via a network. The auxiliary storage device 102 stores the installed program as well as necessary files, data, etc.

[0024] When an instruction to start the program is received, the memory device 103 reads the program from the auxiliary storage device 102 and stores it. The CPU 104 executes functions related to the compression device 10 in accordance with the program stored in the memory device 103. The interface device 105 is used as an interface for connecting to a network.

[0025] The video processing device 20, the decoding device 30, and the control device 40 also have the same hardware configuration as that shown in FIG.

[0026] The following describes the processing procedure executed in the video processing system 1. Fig. 3 is a flowchart for explaining an example of the processing procedure executed in the video processing system 1 in the first embodiment. Here, it is assumed that the content provider 50 starts distributing video sources A and B in the leftmost column of Fig. 4.

[0027] In step S101, the control request receiving unit 41 of the control device 40 receives video source information from the content provider 50 and registers the video source information in a database. The database is realized using the auxiliary storage device 102, for example.

[0028] Fig. 5 is a diagram showing an example of video source information. As shown in Fig. 5, the video source information includes a video source ID and a size. The video source ID is identification information of the video source. The size is the number of pixels in the horizontal and vertical directions of the video source. In this embodiment, since it corresponds to the specific example of Fig. 4, video source information for each of video source A and video source B is received.

[0029] The processing procedure in Fig. 3 is started with step S101 as a trigger. When a video source is added (for example, when the number of cameras increases during a program) or when a new control request occurs, the processing procedure in Fig. 3 is executed again.

[0030] Next, when the control request receiving unit 41 receives a control request from the content provider 50 or the client terminal 60, it registers the control request in the database (S102).

[0031] FIG. 6 is a diagram showing an example of parameters constituting a control request. FIG. 6 shows two control requests: one for video source A and one for video source B. Each control request includes a time, a video source ID, a size, a position coordinate, a destination ID, and the like. The time indicates the time at which control based on the control request is to begin. The video source ID is the video source ID of the video source that is the target of the control request. The size is the size of the video frame after video processing in accordance with the control request is applied. In other words, the size indicates that video processing should be performed so that the video frame has the specified size. The position coordinates are the position coordinates of the video frame after video processing in accordance with the control request is applied. In other words, the position coordinates indicate that video processing should be performed so that the upper left vertex of the video frame is located at the position indicated by the position coordinates. The destination ID is identification information (such as an IP address) of the client terminal 60 to which the video signal is to be delivered after video processing in accordance with the control request is performed. Note that the destination ID of a control request sent from a client terminal 60 is basically the identification information of the client terminal 60. For example, when a viewer inputs an instruction to edit a video into the client terminal 60, a control request corresponding to the editing instruction is transmitted from the client terminal 60, with the identification information of the client terminal 60 as the destination ID. On the other hand, the destination ID of the control request transmitted from the content provider 50 is designated by the program director or the like. For example, there are cases where the identification information of all destinations (client terminals 60) is designated as the destination ID, and cases where the identification information of a specific client terminal 60 is designated as the destination ID.

[0032] Next, the control device 40 inputs the information stored in the database (video source information (FIG. 5) and control request (FIG. 6)) into a control algorithm to determine the layout of the compression range and the video processing content for each video source (S103). The control algorithm will be described later.

[0033] In this embodiment, as shown in the "Compression Range Layout" column in FIG. 4, the compression range for video source A is distinguished between the range in which video source B is wiped and the other ranges. On the other hand, for video source B, since it is necessary to reduce the video to fit within the wipe range, the compression range is distinguished between the ranges that are thinned out for the reduction and the other ranges. Furthermore, as the video processing content for video source A, processing is determined for IP packets that belong to the range in which video source B is wiped, among the IP packets resulting from the encoding of video source A, to enable the reduced video source B to be combined. As the video processing content for video source B, processing is determined for IP packets that are the encoding result of video source B, required to reduce video source B. In other words, in this embodiment, video processing is performed at the packet level. Specific examples of the layout information of the compression range and the video processing content determined for each of video source A and video source B are shown below.

[0034] [Compression range layout and video processing content for video source A] Compression range layout: The compression range is divided into a range (pixel group) of position 100,100 and size 384x216 and other ranges (pixel groups). Video processing: The header information of each IP packet corresponding to pixels in the range of position 100,100 and size 384x216 is copied to the header of the IP packet of video source B that replaces that IP packet (the IP packet after the video processing described below is applied), and the IP packets of video source A in that range are discarded.

[0035] [Compression range layout and video processing content for video source B] Compression range layout: Divided into 160x180 areas (12 pixels wide x 6 pixels high per area) Video processing: The video is thinned out at regular intervals (some packets are discarded) from 160 to 32 horizontally and from 180 to 36 vertically, and the header information of video source A is copied to the header of the remaining IP packets. Note that thinning out also reduces the size of the video from video source B.

[0036] Next, the video processing control unit 43 of the control device 40 sets the necessary control information for each of the encoder 11, the video processing unit 21, and the decoder 31 (S104). The control information set for the encoder 11 is a video source ID, layout information of the compression range, a control start time, and a distribution destination ID for each video source. The control information set for the video processing unit 21 is a video source ID, video processing content, and a control start time for each video source. The control information set for the decoder 31 is a video source ID, layout information of the compression range, and a control start time for each video source.

[0037] The layout information of the compression range and the video processing content are the values ​​determined in step S103. The control start time and the distribution destination ID are the time and the distribution destination ID included in the control request.

[0038] Next, when the encoder 11 receives the video signals of each of the video sources A and B from the content provider 50, if the control start time set together with the video source ID of each video source has passed, the encoder 11 compresses the video and IP packetizes the video based on the layout information of the compression range set together with the video source ID and the control start time, and sends the IP packets (video data) to the video processing unit 21 (S105). As described above, the encoder 11 performs compression processing separately for each compression range for the video source ID for the video frames of each video source. The encoder 11 also performs IP packetization separately for each compression range. Therefore, pixels belonging to different compression ranges are not included in the same IP packet.

[0039] According to ST2110, the header of an RTP packet stores current time information, and the payload stores pixel (color) information within a video frame, a video source ID, a video frame identification number, and pixel position information within the video frame. For example, ST2110 uses an RTP header, which includes time information as a timestamp value. Furthermore, the destination IP address of each IP packet is set with the destination ID that was set together with the video source ID.

[0040] Next, when the video processing unit 21 receives the IP packet group (video data) of each video source sent from the encoder 11, if the time information of the IP packet group related to that video source has passed the control start time set together with the video source ID of that video source and the distribution destination ID of that IP packet group, then it executes video processing according to the video processing content set together with the video source ID and the distribution destination ID, and sends the IP packet group (video data) after video processing to the decoder 31 (S106).

[0041] According to the example of the video processing content described above, in this embodiment, for video source A, video processing unit 21 copies the header information of each IP packet corresponding to pixels belonging to the range of position 100,100 and size 384x216 to the header of the IP packet of video source B that replaces the IP packet (the IP packet after the video processing content described below has been applied), and discards the IP packets of video source A in that range. Also, for video source B, video processing unit 21 thins out the packets horizontally from 160 to 32 and vertically from 180 to 36 (discarding packets), and copies the header information of video source A to the header of the remaining IP packet.

[0042] As a result of the video processing, as shown in the "Video Processing" column in Fig. 4, for video source A, video data (IP packet group) from which the wipe portion has been deleted (packets containing pixels of that portion have been discarded) is sent to decoder 31, and for video source B, reduced (thinned) video data (IP packet group) is sent to decoder 31. However, since the header information of video source A has been copied into the header of the IP packet group related to video source B, the IP packet group sent to decoder 31 is the IP packet group related to video source A.

[0043] Next, when the decoder 31 receives the IP packets (video data) after video processing sent from the encoder 11, if the time information of the IP packets has passed the control start time set together with the video source ID and destination ID of the IP packets, the decoder 31 generates a video signal by decoding the video data based on the layout information of the compression range set together with the video source ID and destination ID, and sends the video signal to the client terminal 60 associated with the destination ID (S107). During decoding, the decoder 31 extracts video data from the IP packets belonging to each compression range and decodes the extracted video data group together. That is, the decoder 31 performs decoding individually (separately) for each range compressed by the encoder 11. This allows the video signal to be generated correctly.

[0044] As a result, as shown in the "Decoded" column in FIG. 4, a video signal including a reduced version of video source B in the upper left wipe area of ​​video source A is sent to client terminal 60.

[0045] The decoder 31 may output uncompressed ST2110 (IP packets containing decoded video), or SDI or HDMI (registered trademark).

[0046] Furthermore, when sending video data from the decoder 31 (compression device 10) to the video processing unit 21 (video processing device 20) and when sending video data from the video processing unit 21 (video processing device 20) to the decoder 31 (decoding device 30), the specific destination information may be an IP address or a device ID.

[0047] Next, the details of step S103 will be described. Fig. 7 is a flowchart for explaining an example of the processing procedure of the control algorithm.

[0048] In step S201, the compression range control unit 42 assigns 1 to a variable i. The variable i is a variable for storing the order of the control request to be processed.

[0049] Next, the compression range control unit 42 acquires the i-th control request (S202). For example, in the example of Fig. 6, the control request in the first row is acquired. Hereinafter, the acquired control request will be referred to as a "target control request."

[0050] Next, the compression range control unit 42 determines whether the size of the video source information and the size of the target control request are different for the video source ID of the target control request (S203). For the first control request in Fig. 6, the size of the video source information and the size of the target control request are the same, but for the second control request, the size of the video source information and the size of the target control request are different.

[0051] If the size of the video source information and the size of the target control request are different (Yes in S203), the compression range control unit 42 calculates the pixel group size that is the unit of the compression range, treats each pixel group as one compression range, and determines the arrangement information of the compression range as the layout of the compression range (S204). That is, in step S204, for video frames that require reduction processing, each of the small tiles (pixel groups) formed by dividing the video frame vertically and horizontally is treated as one compression range, as in the example of the "compression range layout" of video source B in Fig. 4, so that packets can be thinned (pixels can be deleted) in the video processing unit 21.

[0052] For example, if full HD (1920x1080) is divided into pixel groups of 12 pixels horizontally and 6 pixels vertically, it is divided into 160x180 pixels, and each pixel becomes a compression range. In this case, the video processor 21 can reduce the video to 960x540 by discarding packets corresponding to even numbers both vertically and horizontally.

[0053] Specifically, the compression range control unit 42 determines the compression range by performing the following calculations (1) to (3). (1) Calculate the common divisor between the size of the video source information and the size of the control request for each of the vertical and horizontal directions. (2) For each of the vertical and horizontal directions, an arbitrary value is selected from the calculated common divisors of 1 or more. The smaller the value, the finer the unit, and the better the video quality but the lower the compression efficiency. The value to be selected may be set as one of the parameters of the control request, or may be notified to the control device 40 by another method. (3) Each pixel group relating to a rectangular range formed by the selected values ​​in the vertical and horizontal directions is treated as one compression range, and the layout of the compression range is determined.

[0054] In step S204, the video processing control unit 43 determines the processing content required to reduce video source B (in this embodiment, the video processing content for video source B) for the IP packet group that is the encoding result of the video source corresponding to the target control request (hereinafter referred to as the "target video source") as the video processing content for the target video source.

[0055] If the result of step S203 is No, or following step S204, the compression range control unit 42 determines whether there is another control request indicating that another video frame is to be composited (wiped) into the video frame of the video source associated with the video source ID of the target control request (S205). Specifically, the compression range control unit 42 determines whether there is a control request whose size value is smaller than the size value of the target control request.

[0056] If there is one or more applicable control requests (hereinafter referred to as "applicable control requests") (Yes in S205), the compression range control unit 42 determines the layout of the compression range so that the range indicated by the position and size of the applicable control request (i.e., the range where other video is combined) and the range other than that range are each divided into one compression range in the video frame of the target video source (S206). That is, in step S204, the layout of the compression range is determined to enable reduction processing (thinning), but in step S206, the compression range is divided so that parts of the video frame where rewriting (changes) occur and parts where rewriting does not occur can be decoded independently. This makes it possible to decode the video normally even if part of the video frame is rewritten.

[0057] Note that when there are multiple applicable control requests, i.e., when multiple video frames are to be composited with a video frame of a target video source, the overlapping order of the multiple video frames may be taken into consideration. For example, a parameter indicating the overlapping order may be set in each control request, or the overlapping order may be determined based on the order of the control requests.

[0058] In step S206, the video processing control unit 43 determines the processing content for the target video source (in this embodiment, the video processing content for video source A) to enable other video sources to be synthesized for the IP packet group that is the encoding result of the target video source and that belongs to the range in which the video source corresponding to the control request is wiped, as the video processing content for the target video source.

[0059] If the result of step S205 is No, or following step S206, the compression range control unit 42 determines whether or not there is an (i+1)th control request (S207). If there is an (i+1)th control request (Yes in S207), the compression range control unit 42 adds 1 to i (S208) and repeats step S202 and subsequent steps. If there is no (i+1)th control request (No in S207), the compression range control unit 42 assigns 1 to a variable j (S209). The variable j is a variable for storing the order of the control requests to be processed.

[0060] Next, the compression range control unit 42 acquires the j-th control request (S210). Hereinafter, the acquired control request will be referred to as the "target control request."

[0061] Next, the compression range control unit 42 determines whether a video frame of another video source (hereinafter referred to as "another video frame") is to be combined into a video frame of a video associated with the video source ID of the target control request (hereinafter referred to as "target video frame") (S211). This determination may be made based on the same determination as in step S205. Alternatively, it may be determined whether the result in step S205 is Yes or No.

[0062] If another video frame is to be synthesized within the target video frame (Yes in S211), the compression range control unit 42 sets layout information of the compression range of the other video frame for the range in the target video frame where the other video frame is to be synthesized (hereinafter referred to as the "synthesis range") (S212). In other words, the compression range control unit 42 replaces the layout of the compression range in the synthesis range with the layout of the compression range of the other video frame. In this embodiment, the layout of the compression range in the range in which the video frame of video source B is synthesized in the video frame of video source A is set to the layout of the compression range determined for video source B. By doing so, in the above-mentioned step S107, the decoder 31 can also correctly decode the synthesis range (for each compression range determined for video source B) based only on the compression range corresponding to video source A. If step S211 is No, or following step S212, the compression range control unit 42 determines whether or not there is a j+1th control request (S213). If there is a j+1th control request (Yes in S213), the compression range control unit 42 adds 1 to j (S214) and repeats step S202 and subsequent steps. If there is no j+1th control request (No in S213), the compression range control unit 42 ends the processing procedure of FIG.

[0063] As described above, according to the first embodiment, the entire video frame is not treated as a single compression range, but the compression range is divided according to the video processing required for the video, compression (encoding) is performed for each compression range, and IP packetization is performed within the compression range. As a result, when processing video in the form of IP packets, video processing can be performed without destroying the compression range. Therefore, it is possible to change part of the compressed video.

[0064] By making it possible to change parts of compressed video, video processing can be carried out and distributed with less latency and bandwidth than uncompressed video, compared to video processing that requires conventional video decoding.

[0065] Next, a second embodiment will be described. In the second embodiment, differences from the first embodiment will be described. Points not specifically mentioned in the second embodiment may be the same as those in the first embodiment.

[0066] Fig. 8 is a flowchart illustrating an example of a processing procedure executed in the video processing system 1 according to the second embodiment. In Fig. 8, the same steps as those in Fig. 3 are assigned the same step numbers, and their description will be omitted.

[0067] Following step S103, the video processing control unit 43 sets control information including a video source ID, compression range layout information, control start time, and distribution destination ID for each video source to the encoder 11, video processing unit 21, and decoder 31 (S114).

[0068] Next, the encoder 11 executes basically the same process as step S105 in Fig. 3 (S115), except that the encoder 11 sends control information to the video processing unit 21, and then sends a group of IP packets to the video processing unit 21.

[0069] Next, when the video processing unit 21 receives the control information sent from the encoder 11, it retains the control information and sends the control information to the decoder 31. When the video processing unit 21 receives a group of IP packets (video data) of each video source sent from the encoder 11, it executes processing similar to step S106 in Figure 3 based on the retained control information (S116).

[0070] Next, when the decoder 31 receives the control information sent from the video processing unit 21, it retains the control information, and when it receives the IP packets (video data) of each video source sent from the video processing unit 21, it executes processing similar to step S107 in Figure 3 based on the retained control information (S117).

[0071] That is, in the second embodiment, control information is transmitted to the encoder 11, the video processing unit 21, and the decoder 31. Even in this configuration, the same effects as in the first embodiment can be obtained.

[0072] In each of the above embodiments, the encoder 11 is an example of a compression unit, and the decoder 31 is an example of a decoding unit.

[0073] Although the embodiments of the present invention have been described in detail above, the present invention is not limited to such specific embodiments, and various modifications and variations are possible within the scope of the gist of the present invention as described in the claims. [Explanation of symbols]

[0074] 1. Video processing system 10 Compression device 11 Encoder 20. Image Processing Device 21 Video Processing Unit 30 Decoding device 31 Decoder 40 Control device 41 Control request reception unit 42 Compression range control section 43 Image processing control unit 50 Content Providers 60 client terminals 100 Drive device 101 Recording media 102 Auxiliary storage device 103 Memory Device 104 CPU 105 Interface Device B Bus

Claims

1. a compression unit configured to compress and packetize video signals individually for one or more first ranges in the video that are to be changed, and one or more second ranges in the video other than the first ranges; a video processing unit configured to execute the process for the change on a group of packets related to the first range as a processing target; a decoding unit configured to individually decode a packet group relating to the first range and a packet group relating to the second range among the packet groups processed by the video processing unit; A video processing system comprising:

2. When the change is to thin out a part of the image at a fixed interval in order to reduce the image, the first range is a thinned-out range, the video processing unit is configured to discard packets related to the first range.

2. The video processing system according to claim 1.

3. When the change is to change a partial range of the image, the first range is the partial range, the video processing unit is configured to modify packets related to the first range.

3. The video processing system according to claim 1 or 2.

4. a compression unit configured to compress and packetize video signals individually for one or more first ranges in the video to be changed and one or more second ranges in the video other than the first ranges; A compression device comprising:

5. a compression step of compressing and packetizing video signals individually for one or more first ranges in the video to be changed and one or more second ranges in the video other than the first ranges; a video processing procedure for executing a process for the change on a group of packets related to the first range; a decoding procedure for individually decoding a packet group relating to the first range and a packet group relating to the second range among the packet groups processed by the video processing procedure; A video processing method characterized by being executed by a computer.

6. a compression step of compressing and packetizing video signals separately for one or more first ranges in the video to be changed and one or more second ranges in the video other than the first ranges; A program characterized by causing a computer to execute the above.

Images