Video data processing device, video data processing method and program, content receiving device, content playback device, content display device, server, content broadcasting system, and content distribution system

Abstract

To provide a moving image data processor capable of specifying a person who illegally outputs moving image data.SOLUTION: The moving image data processing device includes a frame dividing unit that divides each of a plurality of frames constituting moving image data into a plurality of regions by a predetermined dividing method, an information embedding unit that embeds information for specifying an output person of the moving image data in a part or all of the plurality of regions obtained by dividing the frame for each of the plurality of frames, and a frame returning unit that combines the plurality of regions in which the information is embedded to return the plurality of regions to the frame for each of the plurality of frames.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to video data processing. [Background technology]

[0002] Conventionally, there has been known a technology for preventing the unauthorized output of content including video data by encrypting, using predetermined key information, video data of conditional access broadcasts received by a broadcast receiving device or copyright-protected video data output from devices such as video playback players. For example, Patent Document 1 discloses a broadcast receiving device that receives individual information (EMM) carried on digital broadcast waves, decrypts the individual information with a unique master key Km to extract a work key Kw for the content, decrypts encrypted information received via the Internet with the work key Kw to extract an encryption key Kc, and decrypts the encryption of the content with this encryption key Kc. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2003-264541 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the technology for preventing the unauthorized output of video data by encryption using the key information may not be able to prevent the unauthorized output of video data due to unauthorized tampering with the key information, etc. Therefore, studies are being conducted to prevent the unauthorized output of video data by making it possible to track those who are unauthorizedly outputting video data. [Means for solving the problem]

[0005] According to one aspect of the present invention, there is provided a video data processing device for processing video data, the video data processing device including: a frame dividing unit that divides each of a plurality of frames constituting the video data into a plurality of regions using a predetermined division method; an information embedding unit that embeds, for each of the plurality of frames, information for identifying a person who has output the video data into some or all of the plurality of regions obtained by dividing the frame; and a frame restoring unit that combines, for each of the plurality of frames, the plurality of regions into which the information has been embedded and restores the frame.

[0006] In the video data processing device, the information embedding unit may embed information for identifying a person who output the video data and time information when the video data was played or output. The information embedding unit may also embed information for identifying a person who output the video data, the time information, and additional information linked to the information.

[0007] In the video data processing device, the information embedding section may embed the information as an invisible digital watermark.

[0008] In the video data processing device, the frame division unit may divide each of the plurality of frames into a plurality of square regions, a plurality of non-square rectangular regions, or a plurality of regions that are a mixture of square regions and non-square rectangular regions.

[0009] In the moving image data processing device, the frame dividing section may divide each of the plurality of frames into a plurality of regions of equal or unequal size.

[0010] In the moving image data processing device, the information embedding section may embed information into the region using a wavelet transform, or using both a wavelet transform and a discrete cosine transform.

[0011] In the video data processing device, the multiple areas within the frame may include multiple small areas that cannot accommodate the information to be embedded, and the information embedding unit may divide the information to be embedded to generate multiple pieces of split information, and distribute and arrange the multiple pieces of split information in the multiple areas within the frame.

[0012] In the moving image data processing device, each of the plurality of pieces of divided information may have position information of the area in which the information is arranged, and an error detection code for the entirety of the plurality of pieces of divided information.

[0013] In the moving image data processing device, the frame dividing section may change the frame dividing method for each frame, for each set of frames, or for each predetermined time period.

[0014] In the moving image data processing device, the frame dividing section may change the frame dividing method for each of a plurality of contents having moving image data or for each of a plurality of contents.

[0015] In the moving image data processing device, the information embedding section may change the information embedding method for each frame, for each set of frames, or for each predetermined time period.

[0016] In the moving image data processing device, the information embedding section may change the information embedding method for each piece of content or for each set of multiple pieces of content having moving image data.

[0017] Another aspect of the present invention is a method for processing video data, which includes: dividing each of a plurality of frames constituting the video data into a plurality of regions using a predetermined division method; embedding information for identifying a producer of the video data in some or all of the regions obtained by dividing each of the plurality of frames; and combining the regions with the embedded information to return each of the plurality of frames to a frame.

[0018] A program according to yet another aspect of the present invention is a program executed on a computer or processor included in a video data processing device that processes video data, the program including: program code for dividing each of a plurality of frames constituting the video data into a plurality of regions using a predetermined division method; program code for embedding, for each of the plurality of frames, information for identifying a person who output the video data into some or all of the plurality of regions obtained by dividing the frame; and program code for combining, for each of the plurality of frames, the plurality of regions with the embedded information to return the frame to its original state.

[0019] In the method and the program, information for identifying the person who output the video data and time information when the video data was played or output may be embedded. Also, information for identifying the person who output the video data, the time information, and additional information linking these pieces of information may be embedded.

[0020] In the method and the program, the information may be embedded as an invisible digital watermark.

[0021] In the method and the program, each of the plurality of frames may be divided into a plurality of square regions, a plurality of non-square rectangular regions, or a plurality of regions that are a mixture of square regions and non-square rectangular regions.

[0022] In the method and the program, each of the plurality of frames may be divided into a plurality of regions of equal or unequal size.

[0023] In the method and the program, information may be embedded in the region using a wavelet transform, or using both a wavelet transform and a discrete cosine transform.

[0024] In the method and the program, the multiple areas within the frame may include multiple small areas that are too small to accommodate the information to be embedded, and the information to be embedded may be divided to generate multiple pieces of split information, and the multiple pieces of split information may be distributed and placed in the multiple areas within the frame.

[0025] In the method and the program, each of the plurality of pieces of division information may have position information of the area in which the information is arranged and an error detection code for the entirety of the plurality of pieces of division information.

[0026] In the method and program, the frame division method may be changed for each frame, for each set of frames, or for each predetermined time period.

[0027] In the method and the program, the frame division method may be changed for each of a plurality of contents having video data or for each of a plurality of contents.

[0028] In the method and program, the information embedding method may be changed for each frame, for each set of frames, or for each predetermined time period.

[0029] In the method and the program, the method of embedding the information may be changed for each of a plurality of contents having video data or for each of a plurality of contents.

[0030] According to yet another aspect of the present invention, there is provided a video data processing device for processing video data, the video data processing device including: a frame dividing unit that divides each of a plurality of frames constituting the video data into a plurality of regions using the predetermined division method; and an information extraction unit that extracts, for each of the plurality of frames, information for identifying a person who output the video data from some or all of the plurality of regions obtained by dividing the frame based on the information embedding method.

[0031] A server according to still another aspect of the present invention is a server that manages information used in any of the video data processing devices, and includes a storage unit that stores information on the frame division method and the information embedding method, and information that identifies the video data processing device, and a communication unit that communicates via a communication network or a communication line.

[0032] The server may transmit information on the frame division method and the information embedding method used in the video data processing device, or may receive information on the frame division method and the information embedding method used in the video data processing device.

[0033] A device according to still another aspect of the present invention is a content receiving device that receives and outputs content including video data via broadcast radio waves or streaming distribution, and includes any one of the video data processing devices described above.

[0034] A broadcasting system according to yet another aspect of the present invention includes the content receiving device described above and a broadcasting device that broadcasts content including video data.

[0035] A distribution system according to yet another aspect of the present invention includes the content receiving device and a server that streams content including video data.

[0036] An apparatus according to yet another aspect of the present invention is a content playback apparatus that plays and outputs content including video data using a video data file read from a recording medium or a video data file downloaded from a server, and is equipped with any of the video data processing apparatuses described above.

[0037] The program that divides the frame into multiple regions, embeds information in the multiple regions, and combines the multiple regions may include a trained model used in machine learning. [Effects of the Invention]

[0038] According to the present invention, information for identifying the outputter of video data is embedded in some or all of the multiple areas into which a frame of video data is divided, and the multiple areas with the embedded information are combined and returned to a frame for output.This makes it possible to extract the information embedded in the frame without tampering even if the output video data is leaked, thereby making it possible to identify the unauthorized outputter of video data. [Brief explanation of the drawings]

[0039] [Figure 1] FIG. 1 is a block diagram showing an example of a moving image data processing device having an information embedding function according to an embodiment. [Figure 2] Fig. 2(a) is an explanatory diagram showing an example of a frame before division, Fig. 2(b) is an explanatory diagram showing an example of multiple regions into which information has been embedded after dividing a frame, and Fig. 2(c) is an explanatory diagram showing an example of a frame into which multiple regions into which information has been embedded have been combined and restored. [Figure 3] FIG. 3 is an explanatory diagram showing an example of frame division. [Figure 4] FIG. 4 is an explanatory diagram showing another example of frame division. [Figure 5] FIG. 5 is an explanatory diagram showing yet another example of frame division. [Figure 6] FIG. 6 is an explanatory diagram showing an example of a change in the screen division method for frames in video data. [Figure 7] FIG. 7 is a block diagram showing an example of a content playback device including a video data processing device according to an embodiment. [Figure 8] FIG. 8 is an explanatory diagram illustrating an example of the overall configuration of a content distribution system according to the embodiment. [Figure 9] FIG. 9 is a sequence diagram showing an example of content distribution in the content distribution system of FIG. [Figure 10] FIG. 10 is a block diagram showing an example of a schematic configuration of a content receiving device including a moving image data processing device according to an embodiment. [Figure 11]FIG. 11 is a block diagram showing an example of a moving image data processing device having an information extraction function according to an embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0040] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. The device according to the embodiment described herein is a video data processing device that divides each of a plurality of frames constituting video data of video content into a plurality of regions using a predetermined division method, embeds information for identifying the outputter of the video data in some or all of the regions obtained by dividing the frame for each of the plurality of frames, and combines the plurality of regions with the embedded information for each of the plurality of frames to return the plurality of frames to a single frame. By embedding information for identifying the outputter of the video data in some or all of the regions obtained by dividing the frame in this manner, the information embedded in the frame can be extracted without being tampered with, thereby enabling the identification of an unauthorized outputter of video data and preventing the unauthorized output of video data.

[0041] 1 is a block diagram showing an example of a schematic configuration of a moving image data processing device 100 according to this embodiment. In FIG. 1, the moving image data processing device 100 includes a frame dividing unit 101, an information embedding unit 102, and a frame returning unit 103.

[0042] The frame dividing unit 101 divides each of the multiple frames constituting the video data into multiple (1 to N) regions using a predetermined division method. For example, the frame dividing unit 101 divides the frame 900 shown in Fig. 2(a) into multiple (four in the illustrated example) equally sized square regions 910(1) to 910(2) shown in Fig. 2(b).

[0043] For each of the multiple frames, the information embedding unit 102 embeds information for identifying the outputter of the video data (hereinafter also referred to as "outputter identification information") in some or all of the multiple regions 910(1) to 910(4) obtained by dividing the frame, as shown in Fig. 2(b). For example, the information embedding unit 102 generates divided images of multiple regions obtained by dividing each frame of the video data received from a content playback device (e.g., a video playback player), and embeds the outputter identification information in the multiple divided images.

[0044] By embedding the output person identification information, when content including video data is leaked, the output person identification information can be restored from the content, and it can be determined who output and viewed the content.

[0045] In Fig. 2(b), for convenience of explanation, the information embedded in each of the regions 910(1) to 910(4) (in the illustrated example, the numerical information "123") is shown so as to be visible, but in reality the information is embedded in an invisible state. Also, in Fig. 2(b), information is embedded in all of the multiple regions 910(1) to 910(4), but information may be embedded in only some of the multiple regions 910(1) to 910(4).

[0046] The outputter of video data is, for example, a viewer of content that includes the video data. The outputter identification information is embedded in a state that cannot be recognized (read) by a normal outputter, for example. The outputter identification information may be embedded as an invisible digital watermark using the digital watermark technology disclosed in Japanese Patent Application Laid-Open No. 10-243398, Japanese Patent Application Laid-Open No. 2020-088469, etc.

[0047] The output person identification information may be, for example, identification (ID) information set in a content playback device (e.g., a video playback player, a terminal with video playback function, a game console, etc.) or a content receiving device (e.g., a broadcast receiving device such as a television), unique information of the terminal, or identification (ID) information specified by a server such as an external distribution server or management server. The output person identification information may be a global IP address of the content playback device or the content receiving device. The output person identification information may be a user ID of a user of the content playback device, a user of the content receiving device, etc. The output person identification information may be a user ID (e.g., a member ID) that identifies a user of a video service or a content distribution service. Furthermore, the output person identification information may be different information for each outputter (e.g., a client or user of a distribution service) who outputs and uses video data.

[0048] The information embedding unit 102 may embed additional information linked to the outputter identification information together with the outputter identification information. Here, the additional information may be, for example, session information such as a session ID that identifies a communication session established with the server, or other information.

[0049] The information embedding unit 102 may embed time information (including date information) when the video data was played or output together with the outputter identification information. By embedding the time information together with the outputter identification information, when content including the video data is leaked, the outputter identification information and time information can be restored from the content, and it can be determined who output and viewed the content and when.

[0050] The information embedding unit 102 may embed additional information linked to the outputter identification information and the time information together with the outputter identification information and the time information. Here, the additional information may be, for example, session information such as a session ID that identifies a communication session established with the server, or may be other information.

[0051] The frame return unit 103 combines the multiple areas in which the information is embedded for each of the multiple frames, as shown in Figure 2(c), and returns the frames to frame 920. In this state, the embedded information cannot be read. Note that, for convenience of explanation, Figure 2(c) shows the embedded information (in the illustrated example, four pieces of numerical information "123") so that it can be seen, but in reality the information is embedded in an invisible manner.

[0052] The moving image data having frames returned by combining images from a plurality of regions in the frame return unit 103 is output to a video display device or the like in synchronization with the audio data.

[0053] In the moving image data processing device 100 configured as described above, the frame dividing unit 101 may divide each of the multiple frames into multiple (1 to N) non-square quadrangular regions, or may divide the frames into multiple regions 911(1) to 911(6) that are a mixture of a square region 911(1) and non-square quadrangular regions 911(2) to 911(6), as shown in Fig. 3. Furthermore, the frame dividing unit 101 may divide each of the multiple frames 900 into multiple regions 911(1) to 911(6) of unequal sizes, as shown in Fig. 3, for example.

[0054] Furthermore, in the moving image data processing device 100 configured as described above, the frame dividing unit 101 may divide a frame 900 into a plurality of regions, for example, as shown in Fig. 4, using a wavelet transform technique disclosed in, for example, Japanese Patent Laid-Open No. 10-276321. The illustrated example shows division into a plurality of regions (HH1, HL1, LH1, LL1, HH2, HL2, LH2, LL2, HH3, HL3, LH3, LL3) using a multiple wavelet transform. By using wavelet transform in this way, it is possible to generate a region of the frame that has little impact on image quality (for example, a high-frequency region in the spatial frequency domain, or a high-frequency region in the frequency domain obtained by converting the temporal change of the image) from the plurality of regions of the frame.

[0055] Here, if the size of each of the multiple regions after division is large enough to accommodate the information to be embedded, the information may be embedded in a region of the smallest size that is a part of the multiple regions. For example, in FIG. 4, if the size of each of the multiple regions HH1 to LL3 of the multiple wavelet transform is large enough to accommodate the information to be embedded, the information is embedded in the smallest size region LL3 or region LL2. If the size of the smallest size region LL3 is not large enough to accommodate the information to be embedded, the information is embedded in region LL2. In this case, in order to remove the embedded information from the video data, an attacker (illegible outputter) needs to know both how the frames of the video data were divided (division method) and in which region of the wavelet transform the information is embedded (location information of the region where the information is embedded), which increases the resistance to tampering and deletion of the embedded information.

[0056] Furthermore, the frame dividing unit 101 may divide each of the multiple frames 900 into multiple regions using both the wavelet transform technology and the discrete cosine transform technology disclosed in, for example, Japanese Patent Application Laid-Open Nos. 11-317859 and 11-317860. By using the wavelet transform or the discrete cosine transform in this way, it is possible to generate regions of the multiple regions of a frame that have little impact on image quality (for example, high-frequency regions in the spatial frequency domain, or high-frequency regions in the frequency domain obtained by transforming the temporal change in the image). In particular, by performing the discrete cosine transform on the wavelet-transformed image, the changes in the image become more natural, making it difficult to tell that information has been embedded.

[0057] 5, the multiple regions 912(1) to 912(12) in the frame 900 may include multiple small regions 912(1) to 912(6) that are too small to contain the information to be embedded. In this case, the information embedding unit 102 divides the information to be embedded into multiple pieces of divided information and distributes the multiple pieces of divided information across the multiple small regions 912(1) to 912(6) in the frame 900. This increases the resistance to extraction, alteration, and deletion of the embedded information when an attacker (a person who outputs illegally) combines leaked videos in detail.

[0058] Here, when the information to be embedded is divided into a plurality of pieces of divided information and embedded, each of the plurality of pieces of divided information may have position information within the frame of the area where the information is placed and an error detection code for the entire plurality of pieces of divided information. In this case, even if an attacker (illegal outputter) combines the leaked videos in detail and the divided information of multiple users (illegal outputters) is mixed in the combined video, it is possible to identify each of the multiple mixed users (illegal outputters).

[0059] Furthermore, in the moving image data processing device 100 configured as above, the frame dividing unit 101 may change the frame screen dividing methods A to F for each frame, for each set of frames, or for each predetermined time period (for example, every 10 seconds or every minute), as shown in Fig. 6. In this case, even if multiple attackers (unauthorized outputters) cooperate to modify the moving image by replacing frames, it becomes difficult to erase all information in the moving image, and the attackers (unauthorized outputters) can be identified.

[0060] Furthermore, in the moving image data processing device 100 configured as described above, the frame dividing section 101 may change the frame dividing method for each of a plurality of contents having moving image data or for each of a plurality of contents.

[0061] Note that information about the division method used by frame division unit 101 is transmitted to the server whenever there is a change, and is stored and managed within the server. The server may be a distribution server that distributes content, or an information management server that is provided separately from the distribution server.

[0062] In the video data processing device 100 having the above configuration, the information embedding unit 102 may embed information into regions of each frame using, for example, wavelet transform technology disclosed in Japanese Patent Application Laid-Open No. 10-276321. Alternatively, the information embedding unit 102 may embed information into regions of each frame using, for example, discrete cosine transform technology disclosed in Japanese Patent Application Laid-Open Nos. 11-317859 and 11-317860. By using wavelet transform or discrete cosine transform in this way, information can be embedded into regions of a frame that have little impact on image quality (for example, high-frequency regions in the spatial frequency domain or high-frequency regions in the frequency domain obtained by transforming temporal changes in the image), thereby suppressing degradation of image quality.

[0063] Furthermore, in the video data processing device 100 configured as described above, the information embedding unit 102 may divide the information to be embedded to generate multiple pieces of divided information, and distribute the multiple pieces of divided information across multiple regions within the frame. Here, each of the multiple pieces of divided information may have position information for the region in which the information is placed and an error detection code for the entire multiple pieces of divided information. Even if an attacker (illegal outputter) carefully combines leaked videos and the combined video contains divided information from multiple users (illegal outputters), it is possible to identify each of the multiple users (illegal outputters).

[0064] Furthermore, the information embedding unit 102 may change the information embedding method for each frame, for each set of frames, or for each predetermined time period (for example, every 10 seconds or every minute). In this case, even if multiple attackers (unauthorized outputters) cooperate to modify the video by replacing frames, it becomes difficult to erase all of the information in the video, and the attackers (unauthorized outputters) can be identified. Furthermore, the information embedding unit 102 may change the information embedding method for each piece of content or for each set of content containing video data.

[0065] Whenever there is a change in the information on the embedding method used by the information embedding unit 102, the information is transmitted to the server and stored and managed in the server. The server may be a distribution server that distributes content, or an information management server that is provided separately from the distribution server.

[0066] 7 is a block diagram showing an example of a content playback device including a video data processing device according to an embodiment. The content playback device (hereinafter also referred to as a "video playback player") 10 plays video data using a video data file read from a recording medium or a video data file downloaded from a server. of 7, a content playback device (hereinafter also referred to as a "video playback player") 10 includes the video data processing device 100 configured as described above, a storage unit 110, a communication unit 120, a playback / control unit 130, and an output unit 140. The storage unit 110 stores a content file having video data received from a server such as a distribution server, information on a frame division method and an information embedding method received from the server such as a distribution server, information for identifying the video data processing device 100, and various programs. The communication unit 120 communicates with a server such as a distribution server via a communication network or communication line. The playback / control unit 130 plays video data and audio data consisting of multiple consecutive frames based on the content file stored in the storage unit 110. The playback / control unit 130 also executes a predetermined control program to control each unit. The output unit 140 outputs video data having frames in which the predetermined information is embedded by the video data processing device 100 to a video display device or the like in synchronization with the audio data. It should be noted that the content reproduction device 10 may include, instead of or in addition to the output unit 140, a display unit that displays video data and an audio output unit that outputs audio data.

[0067] FIG. 8 is an explanatory diagram showing an example of the overall configuration of a content distribution system according to an embodiment. In FIG. 8, the content distribution system includes a content playback device (video playback player) 10 having the video data processing device 100 configured as described above, a server group 20 including a distribution server 210 and a time server 220, and a video display device 30. The distribution server 210 also serves as a management server and includes a storage unit that stores information on a frame division method and an information embedding method used in the video data processing device 100 and information for identifying the video data processing device 100, and a communication unit that communicates with the content playback device (video playback player) 10 via a communication network or communication line. The distribution server 210 transmits information on the frame division method and the information embedding method used in the video data processing device 100. The distribution server 210 may receive information on the frame division method and the information embedding method used in the video data processing device 100. The management server may be provided separately from the distribution server 210. The time data distributed from the time server 220 to the content playback device (video playback player) 10 can be used for synchronization processing of the video data processing device 100 in the content playback device (video playback player) 10. The video display device 30 is, for example, a monitor such as an LCD, a projector, or a display of a terminal device (for example, a smartphone).

[0068] FIG. 9 is a sequence diagram showing an example of content distribution in the content distribution system of FIG. 8. In FIG. 9, the playback control unit 130 of the video playback player (content playback device) 10 executes a predetermined application program and transmits a playback request to the distribution server 210, requesting playback of video content. Upon receiving the playback request from the video playback player 10, the distribution server 210 transmits to the video playback player 10 the file of the video content to be played, initial information specifying the frame division method and the information embedding method, and embedding information to be embedded in the divided areas of the frames. The playback control unit 130 of the video playback player 10 transfers the initial information specifying the frame division method and the information embedding method received from the distribution server 210 to the video data processing device 100, and begins transmitting video data generated by playing the video content file to the video data processing device 100. The video data processing device 100 embeds information into the video data based on the division method and embedding method specified by the distribution server 210, and begins transmitting the video data with the embedded information to the video display device 30.

[0069] The distribution server 210 changes the frame division method and the information embedding method every predetermined time (e.g., every 10 seconds) and transmits information about the changed division method and embedding method to the video playback player 10. The distribution server 210 may receive information about the frame division method and information embedding method used in the video data processing device 100. When the playback control unit 130 of the video playback player 10 receives information about the changed division method and embedding method from the distribution server 210, it transfers the information about the changed division method and embedding method to the video data processing device 100. Every time the distribution server 210 changes the division method and embedding method, the video data processing device 100 embeds information into subsequent video data based on the changed division method and embedding method and transmits the video data with the embedded information to the video display device 30.

[0070] Fig. 10 is a block diagram showing an example of a schematic configuration of a content receiving device 11 including a video data processing device 100 according to an embodiment. The content receiving device 11 receives and outputs content including video data via, for example, broadcast radio waves or streaming distribution. In Fig. 10, components common to those in Fig. 7 are designated by the same reference numerals, and descriptions thereof will be omitted.

[0071] 10, the content receiving device 11 includes the moving image data processing device 100 configured as described above, a storage unit 110, a communication unit 120, a playback / control unit 130, an output unit 140, and a receiving unit 150. The receiving unit 150 receives content including moving image data from a broadcasting device at a broadcast station via airwaves, or receives content including moving image data from a server via streaming distribution. The playback / control unit 130 plays back moving image data and audio data consisting of multiple consecutive frames based on the content received via airwaves or streaming distribution, and sends the played back moving image data and audio data to the moving image data processing device 100. The output unit 140 outputs moving image data having frames in which the predetermined information is embedded, synchronized with the audio data, to a video display device or the like. Note that the content receiving device 11 may include a display unit for displaying moving image data and an audio output unit for outputting audio data instead of or in addition to the output unit 140.

[0072] A broadcasting system according to the embodiment may be configured to include the content receiving device 11 of Fig. 10 and a broadcasting device that broadcasts content including video data. Also, a distribution system according to the embodiment may be configured to include the content receiving device 11 of Fig. 10 and a server that streams content including video data.

[0073] FIG. 11 is a block diagram illustrating an example of a video data processing device 160 having an information extraction function according to an embodiment. In FIG. 11, the video data processing device 160 is a device capable of extracting information embedded in video data when the video data embedded by the video data processing device 100 is leaked. The video data processing device 160 includes a frame division unit 161 and an information extraction unit 162. The frame division unit 161 divides each of a plurality of frames constituting video data received from a content playback device (video playback player) or the like into a plurality of regions using a predetermined division method used by the video data processing device 100. The information extraction unit 162 extracts information for identifying the outputter of the video data from some or all of the plurality of regions obtained by dividing each of the plurality of frames based on the information embedding method used by the video data processing device 100. For example, the information extraction unit 162 extracts information from the regions where the information is embedded using an inverse discrete cosine transform or an inverse wavelet transform after dividing the frames.

[0074] In the above embodiment, machine learning may be used to divide a frame into a plurality of regions, embed information in the plurality of regions of a frame, and combine the plurality of regions.

[0075] As described above, according to this embodiment, it is possible to prevent the falsification and deletion of information embedded in video data and to identify the person who is illegally outputting video data, thereby preventing the illegal output of video data.

[0076] Furthermore, the present invention can provide a video data processing device that can prevent unauthorized output of video data, thereby contributing to the achievement of Goal 9 of the Sustainable Development Goals (SDGs), which is to "build resilient infrastructure, promote inclusive and sustainable industrialization and foster innovation."

[0077] The processing steps and components of the video data processing device, content receiving device, content playback device, broadcasting system, and distribution system described herein can be implemented by various means. For example, these steps and components may be implemented by hardware, firmware, software, or a combination thereof.

[0078] For hardware implementations, the processing units and other means used to implement the above steps and components in an entity (e.g., various computing devices, communication devices, receivers, transmitters, displays, terminals, hard disk drives, or optical disk drives) may be implemented in one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processors (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, microcontrollers, microprocessors, electronic devices, other electronic units, computers designed to perform the functions described herein, or combinations thereof.

[0079] Furthermore, with regard to firmware and / or software implementations, the means, such as a processing unit, used to realize the above components may be implemented with a program (e.g., code, such as procedures, functions, modules, instructions, etc.) that performs the functions described herein. In general, any computer / processor-readable medium tangibly embodying firmware and / or software code may be used to implement the means, such as a processing unit, used to realize the above steps and components described herein. For example, the firmware and / or software code may be stored in a memory and executed by a computer or processor, such as in a controller. The memory may be implemented within the computer or processor or external to the processor. Furthermore, the firmware and / or software code may be stored in a computer- or processor-readable medium, such as random access memory (RAM), read-only memory (ROM), non-volatile random access memory (NVRAM), programmable read-only memory (PROM), electrically erasable programmable read-only memory (EEPROM), flash memory, floppy disk, compact disk (CD), digital versatile disk (DVD), magnetic or optical data storage device, etc. The code may be executed by one or more computers or processors and may cause the computers or processors to perform certain aspects of the functionality described herein.

[0080] The medium may be a non-transitory recording medium. The program code may be in any format as long as it can be read and executed by a computer, processor, or other device or machine. For example, the program code may be in any of source code, object code, and binary code, or may be a mixture of two or more of these codes.

[0081] Moreover, the description of the embodiments disclosed herein is provided to enable any person skilled in the art to make or use the present disclosure. Various modifications to the present disclosure will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other variations without departing from the spirit or scope of the present disclosure. Thus, the present disclosure is not intended to be limited to the examples and designs described herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein. [Explanation of symbols]

[0082] 10: Content playback device (video player) 11: Content receiving device 20: Server group 30:Video display equipment 100: Video data processing device 101: Frame division section 102: Information embedding section 103: Frame return part 110: Storage section 120: Communications Department 130: Control unit 140: Output section 150: Receiving unit 160: Video data processing device 161: Frame division section 162: Information extraction section 210: Distribution server 220: Time Server 900: Frame 910, 911, 912: Areas (frame division) 920: Frame with embedded information

Claims

1. A video data processing device that processes video data, a frame dividing unit that divides each of a plurality of frames constituting the video data into a plurality of regions using a predetermined division method; an information embedding unit that embeds information for identifying a person who outputs the video data into a part of the plurality of regions obtained by dividing each of the plurality of frames; a combining unit that combines the plurality of regions after embedding the information in parts of the plurality of regions for each of the plurality of frames to return the plurality of regions to the frame; A video data processing device comprising:

2. 2. The video data processing device of claim 1, the video data composed of the plurality of frames before being divided into the plurality of regions by the frame dividing unit is video data output from a content playback device that plays video content including the video data read from a recording medium, or video data output from a content receiving device that receives video content including the video data via broadcast radio waves or streaming distribution, The video data processing device, wherein the information embedding unit embeds information for identifying the person who output the video data and time information when the content playback device or the content receiving device output the video data.

3. 2. The video data processing device of claim 1, The video data processing device, wherein the information embedding unit embeds the information as an invisible digital watermark.

4. 2. The video data processing device of claim 1, A video data processing device characterized in that the frame division unit divides each of the multiple frames into multiple square regions, multiple non-square rectangular regions, or multiple regions that are a mixture of square regions and non-square rectangular regions.

5. 2. The video data processing device of claim 1, The video data processing device, wherein the frame dividing unit divides each of the plurality of frames into a plurality of regions of equal or unequal size.

6. 2. The video data processing device of claim 1, The information embedding unit embeds information into the region using a wavelet transform, or performs a discrete cosine transform on the image after embedding information into the region using the wavelet transform. A video data processing device comprising:

7. 2. The video data processing device of claim 1, the plurality of regions in the frame include a plurality of small regions that are too small to accommodate information to be embedded by the information embedding unit, The video data processing device, wherein the information embedding unit divides the information to be embedded into a plurality of pieces of divided information, and distributes and arranges the plurality of pieces of divided information in a plurality of areas within the frame.

8. 8. The video data processing device of claim 7, 10. A video data processing device, comprising: a plurality of pieces of division information each having position information of the area in which the piece of division information is arranged; and an error detection code for the entirety of the plurality of pieces of division information.

9. 2. The video data processing device of claim 1, The video data processing device, wherein the frame division unit changes the frame division method for each frame, for each set of frames, or for each predetermined time period.

10. 2. The video data processing device of claim 1, The video data processing device, wherein the frame dividing unit changes the frame dividing method for each of a plurality of video contents having video data or for each of a plurality of video contents.

11. 2. The video data processing device of claim 1, The video data processing device, wherein the information embedding unit changes the information embedding method for each frame, for each set of frames, or for each predetermined time period.

12. 2. The video data processing device of claim 1, The video data processing device, wherein the information embedding unit changes the information embedding method for each video content or for each of a plurality of video contents having video data.

13. A video data processing device that processes video data, a frame dividing unit that divides each of a plurality of frames constituting the video data in which the information is embedded into a plurality of regions by the predetermined dividing method used in the video data processing device of claim 1; an information extraction unit that extracts, for each of the plurality of frames, information for identifying a person who has output the video data from a part of the plurality of regions into which the frame is divided, based on the information embedding method used in the video data processing device of claim 1; A video data processing device comprising:

14. A server for managing information used in any one of the video data processing devices according to any one of claims 1 to 13, a storage unit that stores information on the frame division method and the information embedding method, and information for identifying the moving image data processing device; A server comprising: a communication unit that communicates via a communication network or a communication line.

15. 15. The server of claim 14, A server that transmits information on a method for dividing the frames and a method for embedding the information used in the video data processing device.

16. 15. The server of claim 14, A server that receives information on the frame division method and the information embedding method used in the video data processing device.

17. A content receiving device that receives and outputs video content including video data via broadcast radio waves or streaming distribution, A video data processing device according to any one of claims 1 to 13, the frame division unit of the video data processing device divides each of a plurality of frames constituting the video data output from the content receiving device into a plurality of regions using a predetermined division method; the information embedding unit of the video data processing device embeds, for each of the plurality of frames, information for identifying an outputter of the video data who output the video data from the content receiving device in a part of the plurality of regions obtained by dividing the frame; A content receiving device comprising:

18. 18. A broadcasting system comprising: the content receiving device of claim 17; and a broadcasting device that broadcasts video content including the video data.

19. 20. A distribution system comprising: the content receiving device of claim 17; and a server that streams video content including the video data.

20. A content playback device that plays back and outputs video content including video data using a file of video data read from a recording medium or a file of video data downloaded from a server, comprising: A video data processing device according to any one of claims 1 to 13, the frame division unit of the video data processing device divides each of a plurality of frames constituting the video data output from the content playback device into a plurality of regions using a predetermined division method; the information embedding unit of the video data processing device embeds, for each of the plurality of frames, information for identifying a person who output the video data from the content playback device in a part of the plurality of regions obtained by dividing the frame; A content playback device comprising:

21. 1. A method for processing video data, comprising: Dividing each of a plurality of frames constituting video data into a plurality of regions using a predetermined division method; embedding information for identifying a person who outputs the video data in a part of the plurality of regions obtained by dividing each of the plurality of frames; For each of the plurality of frames, embedding the information in a portion of the plurality of regions and then combining the plurality of regions to return the frame; A method comprising:

22. A program executed on a computer or processor provided in a video data processing device that processes video data, program code for dividing each of a plurality of frames constituting video data into a plurality of regions using a predetermined division method; a program code for embedding, for each of the plurality of frames, information for identifying a person who outputs the video data in a part of the plurality of regions obtained by dividing the frame; a program code for embedding the information in a part of each of the plurality of regions, and then combining the plurality of regions to return the frame to the original frame; A program comprising:

Images