Electronic equipment

A dual digital watermarking approach with varying robustness levels addresses the challenge of protecting copyright and detecting tampering in electronic devices, ensuring effective copyright protection and tampering prevention.

JP7591512B2Active Publication Date: 2024-11-28SONY SEMICON SOLUTIONS CORP
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2021554077
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2019-10-30
Filing Date
2020-07-17
Publication Date
2024-11-28
Estimated Expiration
2040-07-17

AI Technical Summary

Technical Problem

Conventional electronic devices face challenges in achieving both effective copyright protection and tampering prevention when using robust digital watermarks, as reducing robustness to detect tampering leads to potential loss of copyright information.

Method used

The technology employs a dual digital watermarking approach, where first and second embedded information with different robustness levels are used, allowing for robustness adjustment and separate detection of tampering while maintaining copyright protection.

Benefits of technology

This method enables simultaneous copyright protection and tampering prevention by using first and second digital watermarks with varying robustness, ensuring the integrity of copyright information and enabling detection of tampering.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007591512000001
    Figure 0007591512000001
  • Figure 0007591512000002
    Figure 0007591512000002
  • Figure 0007591512000003
    Figure 0007591512000003
Patent Text Reader

Abstract

The present invention achieves both copyright protection and tampering prevention in an electronic device that embeds information in content. This electronic device is provided with a content generation unit, a first embedding processing unit, and a second embedding processing unit. In this electronic device the content generation unit generates content. In this electronic device the first embedding processing unit embeds in the content first embedded information related to the content. The second embedding processing unit embeds second embedded information in the content.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present technology relates to electronic devices, and more particularly to electronic devices that process content. [Background technology]

[0002] Conventionally, in electronic devices that process contents such as images and audio, embedding techniques called information hiding have been widely used for the purpose of copyright management and the like. Information embedded in this information hiding can be roughly divided into electronic watermarks and steganography. Of these, electronic watermarks are information related to the content to be embedded and should be read by the receiving side, such as copyright information. On the other hand, steganography is information that should be kept secret and is not necessarily related to the content, such as encryption information. For example, electronic devices that embed electronic watermarks indicating copyright information into RAW image data have been proposed (see, for example, Patent Document 1). When embedding copyright information in this way, electronic watermarks that are highly resistant to attacks such as compression, editing, and processing are often used so that the copyright information is not lost, and such electronic watermarks are called robust electronic watermarks. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2005-278099 A Summary of the Invention [Problem to be solved by the invention]

[0004] In the above-mentioned conventional technology, copyright protection is achieved by embedding a robust digital watermark indicating copyright information. However, when a robust digital watermark is used, it becomes difficult to determine whether or not content has been tampered with. In order to determine whether or not content has been tampered with, it is sufficient to reduce the robustness of the digital watermark, but reducing the robustness makes it easier for copyright information to be lost. Thus, the above-mentioned electronic devices have a problem in that it is difficult to achieve both copyright protection and tamper prevention at the same time.

[0005] This technology was developed in light of these circumstances, and aims to achieve both copyright protection and tamper prevention in electronic devices that embed information in content. [Means for solving the problem]

[0006] The present technology has been made to solve the above-mentioned problems, and a first aspect thereof is an electronic device including a content generating unit that generates content, a first embedding processing unit that embeds first embedding information related to the content in the content, and a second embedding processing unit that embeds second embedding information in the content. This brings about an effect that copyright protection and tamper prevention can be easily realized.

[0007] In the first aspect, the first embedding information and the second embedding information may be digital watermark information, which provides an advantage in that it is easy to adjust the robustness of the digital watermark information.

[0008] In the first aspect, the first embedding information and the second embedding information may have different robustness, which provides an advantage that the robustness of the embedded information can be easily adjusted.

[0009] In the first aspect, the first embedding information may have a higher robustness than the second embedding information, thereby providing an effect of facilitating adjustment of the robustness of the embedded information.

[0010] In addition, in the first aspect, the second embedding processing unit may embed the second embedding information in the content in which the first embedding information is embedded. This brings about an effect that loss of the second embedded information due to embedding of the first embedded information is prevented.

[0011] In addition, in the first aspect, the content may further include an image processing unit that performs a predetermined image processing on the content in which the first embedding information is embedded, and the second embedding processing unit may embed the second embedding information in the content on which the image processing has been performed, thereby preventing the second embedding information from being lost due to the image processing.

[0012] In the first aspect, the content may be image data, and the image processing may include a demosaic process. This brings about an effect that loss of the second embedded information due to the demosaic process is prevented.

[0013] In the first aspect, the image processing may include a compression process, which brings about an effect of preventing the second embedding information from being lost due to the compression process.

[0014] In addition, in the first aspect, the first embedded information may be robust digital watermark information or semi-fragile digital watermark information, and the second embedded information may be semi-fragile digital watermark information or fragile digital watermark information. This provides an advantage that the presence or absence of tampering can be determined while protecting copyright.

[0015] In addition, in the first aspect, the content may be image data including a first pixel region and a second pixel region, the first embedding information may be embedded in the first pixel region, and the second embedding information may be embedded in a region corresponding to the second pixel region in the image data after the image processing, so that the first pixel region and the second pixel region do not overlap. This provides an effect of improving the image quality of the image data.

[0016] In the first aspect, the image processing may include a compression process, which brings about an effect of preventing the second embedding information from being lost due to the compression process.

[0017] In addition, in the first aspect, the content may be image data including a first pixel region and a second pixel region, the first embedding information may be embedded in the first pixel region, and the second embedding information may be embedded in a region of the image data after the image processing that corresponds to the second pixel region, and at least a portion of the first pixel region and the second pixel region may overlap. This provides an effect that digital watermark information is less likely to be lost even if an attack is made on a portion of an image.

[0018] In the first aspect, the image processing may include a compression process, which brings about an effect of preventing the second embedding information from being lost due to the compression process.

[0019] In the first aspect, the first embedded information may include information related to the second embedded information, thereby making it easier to read the second embedded information.

[0020] In the first aspect, the second embedding information may be encrypted non-digital watermark information, which provides an advantage of improving security.

[0021] In addition, in the first aspect, the content may be an image file including image data and non-image data, and the second embedding information may be embedded in the non-image data. This provides an effect of preventing deterioration of image quality of the image data.

[0022] In the first aspect, the second embedded information may be information related to a digital signature, thereby providing an effect of improving security.

[0023] In the first aspect, the first embedded information may include information related to the second embedded information, thereby making it easier to read the second embedded information.

[0024] In the first aspect, the second embedded information may include information related to the first embedded information, which provides an effect of making it easier to read the first embedded information.

[0025] In the first aspect, the first embedded information may include copyright information, thereby providing an effect of protecting the copyright. [Brief description of the drawings]

[0026] [Figure 1] 1 is a block diagram showing a configuration example of a communication system according to a first embodiment of the present technology. [Diagram 2] 1 is a block diagram showing an example of a configuration of an imaging device according to a first embodiment of the present technology. [Diagram 3] 1 is a block diagram showing an example of a configuration of an imaging element according to a first embodiment of the present technology. [Figure 4] 1 is a circuit diagram showing a configuration example of a pixel according to a first embodiment of the present technology. [Diagram 5] 1 is an example of a cross-sectional view of a pixel according to a first embodiment of the present technology. [Figure 6]1 is a block diagram showing a configuration example of an application processor according to a first embodiment of the present technology. [Figure 7] 3 is a diagram showing an example of an arrangement of a first pixel region and a second pixel region according to the first embodiment of the present technology. FIG. [Figure 8] 10 is a diagram showing another example of an arrangement of the first pixel region and the second pixel region in the first embodiment of the present technology. FIG. [Figure 9] 2 is a block diagram showing an example of the configuration of a first digital watermark information embedding unit according to the first embodiment of the present technology. FIG. [Figure 10] 2 is a block diagram showing an example of the configuration of a first digital watermark information generating unit in the first embodiment of the present technology. FIG. [Figure 11] 2 is a block diagram showing an example of the configuration of a digital watermark embedding unit according to the first embodiment of the present technology. FIG. [Figure 12] 4 is a block diagram showing an example of the configuration of a second digital watermark information embedding unit in the first embodiment of the present technology. FIG. [Figure 13] 2 is a block diagram showing an example of the configuration of a second digital watermark information generating unit in the first embodiment of the present technology. FIG. [Figure 14] 2 is a block diagram showing a configuration example of a server according to the first embodiment of the present technology. FIG. [Figure 15] 5 is a flowchart showing an example of an operation of the electronic device according to the first embodiment of the present technology. [Figure 16] 13 is a flowchart showing an example of an operation of an electronic device in a first modified example of the first embodiment of the present technology. [Figure 17] 13 is a flowchart showing an example of an operation of an electronic device according to a second modified example of the first embodiment of the present technology. [Figure 18] 13 is a flowchart showing an example of an operation of an electronic device according to a third modified example of the first embodiment of the present technology. [Figure 19] 13 is a flowchart showing an example of an operation of an electronic device in a fourth modified example of the first embodiment of the present technology. [Figure 20]13 is a flowchart showing an example of an operation of an electronic device according to a fifth modified example of the first embodiment of the present technology. [Figure 21] 13 is a flowchart showing an example of an operation of an electronic device according to a sixth modified example of the first embodiment of the present technology. [Figure 22] 13 is a flowchart showing an example of an operation of an electronic device according to a seventh modified example of the first embodiment of the present technology. [Diagram 23] 13 is a flowchart showing an example of an operation of an electronic device according to an eighth modified example of the first embodiment of the present technology. [Figure 24] 13 is a flowchart showing an example of an operation of an electronic device according to a ninth modification of the first embodiment of the present technology. [Diagram 25] 13 is a flowchart showing an example of an operation of an electronic device according to a second embodiment of the present technology. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0027] Hereinafter, modes for carrying out the present technology (hereinafter, referred to as embodiments) will be described. The description will be made in the following order. 1. First embodiment (Example of embedding two pieces of digital watermark information) 2. Second embodiment (Example of embedding digital watermark information and digital signature)

[0028] <1. First embodiment> [Example of communication system configuration] 1 is a block diagram showing an example of a configuration of a communication system according to a first embodiment of the present technology. The communication system is a system for transmitting and receiving content, and includes an electronic device 100 and a server 500.

[0029] The electronic device 100 performs a process of embedding digital watermark information in content and includes an image capture device 200, an application processor 400, a recording unit 110, and a data processing unit 120.

[0030] The imaging device 200 captures an image as a content. No digital watermark information is embedded in an image immediately after capture, and the image in this state is hereinafter referred to as an "original image." A message M1 including copyright information is input to the imaging device 200 in advance. For example, the user name of the imaging device 200 is used as this copyright information. The imaging device 200 creates digital watermark information from the message M1 as first digital watermark information and embeds it in the original image. The image with the embedded digital watermark information is hereinafter referred to as a "watermark image." The imaging device 200 supplies the watermark image with the embedded first digital watermark information as watermark image IMG1 to the application processor 400 via a signal line 209.

[0031] The application processor 400 performs a predetermined image processing on the watermark image IMG1. The application processor 400 also creates second digital watermark information from a preset message M2 and embeds it in the watermark image IMG1 after image processing. This message M2 is used, for example, as input data for a hash function. The application processor 400 supplies the watermark image in which the second digital watermark information is embedded as a watermark image IMG2 to the data processing unit 120 via a signal line 409.

[0032] Here, it is desirable that the first digital watermark information is more robust than the second digital watermark information that is embedded thereafter. Robustness refers to resistance to attacks such as compression, editing, and processing. Digital watermark information with a relatively high robustness is called robust digital watermark information, and digital watermark information with a relatively low robustness is called fragile digital watermark information. Digital watermark information that is less robust than robust digital watermark information and more robust than fragile digital watermark information is called semi-fragile digital watermark information.

[0033] To verify robustness, for example, the IHC (Information Hiding and its. Criteria for evaluation) Committee's IHC evaluation criteria are used. If a predetermined level of attack described in the IHC evaluation criteria is performed and the digital watermark information is not lost, it is determined to be robust digital watermark information. Alternatively, the attack tool StirMark, which is used as an industry standard, can be used instead of the IHC evaluation criteria.

[0034] As the first digital watermark information, for example, robust digital watermark information or semi-fragile digital watermark information can be used. When the first digital watermark information is robust digital watermark information, it is preferable to use semi-fragile digital watermark information or fragile digital watermark information as the second digital watermark information. On the other hand, when the first digital watermark information is semi-fragile digital watermark information, it is preferable to use fragile digital watermark information as the second digital watermark information. Also, there are a plurality of methods of semi-fragile digital watermark information with different robustness. For this reason, when the first digital watermark information is semi-fragile digital watermark information, it is also possible to use semi-fragile digital watermark information with lower robustness as the second digital watermark information.

[0035] As described above, when robustness is increased, it is possible to prevent the loss of digital watermark information even if an attack (such as compression or processing) is made on the image. This makes it possible to protect copyrights, etc. On the other hand, when robustness is decreased, digital watermark information is more likely to be lost when an attack is made on the image. Therefore, when robustness is low, the communication system can determine whether or not undesirable processing (so-called tampering) has been made on the image intentionally or accidentally.

[0036] When there is only one type of digital watermark information, increasing the robustness makes it difficult to determine whether or not there has been tampering, and decreasing the robustness makes it difficult to protect copyright. This makes it difficult to adjust the robustness. However, in the communication system, first and second digital watermark information with different robustness are embedded, so it is possible to determine whether or not there has been tampering while protecting copyright.

[0037] Furthermore, if the first digital watermark information is embedded after the second digital watermark information is embedded, there is a risk that the fragile second digital watermark information will be lost due to the embedding of the first digital watermark information. For this reason, the second digital watermark information is embedded after the more robust first digital watermark information.

[0038] The data processing unit 120 accesses the recording unit 110 via a signal line 128 and stores image data of the watermark image IMG2. The data processing unit 120 also transmits the watermark image IMG2 to the server 500 via a signal line 129 or the Internet. The recording unit 110 records the watermark image IMG2.

[0039] The server 500 reads the first digital watermark information and the second digital watermark information from the watermark image IMG 2. The server 500 uses the first digital watermark information to determine whether or not the image has been spoofed, and uses the second digital watermark information to determine whether or not the image has been tampered with.

[0040] Although electronic device 100 embeds digital watermark information, the information to be embedded is not limited to digital watermark information. For example, electronic device 100 can embed digital signature information instead of digital watermark information, as described later. Note that the first digital watermark information is an example of first embedded information as defined in the claims, and the second digital watermark information is an example of second embedded information as defined in the claims.

[0041] Although electronic device 100 embeds information such as digital watermark information in an image, it is also possible to embed information in content other than an image, such as audio or text. Note that image data of an original image is an example of the content described in the claims.

[0042] [Example of imaging device configuration] 2 is a block diagram showing an example of a configuration of an imaging device 200 according to the first embodiment of the present technology. The imaging device 200 includes an imaging element 300, a signal processing unit 210, and an interface 250.

[0043] The imaging element 300 generates an original image (img). The imaging element 300 supplies image data of the original image (img) to the signal processing unit 210. The imaging element 300 is an example of a content generating unit described in the claims.

[0044] The signal processing unit 210 performs predetermined signal processing on the original image. The signal processing unit 210 includes a clamping unit 211, a defect correction unit 212, a shading correction unit 213, and a first digital watermark information embedding unit 220.

[0045] The clamp unit 211 subtracts a black level, which is a level determined to be black, from the image data of the original image img. The clamp unit 211 supplies the image data from which the black level has been subtracted to the defect correction unit 212.

[0046] The defect correction unit 212 corrects defective pixels (such as phase difference pixels) from which correct pixel values ​​cannot be obtained, based on the image data from the clamp unit 211. The defect correction unit 212 supplies the corrected image data to the shading correction unit 213.

[0047] The shading correction unit 213 performs shading correction to remove luminance unevenness on the image data from the defect correction unit 212. The shading correction unit 213 supplies the image data after the shading correction to the first digital watermark information embedding unit 220.

[0048] The first digital watermark information embedding unit 220 generates first digital watermark information from the message M1 and embeds it in the image data of the original image img after shading correction. This first digital watermark information embedding unit 220 supplies the image in which the first digital watermark information is embedded as a watermark image IMG1 to the application processor 400 via the interface 250. Note that the first digital watermark information embedding unit 220 is an example of a first embedding processing unit described in the claims.

[0049] [Example of imaging device configuration] 3 is a block diagram showing an example of a configuration of an image sensor 300 according to the first embodiment of the present technology. The image sensor 300 includes a vertical scanning circuit 310, a pixel array section 320, a constant current source circuit 340, a timing control section 350, a column AD conversion section 360, a reference signal generation section 370, and a horizontal scanning circuit 380.

[0050] A plurality of pixels 330 are arranged in a two-dimensional lattice in the pixel array section 320. Hereinafter, a set of pixels 330 arranged in the horizontal direction will be referred to as a "row", and a set of pixels 330 arranged in the vertical direction will be referred to as a "column".

[0051] The vertical scanning circuit 310 drives the rows in sequence to output pixel signals.

[0052] The pixels 330 generate analog pixel signals by photoelectric conversion and supply the pixel signals to a column AD conversion unit 360 via vertical signal lines.

[0053] A load MOS (Metal-Oxide-Semiconductor) 341 is provided for each column in the constant current source circuit 340. A bias voltage is applied to the gate of this load MOS 341, and the source is grounded, and the load MOS 341 and the transistor in the pixel 330 of the corresponding column form a source follower circuit.

[0054] The reference signal generating unit 370 generates a sawtooth ramp signal or the like as a reference signal. The reference signal generating unit 370 includes a DAC (Digital to Analog Converter) 371. The DAC 371 generates a reference signal by DA (Digital to Analog) conversion. The DAC 371 supplies the reference signal to the column AD conversion unit 360.

[0055] The column AD conversion unit 360 is provided with an ADC 361 for each column. The ADC 361 performs AD conversion processing and CDS (Correlated Double Sampling) processing on pixel signals using a reference signal. The ADC 361 supplies the processed digital signal as pixel data to the signal processing unit 210 under the control of the horizontal scanning circuit 380. The image in which the pixel data is arranged corresponds to the original image img.

[0056] The horizontal scanning circuit 380 drives each of the ADCs 361 in sequence to output pixel data.

[0057] The timing control section 350 controls the operation timing of the vertical scanning circuit 310 and the horizontal scanning circuit 380 .

[0058] [Pixel configuration example] 4 is a circuit diagram showing an example of a configuration of a pixel 330 according to the first embodiment of the present technology. The pixel 330 includes a photodiode 331, a transfer transistor 332, a reset transistor 333, a floating diffusion layer 334, an amplifier transistor 335, and a selection transistor 336.

[0059] The photodiode 331 generates electric charges by photoelectric conversion. The transfer transistor 332 transfers electric charges from the photodiode 331 to the floating diffusion layer 334 in accordance with a transfer signal TX from the vertical scanning circuit 310.

[0060] The floating diffusion layer 334 accumulates the transferred charge and generates a voltage according to the amount of charge. The reset transistor 333 sweeps out the charge from the floating diffusion layer 334 and initializes it in accordance with a reset signal RST from the vertical scanning circuit 310.

[0061] The amplification transistor 335 amplifies the voltage of the floating diffusion layer 334. The selection transistor 336 supplies the amplified voltage signal to the column AD conversion unit 360 as a pixel signal in accordance with a selection signal SEL from the vertical scanning circuit 310.

[0062] 5 is an example of a cross-sectional view of a pixel 330 in the first embodiment of the present technology. As illustrated in the figure, in the pixel 330, a photodiode 331 is formed on a semiconductor substrate 391. A color filter 392 is provided on the upper layer of the photodiode 331, and an on-chip lens 393 is provided on the upper layer thereof. As the color filter 392, for example, a filter that transmits R (Red), G (Green), and B (Blue) light is used.

[0063] [Example of application processor configuration] 6 is a block diagram showing an example of a configuration of an application processor 400 according to the first embodiment of the present technology. The application processor 400 includes an interface 411, a white balance correction unit 412, a noise suppression unit 413, a demosaic unit 414, a linear matrix correction unit 415, a gamma correction unit 416, and a luminance / color difference separation unit 417. The application processor 400 further includes a luminance correction unit 418, a color difference thinning unit 419, a color difference correction unit 420, an image compression unit 421, a second digital watermark information embedding unit 450, and an interface 422.

[0064] The interface 411 receives image data of the watermark image IMG1 from the imaging device 200. The interface 411 supplies the received image data to a white balance correction unit 412. This image data is data before image processing such as compression processing and demosaic processing, and is generally called RAW image data.

[0065] The white balance correction unit 412 corrects the white balance by controlling the gain for each of the R, G, and B channels in the image data. The white balance correction unit 412 supplies the corrected image data to the noise suppression unit 413.

[0066] The noise suppression unit 413 performs processing to remove noise from the image data from the white balance correction unit 412. The noise suppression unit 413 supplies the image data after noise removal to a demosaic unit 414.

[0067] The demosaic unit 414 performs demosaic processing on the RAW image data to complement, for each pixel, missing color information among R, G, and B. The demosaic unit 414 supplies the image data after the demosaic processing to the linear matrix correction unit 415.

[0068] The linear matrix correction unit 415 corrects each color information of the pixel data using a matrix coefficient in order to fill the difference between the chromaticity point according to the standard and the chromaticity point of the actual camera. The linear matrix correction unit 415 supplies the corrected image data to the gamma correction unit 416.

[0069] The gamma correction unit 416 performs gamma correction to adjust the relative relationship between the color of the image data and the device characteristics on the output side to obtain a display closer to the original. The gamma correction unit 416 supplies the gamma-corrected image data to a luminance and chrominance separation unit 417.

[0070] The luminance / color difference separation unit 417 separates the image data into a luminance component and a color difference component. The luminance / color difference separation unit 417 supplies the luminance component to a luminance correction unit 418, and supplies the color difference component to a color difference thinning unit 419.

[0071] The luminance correction unit 418 corrects the luminance component in accordance with brightness, etc. The luminance correction unit 418 supplies the corrected luminance component to the image compression unit 421.

[0072] The chrominance thinning unit 419 thins out the chrominance components of some pixels. The chrominance thinning unit 419 supplies the chrominance components after thinning to the chrominance correction unit 420. The chrominance correction unit 420 corrects color shifts caused by the thinning out of the chrominance components. The chrominance correction unit 420 supplies the corrected chrominance components to the image compression unit 421.

[0073] The image compression unit 421 compresses the image data separated into the luminance component and the color difference component. For example, the compression process is performed in the Joint Photographic Experts Group (JPEG) format. The image compression unit 421 supplies the image after the compression process to the second digital watermark information embedding unit 450 as a compressed watermark image IMG1'.

[0074] The second digital watermark information embedding unit 450 creates second digital watermark information from the message M2 and embeds it in the compressed watermark image IMG1'. The second digital watermark information embedding unit 450 supplies the image in which the second digital watermark information is embedded as a watermark image IMG2 to the interface 422. The second digital watermark information embedding unit 450 is an example of a second embedding processing unit described in the claims.

[0075] The interface 422 supplies the image data of the watermark image IMG2 to the data processing unit 120.

[0076] 7 is a diagram showing an example of the arrangement of the first pixel region and the second pixel region in the first embodiment of the present technology. Image data 600 of the original image img before compression processing includes a first pixel region 611 and a second pixel region 612.

[0077] First digital watermark information is embedded in the first pixel region 611. Also, a second digital watermark image is embedded in a region corresponding to the second pixel region 612 in the compressed watermark image IMG1'.

[0078] The first pixel region 611 and the second pixel region 612 do not overlap. For example, as illustrated in the figure, image data 600 is divided into two, one of which is set to the first pixel region 611 and the other to the second pixel region 612. The areas of the first pixel region 611 and the second pixel region 612 may be the same or different. The shapes of the first pixel region 611 and the second pixel region 612 are, for example, rectangular, but are not limited to this shape and may be circular, etc.

[0079] By setting the first pixel region 611 and the second pixel region 612 so that they do not overlap, the image quality of the image data can be improved. Even if an attack such as processing or trimming is performed on one of the first pixel region 611 and the second pixel region 612, the digital watermark information of the other region will not be affected. Furthermore, the embedding process of the second digital watermark information can prevent a part of the first digital watermark information from being lost.

[0080] FIG. 8 is a diagram showing another example of the arrangement of the first pixel region 611 and the second pixel region 612 in the first embodiment of the present technology. In the figure, a shows an example of image data in which the first pixel region 611 and the second pixel region 612 are arranged alternately in the column direction. In the figure, b shows an example of image data in which the first pixel region 611 and the second pixel region 612 are arranged alternately in the column direction and the row direction. With this arrangement, when one of the first pixel region 611 and the second pixel region 612 is painted black and the other is painted white, a checkered flag pattern is formed. In the figure, c shows an example of image data in which the first pixel region 611 is arranged so that the entire first pixel region 611 overlaps with the second pixel region 612. In the figure, d shows an example of image data in which the first pixel region 611 is arranged so that a part of the first pixel region 611 overlaps with the second pixel region 612.

[0081] As illustrated in FIG. 13A, the first pixel regions 611 and the second pixel regions 612 can be arranged alternately in the column direction. If the number of rows in each of the first pixel regions 611 and the second pixel regions 612 is K (K is an integer), the imaging device 200 and the application processor 400 each acquire the rows in order when embedding a digital watermark, and store K rows in memory to perform the embedding process. By arranging the first pixel regions 611 and the second pixel regions 612 alternately in the column direction, the memory capacity can be reduced. Also, the robustness and the accuracy of determining tampering in the column direction can be improved.

[0082] Also, as illustrated in b in the figure, the first pixel regions 611 and the second pixel regions 612 can be arranged alternately in the column direction and the row direction, respectively. This arrangement can improve robustness and accuracy of distinguishing tampering in the horizontal and column directions.

[0083] Also, as shown in c in the figure, the first pixel region 611 can be arranged so that the entirety of the first pixel region 611 overlaps with the second pixel region 612. This makes it difficult for the digital watermark information to be lost even if an attack is made on a part of the image. Also, it is possible to determine whether an attack has been made on the first digital watermark information by using the second digital watermark information.

[0084] Also, as shown in d in the figure, the first pixel region 611 can be arranged so that a part of it overlaps with the second pixel region 612. For example, the top row to the Y2 row are set as the first pixel region 611, and the Y1 row above Y2 to the bottom row are set as the second pixel region 612. By arranging the first pixel region and the second pixel region so that they overlap, even if an attack is made on the overlapping part, the digital watermark information is less likely to be lost. Also, the image quality of the non-overlapping part can be improved. Note that important parts of an image are often located near the center of the image, so it is preferable that the overlapping part includes the center of the image.

[0085] [Example of the configuration of the first digital watermark information embedding unit] 9 is a block diagram showing an example of a configuration of the first digital watermark information embedding unit 220 in the first embodiment of the present technology. The first digital watermark information embedding unit 220 includes a first digital watermark information generating unit 230 and a digital watermark embedding unit 240.

[0086] The first digital watermark information creation unit 230 creates first digital watermark information from the original image img and the message M1 from the shading correction unit 213. The first digital watermark information creation unit 230 supplies the created first digital watermark information to the digital watermark embedding unit 240 together with the original image img.

[0087] The digital watermark embedding section 240 embeds first digital watermark information in the original image img. The digital watermark embedding section 240 supplies the image in which the first digital watermark information is embedded to the interface 250 as a watermark image IMG1.

[0088] Although the first digital watermark information embedding unit 220 embeds only the first digital watermark information, it can also embed information related to the second digital watermark information. For example, information for specifying the second pixel region 612 in which the second digital watermark information is embedded (such as the coordinates of a representative point in the region) is embedded as the information related to the second digital watermark information. Alternatively, information indicating the type of the second digital watermark information (such as semi-fragile or fragile) is embedded as the information related to the second digital watermark information. Using these pieces of information, the server 500 can specify the region in which the second digital watermark information is embedded and detect the presence or absence of tampering based on the type.

[0089] 10 is a block diagram showing an example of a configuration of the first digital watermark information creation unit 230 in the first embodiment of the present technology. The first digital watermark information creation unit 230 includes a 1-bit divider 231, a plurality of pseudo-random number generators 232, a plurality of selectors 233, and an adder 234. Each of the pseudo-random number generators 232 and the selectors 233 is provided for each bit of the message M1. When the number of bits of the message M1 is L (L is an integer), L pseudo-random number generators 232 and selectors 233 are provided.

[0090] The 1-bit divider 231 divides the message M1 on a bit-by-bit basis and supplies each of the bits to a corresponding selector 233.

[0091] The pseudorandom number generator 232 generates pseudorandom numbers based on pixel data in the original image img. L pieces of pixel data of pixels in a pixel area 611 in the original image img and having different coordinates are input to the L pseudorandom number generators 232. The pseudorandom number generators 232 generate pseudorandom numbers from a preset seed value and the input pixel data, and supply the pseudorandom numbers to the corresponding selectors 233. For example, the following formula is used to generate the pseudorandom numbers. x n+1 =(A x n +B) mod M...Formula 1 In the above formula, the left side is the pseudorandom number to be generated, and x n The initial value of corresponds to the seed value. M is a real number that represents the range of the pseudorandom number, and A and B are constants. For example, the pixel data value is set to one of the values ​​of A, B, or n. "mоd" is the sum of (A·x n +B) by M. Note that the pseudo-random number generator 232 can use a formula other than Formula 1 as long as it can generate pseudo-random numbers.

[0092] The selector 233 outputs the pseudo-random number from the corresponding pseudo-random number generator 232 to the adder 234 when the corresponding bit is a predetermined value (such as a logical value “1”).

[0093] The adder 234 adds up the output values ​​from the L selectors 233. The adder 234 supplies information indicating the added value as first digital watermark information WM1 to the digital watermark embedding unit 240. The original image img is also supplied to the digital watermark embedding unit 240 together with the first digital watermark information WM1.

[0094] The configuration of the first digital watermark information creation unit 230 is not limited to the one illustrated in the figure, so long as it is capable of creating the first digital watermark information WM1 from the message M1.

[0095] 11 is a block diagram showing an example of the configuration of the digital watermark embedding unit 240 according to the first embodiment of the present technology. The digital watermark embedding unit 240 includes an adder 241 and a value limiting unit 242.

[0096] The adder 241 adds the first digital watermark information WM1 to pixel data of a specific pixel in the first pixel region 611 in the original image img. In this way, the first digital watermark information WM1 is embedded in the first pixel region 611. The adder 241 supplies the original image img after the addition to the value limiting unit 242.

[0097] The value limiting section 242 limits the value of pixel data in the original image img after addition to within a predetermined range. The value limiting section 242 supplies the image after the limiting process to the interface 250 as the watermark image IMG1.

[0098] The configuration of the digital watermark embedding unit 240 is not limited to the configuration exemplified in the figure, so long as it is capable of embedding digital watermark information.

[0099] [Example of the configuration of the second digital watermark information embedding unit] 12 is a block diagram showing an example of the configuration of the second digital watermark information embedding unit 450 in the first embodiment of the present technology. In the figure, "a" is a block diagram showing an example of the configuration of the second digital watermark information embedding unit 450 when the first digital watermark information is not read. In the figure, "b" is a block diagram showing an example of the configuration of the second digital watermark information embedding unit 450 when the first digital watermark information is read. As illustrated in "a" in the figure, when the first digital watermark information is not read, the second digital watermark information embedding unit 450 includes a second digital watermark information creation unit 460 and a digital watermark embedding unit 451.

[0100] The second digital watermark information embedding unit 450 creates second digital watermark information from the compressed watermark image IMG1' from the image compression unit 421 and the message M2. The second digital watermark information creation unit 460 supplies the created second digital watermark information to the digital watermark embedding unit 451 together with the compressed watermark image IMG1'.

[0101] The configuration of the digital watermark embedding unit 451 is similar to that of the digital watermark embedding unit 240 illustrated in Fig. 11. This digital watermark embedding unit 451 supplies the image in which the second digital watermark information is embedded to the interface 422 as a watermark image IMG2.

[0102] As shown in b in the figure, it is also possible to further provide a digital watermark information reading unit 452 that reads the first digital watermark information WM1 and supplies a flag indicating the presence or absence of the first digital watermark information WM1 to the second digital watermark information creation unit 460. In this case, the second digital watermark information creation unit 460 creates the second digital watermark information WM2 when the first digital watermark information WM1 is present, and does not create the second digital watermark information WM2 when the first digital watermark information WM1 is not present.

[0103] Although the second digital watermark embedding unit 450 embeds only the second digital watermark information WM2, it can also embed information related to the first digital watermark information WM1. For example, information for specifying the first pixel region 611 in which the first digital watermark information WM1 is embedded (such as the coordinates of a representative point in the region) is embedded as the information related to the first digital watermark information WM1. Alternatively, information indicating the method of the first digital watermark information WM1 (such as robust or semi-fragile) is embedded as the information related to the first digital watermark information WM1. Using these pieces of information, the server 500 can specify the region in which the first digital watermark information WM1 is embedded and determine the presence or absence of spoofing based on the method.

[0104] 13 is a block diagram showing an example of the configuration of the second digital watermark information creation unit 460 in the first embodiment of the present technology. The second digital watermark information creation unit 460 includes an image-related data two-part divider 461, a message authentication code generator 462, a subtractor 463, and an image-related data combiner 464.

[0105] The image-related data 2-part divider 461 divides pixel data of a specific pixel in an area corresponding to the second pixel area 612 in the compressed watermark image IMG1' into an upper bit string and a lower bit string. The image-related data 2-part divider 461 supplies the upper bit string to a message authentication code generator 462 and supplies the lower bit string to a subtractor 463. The number of bits in the upper bit string and the lower bit string may be the same or different.

[0106] The message authentication code generator 462 generates second digital watermark information based on the upper bit string from the image-related data 2-part divider 461 and the message M2. The message authentication code generator 462 generates a message authentication code using, for example, a predetermined hash function f(x, y). Here, the hash function f(x, y) is a function that returns a pseudo-random number in response to inputs of x and y (x and y are integers). The message authentication code generator 462 receives the message M2 as x and the upper bit string as y, and outputs the obtained pseudo-random number to the subtractor 463 as a message authentication code. The number of bits of the subtraction result is, for example, the same as that of the upper bit string.

[0107] The subtractor 463 subtracts the lower bit string from the message authentication code and supplies the subtraction result to the image-related data combiner 464.

[0108] The image-related data combiner 464 combines a bit string in which bits of a predetermined value (logical value "0") are arranged with the subtraction result of the subtractor 463. The number of bits in the bit string to be combined shall be the same as that of the lower bit string. The image-related data combiner 464 supplies the combined result to the digital watermark embedding unit 451 as the second digital watermark information WM2. In addition to the second digital watermark information WM2, the compressed watermark image IMG2' is also supplied to the digital watermark embedding unit 451.

[0109] The configuration of the second digital watermark information creation unit 460 is not limited to the one illustrated in the figure, so long as it is capable of creating the second digital watermark information WM2 from the message M2.

[0110] Furthermore, the application processor 400 embeds the second digital watermark information WM2 in the image data, but is not limited to this configuration. For example, the application processor 400 can generate an image file including image data and non-image data such as metadata as the content, and embed the second digital watermark information WM2 in the non-image data. By embedding the second digital watermark information WM2 in the non-image data, it is possible to prevent deterioration of the image quality of the image data due to the embedding.

[0111] [Server configuration example] 14 is a block diagram showing an example of a configuration of the server 500 in the first embodiment of the present technology. The server 500 includes a digital watermark information reading unit 510, an interface 520, a spoofing determination unit 530, a tampering determination unit 540, and a database 550.

[0112] The interface 520 receives image data of the watermark image IMG2 from the electronic device 100 via the Internet or the like. The interface 520 supplies the watermark image IMG2 to the digital watermark information reading unit 510.

[0113] The digital watermark information reading unit 510 reads the first digital watermark information WM1 and the second digital watermark information WM2 embedded in the watermark image IMG2 by using a method corresponding to the embedding method used by the electronic device 100. The digital watermark information reading unit 510 supplies the first digital watermark information WM1 to the spoofing determination unit 530, and supplies the second digital watermark information WM2 to the tampering determination unit 540.

[0114] The database 550 stores a predetermined number of pieces of copyright information.

[0115] The spoofing determination unit 530 uses the first digital watermark information WM1 to determine whether or not spoofing has occurred. The spoofing determination unit 530 reads copyright information from the database 550 and determines whether or not there is any information that matches the message M1 (i.e., copyright information) in the first digital watermark information WM1. If there is any matching information, it is determined that no spoofing has occurred. Then, the spoofing determination unit 530 outputs the determination result to the outside. By determining whether or not there has been spoofing, the copyright is appropriately protected.

[0116] The tampering determination unit 540 uses the second digital watermark information WM2 to determine whether or not the watermark image IMG2 has been tampered with. This tampering determination unit 540 determines whether or not the second digital watermark information WM2 has been damaged. If the second digital watermark information WM2 has been damaged, it is determined that tampering has occurred in the area of ​​the watermark image IMG2 corresponding to the second pixel area 612. Then, the tampering determination unit 540 outputs the determination result to the outside.

[0117] As described above, the first digital watermark information WM1 and the second digital watermark information WM2, which have different robustness, are embedded in the watermark image IMG2 by the electronic device 100. Therefore, the server 500 can use these pieces of digital watermark information to determine whether or not there has been any tampering while protecting the copyright.

[0118] [Examples of electronic device operation] 15 is a flowchart showing an example of the operation of the electronic device 100 according to the first embodiment of the present technology. This operation is started, for example, when a predetermined application for capturing an image is executed.

[0119] The imaging device 200 in the electronic device 100 generates a pixel signal by photoelectric conversion (step S901), and performs AD conversion on the pixel signal to generate pixel data (step S902). The imaging device 200 performs black level correction (step S903) and defective pixel correction (step S904) on the pixel data to generate an original image. The imaging device 200 then embeds the first digital watermark information WM1 in the original image to generate a watermark image IMG1 (step S921).

[0120] Then, the application processor 400 performs demosaic processing (step S911) and gamma correction (step S912) on the watermark image IMG1. Furthermore, the application processor 400 separates the image data into luminance and chrominance components (step S913), corrects the luminance component, and thins out and corrects the chrominance component (step S914). Then, the application processor 400 performs compression processing on the image data separated into the luminance and chrominance components (step S915), and embeds the second digital watermark information WM2 (step S922). After step S922, the electronic device 100 ends the operation for imaging.

[0121] As shown in the figure, the image capturing device 200 often outputs an image before demosaicing (so-called a RAW image). For this reason, the image capturing device 200 embeds the first digital watermark information WM1 before demosaicing, thereby protecting the copyright of the RAW image. When embedding the first digital watermark information WM1 before demosaicing, it is necessary to use digital watermark information in a format that will not be lost by demosaicing and image compression as the first digital watermark information WM1. As an example of such digital watermark information, digital watermark information embedded in DCT (Discrete Cosine Transform) coefficients is assumed.

[0122] Furthermore, by embedding the second digital watermark information WM2 after the image compression process, it is possible to prevent the fragile second digital watermark information WM2 from being lost due to image compression.

[0123] As described above, according to the first embodiment of the present technology, the electronic device 100 embeds the first digital watermark information related to the content together with the second digital watermark information in the content, so that it is possible to achieve both copyright protection and tamper prevention. For example, while protecting the copyright by embedding information related to the copyright of the content as the first digital watermark information, it is possible to determine whether tampering has occurred by determining whether the embedded second digital watermark information has been lost.

[0124] [First Modification] In the above-mentioned first embodiment, the application processor 400 embeds the second digital watermark information WM2 after image processing. However, in this configuration, the server 500 cannot determine whether or not there has been tampering before image processing. The electronic device 100 of the first modification of the first embodiment differs from the first embodiment in that the imaging device 200 embeds the second digital watermark information WM2.

[0125] 16 is a flowchart showing an example of the operation of the electronic device 100 in the first modification of the first embodiment of the present technology. The operation of the electronic device 100 in the first modification of the first embodiment differs from the first embodiment in that embedding of digital watermark information (steps S921 and S922) is performed before AD conversion (step S902). The imaging device 200 embeds the first digital watermark information WM1 in the analog pixel signal generated by photoelectric conversion (step S901) (step S921), and then embeds the second digital watermark information WM2 (step S922).

[0126] As illustrated in the figure, the imaging device 200 embeds the second digital watermark information WM2 in the analog pixel signal before image processing, so that the server 500 can determine whether or not there has been any tampering before the image processing.

[0127] In this way, according to the first variant of the first embodiment of the present technology, the imaging device 200 embeds the second electronic watermark information WM2 in the analog pixel signal before image processing, making it possible to determine whether or not tampering has occurred before image processing.

[0128] [Second modified example] In the above-mentioned first embodiment, the application processor 400 embeds the second digital watermark information WM2 after image processing. However, in this configuration, the server 500 cannot determine whether or not there has been tampering before image processing. The electronic device 100 of the second modification of the first embodiment differs from the first embodiment in that the imaging device 200 embeds the second digital watermark information WM2.

[0129] 17 is a flowchart showing an example of the operation of the electronic device 100 in the second modified example of the first embodiment of the present technology. The operation of the electronic device 100 in the second modified example of the first embodiment differs from that in the first embodiment in that embedding of digital watermark information (steps S921 and S922) is performed before demosaicing (step S911). The imaging device 200 embeds the first digital watermark information WM1 in an analog pixel signal generated by photoelectric conversion (step S901) (step S921). In addition, the imaging device 200 embeds the second digital watermark information WM2 (step S922) after defective pixel correction (step S904).

[0130] As illustrated in the figure, the imaging device 200 embeds the second digital watermark information WM2 in the pixel data after AD conversion before image processing, so that the server 500 can determine whether or not tampering has occurred before image processing.

[0131] In this way, according to the second variant of the first embodiment of the present technology, the imaging device 200 embeds the second electronic watermark information WM2 in the pixel data before image processing, making it possible to determine whether or not tampering has occurred before image processing.

[0132] [Third Variation] In the above-mentioned first embodiment, the imaging device 200 embeds the first digital watermark information WM1 after AD conversion, but the first digital watermark information WM1 can also be embedded before AD conversion. Also, in the first embodiment, the application processor 400 embeds the second digital watermark information WM2 after the image compression process, but in this configuration, the server 500 cannot determine whether or not tampering has occurred before the compression process.

[0133] The electronic device 100 of the third modified example of the first embodiment differs from the first embodiment in that the first digital watermark information WM1 is embedded before AD conversion, and the second digital watermark information WM2 is embedded before compression processing.

[0134] 18 is a flowchart showing an example of the operation of the electronic device 100 in the third modified example of the first embodiment of the present technology. The operation of the electronic device 100 in the third modified example of the first embodiment of the present technology differs from the first embodiment in that the embedding of the first digital watermark information WM1 (step S921) is performed before the AD conversion (step S902). Also, it differs from the first embodiment in that the embedding of the second digital watermark information WM2 (step S922) is performed before the image compression (step S915).

[0135] As shown in the figure, the application processor 400 embeds the second digital watermark information WM2 before the compression process, so that the server 500 can determine whether or not there has been any tampering before the compression process.

[0136] In this way, according to the third variant of the first embodiment of the present technology, the application processor 400 embeds the second digital watermark information WM2 before the compression process, making it possible to determine whether or not tampering has occurred before the compression process.

[0137] [Fourth Variation] In the above-described first embodiment, the imaging device 200 embeds the first digital watermark information WM1 after AD conversion, but the first digital watermark information WM1 can also be embedded before AD conversion. The imaging device 200 of the fourth modification of the first embodiment differs from the first embodiment in that the first digital watermark information WM1 is embedded before AD conversion.

[0138] 19 is a flowchart showing an example of the operation of the electronic device 100 in the fourth modified example of the first embodiment of the present technology. The operation of the electronic device 100 in the fourth modified example of the first embodiment of the present technology differs from that in the first embodiment in that embedding of the first digital watermark information WM1 (step S921) is performed before AD conversion (step S902).

[0139] As shown in the figure, the image capturing device 200 embeds the first digital watermark information WM1 in the analog pixel signal before AD conversion, so that the server 500 can determine whether the image has been spoofed and thereby protect the copyright of the RAW image.

[0140] As described above, according to the fourth modification of the first embodiment of the present technology, the imaging device 200 embeds the first digital watermark information WM1 before AD conversion, so that the copyright of the RAW image can be protected.

[0141] [Fifth Variation] In the above-mentioned first embodiment, the application processor 400 embeds the second digital watermark information WM2 after image processing. However, in this configuration, the server 500 cannot determine whether or not there has been tampering before image processing. The electronic device 100 of the fifth modification of the first embodiment differs from the first embodiment in that the imaging device 200 embeds the second digital watermark information WM2.

[0142] 20 is a flowchart showing an example of the operation of the electronic device 100 in the fifth modified example of the first embodiment of the present technology. The operation of the electronic device 100 in the fifth modified example of the first embodiment of the present technology differs from that in the first embodiment in that embedding of digital watermark information (steps S921 and S922) is performed after AD conversion, for example, after correction of defective pixels (step S904).

[0143] As illustrated in the figure, the imaging device 200 embeds the second digital watermark information WM2 after AD conversion, so that the server 500 can determine whether or not tampering has occurred before compression processing.

[0144] In this way, according to the fifth variant of the first embodiment of the present technology, the imaging device 200 embeds the second digital watermark information WM2 after AD conversion, making it possible to determine whether or not tampering has occurred before the compression process.

[0145] [Sixth Variation] In the above-mentioned first embodiment, the application processor 400 embeds the second digital watermark information WM2 after compressing the image. However, in this configuration, the server 500 cannot determine whether or not there has been tampering before the compression process. The application processor 400 of the sixth modified example of the first embodiment differs from the first embodiment in that the application processor 400 embeds the second digital watermark information WM2 before the compression process.

[0146] 21 is a flowchart showing an example of the operation of the electronic device 100 in the sixth modified example of the first embodiment of the present technology. The operation of the electronic device 100 in the sixth modified example of the first embodiment of the present technology differs from that in the first embodiment in that the embedding of the second digital watermark information WM2 (step S921) is performed before the image compression (step S915).

[0147] As illustrated in the figure, the application processor 400 embeds the second digital watermark information WM2 before the compression process, so that the server 500 can determine whether or not there has been any tampering before the compression process.

[0148] In this way, according to the sixth variant of the first embodiment of the present technology, the application processor 400 embeds the second digital watermark information WM2 before the compression process, making it possible to determine whether or not tampering has occurred before the compression process.

[0149] [Seventh Variation] In the above-mentioned first embodiment, the imaging device 200 embeds the first digital watermark information WM1 before demosaicing, but the first digital watermark information WM1 can also be embedded after demosaicing. Also, the application processor 400 embeds the second digital watermark information WM2 after image processing, but in this configuration, the server 500 cannot determine whether or not there has been tampering before image processing. The electronic device 100 of the seventh modification of the first embodiment differs from the first embodiment in that the application processor 400 embeds digital watermark information before compression processing.

[0150] 22 is a flowchart showing an example of the operation of the electronic device 100 in the seventh modification of the first embodiment of the present technology. In the electronic device 100 in the seventh modification of the first embodiment, the application processor 400 embeds digital watermark information (steps S921 and S922) before compression processing, for example, after correcting the luminance component and the chrominance component (step S914).

[0151] As illustrated in the figure, the application processor 400 embeds the second digital watermark information WM2 before the compression process, so that the server 500 can determine whether or not there has been any tampering before the compression process.

[0152] In this way, according to the seventh variant of the first embodiment of the present technology, the application processor 400 embeds the second digital watermark information WM2 before the compression process, making it possible to determine whether or not tampering has occurred before the compression process.

[0153] [Eighth Modification] In the above-described first embodiment, the imaging device 200 embeds the first digital watermark information WM1 before demosaicing, but the first digital watermark information WM1 can also be embedded after demosaicing. The electronic device 100 of the eighth modification of the first embodiment differs from the first embodiment in that the application processor 400 embeds the first digital watermark information WM1 after demosaicing.

[0154] 23 is a flowchart showing an example of the operation of the electronic device 100 in the eighth modification of the first embodiment of the present technology. In the electronic device 100 in the eighth modification of the first embodiment, the application processor 400 embeds the first digital watermark information WM1 (step S921) before the compression process, for example, after correcting the luminance component and the chrominance component (step S914).

[0155] As shown in the figure, the application processor 400 embeds the first digital watermark information WM1 after demosaic processing, so that the server 500 can determine whether the image has been spoofed to protect the copyright of the image after demosaic processing.

[0156] In this way, according to the eighth variant of the first embodiment of the present technology, the application processor 400 embeds the first electronic watermark information WM1 after the demosaic processing, thereby protecting the copyright of the image after the demosaic processing.

[0157] [Ninth Variation] In the above-described first embodiment, the imaging device 200 embeds the first digital watermark information WM1 before the compression process, but the first digital watermark information WM1 can also be embedded after the compression process. The electronic device 100 of the ninth modification of the first embodiment differs from the first embodiment in that the application processor 400 embeds the first digital watermark information WM1 after the compression process.

[0158] 24 is a flowchart showing an example of the operation of the electronic device 100 in the ninth modification of the first embodiment of the present technology. The operation of the electronic device 100 in the ninth modification of the first embodiment of the present technology differs from that in the first embodiment in that the application processor 400 embeds the first digital watermark information WM1 (step S921) after image compression (step S915).

[0159] As shown in the figure, the application processor 400 embeds the first digital watermark information WM1 after compression processing, so that the server 500 can perform spoofing determination to protect the copyright of the compressed image.

[0160] In this way, according to the ninth modification of the first embodiment of the present technology, the application processor 400 embeds the first digital watermark information WM1 after the compression process, thereby protecting the copyright of the image after the compression process.

[0161] <2. Second embodiment> In the first embodiment described above, the application processor 400 embeds digital watermark information, but this configuration may not be able to sufficiently improve security. The application processor 400 of the second embodiment differs from the first embodiment in that it embeds information related to a digital signature instead of digital watermark information, thereby improving security.

[0162] 25 is a flowchart showing an example of the operation of the electronic device 100 according to the second embodiment of the present technology. The operation of the electronic device 100 according to the second embodiment differs from that of the first embodiment in that the application processor 400 embeds a digital signature instead of digital watermark information (step S923). This digital signature is a type of steganography as described above.

[0163] The application processor 400 generates a message digest from the message M2 using, for example, a hash function, and encrypts the message digest with a private key to generate a digital signature. Then, the application processor 400 embeds information related to the digital signature in the compressed watermark image IMG2' (step S923). The server 500 generates a message digest from the received data using a hash function, and generates a message digest from the digital signature with a public key, and compares them. This type of encryption method is called a public key encryption method. When embedding a digital signature, the electronic device 110 can further embed information related to the digital signature (encryption method, etc.) together with the first digital watermark information WM1.

[0164] Although the application processor 400 embeds the digital signature in the image data, it can also embed the digital signature in non-image data. Also, any of the first to ninth modifications of the first embodiment can be applied to the second embodiment.

[0165] The information related to the digital signature is an example of the second embedded information in the claims.

[0166] As shown in the figure, the application processor 400 can ensure the confidentiality of communication by embedding an encrypted digital signature, thereby improving the security of the communication system.

[0167] In this way, according to the second embodiment of the present technology, the application processor 400 embeds a digital signature in the content, thereby improving the security of the communication system.

[0168] The above-mentioned embodiment shows an example for realizing the present technology, and the matters in the embodiment and the matters specified in the claims correspond to each other. Similarly, the matters specified in the claims and the matters in the embodiment of the present technology having the same name correspond to each other. However, the present technology is not limited to the embodiment, and can be realized by applying various modifications to the embodiment within the scope of the gist of the technology.

[0169] The processing procedures described in the above embodiments may be regarded as a method having a series of these procedures, or as a program for causing a computer to execute the series of procedures or a recording medium for storing the program. For example, a CD (Compact Disc), an MD (MiniDisc), a DVD (Digital Versatile Disc), a memory card, a Blu-ray (registered trademark) Disc, etc. may be used as this recording medium.

[0170] It should be noted that the effects described in this specification are merely examples and are not limiting, and other effects may also be obtained.

[0171] The present technology can also be configured as follows. (1) a content generation unit that generates content; a first embedding processing unit that embeds first embedding information related to the content into the content; a second embedding process for embedding second embedding information into the content; An electronic device comprising: (2) The first embedding information and the second embedding information are digital watermark information. The electronic device according to (1) above. (3) The first embedding information and the second embedding information have different robustnesses. The electronic device according to (2) above. (4) The robustness of the first embedding information is higher than that of the second embedding information. The electronic device according to (3) above. (5) The second embedding processing unit embeds the second embedding information in the content in which the first embedding information is embedded. The electronic device according to (4) above. (6) further comprising an image processing unit that performs a predetermined image processing on the content in which the first embedded information is embedded; The second embedding processing unit embeds the second embedding information in the content on which the image processing has been performed. The electronic device according to (4) or (5). (7) The content is image data, The image processing includes demosaic processing. The electronic device according to (6) above. (8) The image processing includes a compression process. The electronic device according to (6) or (7). (9) The first embedded information is robust digital watermark information or semi-fragile digital watermark information, and the second embedded information is semi-fragile digital watermark information or fragile digital watermark information. The electronic device according to any one of (4) to (8). (10) The content is image data including a first pixel region and a second pixel region; the first embedded information is embedded in the first pixel region; the second embedding information is embedded in a region corresponding to the second pixel region in the image data after the image processing; The first pixel region and the second pixel region do not overlap. The electronic device according to any one of (6) to (9). (11) The image processing includes a compression process. The electronic device according to (10) above. (12) The content is image data including a first pixel region and a second pixel region; the first embedded information is embedded in the first pixel region; the second embedding information is embedded in a region corresponding to the second pixel region in the image data after the image processing; The first pixel region and the second pixel region at least partially overlap each other. The electronic device according to any one of (6) to (9). (13) The image processing includes a compression process. The electronic device according to (12) above. (14) The first embedded information includes information related to the second embedded information. The electronic device according to (13) above. (15) The second embedding information is encrypted non-digital watermark information. The electronic device according to (1) above. (16) The content is an image file including image data and non-image data, The second embedding information is embedded in the non-image data. The electronic device according to (15) above. (17) The second embedded information is information related to a digital signature. The electronic device according to (16) above. (18) The first embedded information includes information related to the second embedded information. 18. The electronic device according to any one of (1) to (17). (19) The second embedded information includes information related to the first embedded information. 19. The electronic device according to any one of (1) to (18). (20) The first embedded information includes copyright information. 20. The electronic device according to any one of (1) to (19). [Explanation of symbols]

[0172] 100 Electronic equipment 110 Recording section 120 Data Processing Unit 200 Imaging device 210 Signal Processing Section 211 Clamp section 212 Defect correction unit 213 Shading correction section 220 First digital watermark information embedding unit 230 First Digital Watermark Information Creation Unit 231 1-bit divider 232 Pseudorandom number generator 233 Selector 234, 241 Adder 240, 451 Digital watermark embedding section 242 Value Restriction Section 250, 411, 422, 520 Interface 300 Image sensor 310 Vertical scanning circuit 320 Pixel array section 330 pixels 331 Photodiode 332 Transfer transistor 333 Reset Transistor 334 Floating Diffusion Layer 335 Amplifying Transistor 336 Selection transistor 340 Constant current source circuit 341 Load MOS 350 Timing control section 360 Column AD conversion section 361 ADC 370 Reference signal generation section 371 DAC 380 Horizontal scanning circuit 391 Semiconductor Substrates 392 Color Filter 393 On-chip lens 400 Application Processors 412 White balance correction section 413 Noise suppression section 414 Demosaic Department 415 Linear matrix correction section 416 Gamma Correction Unit 417 Luminance and Chrominance Separation Unit 418 Brightness correction section 419 Color Difference Thinning Unit 420 Color difference correction section 421 Image Compression Unit 450 Second digital watermark information embedding unit 452, 510 Digital watermark information reading unit 460 Second Digital Watermark Information Creation Unit 461 Image-related data splitter 462 Message Authentication Code Generator 463 Subtractor 464 Image-related Data Combiner 500 servers 530 Spoofing Detection Unit 540 Tampering Detection Unit 550 Database

Claims

1. a content generating unit that generates content; a first embedding unit that embeds first embedding information related to the content into the content; a second embedding processing unit that embeds second embedding information into the content in which the first embedding information is embedded; An electronic device comprising:

2. The first embedding information and the second embedding information are digital watermark information.

2. The electronic device according to claim 1.

3. The first embedding information and the second embedding information have different robustnesses.

3. The electronic device according to claim 2.

4. The robustness of the first embedding information is higher than that of the second embedding information.

4. The electronic device according to claim 3.

5. Further comprising an image processing unit that performs predetermined image processing on the content.

2. The electronic device according to claim 1.

6. The image processing unit performs the image processing on the content in which the first embedding information is embedded, The second embedding processing unit embeds the second embedding information in the content on which the image processing has been performed.

6. The electronic device according to claim 5.

7. the content is image data; The image processing includes demosaic processing.

7. The electronic device according to claim 6.

8. The image processing includes a compression process.

7. The electronic device according to claim 6.

9. The content includes a predetermined number of analog pixel signals; the content generation unit includes an ADC (Analog to Digital Converter) that converts the pixel signal into a digital signal; The first embedding processing unit embeds the first embedding information in the pixel signal.

2. The electronic device according to claim 1.

10. the content is image data including a first pixel region and a second pixel region; the first embedded information is embedded in the first pixel region; the second embedding information is embedded in a region corresponding to the second pixel region in the image data after the image processing; The first pixel region and the second pixel region do not overlap.

7. The electronic device according to claim 6.

11. The image processing includes a compression process. The electronic device according to claim 10.

12. the content is image data including a first pixel region and a second pixel region; the first embedded information is embedded in the first pixel region; the second embedding information is embedded in a region corresponding to the second pixel region in the image data after the image processing; The first pixel region and the second pixel region at least partially overlap each other.

7. The electronic device according to claim 6.

13. The image processing includes a compression process.

13. The electronic device according to claim 12.

14. The first embedded information includes information related to the second embedded information.

14. The electronic device according to claim 13.

15. The second embedding information is encrypted non-digital watermark information.

2. The electronic device according to claim 1.

16. the content is an image file including image data and non-image data; The second embedded information is embedded in the non-image data.

16. The electronic device according to claim 15.

17. The second embedded information is information related to a digital signature.

17. The electronic device according to claim 16.

18. The first embedded information includes information related to the second embedded information.

2. The electronic device according to claim 1.

19. The second embedded information includes information related to the first embedded information.

2. The electronic device according to claim 1.

20. The first embedded information includes copyright information.

2. The electronic device according to claim 1.

Citation Information

Patent Citations

  • Image management system, electronic watermark embedding device, authentication code managing device, electronic watermark detecting device, and image managing method

    JP2003304387A

  • Image-taking device, electronic watermark detection program and electronic watermark embedding method

    JP2005278099A

  • Verification data embedding method, program and apparatus, image tampering detecting method, program, apparatus, and image tampering detection system

    JP2008067309A

  • Digital watermarking device, digital watermark verification device, digital watermarking method, and digital watermark verification method

    JP2009200755A

  • Content Processing Methods Using Reversible Watermarking

    US20100135525A1