Method for authenticating the authenticity of digital individual images or moving images

Abstract

The present invention relates to a method for authenticating the authenticity of digital individual or moving images, in which an individual authentication key (1.5) is assigned while recording an image series (1.6) of individually recorded individual images or while recording an image sequence in the form of moving images. The method according to the invention is characterized in that at least one camera setting and / or at least one recording setting on the camera is changed in a controlled manner from individual image to individual image during recording for the purpose of assigning the authentication key (1.5) and / or creating or incorporating the authentication key (1.5) in the image series (1.6) or is changed in a controlled manner from moving image to moving image during recording for the purpose of assigning the authentication key (1.5) and / or creating or incorporating the authentication key (1.5) in the image sequence.

Description

Method for authenticating the authenticity of digital still images or moving images DESCRIPTION Technical area

[0001] The present invention relates to a method for authenticating the authenticity of digital single or moving images according to the preamble of patent claim 1.

[0002] In particular, the invention relates to a method for authenticating the authenticity of individual digital images by mechanically varying the recording properties and camera sensor signal inputs across an image series for the purpose of incorporating a physical watermark into the image series. State of the art

[0003] Different methods for authenticating individual images by means of digital signatures or additional authentication objects in the image are already known from the state of the art (SDT), whereby it is also generally known to assign individual authentication keys during the recording of a series of individually recorded individual images or during the recording of an image sequence in the form of moving images, by means of which the individual images or the moving images are checked for their authenticity, i.e. authenticated.

[0004] The authentication of individual digital images is based on digital signatures, such as hash values, where a single reference image is analyzed. The disadvantage of such a method is the simplified vulnerability of the authentication process. Analyzing only one reference image results in a “single point of failure”: only a single fake image / video needs to be inserted into the source of the image capture, even before the digital signature is incorporated into the processed image / video, in order to undermine the entire authentication.

[0005] Another disadvantage is the general vulnerability to image-of-image attacks. With known solutions, authenticated photos / videos can still be taken of fake photos, effectively defeating the process, so that a fake image is falsely authenticated as "real" despite the authentication process. Description of the invention

[0006] The object of the present invention is to eliminate the aforementioned disadvantages and to provide a method that reliably authenticates digital images as “real” by reliably filtering out all digital images that represent images of other images, were taken outside a predetermined time window and do not represent an image of a real three-dimensional scene.

[0007] The process should be robust against the introduction of a fake image into the origin of the process.

[0008] According to the invention, the above object is achieved according to the preamble of claim 1 in conjunction with the characterizing features. Advantageous embodiments and further developments of the inventive method are specified in the dependent subclaims.

[0009] In the method according to the invention for authenticating the authenticity of digital single or moving images, an individual authentication key is first assigned during a recording of a series of individually recorded single images taken by a digital camera or during a recording of an image sequence in the form of moving images.

[0010] According to the invention, the present method is characterized in that for the assignment of the authentication key and / or for the creation or incorporation of the authentication key into the image series when recording from individual image to individual image or into the image sequence when recording from moving image to moving image, at least one camera setting and / or at least one recording setting on the camera is changed in a controlled manner.

[0011] In a particularly advantageous embodiment of the invention, the camera setting and / or the recording setting is carried out by mechanical manipulation of the image sensor, by setting the aperture, the exposure time, the zoom level and / or the adjustment of the focus point.

[0012] When taking the image series from single image to single image or when taking the image sequence from moving image to moving image, the same scenery can still be recorded, whereby the scenery is understood to be the totality of what is presented to the viewer from a location.

[0013] In a particularly advantageous embodiment of the invention, a controlled change occurs during the recording of each individual image within the image series or during the recording of each individual moving image within the image sequence. For this purpose, a series of digital images of the same three-dimensional scene can be recorded at the time of recording, instead of just one digital image, with the recording properties being varied in a controlled manner from image to image. On the one hand, the light path of the light incident on the camera sensor can be mechanically manipulated.

[0014] Furthermore, according to an advantageous embodiment, the method can be used in the controlled adjustment of the focus point for the detection of image recaptures, in particular for photographing other images.

[0015] This can be achieved, for example, by mechanically adjusting the focus point, zoom level, aperture, or exposure time, or combinations of these. Alternatively, the sensor sensitivity (ISO) can also be specifically adjusted. In this way, an authentication key transmitted by an authentication server immediately before the capture is physically incorporated into the resulting image series.

[0016] The authentication key advantageously functions as a series of instructions for the targeted manipulation of the digital camera's recording properties. Subsequently, the individual images of the image series or the moving images of the image sequence can preferably be linked together using the authentication key.

[0017] In a particularly preferred embodiment of the invention, the recorded image series or sequence of images is played back to the authentication server, where preferably in a two-stage verification process 1. the abstract information content of the individual or moving images is compared to ensure that the images show the same scenery, and 2. the authentication key incorporated into the image series or sequence is extracted.

[0018] If the image series is sent to the server for verification within a specified time window after the authentication key has been issued and the key extracted during the verification is the one initially issued, each individual image in the series of images or each moving image in the sequence of images is considered authenticated. Advantages of the invention

[0019] Intrinsic picture-from-picture defense Because the focus point is also mechanically adjusted from image to image according to the authentication key, a different depth of the three-dimensional scene is scanned with each image. The depth of field shifts. However, this only applies if a real scene is actually present. If a picture-by-picture attack takes a series of images from a 2D image, this becomes apparent through the analysis of the change in depth of field, since the 2D image does not contain any real depths through which the depth of field can shift.

[0020] No single point of failure To successfully circumvent the authentication process, an entire series of images must be generated in real time according to the transmitted authentication key. Simply injecting a single fake / manipulated image into the source image is not sufficient. This significantly increases the security against forgery compared to the current state of the art.

[0021] The process does not require digital signatures.

[0022] The procedure does not require any additional objects for the purpose of image authentication.

[0023] The present invention is primarily, but not exclusively, used in the field of composite insurance: Defense against insurance fraud through fake / AI-generated digital images in the claim report; Online identity checks: Defense against identity fraud through fake / AI-generated digital images or video streams in online identity verifications such as Postident; judicial system: increasing the credibility of digital images / videos as evidence in court; journalistic reporting: increasing the credibility of digital images / videos in the context of journalistic reporting through the use of a certificate of authenticity for digital images / videos; C2C sales platforms (e.g. eBay): defense against sales fraud through fake / client-generated digital images; dating platforms: avoiding fake profiles based on fake / client-generated images; returns processes in online trading: verification of damage images for reporting a return; real estate: reducing sales fraud through fake / client-generated images; copyright issues relating to digital images / digital videos: recording the copyright information belonging to a digital image / video in a certificate of authenticity for digital images / videos. Brief description of the drawings

[0024] Further objects, features, advantages and possible applications of the method according to the invention will become apparent from the following description of various embodiments with reference to the drawings.

[0025] The drawings show

[0026] Fig. 1 is a schematic representation of the (key exchange) method according to the invention;

[0027] Fig. 2 the use of a camera app to secure a main process;

[0028] Fig. 3 an issuance of a certificate of authenticity for digital images or videos;

[0029] Fig. 4 shows a representation of the method according to the invention with a solution designed as a module for a digital camera. Implementation of the invention

[0030] Further objects, features, advantages and possible applications of the method according to the invention will become apparent from the following description of various embodiments with reference to the drawings.

[0031] As can be seen by way of example from Fig.l, in the method according to the invention, preferably before any scene (1.1) is taken, an authentication server (1.3) selects a random authentication key (1.5) from its server-side key memory (1.4) and transmits it to the photographing digital camera (1.2).

[0032] Each authentication key preferably consists of a random series of numbers (e.g. 1, 4, 7).

[0033] This is followed by the recording of a series of images (1.6) of individually recorded single images or the recording of an image sequence in the form of individually recorded moving images.

[0034] The authentication key is preferably assigned to the entire image series (1.6), wherein for the assignment and / or incorporation of the authentication key (1.5) into the image series (1.6) when recording from individual image to individual image or into the image sequence when recording from moving image to moving image, at least one camera setting and / or at least one recording setting on the digital camera (1.2) is changed in a controlled manner.

[0035] Each number (e.g. 1, 4, 7; see Fig. 1) of the authentication key can define the degree of adjustment of the respective recording setting on the digital camera.

[0036] The image series (1.6) is transmitted to the authentication server for authentication. After a successful comparison (1.8) of the abstract information content of the individual images in the image series (1.6) to ensure that all individual images depict the same scene, the individual images can be related to each other (1.9) to computationally extract the applied authentication key.

[0037] In this way, a key exchange is preferably realized; if the key extracted from the image series (1.10) is identical to the initially issued authentication key (1.5), each individual image of the image series is considered authenticated.

[0038] As can be seen from Fig. 2, the method according to the invention can be implemented as a camera app or as a camera app plug-in for smartphones / tablets for use within a main process, such as o a claim report with insurance companies. o online identification. o a product listing on C2C sales platforms. o profile creation on dating platforms. o initiating a return in online retail. o uploading sales images in real estate.

[0039] The user enters the main process (2.2) (2.1), which requires capturing a digital image (2.3) at a given time. In the next step, the user captures the image series using the new method (2.4), which is then forwarded to an authentication server for authentication (2.5). After successful server-side authentication (2.6) of the image series, the authentication server forwards an authenticated main image of the series (2.7) directly to the next process step (2.8).

[0040] As can be seen from Fig. 3, the method according to the invention can be implemented as a camera app or as a camera app plug-in for smartphones / tablets to obtain a certificate of authenticity for the authenticated digital image. The user takes a digital image series at a time using the novel method (3.1), which is then forwarded to an authentication server for authentication (3.2). After successful server-side authentication (3.3) of the image series, an authenticated main image of the series is saved together with selected metadata (3.4) in a decentralized storage (3.5) to prevent subsequent changes to the authenticated original image. Possible metadata include the time of certificate issuance, the location of the recording, and the photographer (author) of the digital image / video. The authenticated main image is then sent to the server together with a certificate in the form of a link (3.6) is returned to the photographer. Opening the link with an internet-enabled device will display the decentrally stored original image, including the stored metadata. In addition to the authenticated main image, the complete authenticated image series can also be stored decentrally and displayed when verifying a certificate.

[0041] The certificate of authenticity described in paragraph

[0030] can be implemented in the form of a code, including a QR code. A hash value of the authenticated original image can be incorporated into the code. The hash value of the authenticated original image, the issued certificate, and the software for extracting the applied authentication keys from a series of images can be stored in a public or private blockchain.

[0042] The described method can be extended in the case of implementation as a smartphone / tablet app to use brightness sensor data as an additional authentication medium. In addition to the image series, the brightness value is sent to the authentication server. The brightness sensor is sent along, which was recorded by the smartphone / tablet's internal brightness sensor immediately before the image series was taken. In addition to extracting the authentication key from the image series (1.10, Fig. 1), the corresponding brightness sensor value is then extracted from the image series and compared with the value sent along.

[0043] As can be seen from Fig. 4, the method according to the invention can be implemented as a module for digital cameras. The module (4.1) is connected to the camera (4.3) via a suitable wired or wireless interface (4.2) and controls the recording properties and the mechanical adjustment of the signal inputs of the camera sensor via interaction with the camera operating software. The module contacts a server and records a series of images according to the method according to the invention. The recorded series of images is then sent to the server for verification. The authenticated images can be forwarded to a subsequent process step (as described in paragraph

[0028] ). A certificate can also be issued for the authenticated images, as described in paragraph

[0030] .

[0044] The method can also be applied to the authentication of digital videos, since digital videos themselves represent a series of images. The authentication key is extended by a temporal dimension. This is described by several temporal specifications that determine the points in time at which the authentication key is incorporated into an image series during the ongoing video recording. The image series is part of the authenticated video sequence.

[0045] To increase security against counterfeiting, the described method can also use the camera's unprocessed sensor data in raw format. In this case, step (1.8) in Fig. 1 is preceded by processing the raw sensor data into RGB images.

[0046] The method can generally be used for the authentication of sensor data, as long as the measurement signal inputs of the The sensor in question can be mechanically adjusted or the sensor's recording properties can be specifically controlled. The digital camera (1.2) in Fig. 1 can therefore also be replaced by a digital microphone, a pressure sensor, a humidity sensor, a temperature sensor, or an acceleration sensor. List of reference numbers 1 .1 . Real physical 3D scenery 1.2. Digital camera 1.3. Authentication server 1 .4. Server-side storage of authentication keys 1.5. Authentication key issued by the authentication server to the digital camera 1 .6. Series of images taken by the digital camera using the authentication key 1 .7. Transmission of the image series to the authentication server 1 .8. Server-side comparison of the individual images of the image series 1 .9. Server-side extraction of the authentication key applied to the image series 1.10. Authentication key extracted from the image series 2.1. Start of the main process 2.2. Main process 2.3. Starting the camera app as a sub-process 2.4. Taking the image series 2.5. Forwarding the image series to an authentication server for authentication 2.6. Authentication server 2.7. Authenticated main image is returned from the authentication server to the main process 2.8. Re-entry into the main process Photographer taking a digital image / video using the innovative camera app Resulting image series Authentication server Authenticated main image with metadata (time of capture, location of capture, author) Decentralized storage Authenticated main image with certificate of authenticity Camera module for controlling the digital camera Data connection between camera module and digital camera Digital camera

Claims

PATENT CLAIMS 1. A method for authenticating the authenticity of individual digital or moving images, in which an individual authentication key (1.5) is assigned during a recording of an image series (1.6) of individually recorded individual images by means of a digital camera (1.2) or during a recording of an image sequence in the form of moving images, characterized in that for the assignment of the authentication key (1.5) and / or for incorporating the authentication key (1.5) into the image series (1.6) when recording from individual image to individual image or into the image sequence when recording from moving image to moving image, at least one camera setting and / or at least one recording setting on the digital camera (1.2) is changed in a controlled manner.

2. Method according to claim 1, characterized in that a controlled change occurs when each individual image within the image series (1.6) is recorded.

3. Method according to claim 1 or 2, characterized in that the authentication key (1.5) functions as a series of instructions for the targeted manipulation of the camera settings and / or the recording settings of the digital camera (1.2).

4. Method according to one of the preceding claims, characterized in that the individual images of the image series (1.6) or the moving images of the image sequence are linked together via the authentication key.

5. Method according to one of the preceding claims, characterized in that in a testing procedure the abstract information content of the individual or moving images is compared (1.8) in order to ensure that the individual or moving images show the same scenery.

6. Method according to one of the preceding claims, characterized in that the authentication key (1.10) incorporated in the image series or sequence is extracted (1.9).

7. Method according to one of the preceding claims, characterized in that if the image series (1.6) or image sequence is passed to a server for verification within a predetermined time window after the authentication key (1.10) has been issued and the authentication key (1.10) extracted during the verification is identical to the one initially issued, each individual image of the image series or each moving image of the image sequence is considered to be authenticated.

8. Method according to one of the preceding claims, characterized in that the camera setting and / or the recording setting is carried out by a mechanical manipulation of the image sensor, by setting the aperture, the exposure time, the zoom level and / or the adjustment of the focus point.

9. Method according to one of the preceding claims, characterized in that the same scenery is recorded in the recordings of the image series (1.6) from individual image to individual image or in the recordings of the image sequence from moving image to moving image, the scenery being the The totality of what is presented to the viewer from a location is meant.

10. Method according to one of the preceding claims, characterized in that the authentication key (1.5) serves as a means for the targeted manipulation of the camera settings and / or the recording settings on the digital camera (1.2). 1 1. Method according to one of the preceding claims, characterized in that it is used in the controlled adjustment of the focus point for the detection of image recaptures, in particular of photographs of other images.

Images