Program, authenticity determination device, authenticity determination system, mobile terminal and method

Abstract

This invention provides a program, a hologram authenticity determination device, an authenticity determination system, a portable terminal, and a method that enable the determination of the authenticity of holograms through a simpler process. [Solution] The authenticity determination server 1 acquires images of the hologram 5a taken in succession, detects a continuous region containing a specified number or more pixels that satisfy predetermined color conditions from the acquired images as the reconstructed region of the hologram 5a, cuts out the detected reconstructed region from the image, compares the image of the cut-out reconstructed region with the correct image stored in the memory unit in advance, and determines that the hologram 5a is genuine if the match is successful. Furthermore, if the authenticity determination server 1 cannot detect the reconstructed region from the acquired image, it performs the detection process on the next acquired image.

Description

[Technical Field]

[0001] The present invention relates to a program, a genuineness determination device, a genuineness determination system, a mobile terminal, and a method. [Background technology]

[0002] Traditionally, holograms have been used as a countermeasure against counterfeit products (brand protection). A hologram is created by interfering two lights of the same wavelength (object light and reference light), recording the wavefront of the object light as interference fringes on a photosensitive material. When light of the same wavelength as the reference light used to record the interference fringes is shone on the hologram, diffraction occurs due to the interference fringes, and the hologram can reproduce the same wavefront as the original object light. Holograms have advantages such as being aesthetically pleasing and relatively difficult to duplicate.

[0003] However, in recent years, it has become possible to forge simple holograms, and the effectiveness of visual-only anti-counterfeiting measures is diminishing. Therefore, a document authentication method has been disclosed in which a user is instructed to move a device equipped with an illumination unit and a camera over a document to be evaluated as authentic. The device acquires and analyzes images of the document during the movement and determines whether the document contains areas that match features indicating its authenticity (see, for example, Patent Document 1). [Prior art documents] [Patent Documents]

[0004] [Patent Document 1] Special Publication No. 2022-536443 [Overview of the project] [Problems that the invention aims to solve]

[0005] The method described in Patent Document 1 includes a process of taking the difference between preceding and succeeding images. However, because the size and position of the target document within the image change due to the user's actions, the process of taking the difference is difficult, and the process itself becomes computationally intensive.

[0006] The present invention aims to provide a program, a hologram authenticity determination device, an authenticity determination system, a portable terminal, and a method that enable the determination of the authenticity of holograms through a simpler process. [Means for solving the problem]

[0007] The present invention solves the above-mentioned problems by the following means. For ease of understanding, the embodiments of the present invention will be described using reference numerals corresponding to those embodiments, but the invention is not limited thereto. Furthermore, the configurations described with reference numerals may be improved as appropriate, and at least a part of them may be replaced with other components.

[0008] The first invention is a program that causes a computer for determining the authenticity of a hologram to function as follows: an image acquisition means for acquiring images of a hologram taken in succession; a reproduction region detection means for detecting a continuous region containing a specified number or more pixels that satisfy predetermined color conditions from the images acquired by the image acquisition means as the reproduction region of the hologram; a reproduction region extraction means for cutting out the reproduction region detected by the reproduction region detection means from the image; a comparison means for comparing the image of the reproduction region extracted by the reproduction region extraction means with a correct image stored in a memory unit in advance; and a determination means for determining that the hologram is genuine if the comparison by the comparison means is successful. The program also causes the reproduction region detection means to perform a detection process on the next image if it is not possible to detect the reproduction region from the previous image. The second invention is a program in the program of the first invention that causes the playback region detection means to perform a detection process on the next image when the matching means fails to perform a match. The third invention is a program of the first or second invention in which the hologram is reproduced in response to light of a single wavelength, and the reproduction region detection means is configured to detect a specified number or more of the pixels in the color space whose value of a predetermined color similar to the color of the single wavelength is equal to or greater than a first threshold and whose value of colors other than the predetermined color is equal to or less than a second threshold as the reproduction region. The fourth invention is a program in the program of the third invention that, when multiple continuous regions are detected, causes the playback region detection means to function such that, when multiple continuous regions are detected, the continuous region containing the most pixels whose value of a predetermined color is at or above a third threshold (higher than the first threshold) and whose value of a color other than the predetermined color is at or below a fourth threshold (lower than the second threshold) is detected as the playback region. The fifth invention is a program of the first or second invention in which the hologram is reproduced in response to light of a single wavelength, and the reproduction region detection means is configured to detect a continuous region containing a specified number or more of the pixels whose calculated value, obtained by subtracting the sum of the values ​​of colors excluding the predetermined color from the value of the predetermined color that is similar to the color of the single wavelength in the color space, is equal to or greater than a fifth threshold. The sixth invention is a program in which, in the program of the fifth invention, the regeneration region detection means is configured to detect, when multiple continuous regions are detected, the continuous region containing the most pixels whose calculated value is higher than the fifth threshold (a sixth threshold) or higher, as the regeneration region. The seventh invention is a program in which, in any of the programs of the third to sixth inventions, the playback region detection means creates a histogram showing the number of pixels that meet the conditions for each value in the vertical and horizontal directions of the image, and detects as the playback region any continuous region in which the sum of the frequencies within the region is greater than or equal to a predetermined value, among the continuous regions in which the frequency of the histogram is not zero. The eighth invention is a program in which, in the program of the sixth invention, the playback region detection means creates a histogram showing the number of pixels that match a first condition for each value in the vertical and horizontal directions of the image, detects a continuous region among the continuous regions where the frequency of the histogram is not 0 and the sum of the frequencies within the region is equal to or greater than a predetermined value, and if multiple continuous regions are detected, detects the continuous region containing the most pixels that match a second condition which has a higher threshold than the first condition as the playback region. The ninth invention is a program in which, in the program of the seventh or eighth invention, the regeneration area detection means is made to function to perform processing again on the detected regeneration area. The tenth invention is a program in which, in any of the programs from the third to the fifth invention, the color value is a lightness value. The eleventh invention is a program that, in any of the programs from the first to the tenth inventions, causes the determination means to function such that it determines the hologram is not genuine if the matching means fails to perform matching within a certain period of time or if the reproduction area detection means fails to detect the reproduction area within a certain period of time. The twelfth invention is a program in which, in any of the programs from the first to the tenth inventions, the storage unit stores a plurality of different correct images, the matching means functions to match the image of the playback region with the plurality of different correct images, the determination means functions to determine that the hologram is real when the matching means has been able to match one or more specified correct images from the plurality of different correct images, and the playback region detection means functions to perform detection processing on the next image until the determination means determines that the hologram is real. The 13th invention is a program of the 12th invention that causes the determination means to function to determine that the hologram is not real if the matching means fails to perform matching within a certain period of time, if the determination means fails to determine that the hologram is real within a certain period of time, or if the reproduction area detection means fails to detect the reproduction area within a certain period of time. The 14th invention is a program in which, in any of the programs from the 1st to the 13th inventions, the computer is made to function as a code information acquisition means for acquiring a code image via an imaging unit and extracting code information, and a correct answer identification means for identifying the correct answer image from the code information acquired by the code information acquisition means, the matching means is made to match the correct answer image identified by the correct answer identification means with the image of the playback area, and the computer is made to function as a judgment result output means for outputting the judgment result of the judgment means to a display unit. The 15th invention is a genuineness determination device for determining the authenticity of a hologram, comprising: an image acquisition means for acquiring images obtained by continuously photographing a hologram; a reproduction region detection means for detecting a continuous region containing a specified number or more pixels that satisfy predetermined color conditions from the images acquired by the image acquisition means as the reproduction region of the hologram; a reproduction region extraction means for cutting out the reproduction region detected by the reproduction region detection means from the image; a comparison means for comparing the image of the reproduction region extracted by the reproduction region extraction means with a correct image stored in a storage unit in advance; and a determination means for determining that the hologram is genuine if the comparison by the comparison means is successful, wherein the reproduction region detection means performs a detection process on the next image if the reproduction region could not be detected from the previous image. The sixteenth invention is a counterfeit detection system comprising a counterfeit detection device according to the fifteenth invention and a portable terminal communicatively connected to the counterfeit detection device, wherein the counterfeit detection device includes a determination result transmission means for transmitting the determination result by the determination means to the portable terminal, and the portable terminal includes a shooting unit for photographing the hologram, an image transmission means for transmitting the image photographed by the shooting unit to the counterfeit detection device, and a determination result output means for receiving the determination result by the determination means and outputting it to a display unit. The 17th invention is a portable terminal that is communicatively connected to a genuineness determination device for determining the authenticity of a hologram, and comprises: an imaging unit for continuously photographing a hologram; a reproduction region detection means for detecting a continuous region containing a specified number or more pixels that satisfy predetermined color conditions from an image acquired from the imaging unit as a reproduction region of the hologram; a reproduction region extraction means for extracting the reproduction region detected by the reproduction region detection means from the image; an image transmission means for transmitting the image of the reproduction region extracted by the reproduction region extraction means to the genuineness determination device; and a determination result output means for receiving a determination result obtained by comparing the image of the reproduction region with a pre-stored correct image from the genuineness determination device and outputting it to a display unit, wherein the reproduction region detection means performs a detection process on the next image if the reproduction region could not be detected from the previous image. The 18th invention is a genuineness determination system comprising a mobile terminal according to the 17th invention and a genuineness determination device communicated with the mobile terminal, wherein the genuineness determination device comprises an image receiving means for receiving an image of the playback region from the mobile terminal, a matching means for comparing the image of the playback region received by the image receiving means with the correct image stored in a storage unit in advance, a determination means for determining that the hologram is genuine when the matching by the matching means is successful, and a determination result transmission means for transmitting the determination result from the determination means to the mobile terminal. The 19th invention is a method for determining the authenticity of a hologram, comprising: an image acquisition step of continuously acquiring an image of the hologram using an imaging device while changing the imaging direction of the hologram; a reproduction area detection step of detecting, as a reproduction area of the hologram, a continuous area containing a specified number or more of pixels satisfying a predetermined color condition from the image acquired in the image acquisition step; a reproduction area cutting step of cutting out the reproduction area detected in the reproduction area detection step from the image; a collation step of collating the image of the reproduction area cut out in the reproduction area cutting step with a correct image stored in a storage unit in advance; a determination step of determining that the hologram is genuine if the collation in the collation step is successful; and a determination result output step of outputting the determination result obtained in the determination step to a display device. The reproduction area detection step performs a process of detecting the next image when the reproduction area cannot be detected from the image.

Effect of the Invention

[0009] According to the present invention, it is possible to provide a program, an authenticity determination device, an authenticity determination system, a mobile terminal, and a method that enable the authenticity determination of a hologram to be performed by a simpler process.

Brief Description of the Drawings

[0010] [Figure 1] It is an overall configuration diagram of an authenticity determination system according to the first embodiment. [Figure 2] It is a functional block diagram of an authenticity determination server according to the first embodiment. [Figure 3] It is a diagram showing an example of a storage unit of an authenticity determination server according to the first embodiment. [Figure 4] It is a functional block diagram of a user terminal according to the first embodiment. [Figure 5] It is a diagram for explaining a hologram according to the first embodiment. [Figure 6] It is a flowchart showing the app process of a user terminal according to the first embodiment. [Figure 7]It is a diagram showing a display example of a user terminal according to the first embodiment. [Figure 8] It is a flowchart showing the authenticity determination process of the authenticity determination server according to the first embodiment. [Figure 9] It is a flowchart showing the hologram processing of the authenticity determination server according to the first embodiment. [Figure 10] It is a diagram for explaining the hologram processing of the authenticity determination server according to the first embodiment. [Figure 11] It is a diagram for explaining the hologram processing of the authenticity determination server according to the first embodiment. [Figure 12] It is a diagram for explaining the hologram processing of the authenticity determination server according to the first embodiment. [Figure 13] It is a functional block diagram of the authenticity determination server according to the second embodiment. [Figure 14] It is a functional block diagram of the user terminal according to the second embodiment. [Figure 15] It is a flowchart showing the app processing of the user terminal according to the second embodiment. [Figure 16] It is a continuation of FIG. 15. [Figure 17] It is a flowchart showing the authenticity determination process of the authenticity determination server according to the second embodiment.

Embodiments for Carrying Out the Invention

[0011] Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings. Note that this is merely an example, and the technical scope of the present invention is not limited thereto. (First Embodiment)<于 <Authenticity Determination System 100><于 FIG. 1 is an overall configuration diagram of the authenticity determination system 100 according to the first embodiment. <于 <于

[0012] <于 The authenticity determination system 100 shown in FIG. 1 includes an authenticity determination server 1 (authenticity determination device), a user terminal 3 (mobile terminal), and a medium 5. <于 The medium 5 is a card medium, such as a credit card, that has a hologram 5a. However, the medium 5 is not limited to this. The medium 5 may also be, for example, a label that can be attached to an article. In such a case, by verifying the hologram 5a, the article to which the medium 5 is attached can be identified as genuine, and it can be used as a measure against counterfeit products.

[0013] The authenticity determination system 100 works as follows: the user terminal 3 photographs the hologram 5a on the medium 5, and the user terminal 3 sequentially transmits the captured images to the authenticity determination server 1. The authenticity determination server 1 then determines whether the hologram 5a is genuine or not. The authenticity determination server 1 determines whether the hologram 5a is genuine or not by targeting a continuous region of the hologram 5a that contains a specified number or more pixels that satisfy predetermined color conditions. The determination result is transmitted from the authenticity determination server 1 to the user terminal 3. With this mechanism, the user of user terminal 3 can determine whether the hologram 5a is genuine or not simply by continuously photographing it using user terminal 3, based on the judgment result displayed on user terminal 3. The user of user terminal 3 can then confirm from the judgment result whether the medium 5 containing the hologram 5a is authentic or not.

[0014] The authenticity determination server 1 of the authenticity determination system 100 and the user terminal 3 are connected via a communication network N so that they can communicate with each other. The communication network N is, for example, an internet connection or a mobile device communication network. Furthermore, the communication network N is not limited to the above-mentioned communication lines connecting each device. For example, it may include a LAN (Local Area Network) in part, regardless of whether it is wired or wireless.

[0015] <Authenticity Verification Server 1> Figure 2 is a functional block diagram of the authenticity determination server 1 according to the first embodiment. Figure 3 shows an example of the storage unit 20 of the authenticity determination server 1 according to the first embodiment. Authenticity determination server 1 is a server that determines whether or not hologram 5a is genuine based on the image of hologram 5a. As shown in Figure 2, the authenticity determination server 1 comprises a control unit 10, a storage unit 20, and a communication interface unit 29. The control unit 10 is a CPU (Central Processing Unit) that controls the entire authenticity determination server 1. The control unit 10 works in cooperation with the aforementioned hardware to perform various functions by appropriately reading and executing the OS (Operating System) and application programs stored in the memory unit 20.

[0016] Before explaining the control unit 10, let's explain the storage unit 20. The memory unit 20 is a storage area such as a hard disk or semiconductor memory element for storing programs, data, etc., necessary for the control unit 10 to perform various processes. The memory unit 20 comprises a program memory unit 21, a specific information memory unit 22, and a correct image memory unit 23. The program storage unit 21 is a memory area for storing various programs. The program storage unit 21 stores the authenticity determination program 21a. The authenticity determination program 21a is a program for executing each function of the control unit 10, which will be described later.

[0017] The specific information storage unit 22 is a storage area that stores information for identifying the correct image. Figure 3(A) shows an example of the specific information storage unit 22. The specific information storage unit 22 stores, for example, a two-dimensional code ID (IDentification) and a correct image ID in association. A two-dimensional code ID is an ID obtained from a two-dimensional code (code image), such as a QR code (registered trademark), and is identification information used to identify the two-dimensional code. The correct image ID is identification information used to identify the correct image.

[0018] As shown in the example of the specific information storage unit 22 in Figure 3(A), multiple correct image IDs may be associated with a single two-dimensional code ID. This corresponds to the case where the hologram 5a may have multiple different images as the image to be reproduced. For example, if there are three different images, a correct image ID representing each of the three images will be associated. Also, if the hologram 5a reproduces a three-dimensional object, since the three-dimensional object will be reproduced from various angles, a correct image ID representing each of the images from some of those angles will be associated.

[0019] The correct image storage unit 23 is a storage area for storing correct images. Figure 3(B) shows an example of the items in the correct image storage unit 23. The correct image storage unit 23 stores, for example, a correct image ID and correct image data in association. The correct image data is the image data of the correct image itself. The correct image is the image used for matching, and if matching is successful, it is used to determine that it is genuine.

[0020] Next, the control unit 10 will be described. The control unit 10 includes a code information receiving unit 11 (code information acquisition means), a correct image identification unit 12 (correct image identification means), an image receiving unit 13 (image acquisition means), a playback region detection unit 14 (playback region detection means), a playback region extraction unit 15 (playback region extraction means), a matching unit 16 (matching means), a determination unit 17 (determination means), and a determination result transmission unit 18 (determination result transmission means, determination result output means).

[0021] The code information receiving unit 11 receives code information from the user terminal 3. The code information includes a two-dimensional code ID that identifies the two-dimensional code. The correct image identification unit 12 identifies the correct image from the received code information. More specifically, the correct image identification unit 12 obtains the correct image ID corresponding to the two-dimensional code ID contained in the received code information by referring to the identification information storage unit 22, and identifies the correct image data corresponding to the correct image ID by referring to the correct image storage unit 23.

[0022] The image receiving unit 13 receives images from the user terminal 3. Here, an image refers to, for example, one frame of a video. The image receiving unit 13 continuously receives images from the user terminal 3. The image receiving unit 13 may also receive a video consisting of multiple frames from the user terminal 3 all at once. The reproduction region detection unit 14 detects a continuous region containing a specified number or more pixels that satisfy predetermined color conditions from the image as the reproduction region of the hologram 5a. The reproduction region detection unit 14 detects a specified number of consecutive regions as reproduction regions, where the value of a predetermined color similar to a single wavelength color in the color space is above the first threshold and the value of colors other than the predetermined color is below the second threshold. If the reproduction region detection unit 14 detects multiple such consecutive regions, it may also detect the consecutive region containing the most pixels where the value of the predetermined color is above the third threshold (higher than the first threshold) and the value of colors other than the predetermined color is below the fourth threshold (lower than the second threshold) as the reproduction region. Here, the first to fourth threshold values ​​can be set to appropriate values. The color value, for example, is a brightness value.

[0023] Furthermore, the playback region detection unit 14 may detect as a playback region a specified number or more of pixels whose calculated value, obtained by subtracting the sum of the values ​​of colors excluding a predetermined color from the value of a predetermined color similar to a single wavelength color in the color space, is equal to or greater than the fifth threshold. When multiple playback region detection units are detected, the playback region detection unit 14 may detect as the playback region the continuous region containing the most pixels whose calculated value is higher than the fifth threshold, i.e., a sixth threshold or higher. In this case, the playback region detection unit 14 may create a histogram showing the number of pixels extracted under the above conditions (first condition) in both the vertical and horizontal directions of the image, that is, the number of pixels whose calculated value, obtained by subtracting the sum of the values ​​of colors excluding a predetermined color from the value of a predetermined color similar to a single wavelength color in the color space, is equal to or greater than the fifth threshold. It may then detect continuous regions where the sum of the frequencies within the region is equal to or greater than a predetermined value among the continuous regions where the frequency of the histogram is not zero, and if multiple continuous regions are detected, it may detect as the playback region the continuous region containing the most pixels whose calculated value is equal to or greater than the sixth threshold (second condition). Here, the fifth and sixth thresholds can be set to appropriate values.

[0024] More specifically, if the hologram 5a is reproduced as light of a single wavelength in response to the green component of light, the reproduction region detection unit 14 can detect the reproduction region by, for example, using the lightness value of the G value as the value of a predetermined color similar to a single wavelength color in the RGB (Red-Green-Blue color model) color space, and using the lightness values ​​of the R value and B value as the values ​​of colors other than the predetermined color.

[0025] Furthermore, if the playback region detection unit 14 fails to detect a playback region in the current image, it performs detection on the next image. Furthermore, the playback area detection unit 14 performs detection processing on the next image even if matching is not possible by the matching unit 16, which will be described later. The playback region extraction unit 15 extracts the playback region detected by the playback region detection unit 14 from the image. The reproduction region extraction unit 15 performs preprocessing on the extracted reproduction region image as needed before matching by the matching unit 16. As preprocessing, the reproduction region extraction unit 15 may, for example, convert the reproduction region image to grayscale or invert the colors. The reproduction region extraction unit 15 may also sharpen the edges of the reproduction region image to emphasize them, or rotate the reproduction region image so that it is oriented the same way as the ground truth image.

[0026] The matching unit 16 compares the image of the regenerated region extracted by the regenerated region extraction unit 15 with the correct image pre-stored in the correct image storage unit 23. The matching unit 16 also compares the image of the regenerated region extracted by the regenerated region extraction unit 15 with the correct image in the correct image storage unit 23 identified by the correct image identification unit 12. Here, the matching unit 16 can use various methods for matching images. For example, the matching unit 16 can perform matching by performing a comparison process using pattern matching. Alternatively, the matching unit 16 can extract features from the images and perform matching by performing a comparison process using the extracted features. Furthermore, the matching unit 16 can use a machine learning model that takes an image of the playback region as input and outputs the matching result.

[0027] The determination unit 17 determines that the hologram 5a is genuine if the matching unit 16 is able to perform the matching. The determination unit 17 also determines that the hologram 5a is genuine if the matching unit 16 is able to perform the matching against a predetermined number of correct images. Furthermore, the determination unit 17 determines that the hologram 5a is not genuine if the matching unit 16 is unable to perform the matching within a certain time, if the determination unit 17 is unable to determine that the hologram 5a is genuine within a certain time, or if the reproduction area detection unit 14 is unable to detect the reproduction area within a certain time.

[0028] Here, the set time can be any appropriate amount of time, for example, 10 seconds. Also, for example, if the playback area cannot be detected, it may be a time corresponding to the number of images processed by the playback area detection unit 14. Furthermore, for example, if matching cannot be performed, it may be a time corresponding to the number of images processed by the matching unit 16. Furthermore, when comparing with multiple different correct images, the set time may be the time set when there is only one correct image multiplied by the number of correct images. The judgment result transmission unit 18 transmits the judgment result from the judgment unit 17 to the user terminal 3.

[0029] The communication interface unit 29 is, for example, an interface for communicating with the user terminal 3. Here, "computer" refers to an information processing device equipped with a control unit, memory device, etc., and the authenticity determination server 1 is an information processing device equipped with a control unit 10, a memory unit 20, etc., and is included in the concept of a computer. Furthermore, there is no limit to the number of hardware components that make up the authenticity determination server 1; it may be configured with one or more components as needed. The authenticity determination server 1 may also be, for example, a cloud-based system.

[0030] <User Terminal 3> The user terminal 3 shown in Figure 1 is a device operated by the user, and is, for example, a mobile device such as a smartphone. The user terminal 3 may also be a tablet or the like. The user terminal 3 photographs the hologram 5a contained in the medium 5 and sends it to the authenticity determination server 1, and receives and displays the determination result from the authenticity determination server 1. The user terminal 3 performs processing such as photographing the hologram 5a by, for example, installing the authenticity determination application 41a described later.

[0031] Figure 4 is a functional block diagram of the user terminal 3 according to the first embodiment. The user terminal 3 comprises a control unit 30, a storage unit 40, a camera 45 (shooting unit, shooting device), a light 46, a touch panel display 47 (display unit, display device), and a communication interface unit 49. The control unit 30 is a CPU that controls the entire user terminal 3. The control unit 30 works in cooperation with the aforementioned hardware to perform various functions by appropriately reading and executing the OS and application programs stored in the memory unit 40.

[0032] The control unit 30 includes a guidance output unit 31, a code reading processing unit 32, a video transmission unit 33 (image transmission means), a judgment result receiving unit 34 (judgment result output means), and a result output unit 35 (judgment result output means). The guidance output unit 31 outputs guidance (guides) to the user regarding operations using the user terminal 3. For example, the guidance output unit 31 outputs guidance to the user to scan a two-dimensional code or guidance to the user to photograph the hologram 5a. In the guidance to photograph the hologram 5a, it is desirable to provide guidance such as moving the hologram 5a so that it is photographed from a different angle to the camera 45 of the user terminal 3, or providing guidance to change the shooting angle of the user terminal 3.

[0033] The code reading processing unit 32 activates the camera 45 and reads the two-dimensional code via the camera 45. The code reading processing unit 32 then transmits the code information obtained from reading the two-dimensional code to the authenticity determination server 1. The video transmission unit 33 activates the camera 45 and, if necessary, the light 46, and transmits the image captured by the camera 45 to the authenticity determination server 1. The judgment result receiving unit 34 receives the judgment result from the authenticity judgment server 1. The result output unit 35 outputs the judgment result to the touch panel display 47.

[0034] The memory unit 40 is a memory area such as a semiconductor memory element for storing programs, data, etc., necessary for the control unit 30 to perform various processes. The memory unit 40 includes a program memory unit 41. The program storage unit 41 is a memory area for storing various programs. The program storage unit 41 stores the authenticity determination application 41a. The authenticity determination application 41a is an application program for executing each of the functions of the control unit 30 described above.

[0035] Camera 45 is a shooting device for acquiring images of two-dimensional codes or capturing moving images. Camera 45 is located, for example, on the back of the casing of the user terminal 3. Light 46 is a point light source that emits white light containing multiple wavelengths. Light 46 is, for example, an LED (Light Emitting Diode) light. Light 46 is located, for example, on the back of the casing of the user terminal 3, near the camera 45. The position of the camera 45 and light 46 allows the camera 45 to capture the direction of illumination of light 46.

[0036] The touch panel display 47 has the function of a display unit composed of a liquid crystal panel or the like, and the function of an input unit that detects touch input by the user's finger or the like. The touch panel display 47 is located, for example, on the front of the housing of the user terminal 3. When the camera 45 is activated, the touch panel display 47 outputs a pass-through image, which is the image captured by the camera 45. In this way, the touch panel display 47 can display the image being captured by the camera 45. Furthermore, the touch panel display 47 can overlay the through-image with, for example, a rectangle representing the area for capturing the hologram 5a, or text instructing the user on how to perform the action, thereby prompting the user on how to capture the image.

[0037] The communication interface unit 49 is, for example, an interface for communicating with the authenticity determination server 1, etc. Furthermore, a computer refers to an information processing device equipped with a control unit, memory device, etc., and user terminal 3 is an information processing device equipped with a control unit 30, a memory unit 40, etc., and is included in the concept of a computer.

[0038] <Hologram 5a> Next, we will describe the hologram 5a contained in the medium 5. Figure 5 is a diagram illustrating the hologram 5a according to the first embodiment. As shown in Figure 5, when regenerative illumination light L is incident on the hologram 5a, images 51, 52, and 53 are regenerated by diffracted light Lr. When the observer's eye E is within the angular range α1 in Figure 5, image 51 is visible; when it is within the angular range α2, image 52 is visible; and when it is within the angular range α3, image 53 is visible. Depending on the viewing direction, the observed image switches from image 51 to image 52 and then to image 53.

[0039] In this embodiment, a Lippmann hologram (volume hologram) is used as an example of hologram 5a. However, hologram 5a can also be an embossed hologram or the like, which is reproduced with white light or laser light. As for the recording method of hologram 5a, for example, there are methods such as multiplexing each screen corresponding to the viewing direction, recording one screen corresponding to the viewing direction on one layer and stacking the layers on which each screen is recorded, or combining multiple screens taken from different viewing directions and recording them as a holographic stereogram on a single hologram, and any of these may be used. In this example, there are three screens, but any number of screens, one or more, is acceptable. Increasing the number of screens allows for smoother screen transitions, for example. The direction of eye movement required for screen transitions can be selected as needed.

[0040] <Explanation of the process> Next, we will explain the processing in the authenticity determination system 100. <Processing on User Terminal 3> First, let's explain the processing on user terminal 3. Figure 6 is a flowchart showing the application processing of the user terminal 3 according to the first embodiment. Figure 7 shows an example of the display on the user terminal 3 according to the first embodiment. To initiate the process, the user prepares, for example, a flyer (not shown) containing instructions for determining the authenticity of medium 5, and medium 5 itself. The flyer has, for example, a two-dimensional code printed on it, which can be used to identify the correct image corresponding to the hologram 5a on medium 5. This example describes the use of a flyer with a printed two-dimensional code, but is not limited to this.

[0041] Then, in order to confirm whether the medium 5 is genuine or not, the user selects the authenticity verification application 41a (see Figure 4) stored on the user terminal 3 and launches the authenticity verification application 41a. In this way, in step S (hereinafter referred to simply as "S") 11 of Figure 6, the control unit 30 (guidance output unit 31) outputs guidance to the touch panel display 47. The guidance output here is, for example, guidance for reading a two-dimensional code. The control unit 30 (code reading processing unit 32) also activates the camera 45.

[0042] In S12, the control unit 30 (code reading processing unit 32) reads the two-dimensional code via the camera 45. In S13, the control unit 30 (code reading processing unit 32) determines whether or not the two-dimensional code has been read. If the two-dimensional code has been read (S13: YES), the control unit 30 moves the process to S14. On the other hand, if the two-dimensional code has not been read (S13: NO), the control unit 30 moves the process to S12 and repeats the process of reading the two-dimensional code. In S14, the control unit 30 (code reading processing unit 32) transmits the code information obtained by reading the two-dimensional code to the authenticity determination server 1. The code information includes a two-dimensional code ID that identifies the two-dimensional code.

[0043] In S15, the control unit 30 (guidance output unit 31) outputs guidance to the touch panel display 47. Figure 7(A) shows an example of a guidance screen 60 output to the touch panel display 47. The guidance provided by the guidance screen 60 is, for example, an operation guide for taking a photograph of the hologram 5a on the medium 5. As shown in the guidance screen 60, it is desirable that the operation guide include instructions for taking photographs of the hologram 5a from various angles. Furthermore, when the guidance screen 60 shown in Figure 7(A) is displayed, the control unit 30 (video transmission unit 33) activates the camera 45 when the user touches (taps) any location on the guidance screen 60. At that time, the control unit 30 may also turn on the light 46 as needed.

[0044] When the camera 45 is activated, the control unit 30 (guidance output unit 31) outputs, for example, the screen 61 shown in Figure 7(B) to the touch panel display 47 as the image captured by the camera 45. The screen 61 includes a frame 61a and an arrow icon 61b. The frame 61a allows the user to frame the hologram 5a within the frame 61a for shooting. The frame 61a also allows the size of the captured hologram 5a to be standardized to a certain size. Note that displaying the frame 61a is not mandatory. In addition, an icon image indicating the direction to move the medium 5, such as the arrow icon 61b, is superimposed on the captured image and displayed. The arrow icon 61b may be, for example, a simple animation. The arrow icon 61b can prompt the user to move the medium 5 for shooting.

[0045] In S16 of Figure 6, the control unit 30 (video transmission unit 33) transmits the images captured by the camera 45 to the authenticity determination server 1. For example, the control unit 30 sequentially transmits the images continuously captured by the camera 45 to the authenticity determination server 1. In S17, the control unit 30 (judgment result receiving unit 34) determines whether or not it has received a judgment result from the authenticity judgment server 1. If a judgment result has been received (S17: YES), the control unit 30 moves the process to S18. On the other hand, if a judgment result has not been received (S17: NO), the control unit 30 moves the process to S16 and repeats the process of sending the image captured by the camera 45 to the authenticity judgment server 1.

[0046] In S18, the control unit 30 (result output unit 35) outputs the determination result to the touch panel display 47 and terminates this process. Figure 7(C) shows screen 62, which is displayed when the judgment result is genuine. Figure 7(D) shows screen 63, which is displayed when the judgment result is not genuine. The user can check, for example, whether the medium 5 is genuine by looking at the judgment result displayed on the touch panel display 47.

[0047] <Processing by Authenticity Determination Server 1> Next, we will explain the processing of the authenticity determination server 1. Figure 8 is a flowchart showing the authenticity determination process of the authenticity determination server 1 according to the first embodiment. Figure 9 is a flowchart showing the hologram processing of the authenticity determination server 1 according to the first embodiment. Figures 10 to 12 are diagrams illustrating the hologram processing of the authenticity determination server 1 according to the first embodiment.

[0048] In step S31 of Figure 8, the control unit 10 (code information receiving unit 11) of the authenticity determination server 1 receives the code information transmitted by the user terminal 3. In S32, the control unit 10 (correct image identification unit 12) identifies the correct image from the received code information. The control unit 10 can identify the correct image from the code information by referring to the identification information storage unit 22 of the storage unit 20. In S33, the control unit 10 (image receiving unit 13) receives an image from the user terminal 3. In S34, the control unit 10 starts the timer count. The timer is used to measure a certain period of time, and the control unit 10 determines whether or not the hologram 5a is genuine within that period of time.

[0049] In S35, the control unit 10 performs hologram processing. Here, we will explain hologram processing based on Figure 9. In S41 of FIG. 9, the control unit 10 (reproduction area detection unit 14) detects the reproduction area. In S42, the control unit 10 (reproduction area detection unit 14) determines whether or not the reproduction area has been detected. If the reproduction area has been detected (S42: YES), the control unit 10 moves the process to S43. On the other hand, if the reproduction area has not been detected (S42: NO), the control unit 10 moves the process to S47. In S43, the control unit 10 (reproduction area extraction unit 15) extracts the detected reproduction area.

[0050] Here, the processes from S41 to S43 will be described based on a specific example. FIG. 10(A) shows a frame 70 which is an image to be processed. The frame 70 includes a reproduction image 70a of the hologram 5a. Also, since this frame has photographed the surroundings including the hologram 5a, in this example, it includes an object image 70b. When detecting the reproduction area, the control unit 10 performs the following calculation (Equation 1) on the RGB values of each pixel (picture element) of the frame 70 to obtain the brightness value P xy , , , xy , , (calculated value). P xy = G xy - (R xy + B xy ) However, if P xy < 0, then P xy = 0. ··· (Equation 1)

[0051] Next, the number of pixels whose brightness value P xy is greater than or equal to a threshold value P1 (fifth threshold value) is counted in the X direction (horizontal direction) and the Y direction (vertical direction), and histograms H1 are created respectively. Also, the number of pixels whose brightness value P xy is greater than or equal to a threshold value P2 (sixth threshold value) is counted in the X direction (horizontal direction) and the Y direction (vertical direction), and histograms H₂ are created respectively. Here, the threshold value P1 < the threshold value P2. FIG. 10(B) shows the histogram H1 and the histogram H2 of the frame 70. Histogram H1 and histogram H2 show that the frequency of histogram H1 is higher due to the relationship P1 < P2.

[0052] Then, as shown in Figures 11(A) and 11(B), the control unit 10 detects the region 71 with the largest sum of frequencies in histogram H2 among the continuous regions detected from histogram H1 as the regeneration region. Note that gaps may occur in the histogram H1. In such cases, if the gap is less than or equal to a predetermined interval, both regions on either side of the gap may be treated as continuous regions. This is because gaps may occur depending on the design of the hologram 5a, and this has been taken into consideration.

[0053] Next, the control unit 10 creates histograms H1 and H2 again for the detected region 71. Then, the control unit 10 detects the region 72 shown in Figure 11(C) as the regeneration region, which is the continuous region from which the sum of the frequencies in histogram H2 is the largest among the continuous regions detected from histogram H1. In this way, by using the previously detected regeneration region as the image to be processed and performing regeneration region detection again, it is possible to eliminate extraneous areas that are not hologram 5a and could not be eliminated in the first regeneration region detection, thereby narrowing down the regeneration region. Also, the brightness value P of each pixel xy If the total number of pixels greater than or equal to P2 is less than Tn (specified value), the control unit 10 determines that it could not detect the playback area. Furthermore, the control unit 10 (reproduction area extraction unit 15) may perform preprocessing on the image of the reproduction area to facilitate matching. In addition, to improve matching accuracy, noise reduction to reduce image noise and edge enhancement may be performed as preprocessing if necessary. The control unit 10 may, for example, prepare an image 82 shown in Figure 12(B) which is the reverse of the black and white colors of the image 81 of the playback region shown in Figure 12(A).

[0054] In S44 of Figure 9, the control unit 10 (matching unit 16) matches the image of the regenerated area with the identified correct image. The control unit 10 can perform image matching using various known techniques. In S45, the control unit 10 (matching unit 16) determines whether or not a match has been made. Here, the control unit 10 may determine whether or not a match has been made by, for example, calculating the degree of agreement between the two images as a score, for example, represented by a numerical value from 0 to 100, and determining that a match has been made if the score is equal to or greater than a specified value. If the matching is successful (S45: YES), the control unit 10 moves the process to S46. On the other hand, if the matching is unsuccessful (S45: NO), the control unit 10 moves the process to S47.

[0055] Furthermore, if it is necessary to compare with multiple correct images, the playback region image is compared with all correct images, and the correct images that are matched are stored. If all correct images are matched, the process is set to YES; otherwise, the process is set to NO, and the process continues until all correct images are matched. It is also possible to speed up the process by not performing the matching process on correct images that have already been matched in subsequent processing. Furthermore, when matching with multiple correct images, the process may be set to YES if a specified number of correct images are matched. For example, if there are 3 correct images, the process may be set to YES if 2 images are matched. Furthermore, while the above assumes a fixed time equal to the number of correct images to be matched, it is also possible to use a uniform time and reset the timer and start counting once a match is achieved. In S46, the control unit 10 (determination unit 17) determines that the hologram 5a is genuine. Subsequently, the control unit 10 moves the process to S36 in Figure 8.

[0056] On the other hand, in S47, the control unit 10 determines whether a certain amount of time has elapsed. If a certain amount of time has elapsed (S47: YES), the control unit 10 moves the process to S48. On the other hand, if a certain amount of time has not elapsed (S47: NO), the control unit 10 moves the process to S49. In S48, the control unit 10 (determination unit 17) determines that the hologram 5a is not genuine. Subsequently, the control unit 10 moves the process to S36 in Figure 8. In S49, the control unit 10 (image receiving unit 13) receives the next image from the user terminal 3. After that, the control unit 10 moves the processing to S36 in Figure 8.

[0057] In step S36 of Figure 8, the control unit 10 determines whether or not a determination has been made. If the processes in S46 or S48 of Figure 9 are performed, the control unit 10 determines that a determination has been made. On the other hand, if the process in S49 of Figure 9 is performed, the control unit 10 determines that a determination has not been made. If a determination has been made (S36: YES), the control unit 10 moves the process to S37. On the other hand, if a determination has not been made (S36: NO), the control unit 10 moves the process to S35 and performs hologram processing (Figure 9) on the next received image. In S37, the control unit 10 (judgment result transmission unit 18) transmits the judgment result to the user terminal 3. After that, the control unit 10 terminates this process.

[0058] Thus, according to the first embodiment, the following effects are obtained. (1) The authenticity determination server 1 acquires images of the hologram 5a taken in succession, detects a continuous region containing a specified number or more pixels that satisfy predetermined color conditions from the acquired images as the reproduction region of the hologram 5a, cuts out the detected reproduction region from the image, compares the image of the cut-out reproduction region with the correct image stored in the storage unit 20 beforehand, and determines that the hologram 5a is genuine if the match is successful. In addition, if the authenticity determination server 1 cannot detect the reproduction region from the image, it performs the detection process on the next image. Therefore, it is possible to determine whether or not hologram 5a is real from the image of the hologram 5a's reproduction region. Furthermore, the processing can be simplified by defining the hologram 5a's reproduction region as a continuous region containing a specified number or more pixels that satisfy predetermined color conditions. In addition, processing efficiency can be improved by performing detection on the next image if the reproduction region could not be detected from the previous image.

[0059] (2) If the authenticity determination server 1 fails to match the image, it will perform a process to detect the reproduction area of ​​the hologram 5a for the next image. Therefore, images of the hologram 5a captured in sequence can be processed sequentially. As a result, by processing the captured images sequentially, images of the hologram 5a taken from various angles can be obtained, and processing can be performed on the images reproduced by the hologram 5a.

[0060] (3) The hologram 5a is reproduced in response to light of a single wavelength, and the authenticity determination server 1 detects a continuous region containing a specified number of pixels whose calculated value, obtained by subtracting the sum of the values ​​of colors (R, B) excluding the predetermined color from the lightness value of a predetermined color (G) similar to a single wavelength color in the RGB color space, is equal to or greater than the threshold P1. Therefore, the reproduction area of ​​the hologram 5a can be detected from the calculated value, and authenticity can be determined in an efficient manner.

[0061] (4) When the authenticity determination server 1 detects multiple reproduction regions, it is configured to detect as the reproduction region the contiguous region that contains the most pixels with a calculated value higher than threshold P1, which is threshold P2. Therefore, the reproduction area of ​​the hologram 5a can be narrowed down, and the matching process can be performed efficiently.

[0062] (5) The authenticity determination server 1 creates histograms H1 and H2, which show the number of pixels that meet the conditions for each value in the X and Y directions of the image, respectively. It detects continuous regions in histogram H1 where the frequency is not 0 and the sum of the frequencies within the region is greater than or equal to a predetermined value. If multiple continuous regions are detected, it detects the continuous region containing the most pixels in histogram H2 as the reproduction region. Therefore, the playback area can be easily found.

[0063] (6) The authenticity determination server 1 is configured to perform a process of re-detecting the playback area using the playback area that was detected. Therefore, by eliminating unnecessary areas, the area to be detected as a regeneration area can be narrowed down to the area where the hologram 5a is being regenerated.

[0064] (7) The authenticity determination server 1 is configured to determine that the hologram 5a is not genuine if it is not possible to verify it within a certain period of time or if it is not possible to detect the reproduction area within a certain period of time. Therefore, the authenticity determination process can be completed within a certain time.

[0065] (8) The authenticity determination server 1 compares the image of the reconstructed region with multiple different correct images, and determines that the hologram 5a is genuine if it can match one or more specified correct images from the multiple different correct images. Furthermore, the authenticity determination server 1 continues to process the detection of the reconstructed region for the next image until it determines that the hologram 5a is genuine, and if it is not determined that the hologram 5a is genuine within a certain period of time, it also determines that the hologram 5a is not genuine. Therefore, by comparing a hologram 5a that plays multiple different images with multiple correct images, it is possible to determine whether or not the hologram 5a is genuine. For example, if a hologram 5a that plays two different images can only be matched with one correct image, it can be determined that it is not genuine.

[0066] (9) The authenticity determination server 1 receives a two-dimensional code from the user terminal 3 via the camera 45, identifies the correct image from the code information extracted from the acquired two-dimensional code, and compares the identified correct image with the image in the playback area. Therefore, the correct image to match with the image in the playback area can be identified, improving processing efficiency.

[0067] (Second Embodiment) In the second embodiment, we will describe a system in which some of the processing performed by the authenticity determination server in the first embodiment is performed on the user terminal. In the following description, parts that perform the same functions as in the first embodiment described above will be denoted by the same reference numerals or the same reference numerals at the end, and redundant explanations will be omitted as appropriate.

[0068] <Authenticity Determination System 200> Although not shown in the diagram, the authenticity determination system 200 comprises an authenticity determination server 201, a user terminal 203, and a medium 5.

[0069] <Authenticity Verification Server 201> Figure 13 is a functional block diagram of the authenticity determination server 201 according to the second embodiment. As shown in Figure 13, the authenticity determination server 201 comprises a control unit 210, a storage unit 220, and a communication interface unit 29. The control unit 210 includes a code information receiving unit 11, a correct image identification unit 12, a cropped image receiving unit 213 (image receiving means), a matching unit 216, a determination unit 17, and a determination result transmission unit 18.

[0070] The cropped image receiving unit 213 receives the image of the playback area cropped by the user terminal 203 from the user terminal 203. The matching unit 216 compares the image of the playback region received by the cropped image receiving unit 213 with the correct image previously stored in the correct image storage unit 23. The memory unit 220 includes a program memory unit 221, a specific information memory unit 22, and a correct image memory unit 23. The program storage unit 221 stores the authenticity determination program 221a, which is a program for executing each of the functions of the control unit 210 described above.

[0071] <User Terminal 3> Figure 14 is a functional block diagram of the user terminal 203 according to the second embodiment. The user terminal 203 includes a control unit 230, a storage unit 240, a camera 45, a light 46, a touch panel display 47, and a communication interface unit 49. The control unit 230 includes a guidance output unit 31, a code reading processing unit 32, an image acquisition unit 236, a playback area detection unit 237 (playback area detection means), a playback area extraction unit 238 (playback area extraction means), an extracted image transmission unit 239 (image transmission means), a determination result receiving unit 34, and a result output unit 35.

[0072] The image acquisition unit 236 activates the camera 45 and, if necessary, the light 46, and acquires the image captured by the camera 45. The regeneration area detection unit 237 detects a continuous region containing a specified number or more pixels that satisfy predetermined color conditions from the image acquired by the image acquisition unit 236 as the regeneration area of ​​the hologram 5a. The regeneration region extraction unit 238 extracts the regeneration region detected by the regeneration region detection unit 237 from the image. The regeneration region extraction unit 238 may perform preprocessing on the extracted image of the regeneration region as needed.

[0073] The extracted image transmission unit 239 transmits the image of the regenerated region extracted by the regenerated region extraction unit 238 to the authenticity determination server 201. The memory unit 240 includes a program memory unit 241. The program storage unit 241 stores the authenticity determination application 241a, which is an application program for executing each of the functions of the control unit 230 described above.

[0074] <Explanation of the process> Next, we will explain the processing in the authenticity determination system 200. <Processing on user terminal 203> First, let's explain the processing on user terminal 203. Figures 15 and 16 are flowcharts illustrating the application processing of the user terminal 203 according to the second embodiment. The processes from S211 to S215 in Figure 15 are the same as the processes from S11 to S15 in the first embodiment (Figure 6).

[0075] In S216 of Figure 15, the control unit 230 starts the timer count. The timer is used to measure a certain period of time, and the control unit 230 determines whether the hologram 5a is genuine or not within that period. The control unit 230 also starts a separate thread for receiving results from the authenticity determination server 201. This is a measure to eliminate waiting time caused by the communication time lag, which usually occurs in seconds. By keeping track of whether the thread has received the determination result from the authenticity determination server 201, the thread can be checked in subsequent processing. In S217, the control unit 230 (image acquisition unit 236) acquires the image captured by the camera 45. In S218, the control unit 230 (reproduction area detection unit 237) detects the reproduction area. Subsequently, the control unit 230 moves the process to S221 in Figure 16.

[0076] In S221 of Figure 16, the control unit 230 (playback area detection unit 237) determines whether or not it was able to detect the playback area. If it was able to detect the playback area (S221: YES), the control unit 230 moves the process to S222. On the other hand, if it was not able to detect the playback area (S221: NO), the control unit 230 moves the process to S227. In S222, the control unit 230 (regeneration region extraction unit 238) extracts the detected regeneration region. Here, the processing performed by the control unit 230 from detection to extraction of the regeneration region is the same as in the first embodiment. In S223, the control unit 230 (extracted image transmission unit 239) transmits the extracted image of the reconstructed region to the authenticity determination server 201.

[0077] In S224, the control unit 230 (judgment result receiving unit 34) receives the judgment result from the authenticity judgment server 201 by checking the thread. In S225, the control unit 230 determines whether the received judgment result is "genuine" or not. If the received judgment result is "genuine" (S225: YES), the control unit 230 moves the process to S226. On the other hand, if the received judgment result is not "genuine" (S225: NO), the control unit 230 moves the process to S227. In S226, the control unit 230 (result output unit 35) outputs the determination result as "genuine" to the touch panel display 47 and terminates this process.

[0078] On the other hand, in S227, the control unit 230 determines whether a certain amount of time has elapsed. If a certain amount of time has elapsed (S227: YES), the control unit 230 moves the process to S228. On the other hand, if a certain amount of time has not elapsed (S227: NO), the control unit 230 moves the process to S217 in Figure 15. In S228, the control unit 230 (result output unit 35) outputs the determination result "not genuine" to the touch panel display 47 and terminates this process.

[0079] <Processing by Authenticity Verification Server 201> Next, we will explain the processing performed by the authenticity determination server 201. Figure 17 is a flowchart showing the authenticity determination process of the authenticity determination server 201 according to the second embodiment. Steps S231 and S232 in Figure 17 are the same as steps S31 and S32 in the first embodiment (Figure 8). In S233, the control unit 210 (extracted image receiving unit 213) receives an image of the playback area from the user terminal 203.

[0080] In S234, the control unit 210 (matching unit 216) matches the received image of the playback region with the identified correct image. In S235, the control unit 210 (verification unit 216) determines whether or not a verification was successful. If a verification is successful (S235: YES), the control unit 210 moves the process to S236. On the other hand, if a verification is unsuccessful (S235: NO), the control unit 210 moves the process to S237.

[0081] In S236, the control unit 210 (determination unit 17) determines that the hologram 5a is genuine. Subsequently, the control unit 210 moves the process to S238. On the other hand, in S237, the control unit 210 (determination unit 17) determines that the matching could not be performed. In S238, the control unit 210 (judgment result transmission unit 18) transmits the judgment result to the user terminal 203. After that, the control unit 210 terminates this process.

[0082] Thus, the second embodiment has the following effects. The user terminal 203 detects a continuous region containing a specified number of pixels that satisfy predetermined color conditions from a series of images of the hologram 5a, and identifies this region as the reproduction region of the hologram 5a. The user terminal 203 then extracts the detected reproduction region from the image and sends the extracted image of the reproduction region to the authenticity determination server 201. The authenticity determination server 201 compares the image of the reproduction region received from the user terminal 203 with the correct image previously stored in the storage unit 220, and determines that the hologram 5a is genuine if a match is found.

[0083] Therefore, by performing the processing up to the point of verification on the user terminal 203, it is only necessary to send a small image data file containing only the image of the reproduction region to the authenticity determination server 201, dramatically reducing the amount of communication between the user terminal 203 and the authenticity determination server 201. Furthermore, since the correct image is not stored on the user terminal 203, a highly confidential information system can be implemented. In addition, if the reproduction region cannot be detected from an image, the process of detecting the reproduction region is performed on the next image, so the process can be completed on the user terminal 203, thereby reducing communication with the authenticity determination server 201.

[0084] Although embodiments of the present invention have been described above, the present invention is not limited to the embodiments described above. Furthermore, the effects described in the embodiments are merely a list of the most preferred effects arising from the present invention, and the effects of the present invention are not limited to those described in the embodiments. The embodiments described above and the modified forms described later can be used in combination as appropriate, but a detailed explanation is omitted.

[0085] (Transformed form) (1) In each embodiment, the hologram 5a is described as being reproduced as light of a single wavelength in response to the green (G) component of light, but is not limited to this. The hologram may reproduce patterns of multiple colors with different wavelengths. In that case, the illumination light source provided by the user terminal shall emit monochromatic light. In this way, the reproduced image of the hologram acquired by the imaging unit shall be a monochromatic image corresponding to the wavelength of the emitted light. Monochromatic light means, for example, light that outputs a monochromatic red color in the wavelength range of 635 nm to 690 nm, and light that outputs a monochromatic green color in the wavelength range of 520 nm to 532 nm. Light within the wavelength range of red or green may be red or green containing multiple wavelengths, or red or green of a single wavelength.

[0086] (2) In each embodiment, the example described involves reading a two-dimensional code before photographing the hologram to identify the correct image, but the invention is not limited to this. For example, if there is no type of hologram, the hologram may be photographed directly without reading the two-dimensional code. Also, even if there is a type of hologram, the hologram may be photographed directly without reading the two-dimensional code, but this may take time to match it with the correct image. Furthermore, while a two-dimensional code was used to identify the correct image, it is not limited to this. A barcode or textual information could also be used.

[0087] (3) In each embodiment, a card medium was described as an example of a medium having a hologram, but it is not limited to this. Any medium having a hologram is acceptable, and in addition to the stickers for attaching to articles described in the first embodiment, other examples include tickets used for admission to entertainment facilities, cards used in games, etc.

[0088] (4) In each embodiment, the hologram has been described as having a rectangular shape, but it is not limited to this. For example, it may be circular, elliptical, or have other shapes.

[0089] (5) In each embodiment, a specific example of the detection of a reconstructed image using a histogram has been described, but the invention is not limited to this. For example, a two-dimensional continuous region of pixels with a calculated value of 5 or higher and pixels with a calculated value of 6 or higher may be detected and used as the regeneration region. Furthermore, it is not necessary to use calculated values. For example, the hologram 5a is reconstructed in response to light of a single wavelength, and pixels where the value of a predetermined color similar to the color of a single wavelength in the color space is above a first threshold and the value of colors other than the predetermined color is below a second threshold may be marked, and a two-dimensional set of adjacent marked pixels may be detected as the reconstruction region.

[0090] (6) In each embodiment, a system was described as one in which an application for authenticity determination is installed on the user terminal and an application stored on the user terminal is used, but the system is not limited to this. The system can be constructed in any way, for example, it may be a web-based system. In that case, the user terminal only needs to have a web browser. In a web-based system, for example, a two-dimensional code adjacent to the hologram can be read by a general code reader to transition to a specified web page, and processing such as capturing the hologram can be performed on the web application. Alternatively, a combination of a counterfeit detection application and a web browser may be used. For example, a web browser may be used to read the QR code, and the counterfeit detection application may be used for subsequent processing. In this case, the QR code contains web page information and a QR code ID. For example, by reading a QR code adjacent to a hologram, the user can transition to a web page with instructions on how to use it, and simultaneously obtain the correct image ID from the QR code ID.

[0091] (7) In each of the second embodiments, the example described was that the image of the playback region extracted by the user terminal 203 is pre-processed before being sent to the authenticity determination server 201, but the invention is not limited to this. The authenticity determination server may perform the pre-processing. Furthermore, the division of processing between the user terminal 203 and the authenticity determination server 201 is not limited to these examples. Furthermore, all processing may be performed solely on the user's terminal, with only the results managed by the authenticity verification server. In this case, the correct image identified by the QR code may be retrieved from the authenticity verification server. [Explanation of symbols]

[0092] 1,201 Authenticity Verification Server 3,203 User Terminals 5 Medium 5a Hologram 10, 30, 210, 230 Control Unit 11 Code Information Receiving Unit 12 Correct Image Identification Unit 13 Image receiving unit 14, 237 Regeneration area detection unit 15, 238 Reproduction area extraction part 16, 216 Verification section 17 Judgment section 18. Judgment Result Transmission Unit 20, 40, 220, 240 storage section 21a, 221a Authenticity Determination Program 22 Specific information storage unit 23 Correct Image Storage Unit 31 Guidance output section 32 Code Reading Processing Unit 33 Video transmission section 34. Judgment Result Receiving Unit 35 Result Output Section 41a, 241a App for determining authenticity 45 Camera 46 Light 47 Touch panel display Screens 51, 52, and 53 60 Guide screen 70 frames 70a Playback image 71, 72 area 100, 200 Authenticity Verification System 213 Image extraction receiving unit 236 Image acquisition unit 239 Image transmission unit

Claims

1. A computer to determine the authenticity of a hologram, An image acquisition means for acquiring images by continuously photographing a hologram, A reproduction region detection means detects a continuous region containing a specified number or more pixels that satisfy predetermined color conditions from the image acquired by the image acquisition means, as the reproduction region of the hologram. A reproduction region extraction means for extracting the reproduction region detected by the reproduction region detection means from the image, The aforementioned reproduction region extraction means compares the image of the reproduction region extracted with the correct image previously stored in the storage unit, A determination means that determines that the hologram is genuine when the verification by the verification means is successful, and make it work A program that causes the playback region detection means to perform a detection process on the next image if it is not possible to detect the playback region from the previous image.

2. In the program described in claim 1, A program that causes the playback region detection means to perform detection processing on the next image if the matching means fails to perform matching.

3. In the program described in claim 1, The aforementioned hologram is reproduced in response to light of a single wavelength, A program that causes the reproduction region detection means to function to detect a specified number or more of the pixels in the color space whose value for a predetermined color similar to the single wavelength color is equal to or greater than a first threshold, and whose value for a color other than the predetermined color is equal to or less than a second threshold, as the reproduction region.

4. In the program described in claim 3, A program that causes the reproduction region detection means to function such that, when multiple consecutive regions are detected, the consecutive region containing the most pixels whose color values ​​are above a third threshold (higher than the first threshold) and whose color values ​​(excluding the predetermined color) are below a fourth threshold (lower than the second threshold) is identified as the reproduction region.

5. In the program described in claim 1, The aforementioned hologram is reproduced in response to light of a single wavelength, A program that causes the reproduction region detection means to function to detect a continuous region containing a specified number or more of the pixels whose calculated value, obtained by subtracting the sum of the values ​​of colors excluding the predetermined color from the value of the predetermined color that is similar to the color of the single wavelength in the color space, is equal to or greater than a fifth threshold.

6. In the program described in claim 5, A program that causes the reproduction region detection means to function such that, when multiple consecutive regions are detected, it detects as the consecutive region containing the most pixels whose calculated value is higher than the fifth threshold (a sixth threshold or higher), which is equal to or greater than the fifth threshold.

7. In the program according to any one of claims 3 to 6, A program that causes the playback region detection means to create a histogram showing the number of pixels that meet the conditions for each value in the vertical and horizontal directions of the image, and to detect as the playback region any continuous region in which the sum of the frequencies within the region is greater than or equal to a predetermined value, among the continuous regions in which the frequency of the histogram is not zero.

8. In the program described in claim 6, A program that causes the playback region detection means to create a histogram showing the number of pixels that meet a first condition for each value in the vertical and horizontal directions of the image, detects continuous regions among the continuous regions where the frequency of the histogram is not zero and the sum of the frequencies within the region is equal to or greater than a predetermined value, and if multiple continuous regions are detected, detects the continuous region containing the most pixels that meet a second condition which has a higher threshold than the first condition as the playback region.

9. In the program described in claim 7, A program that causes the playback region detection means to function by performing processing again on the detected playback region.

10. In the program according to any one of claims 3 to 5, The aforementioned color value is a lightness value, according to the program.

11. In the program described in claim 1, A program that causes the determination means to function such that it determines the hologram is not genuine if the matching means fails to perform a match within a certain period of time or if the reproduction area detection means fails to detect the reproduction area within a certain period of time.

12. In the program described in claim 1, The memory unit stores a plurality of different correct images. The matching means is configured to match the image of the regeneration region with a plurality of different correct images. The determination means is configured to determine that the hologram is genuine when the matching means can match one or more specified correct images from among a plurality of different correct images. A program that causes the reproduction region detection means to perform detection processing on the next image until the determination means determines that the hologram is real.

13. In the program described in claim 12, A program that causes the determination means to determine that the hologram is not real if the matching means fails to perform a match within a certain period of time, if the determination means fails to determine that the hologram is real within a certain period of time, or if the reproduction area detection means fails to detect the reproduction area within a certain period of time.

14. In the program described in claim 1, The aforementioned computer, A code information acquisition means that acquires a code image via the imaging unit and extracts code information, The code information acquisition means identifies the correct image from the code information acquired by the code information acquisition means, To make it function as, The matching means is configured to compare the correct image identified by the correct answer identification means with the image of the playback region. A program that causes the computer to function as a determination result output means for outputting the determination result obtained by the determination means to a display unit.

15. A device for determining the authenticity of a hologram, An image acquisition means for acquiring images by continuously photographing a hologram, A reproduction region detection means detects a continuous region containing a specified number or more pixels that satisfy predetermined color conditions from the image acquired by the image acquisition means, as the reproduction region of the hologram. A reproduction region extraction means for extracting the reproduction region detected by the reproduction region detection means from the image, The aforementioned reproduction region extraction means compares the image of the reproduction region extracted with the correct image previously stored in the storage unit, A determination means that determines that the hologram is genuine when the verification by the verification means is successful, Equipped with, The reproduction region detection means is a genuineness determination device that, if it is not possible to detect the reproduction region from the image, performs a detection process on the next image.

16. The authenticity determination device according to claim 15, A portable terminal that is communicatively connected to the aforementioned authenticity determination device, A genuine / counterfeit detection system equipped with, The authenticity determination device includes a determination result transmission means for transmitting the determination result obtained by the determination means to the mobile terminal. The aforementioned mobile terminal is A camera unit for capturing the aforementioned hologram, Image transmission means for transmitting the image captured by the aforementioned imaging unit to the authenticity determination device, A determination result output means that receives the determination result from the determination means and outputs it to the display unit, A genuine / counterfeit detection system equipped with [the following features].

17. A portable terminal that is communicatively connected to a device for determining the authenticity of a hologram, The photography unit takes continuous shots of the holograms, A reproduction region detection means for detecting a continuous region containing a specified number or more pixels that satisfy predetermined color conditions from an image acquired from the aforementioned imaging unit, as the reproduction region of the hologram, A reproduction region extraction means for extracting the reproduction region detected by the reproduction region detection means from the image, Image transmission means for transmitting the image of the regeneration region extracted by the regeneration region extraction means to the authenticity determination device, A judgment result output means receives a judgment result obtained by comparing the image of the playback area with a pre-stored correct image from the authenticity determination device and outputs it to the display unit. Equipped with, The playback region detection means is a mobile terminal that, if it is not possible to detect the playback region from the image, performs a detection process on the next image.

18. The mobile terminal described in claim 17, The authenticity determination device is connected to the aforementioned mobile terminal in a communication manner, A genuine / counterfeit detection system equipped with, The aforementioned authenticity determination device is Image receiving means for receiving the image of the playback area from the mobile terminal, A comparison means for comparing the image of the playback region received by the image receiving means with the correct image previously stored in the storage unit, A determination means that determines that the hologram is genuine when the verification by the verification means is successful, A determination result transmission means for transmitting the determination result obtained by the determination means to the mobile terminal, A genuine / counterfeit detection system equipped with [the following features].

19. A method for determining the authenticity of a hologram, Image acquisition step: Continuously photograph the hologram using a photography device while changing the direction of photography of the hologram to acquire an image. A reproduction region detection step in which a continuous region containing a specified number or more pixels that satisfy predetermined color conditions is detected from the image acquired in the image acquisition step as the reproduction region of the hologram, The reproduction region extraction step involves extracting the reproduction region detected in the reproduction region detection step from the image, The aforementioned reproduction region extraction step involves comparing the image of the reproduction region extracted with a correct image previously stored in the storage unit, A determination step in which, if the verification in the aforementioned verification step is successful, it is determined that the hologram is genuine, A determination result output step which outputs the determination result obtained in the above determination step to a display device, Includes, The method for detecting the playback region, wherein if the playback region could not be detected from the image, the process is performed to detect it in the next image.

Images