Program, information processing method and information processor

Abstract

To provide a program, etc. that can preferably support authenticity determination.SOLUTION: A program causes a computer to execute processing of acquiring an image of an object illuminated by light, detecting the position of the object from the image, detecting the irradiation position of the zero-order diffracted light from the image, and superimposing and displaying an object on the image to guide the irradiation position of the zero-order diffracted light to a predetermined position on the object in accordance with the detected position of the object and the irradiation position of the zero-order diffracted light.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a program, an information processing method, and an information processing device. [Background technology]

[0002] Holograms are used for the purpose of preventing counterfeiting, such as brand protection. However, apart from experts who are familiar with hologram products, end users who have no knowledge of holograms cannot distinguish what state a hologram must be in to be genuine, making it difficult to determine whether it is genuine or not.

[0003] For example, Patent Document 1 discloses an authenticity determination support device for supporting the authenticity determination of an anti-counterfeiting medium (such as a hologram) attached to an object to be subjected to authenticity determination, which generates and outputs image data that juxtaposes an image of the object and a correct image that shows the light pattern emitted by the genuine anti-counterfeiting medium. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] International Publication No. 2016 / 190107 Summary of the Invention [Problem to be solved by the invention]

[0005] In one aspect, an object of the present invention is to provide a program or the like that can favorably assist in authenticity determination. [Means for solving the problem]

[0006] In one aspect, the program causes a computer to execute a process of acquiring an image of an object illuminated with light, detecting a position of the object from the image, detecting an irradiation position of the zeroth-order diffracted light from the image, and superimposing an object on the image to guide the irradiation position of the zeroth-order diffracted light to a predetermined position on the object according to the detected position of the object and the irradiation position of the zeroth-order diffracted light. Effect of the Invention

[0007] According to one aspect, it is possible to favorably assist in authenticity determination. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is an explanatory diagram showing an example of the configuration of an authenticity determination system. [Diagram 2] FIG. 2 is an explanatory diagram of a hologram portion. [Diagram 3] FIG. 2 is a block diagram showing an example of the configuration of a server. [Figure 4] FIG. 2 is a block diagram showing a configuration example of a terminal. [Figure 5A] FIG. 11 is an explanatory diagram relating to a bright point induction process. [Figure 5B] FIG. 11 is an explanatory diagram relating to a bright point induction process. [Figure 6A] FIG. 11 is an explanatory diagram relating to the drawing process of a first rectangular area. [Figure 6B] FIG. 11 is an explanatory diagram relating to the drawing process of a first rectangular area. [Figure 7A] FIG. 11 is an explanatory diagram relating to the drawing process of a second rectangular area. [Figure 7B] FIG. 11 is an explanatory diagram relating to the drawing process of a second rectangular area. [Figure 8] FIG. 11 is an explanatory diagram regarding a process of cutting out a hologram portion. [Figure 9A] FIG. 11 is an explanatory diagram regarding a process of cutting out a hologram portion. [Figure 9B] FIG. 11 is an explanatory diagram regarding a cut-out process of a hologram portion. [Figure 10] FIG. 11 is an explanatory diagram regarding a cut-out process of a hologram portion. [Figure 11] FIG. 11 is an explanatory diagram regarding an authenticity determination process. [Figure 12A] FIG. 11 is an explanatory diagram regarding an authenticity determination process. [Figure 12B] FIG. 11 is an explanatory diagram regarding an authenticity determination process. [Figure 13] 11 is a flowchart illustrating an example of a processing procedure executed by the authenticity determination system. [Figure 14] FIG. 11 is an explanatory diagram showing an overview of a second embodiment. [Figure 15] 10 is a flowchart showing a processing procedure executed by the authenticity determining system according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] The present invention will now be described in detail with reference to the drawings showing embodiments thereof. (Embodiment 1) Fig. 1 is an explanatory diagram showing an example of the configuration of an authenticity determination system. In this embodiment, an authenticity determination system is described that guides a user to align the position of a bright spot (zeroth-order diffracted light) on a hologram and performs authenticity determination from a captured image in which the bright spot is superimposed on the hologram. The authenticity determination system includes a server 1 and a terminal 2. Each device is communicatively connected via a network N such as the Internet.

[0010] The server 1 is a server computer that performs various information processing and information transmission / reception. As will be described later, the server 1 performs processing for determining the authenticity of the authenticity determination target 3 based on an image of the authenticity determination target 3.

[0011] The terminal 2 is an information processing terminal used by a user of the system, such as a smartphone, a tablet terminal, etc. The terminal 2 includes a light source (e.g., an LED (Light-Emitting Diode) light) that irradiates illumination light, and a camera that captures an image of a subject, and captures an image of the authenticity determination target object 3 illuminated with the illumination light. The terminal 2 transmits the captured image to the server 1, which performs an authenticity determination.

[0012] In this embodiment, the object 3 to be authenticated is provided with a hologram section 30. FIG. 2 is an explanatory diagram of the hologram section 30. As shown in FIG. 2, the hologram section 30 is provided with a hologram portion in a circular ring shape, and when illuminated with light, the reflected light is diffracted and appears to have a predetermined color. Specifically, when a bright spot (zeroth-order diffracted light (specularly reflected light)) of the illumination light is located at the center of the hologram section 30, orange wavelengths are diffracted in the area above the bright spot, and green wavelengths are diffracted in the area below the bright spot. As such a hologram, the hologram recording medium described in Japanese Patent No. 4338124 can be used.

[0013] As in the modified example described below, the hologram is not limited to a hologram in which orange and green wavelengths are diffracted (a Lippmann hologram in which the wavelengths are diffracted into multiple colors), but may be, for example, a hologram in which a single color wavelength is diffracted, a hologram in which the wavelengths are diffracted into two or more colors (multiple colors), etc. Furthermore, the object of authenticity determination may be any optical structure that allows for authenticity determination, and may be, for example, a diffraction grating other than a hologram.

[0014] In addition, in the present embodiment, the hologram is described as being provided in a circular shape, but the shape, pattern, etc. of the hologram are not particularly limited. Accordingly, the target position of a bright spot, which will be described later, may be changed to a position different from the center of hologram section 30.

[0015] Incidentally, an expert with knowledge of the hologram section 30 knows that the irradiation position of the zeroth-order diffracted light (position of the bright spot) should be aligned with the center of the hologram section 30 in order to determine authenticity, but an end user without such knowledge is expected to not know where to align the irradiation position of the zeroth-order diffracted light. Therefore, in this embodiment, a guide line 35 that connects the bright spot and the target position during imaging is drawn and superimposed on the display screen to assist the end user in easily performing imaging operations (see Figs. 5A and B).

[0016] 3 is a block diagram showing an example of the configuration of the server 1. The server 1 includes a control unit 11, a main storage unit 12, a communication unit 13, and an auxiliary storage unit . The control unit 11 has one or more arithmetic processing devices such as a central processing unit (CPU), a micro-processing unit (MPU), a graphics processing unit (GPU), etc., and performs various information processing, control processing, etc. by reading and executing a program P1 stored in the auxiliary storage unit 14. The main storage unit 12 is a temporary storage area such as a static random access memory (SRAM) or a dynamic random access memory (DRAM), and temporarily stores data required for the control unit 11 to execute arithmetic processing. The communication unit 13 is a communication module for performing processing related to communication, and transmits and receives information to and from the outside. The auxiliary storage unit 14 is a non-volatile storage area such as a large-capacity memory or a hard disk, and stores the program P1 (program product) and other data required for the control unit 11 to execute processing.

[0017] The auxiliary storage unit 14 may be an external storage device connected to the server 1. The server 1 may be a multi-computer consisting of a plurality of computers, or may be a virtual machine virtually constructed by software.

[0018] In the present embodiment, the server 1 is not limited to the above configuration, and may include, for example, an input unit for accepting operation input, a display unit for displaying images, etc. The server 1 may also include a reading unit for reading a portable storage medium 1a such as a CD (Compact Disk)-ROM or a DVD (Digital Versatile Disc)-ROM, and may read and execute the program P1 from the portable storage medium 1a.

[0019] 4 is a block diagram showing an example of the configuration of the terminal 2. The terminal 2 includes a control unit 21, a main memory unit 22, a communication unit 23, a display unit 24, an input unit 25, an imaging unit 26, a light source 27, and an auxiliary memory unit . The control unit 21 has one or more processors such as CPUs, and performs various information processing by reading and executing the program P2 stored in the auxiliary storage unit 28. The main storage unit 22 is a temporary storage area such as RAM, and temporarily stores data necessary for the control unit 21 to execute arithmetic processing. The communication unit 23 is a communication module for performing processing related to communication, and transmits and receives information to and from the outside. The display unit 24 is a display screen such as a liquid crystal display, and displays images. The input unit 25 is an operation interface such as a touch panel, and accepts operation input from a user. The imaging unit 26 is a camera equipped with an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) sensor, and captures images. The light source 27 is a light source that irradiates illumination light, and is, for example, an LED light. The auxiliary storage unit 28 is a non-volatile storage area such as a hard disk, and stores the program P2 (program product) and other data necessary for the control unit 21 to execute processing.

[0020] The terminal 2 may be provided with a reading unit for reading a portable storage medium 2a such as a CD-ROM, and may read and execute the program P2 from the portable storage medium 2a.

[0021] 5A and 5B are explanatory diagrams regarding the bright spot guiding process. In Fig. 5A and 5B, the display screen of the terminal 2 during imaging is shown with a superimposed guiding line 35 for guiding the bright spot position to a target position (center) on the hologram section 30 (Fig. 5A), and the hologram section 30 is cut out when the bright spot overlaps the target position (Fig. 5B). The following is an overview of this embodiment.

[0022] The terminal 2 captures an image of the hologram section 30 of the object 3 to be authenticated in accordance with an operation by a user. The terminal 2 first detects the marker 31 that has been added to the hologram section 30 in advance from the captured frame image. The marker 31 is a marker that has been added to enable detection of the position of the hologram section 30, and is, for example, an ARUco marker. The marker 31 is added to the diagonal of the rectangular hologram section 30. The terminal 2 detects the position of the marker 31 to detect the position of the hologram section 30 (object).

[0023] In this embodiment, the marker 31 is described as an ARUco marker, but the present embodiment is not limited to this. For example, the marker 31 may be a QR code (registered trademark). For example, the terminal 2 stores the relative position between the QR code and the hologram section 30 in advance, detects the position of the QR code from the frame image, and detects the position of the hologram section 30 from the detected position of the QR code and a predetermined relative position. In this way, a QR code may be adopted as the marker 31.

[0024] For example, relative position information between the QR code and the hologram section 30 may be embedded in the QR code itself, and the terminal 2 may read out the relative position information to detect the position of the hologram section 30.

[0025] Based on the position of the detected marker 31, the terminal 2 superimposes and displays a first rectangular area 32 drawn to surround the hologram section 30 and a second rectangular area 33 drawn in the center of the hologram section 30, i.e., at the target position of the bright point.

[0026] 6A and 6B are explanatory diagrams relating to the drawing process of the first rectangular area 32. The terminal 2 calculates the coordinates of the midpoint C based on the positions of vertices A and B of the marker 31 arranged diagonally in the hologram section 30. In addition, the distance AB between the vertices A and B in the X direction X and the distance AB in the Y direction Y Then, terminal 2 calculates the distance AB with the midpoint C as the center. X , A.B. YThe terminal 2 calculates the diagonal coordinates DA0, DB0 of a square having the longer side of the two rectangular areas DA0, DB0. The terminal 2 draws the square having the diagonals DA0, DB0 as the first rectangular area 32.

[0027] 7A and 7B are explanatory diagrams regarding the drawing process of the second rectangular area 33. In the same manner as when the first rectangular area 32 is drawn, the terminal 2 inputs the coordinates of the midpoint C and the distance AB X , A.B. Y Then, terminal 2 calculates AB X , A.B. Y The terminal 2 calculates the diagonal coordinates DA1, DB1 of a square with the calculated long side as one side and centered at the midpoint C. The terminal 2 draws the square with DA1, DB1 as the diagonal as the second rectangular area 33.

[0028] 5A and 5B, the description will be continued. Terminal 2 further detects the position of the bright spot (the irradiation position of the zeroth-order diffracted light) from the frame image, and displays a circular bright spot region 34 corresponding to the range of the bright spot (the irradiation range of the zeroth-order diffracted light) superimposed on the frame image.

[0029] The bright spot referred to here is a portion of the captured image that is generally called a blown-out highlight portion. For example, a bright spot is not an isolated point, but is a roughly circular continuous region that includes a certain region in the captured image where the gradation of the highlight portion has been lost.

[0030] For example, the terminal 2 creates a brightness histogram based on the brightness and saturation of the image, and calculates a brightness threshold value for detecting bright spots. The terminal 2 detects pixels whose brightness is equal to or greater than the threshold value and whose saturation is equal to or less than a predetermined threshold value as bright spot dots, and detects continuous areas in which bright spot dots are continuous. In addition to the above detection method, for example, in the case of an image in which each of the RGB values ​​is 8 bits, dots whose three colors are equal to or greater than a predetermined value, such as 250, may be detected as bright spot dots.

[0031] The terminal 2 extracts the area with the maximum average luminance from the detected continuous area or areas as the area of ​​the 0th order diffracted light. The terminal 2 sets the center of gravity of the extracted area as the center of the bright spot. The terminal 2 assumes that the final bright spot area 34 is circular, and calculates the radius from the area (number of dots) of the area of ​​the 0th order diffracted light. The terminal 2 draws the bright spot area 34 based on the calculated radius and the center of the bright spot identified above.

[0032] Then, terminal 2 superimposes and displays guiding line 35 for guiding the position of the bright spot (the irradiation position of the zero-order diffracted light) to a predetermined position on hologram section 30 (object) based on the position of the bright spot detected above and the position of hologram section 30. Specifically, terminal 2 draws an arrow-shaped object extending from the center of bright spot area 34 to the center of second rectangular area 33.

[0033] Note that the arrow is an example of the guiding line 35 (object), and the shape of the object corresponding to the guiding line 35 is not limited to an arrow. For example, the terminal 2 may draw a simple straight line.

[0034] The user refers to guiding line 35 and operates terminal 2 so that the center of bright spot region 34 overlaps with second rectangular region 33. When the position of the bright spot overlaps with the target position on the hologram, terminal 2 cuts out the image region corresponding to hologram section 30 from the frame image. Specifically, when the center of bright spot region 34 is located within the coordinate range of second rectangular region 33, terminal 2 executes the cut-out process.

[0035] 8 to 10 are explanatory diagrams relating to the cut-out process of the hologram portion 30. In Fig. 8 to Fig. 10, the cut-out process of the hologram portion 30 is illustrated in detail.

[0036] First, the terminal 2 calculates a vector sAB by multiplying the diagonal line between vertices A and B of the marker 31 by a predetermined magnification (for example, 0.1 times) as shown in Fig. 8. The terminal 2 calculates vertices sA and sB by extending vertices A and B by subtracting or adding the vector sAB to the vertices A and B.

[0037] It should be noted that the expansion of the area (vertices A and B) is an arbitrary process, and it is sufficient if the server 1 can cut out an image area of ​​a size that allows the hologram section 30 to be appropriately recognized.

[0038] Next, terminal 2 calculates vector sAsB connecting vertices sA and sB, and calculates vector V which is 1 / 2 of the calculated vector sAsB, as shown in Fig. 9A. Terminal 2 calculates four vertices S0 to S3 based on the coordinates of midpoint C and the calculated vector V, as shown in Fig. 9B.

[0039] 10, terminal 2 calculates the rotation angle θ of the image from the coordinates of vertex S0 and applies rotation processing to the image. Terminal 2 cuts out the image region that has been rotated, with S0 to S3 as vertices, as an image of hologram section 30.

[0040] Fig. 11 and Fig. 12A and B are explanatory diagrams regarding the authenticity determination process. The terminal 2 transmits the cut-out image to the server 1, which performs an authenticity determination. Fig. 11 illustrates an overview of the authenticity determination process. Fig. 12A and Fig. 12B illustrate how a bright spot region 34 is detected when performing an authenticity determination (Fig. 12A), and how an area based on the center of gravity of the bright spot region 34 is divided into multiple areas (Fig. 12B).

[0041] First, the server 1 converts the image (RGB image) acquired from the terminal 2 into an HSV image represented by hue, saturation, and brightness. The server 1 then detects a circular image area corresponding to the range of the bright spot (the irradiation range of the zeroth-order diffracted light) in a manner substantially similar to that in which the terminal 2 identifies the bright spot area 34. That is, the server 1 detects bright spot dots whose brightness is equal to or greater than a threshold value and whose saturation is equal to or less than a threshold value, and detects a continuous area in which the bright spot dots are continuous. The server 1 detects the bright spot area 34 by setting the center of gravity of the detected continuous area as the center of the bright spot and calculating the radius of the circular area according to the area of ​​the continuous area. As a result, the circular bright spot area 34 is detected as shown in FIG. 12A.

[0042] Next, server 1 divides the area based on the center of gravity of detected bright spot area 34 into multiple areas. Specifically, as shown in Fig. 12B, server 1 divides the area into two areas, with the area above the bright spot as orange detection area 36 and the area below the bright spot as green detection area 37. Server 1 calculates distance L by multiplying the radius of bright spot area 34 by a predetermined magnification (e.g., 1.5 times), and excludes a distance range expanded in the Y direction by distance L from the center of bright spot area 34. Server 1 divides the remaining area into upper and lower areas, with the upper area designated as orange detection area 36 and the lower area designated as green detection area 37.

[0043] The server 1 performs authenticity determination by determining whether or not a predetermined color component is present in each divided area at a rate equal to or greater than a predetermined value.

[0044] Specifically, the server 1 detects pixels of orange and green color components by comparing the hue, saturation, and brightness of the HSV image with respective thresholds, and judges whether the number of detected pixels is equal to or greater than a predetermined value. The server 1 counts, from the orange detection area 36, ​​pixels whose hue is within a predetermined numerical range and whose saturation and brightness are equal to or greater than a predetermined threshold as orange dots. Similarly, the server 1 counts, from the green detection area 37, pixels whose hue is within a predetermined numerical range and whose saturation and brightness are equal to or greater than a predetermined threshold as green dots. The server 1 judges whether the number of dots counted in each area is equal to or greater than a predetermined value. If it is judged that the number of dots in both areas is equal to or greater than the predetermined value, the server 1 judges that the authenticity judgment target object 3 is genuine.

[0045] In the above, the server 1 simply judges whether the number of dots of the target color component is equal to or greater than a predetermined value, but the present embodiment is not limited to this. For example, the server 1 may make a judgment based on the ratio (area ratio) between the area of ​​each detection region and the number of dots (number of pixels).

[0046] Specifically, the server 1 detects the number of orange dots from the orange detection region 36 in the same manner as described above, and calculates the area of ​​the orange detection region 36. The server 1 then determines whether the value (area ratio) obtained by dividing the number of orange dots by the area of ​​the orange detection region 36 is equal to or greater than a predetermined value. The server 1 similarly calculates the area ratio for the green detection region 37, and determines whether the area ratio is equal to or greater than a predetermined value. If the server 1 determines that the area ratio is equal to or greater than the predetermined value in both the orange detection region 36 and the green detection region 37, it determines that the authenticity determination target object 3 is genuine.

[0047] In this way, by making a judgment based on the area ratio, appropriate judgment is possible even if the detection area becomes extremely narrow or the image size changes.

[0048] As described above, the server 1 performs authenticity determination by determining whether or not orange and green color components are present at a ratio equal to or greater than a predetermined value in the orange detection area 36 and the green detection area 37. The server 1 outputs the determination result to the terminal 2, and the terminal 2 displays the determination result.

[0049] In the above, the authenticity was determined by converting the colors that appear as a result of diffraction of the wavelengths in the orange detection area 36 and the green detection area 37 into HSV conversion. However, the authenticity may also be determined based on the ratio of the luminance values ​​of each RGB color rather than the color components in the HSV color space.

[0050] Specifically, the server 1 may perform the authenticity determination by determining whether or not the ratio of the brightness values ​​of the RGB colors of each dot (pixel) in each detection area (orange detection area 36 and green detection area 37) is a predetermined ratio. More specifically, the server 1 may perform the authenticity determination by determining whether or not the number of dots (number of pixels) in which the brightness values ​​of the RGB colors are a predetermined ratio in each detection area is equal to or greater than a predetermined value. Alternatively, the server 1 may perform the authenticity determination by determining whether or not the area ratio obtained by dividing the number of dots in which the brightness values ​​of the RGB colors are a predetermined ratio in each detection area by the area of ​​the detection area is equal to or greater than a predetermined value. The server 1 performs the authenticity determination by detecting the number of dots in which the brightness values ​​of the RGB colors of each dot in the detection area are equal to or greater than a predetermined value, for example, in the orange detection area 36, ​​based on the brightness of each RGB color of each dot in the detection area, where the ratio of the brightness values ​​of R:G:B is approximately 1:0.5±0.1:0±0.1.

[0051] As described above, according to this embodiment, by displaying the guiding line 35 when imaging the hologram section 30, it is possible to guide the bright spot (zeroth order diffracted light) to the correct position, thereby providing ideal assistance in authenticity determination.

[0052] Furthermore, according to this embodiment, the server 1 divides the image of the hologram section 30 into multiple regions and determines whether a predetermined color component is present in each region at a ratio equal to or greater than a predetermined value (or whether the ratio of the brightness values ​​of each RGB color of each dot in each region is a predetermined ratio), thereby enabling automatic authenticity determination.

[0053] 13 is a flowchart showing an example of a processing procedure executed by the authenticity determination system, and the processing contents executed by this system will be described with reference to FIG. The control unit 21 of the terminal 2 starts capturing an image of the hologram unit 30 (object) in accordance with an operation by the user (step S11). The control unit 21 acquires a frame image capturing the image of the hologram unit 30 (step S12).

[0054] The control unit 21 detects the markers 31, which are given in advance to the hologram unit 30, from the frame image (step S13). The control unit 21 also detects the positions of the bright spots (the irradiation positions of the zero-order diffracted light) from the frame image (step S14).

[0055] Based on the detected positions of the marker 31 and the bright spot, the control unit 21 displays, in a superimposed manner, a guiding line 35 (object) for guiding the bright spot to a predetermined position on the hologram unit 30, on the frame image (step S15). Specifically, based on the position of the marker 31, the control unit 21 identifies a first rectangular area 32 surrounding the hologram unit 30 and a second rectangular area 33 to be irradiated with the zeroth-order diffracted light, and displays them in a superimposed manner. Furthermore, based on the saturation and brightness of the frame image, the control unit 21 identifies a bright spot area 34 corresponding to the irradiation range of the zeroth-order diffracted light, and displays them in a superimposed manner. Then, the control unit 21 displays, in a superimposed manner, a guiding line 35 extending from the center of the bright spot area 34 to the center of the second rectangular area 33.

[0056] The control unit 21 determines whether the position of the bright spot (the center of the bright spot area 34) overlaps with a predetermined position (the second rectangular area 33) on the hologram unit 30 (step S16). If it is determined that they do not overlap (S16: NO), the control unit 21 returns the process to step S12.

[0057] If it is determined that there is overlap (S16: YES), the control unit 21 cuts out an image area corresponding to the hologram unit 30 from the frame image (step S17). The control unit 21 transmits the cut-out image to the server 1 (step S18).

[0058] The control unit 11 of the server 1 converts the image of the hologram unit 30 acquired from the terminal 2 into an HSV image (step S19). The control unit 11 detects a circular bright point region 34 based on the saturation and brightness of the converted image (step S20).

[0059] The control unit 11 divides the area excluding the distance range obtained by multiplying the radius of the bright spot area 34 by a predetermined magnification into a plurality of areas (step S21). Specifically, as described above, the control unit 11 divides the area above the bright spot into an orange detection area 36 and a green detection area 37. The control unit 11 determines whether or not a predetermined color component is present in each divided area at a ratio equal to or greater than a predetermined value (step S22). Specifically, the control unit 11 determines whether or not the orange detection area 36 contains orange dots and the green detection area 37 contains green dots at a ratio equal to or greater than a predetermined value.

[0060] The control unit 11 outputs the determination result to the terminal 2 (step S23). The control unit 21 of the terminal 2 displays the determination result output from the server 1 (step S24), and ends the series of processes.

[0061] In the above description, the terminal 2 performs the process up to cutting out the hologram portion 30, and the server 1 performs the authenticity determination, but the present embodiment is not limited to this. For example, the terminal 2 may transmit the entire frame image to the server 1, and the server 1 may perform the image cutting out. Alternatively, the terminal 2 may perform the authenticity determination by itself. In this way, the processing contents executed by the server 1 and the terminal 2 can be appropriately divided and changed, and the present embodiment may also include a case where all the processing is executed by a single computer.

[0062] In addition, in the above, the determination is made from one cut-out image, but the present embodiment is not limited to this. Specifically, the server 1 acquires multiple cut-out images (for example, five) from the terminal 2, and when it is determined that the orange and green color components are present in a ratio equal to or greater than a predetermined value in the majority of the images (or when it is determined that the ratio of the brightness values ​​of each of the RGB colors is a predetermined ratio in the majority of the images), it determines that the object 3 to be subjected to authenticity determination is genuine. In this way, by making a determination using multiple images, it is expected that erroneous determinations can be suppressed.

[0063] As described above, according to the first embodiment, it is possible to favorably assist in authenticity determination.

[0064] (Embodiment 2) In this embodiment, a two-stage determination will be described, that is, a determination made in a state where the zeroth-order diffracted light is irradiated onto the hologram section 30, and a determination made in a state where the zeroth-order diffracted light is not irradiated onto the hologram section 30. Note that the same reference numerals are used to denote contents that overlap with those in the first embodiment, and the description thereof will be omitted.

[0065] Fig. 14 is an explanatory diagram showing an overview of the embodiment 2. The overview of the present embodiment will be described with reference to Fig. 14.

[0066] First, terminal 2 displays first rectangular region 32 and second rectangular region 33 superimposed on the frame image in the same manner as in embodiment 1, guides bright spot region 34 to second rectangular region 33 using guide line 35, and cuts out an image in which zero-order diffracted light is irradiated onto a predetermined position (center) of hologram section 30. Then server 1 divides the image into orange detection region 36 and green detection region 37, and determines whether or not orange and green color components are present in each region at a ratio equal to or greater than a predetermined value.

[0067] In this embodiment, the position of the bright spot is further guided to a position outside the hologram section 30 (upper side in FIG. 14) as shown on the right side of FIG. 14, and a frame image (second image) in which the zeroth-order diffracted light is not irradiated is acquired. Then, by confirming that a predetermined color component (orange in this embodiment) does not exist (is equal to or less than a predetermined value) in the image, it becomes possible to detect a fake that is simply orange at the top and green at the bottom.

[0068] Specifically, terminal 2 first superimposes and displays guiding line 35 for guiding the position of the bright spot (the irradiation position of the zeroth-order diffracted light) to a predetermined position outside hologram section 30. For example, as shown on the right side of Fig. 14, terminal 2 draws first rectangular area 32 in the same manner as in embodiment 1, and draws third rectangular area 38 at a predetermined position outside hologram section 30. Then, terminal 2 draws guiding line 35 extending from the center of bright spot area 34 to third rectangular area 38. This guides the position of the bright spot to the outside of hologram section 30, and an image not irradiated with zeroth-order diffracted light is acquired.

[0069] The server 1 converts the image into an HSV image. The server 1 then judges whether the ratio of a predetermined color component is equal to or less than a predetermined value based on the hue, saturation, and brightness of the converted image. Specifically, the server 1 detects pixels of an orange color component by comparing the hue, saturation, and brightness of the HSV image with respective thresholds, and judges whether the number of detected pixels is equal to or less than a predetermined value. That is, the server 1 counts pixels whose hue is within a predetermined numerical range and whose saturation and brightness are equal to or greater than a predetermined threshold as orange dots, and judges whether the number of counted orange dots is equal to or less than a predetermined value. In this way, the server 1 confirms that the hologram section 30 is not reproduced in orange when the zero-order diffracted light is not irradiated.

[0070] The server 1 judges the authenticity of the authenticity judgment target 3 based on the judgment result when the zeroth-order diffracted light is irradiated to a predetermined position (center) on the hologram section 30 and the judgment result when the zeroth-order diffracted light is not irradiated to the hologram section 30. That is, the server 1 judges that the authenticity judgment target 3 is genuine when it judges that the orange and green color components are present in the orange detection area 36 and the green detection area 37 at a ratio equal to or greater than a predetermined value in the former and judges that the ratio of the orange color component is equal to or less than a predetermined value in the latter.

[0071] As in the first embodiment, the server 1 may make a judgment based on the luminance of each RGB color, instead of the color in the HSV color space. Specifically, when the bright spot region 34 overlaps the second rectangular region 33, the server 1 judges whether the ratio of the luminance values ​​of each RGB color of each dot (pixel) in the orange detection region 36 and the green detection region 37 is a predetermined ratio, and when the bright spot region 34 overlaps the third rectangular region 38, the server 1 judges whether the ratio of the luminance values ​​of each RGB color of each dot is a predetermined ratio. The server 1 may then judge the authenticity according to the two judgment results.

[0072] 15 is a flowchart showing the process steps executed by the authenticity determining system according to embodiment 2. After executing the process of step S18, the terminal 2 executes the following process. The control unit 21 of the terminal 2 acquires a frame image obtained by capturing an image of the hologram unit 30 (object) (step S201). The control unit 21 detects the position of the marker 31 from the frame image (step S202). The control unit 21 also detects the position of the bright spot (the irradiation position of the zero-order diffracted light) from the frame image (step S203).

[0073] Based on the position of the marker 31 detected in step S202 and the position of the bright spot detected in step S203, the control unit 21 displays, in a superimposed manner, on the frame image, guiding line 35 for guiding the position of the bright spot to a predetermined position outside the hologram unit 30 (step S204). That is, the control unit 21 displays, in a superimposed manner, a third rectangular area 38 located outside the hologram unit 30 according to the position of the marker 31, and displays, in a superimposed manner, guiding line 35 connecting the center of the third rectangular area 38 and the center of the bright spot area 34. By guiding the bright spot area 34 to the third rectangular area 38 outside the hologram unit 30, the control unit 21 acquires a frame image (second image) in which the hologram unit 30 is not irradiated with the zero-order diffracted light.

[0074] The control unit 21 determines whether or not the position of the bright spot (the center of the bright spot area 34) overlaps with a predetermined position (third rectangular area 38) outside the hologram unit 30 (step S205). If it is determined that they do not overlap (S205: NO), the control unit 21 returns the process to step S201.

[0075] If it is determined that there is overlap (S205: YES), the control unit 21 cuts out an image area corresponding to the hologram unit 30 from the frame image (step S206). The control unit 21 transmits the cut-out image to the server 1 (step S207).

[0076] The control unit 11 of the server 1 converts the image acquired from the terminal 2 into an HSV image (step S208). The control unit 11 determines whether the ratio of a predetermined color component is equal to or less than a predetermined value based on the hue, saturation, and brightness of the converted image (step S209). Specifically, the control unit 11 determines whether the number of orange dots (pixels) is equal to or less than a certain number.

[0077] The control unit 11 judges the authenticity of the authenticity judgment target 3 based on the judgment result in step S22 and the judgment result in step S209 (step S210). That is, the control unit 11 judges the authenticity based on the judgment result of judging whether or not a predetermined color component exists at a rate equal to or greater than a predetermined value from an image in which the zeroth-order diffracted light is irradiated on a predetermined position (center) on the hologram unit 30, and the judgment result of judging whether or not the rate of the predetermined color component is equal to or less than a predetermined value from an image in which the zeroth-order diffracted light is not irradiated on the hologram unit 30. When the control unit 11 judges that the predetermined color component exists at a rate equal to or greater than a predetermined value in the former and judges that the rate of the predetermined color component is equal to or less than a predetermined value in the latter, the control unit 11 judges that the authenticity judgment target 3 is genuine.

[0078] The control unit 11 outputs the determination result to the terminal 2 (step S211). The control unit 21 of the terminal 2 displays the determination result (step S212), and ends the series of processes.

[0079] As described above, according to this embodiment 2, it is expected that the accuracy of authenticity determination can be improved by performing a two-stage determination: a state in which the zeroth-order diffracted light is irradiated onto the hologram section 30, and a state in which the zeroth-order diffracted light is not irradiated onto the hologram section 30.

[0080] (Variation 1) In the first embodiment, a hologram in which orange and green wavelengths are diffracted (a Lippmann hologram in which multiple colors are diffracted) is taken as an example of the hologram to be authenticated, but the present embodiment is not limited to this. For example, a hologram in which a single color is diffracted may be used.

[0081] When a monochromatic hologram is used, the hologram cannot be seen even if the bright spot is aligned with the center of the hologram section 30, but a diffracted hologram can be seen when the bright spot is moved outward from the center of the hologram section 30. Therefore, terminal 2 displays a rectangular area at a predetermined position outside the hologram section 30 as the target position of the bright spot, and superimposes and displays guiding line 35 (object) connecting the rectangular area and bright spot area 34, thereby guiding the position of the bright spot to the outside of the hologram section 30.

[0082] When the position of the bright spot overlaps with a predetermined position outside the hologram section 30, the terminal 2 cuts out the image area corresponding to the hologram section 30 and transmits it to the server 1. The server 1 determines whether or not a predetermined color component is present in the image area acquired from the terminal 2 at a ratio equal to or greater than a predetermined value, thereby determining the authenticity. Alternatively, the server 1 determines whether or not the ratio of the brightness values ​​of each RGB color of each dot (pixel) in the acquired image area is a predetermined ratio, thereby determining the authenticity.

[0083] In this way, a monochromatic hologram may be used as the hologram.

[0084] (Variation 2) Not only a single-color hologram, but also a hologram that appears to diffract into two or more colors (multiple colors) may be used. In this case, as in the above, terminal 2 displays guiding lines 35 for guiding the position of the luminance to a predetermined position superimposed on the captured image. When the position of the bright point overlaps with the predetermined position, server 1 determines whether each color component is present in the image area corresponding to hologram section 30 at a ratio equal to or greater than a predetermined value (or determines whether the ratio of the luminance values ​​of each RGB color is a predetermined ratio) to determine authenticity.

[0085] (Variation 3) A diffraction grating is also an optical structure capable of guiding a bright spot to determine authenticity. In this case, as in the first embodiment, the terminal 2 superimposes guiding lines 35 on the captured image to guide the position of the bright spot (specularly reflected light) to a predetermined position on the diffraction grating, and guides the bright spot to a position on the diffraction grating. The server 1 can determine whether a predetermined diffracted light exists in a periodic range according to the direction and pitch of the diffraction grating with the zeroth-order diffracted light as the center (whether a predetermined color component exists at a predetermined ratio, or whether dots (pixels) with a luminance value equal to or greater than a predetermined value exist periodically), thereby determining whether the diffraction grating is genuine or not.

[0086] The embodiments disclosed herein are illustrative in all respects and should not be considered as limiting. The scope of the present invention is defined by the claims, not by the above meaning, and is intended to include all modifications within the scope and meaning equivalent to the claims.

[0087] The matters described in each embodiment can be combined with each other. In addition, the independent claims and dependent claims described in the claims can be combined with each other in any and all combinations regardless of the citation format. Furthermore, the claims use a format in which a claim cites two or more other claims (multi-claim format), but this is not limited to this. They may also be written using a format in which a multiple claim cites at least one other multiple claim (multi-multi claim). [Explanation of symbols]

[0088] 1 Server 11 Control section 12 Main memory 13. Communications Department 14 Auxiliary storage P1 Program 2. Terminal 21 Control section 22 Main memory 23 Communications Department 24 Display 25 Input section 26 Imaging unit 27 Light source 28 Auxiliary storage P2 Program 3. Items to be verified for authenticity 30 Hologram Section 31 Marker 32 First rectangular area 33 Second rectangular area 34 Bright spot area 35 Induction Wire 36 Orange detection area 37 Green Detection Area 38 Third rectangular area

Claims

1. Acquire an image of the object illuminated with light; Detecting the position of the object from the image; Detecting an irradiation position of the zeroth order diffracted light from the image; According to the detected position of the object and the irradiation position of the zeroth-order diffracted light, an object for guiding the irradiation position of the zeroth-order diffracted light to a predetermined position on the object is superimposed on the image and displayed. A program that causes a computer to carry out processing.

2. When the irradiation position of the zeroth-order diffracted light overlaps with the predetermined position, an image area corresponding to the object is cut out from the image. The program according to claim 1.

3. Dividing the cut-out image area into a plurality of areas based on the center of gravity of the irradiation range of the zeroth-order diffracted light; It is determined whether a predetermined color component is present in each divided area at a rate equal to or greater than a predetermined value. The program according to claim 2.

4. Detecting pixels of a predetermined color component from the divided regions; It is determined whether the number of detected pixels is equal to or greater than a predetermined value. The program according to claim 3.

5. Detecting pixels of a predetermined color component from the divided regions; It is determined whether the value obtained by dividing the number of detected pixels by the area of ​​the divided region is equal to or greater than a predetermined value. The program according to claim 3.

6. Dividing the cut-out image area into a plurality of areas based on the center of gravity of the irradiation range of the zeroth-order diffracted light; In each divided region, it is determined whether the ratio of the luminance values ​​of each of the RGB colors of each pixel is a predetermined ratio. The program according to claim 2.

7. The position of the object is detected by detecting a marker attached to the object from the image. The program according to claim 1.

8. Based on the detected position of the marker, a first rectangular area surrounding the object and a second rectangular area to be irradiated with the zero-order diffracted light are specified; Objects respectively representing the first rectangular area and the second rectangular area are displayed superimposed on the image. The program according to claim 7.

9. Identifying an image area from the image that corresponds to an irradiation range of the zeroth order diffracted light; An object representing the specified image area is displayed superimposed on the image. The program according to claim 1.

10. When the irradiation position of the zeroth-order diffracted light overlaps with the predetermined position, an object for guiding the irradiation position of the zeroth-order diffracted light to a position outside the object is displayed by being superimposed on the image. The program according to claim 1.

11. When the irradiation position of the zeroth-order diffracted light overlaps with the outer position, an image area corresponding to the object is cut out from the image; It is determined whether the ratio of a predetermined color component in the cut-out image region is equal to or less than a predetermined value or equal to or more than a predetermined value. The program according to claim 10.

12. When the irradiation position of the zeroth-order diffracted light overlaps with the outer position, an image area corresponding to the object is cut out from the image; It is determined whether the ratio of the luminance values ​​of the RGB colors of each pixel in the cut-out image region is a predetermined ratio. The program according to claim 10.

13. Acquire an image of the object illuminated with light; Detecting the position of the object from the image; Detecting an irradiation position of the zeroth order diffracted light from the image; According to the detected position of the object and the irradiation position of the zeroth-order diffracted light, an object for guiding the irradiation position of the zeroth-order diffracted light to a predetermined position on the object is superimposed on the image and displayed. An information processing method in which processing is performed by a computer.

14. An information processing device including a control unit, The control unit: Acquire an image of the object illuminated with light; Detecting the position of the object from the image; Detecting an irradiation position of the zeroth order diffracted light from the image; According to the detected position of the object and the irradiation position of the zeroth-order diffracted light, an object for guiding the irradiation position of the zeroth-order diffracted light to a predetermined position on the object is superimposed on the image and displayed. Information processing device.

15. Acquire an image of the object illuminated with light; Detecting the position of the object from the image; Detecting an irradiation position of the zeroth order diffracted light from the image; An object for guiding the irradiation position of the zeroth-order diffracted light to a predetermined position according to the detected position of the object and the irradiation position of the zeroth-order diffracted light, the object connecting the irradiation position of the zeroth-order diffracted light and the predetermined position is displayed by being superimposed on the image. A program that causes a computer to carry out processing.

Images