Specific processing management system, specific processing management method, and program

Abstract

This specific processing management system comprises: a registration information storage unit that stores registration information in which an object image obtained by imaging an object to be identified is associated with status information indicating whether specific processing has been processed or not as the status of the specific processing with respect the object to be identified; a feature amount determination unit that, in response to a notification of the object image together with a processing specification that specifies whether or not to perform the specific processing, determines whether or not a feature amount extracted from the notified object image is equal to a feature amount extracted from the object image stored in the registration information storage unit; a registration determination unit that determines whether or not the notified object image is to be subjected to duplication processing in the specific processing in accordance with the determination result made by the feature amount determination unit; and an output unit that outputs the determination result made by the registration determination unit.

Description

Specific processing management system, specific processing management method, and program

[0001] The present invention relates to a specific process management system, a specific process management method, and a program. This application claims priority to Japanese Patent Application No. 2024-106960, filed on July 2, 2024, the contents of which are incorporated herein by reference.

[0002] In order to promote sales of products, campaigns are sometimes conducted in which product purchasers can enter prize draws, etc. For example, Patent Document 1 discloses a prize draw entry system in which product purchasers can enter prize draws without reading a barcode or the like on a sticker attached to the product.

[0003] Japanese Patent Application Publication No. 2023-117565

[0004] However, in Patent Document 1, only the specific process of applying to a campaign is managed. Rather than simply managing applications, if it were possible to save the barcodes and other items that are the subject of the application before applying, it would be easier to accumulate application items until the application conditions are met, improving convenience. This improved convenience can liven up campaigns and lead to increased sales.

[0005] The present invention has been made based on the above-mentioned problems, and aims to provide a specific processing management system, a specific processing management method, and a program that can improve the convenience of users who use specific processing such as applying for campaigns.

[0006] The specific processing management system of the present invention comprises a registration information storage unit that stores registration information that associates a target image of an identification target with status information that indicates whether the status of the specific processing for the identification target is processed or unprocessed; a feature determination unit that, in response to the target image being notified along with a processing specification that specifies whether or not the specific processing is to be performed, determines whether a feature extracted from the notified target image is identical to a feature extracted from the target image stored in the registration information storage unit; a registration determination unit that, in response to the determination result by the feature determination unit, reads out the registration information corresponding to the target image that is determined to have the same feature from the registration information storage unit, and determines whether or not the notified target image should be subject to overlapping processing in the specific processing in accordance with the relationship between the status information set in the read registration information and the processing specification; and an output unit that outputs the determination result by the registration determination unit.

[0007] The specific processing management method of the present invention is a specific processing management method performed by a computer used in a specific processing management system, in which a registration information storage unit stores registration information that corresponds to a target image of an identification target and status information that indicates whether the status of the specific processing for the identification target is processed or unprocessed, and a feature determination unit, in response to notification of the target image along with a processing specification that specifies whether or not to perform the specific processing, determines whether the feature extracted from the notified target image is identical to the feature extracted from the target image stored in the registration information storage unit, in response to the determination result by the feature determination unit, reads out from the registration information storage unit the registration information corresponding to the target image whose feature is determined to be identical, and determines whether or not the notified target image should be subject to overlapping processing in the specific processing in response to the relationship between the status information set in the read registration information and the processing specification, and an output unit outputs the determination result by the registration determination unit.

[0008] The program of the present invention causes a computer used in a specific processing management system to store registration information that associates a target image of an identification target with status information indicating whether the status of the specific processing for the identification target has been processed or not, and in response to notification of the target image along with a processing specification specifying whether or not the specific processing is to be performed, performs a feature determination process to determine whether or not a feature extracted from the notified target image is identical to a feature extracted from the target image stored in the registration information, reads out the registration information corresponding to the target image whose feature is determined to be identical in accordance with the determination result of the feature determination process, performs a registration determination process to determine whether or not the notified target image should be subject to overlapping processing in the specific processing in accordance with the relationship between the status information set in the read registration information and the processing specification, and outputs the determination result of the registration determination process.

[0009] According to the present invention, it is possible to improve the convenience for users who use specific processes such as applying for campaigns.

[0010] 1 is a block diagram showing an example of the configuration of a campaign management system of an embodiment; FIG. 2 is a diagram showing an example of a target image of the embodiment; FIG. 3 is a diagram showing an example of the configuration of registration information of the embodiment; FIG. 4 is a sequence diagram showing the flow of processing performed by the campaign management system of the embodiment; FIG. 5 is a flow diagram showing the flow of processing performed by the campaign management system of the embodiment; FIG. 6 is a flow diagram showing the flow of processing performed by the campaign management system of the embodiment;

[0011] Hereinafter, a campaign management system 1 and a campaign management device 10 according to an embodiment will be described with reference to the drawings.

[0012] (Regarding the Campaign Management System 1) The campaign management system 1 will be described with reference to FIG. 1. FIG. 1 is a block diagram showing an example configuration of the campaign management system 1 according to an embodiment. As shown in FIG. 1, the campaign management system 1 includes, for example, a campaign management device 10, a user terminal 20, and a campaign server 30. The campaign management device 10, the user terminal 20, and the campaign server 30 are communicatively connected via a communication network NW such as the Internet. Note that while the example in this figure shows a case where the campaign management device 10 and the campaign server 30 are separate devices, in the campaign management system 1, the campaign management device 10 may also have the functions of the campaign server 30. In this case, the campaign management device 10 and the campaign server 30 may be integrated.

[0013] The campaign server 30 is a web server that provides a website for conducting campaigns. Here, a "campaign" refers to an activity related to a product, such as advertising, publicity, and sales promotion of the product, or promoting recycling. For example, a "campaign" is a service in which purchasers of the product or users who recycle the product can receive benefits such as coupons or points. In this embodiment, a campaign is entered by submitting an image of a target product symbol (target image TG, described later). The product symbol may be set arbitrarily depending on the campaign. For example, a specific design printed on the receipt issued at the time of purchase, the product, or the product packaging, such as a JAN code, a one-dimensional barcode, a two-dimensional code, or a logo indicating the product name or company name, can be used. Here, the receipt and product packaging issued at the time of purchase are examples of "product accessories." Although the above example illustrates a case in which a product symbol is printed, this is not limiting. The product symbol may be applied to the object (the product or product accessories) by some other process, such as printing, laser ablation, or foil stamping.

[0014] 2 and 3 are diagrams showing examples of target images according to the embodiment. Fig. 2 shows an example in which a target image TG1 (TG) is an image of a receipt issued when a product is purchased. Fig. 3 shows an example in which a target image TG2 (TG) is an image of a paper coupon issued at a store or the like, and the target image TG2 is displayed on the user terminal 20.

[0015] Returning to the explanation of FIG. 1 , the user terminal 20 is a computer operated by a user who uses the campaign management system 1. For example, a smartphone, a tablet terminal, or a PC (Personal Computer) can be used as the user terminal 20. The user terminal 20 captures a target image TG in response to an imaging operation by the user, and transmits the captured target image TG to the campaign server 30.

[0016] The campaign management device 10 is a computer that manages a campaign. The campaign management device 10 performs image analysis on the target image TG notified (transmitted) from the user terminal 20 when applying for a campaign, and checks whether it corresponds to a duplicate application. A duplicate application here refers to multiple applications being made by reusing a product that has already been applied for (a symbol of a product that has already been photographed as the target image TG and applied for in the campaign).

[0017] Generally, there are various printing environments in which product symbols are printed, such as the vibration of the printing device, the printing speed, the speed at which the ink is applied, the ink material, the room temperature and humidity at the time of printing, etc. Due to differences in these printing environments, even if symbols look the same to the human eye, the characteristic quantities such as the degree of ink fading or chipping will differ from one product to another.

[0018] Using this property, the campaign management device 10 extracts features from the target image TG and uses the extracted features to identify the individual symbols captured in the target image TG. If the features extracted from the target image TG are identical to the features extracted from an image (an image of a product symbol) that has already been submitted, the campaign management device 10 determines that the application using the target image TG is a duplicate application. On the other hand, if the features extracted from the target image TG are not identical to the features of an image that has already been submitted, the campaign management device 10 determines that the application using the target image TG is not a duplicate application. If it is confirmed that the application is not a duplicate application (if the campaign management device 10 determines that the application using the target image TG is not a duplicate application), the campaign management device 10 notifies the campaign server 30 of the target image TG and submits the application to the campaign. Here, any method can be used to determine whether the features are identical. For example, the campaign management device 10 may determine that the feature quantities extracted from the target image TG and the feature quantities extracted from the submitted image are the same when the similarity between them is equal to or greater than a threshold value. In this case, more specifically, the feature quantities extracted from both images are mapped to a feature vector space, and the campaign management device 10 calculates the similarity according to the inter-vector distance, which is the distance to each feature quantity in the feature vector space. The campaign management device 10 calculates the similarity so that the similarity is greater when the distance is short. The campaign management device 10 may determine that the feature quantities are not similar, i.e., that the feature quantities are not the same, when the inter-vector distance is large and the feature quantities are far apart. On the other hand, the campaign management device 10 may determine that the feature quantities are similar, i.e., that the feature quantities are the same, when the inter-vector distance is small and the feature quantities are close.

[0019] The campaign management device 10 also supports improving the convenience of users when applying for campaigns.

[0020] Generally, campaigns require multiple purchases of products to fulfill entry requirements. For example, some campaigns require users to collect five barcodes from campaign stickers attached to products in order to enter. In other cases, campaigns offer multiple levels of rewards, with the more products purchased, the higher the reward level. For example, a campaign may offer a 200-yen gift certificate as a reward for entrants who submit an entry using a receipt showing a purchase of a target product worth between 400 yen and 800 yen. In the same campaign, a 500-yen gift certificate as a higher-grade reward for entrants who submit an entry using a receipt showing a purchase of a target product worth 800 yen or more. In such campaigns, users typically save and accumulate entries until they fulfill the entry requirements or reach the conditions for a higher-grade reward. However, it is cumbersome and time-consuming for users to retain campaign stickers and receipts attached to previously purchased products. For example, since it often takes time to fulfill the application requirements, it is possible that the collected stickers or receipts may be lost or accidentally discarded, making it impossible to apply.

[0021] To address this issue, the present embodiment ensures that application targets are reliably saved without requiring the user's effort. Specifically, the campaign management device 10 is configured to register target images TG. Specifically, when the target images TG are notified to the campaign management device 10 from the user terminal 20 along with a process specification specifying whether to "apply" or "only register," the campaign management device 10 responds by either submitting an application using the target images TG or only registering the target images TG (without submitting an application), depending on the process specification. The campaign management device 10 then accepts applications from the user terminal 20 specifying one or more registered target images TG. This allows the campaign management system 1 of the present embodiment to register and save target images TG before application. This allows the user to save target images TG until application conditions are met, or until application conditions for a higher-grade reward are met, making it easy to apply once the target images TG are collected. The configuration of the campaign management device 10 is described in detail below.

[0022] (Regarding the campaign management device 10) As shown in FIG. 1, the campaign management device 10 includes, for example, an acquisition unit 101, a feature determination unit 102, a registration determination unit 103, a registration unit 104, a management unit 105, an output unit 106, and a registration information storage unit 107.

[0023] The registration information storage unit 107 stores registration information. The registration information is information that associates a target image TG with status information. The status information is information that indicates the status of an application for a campaign, and includes at least information that indicates whether it is "processed" or "unprocessed." "Unprocessed" indicates that the image has not yet been applied for, but has only been registered and saved. "Processed" indicates that the image has already been used for an application.

[0024] FIG. 4 is a diagram illustrating an example of the configuration of registered information according to an embodiment. FIG. 4 illustrates, as registered information, information corresponding to each of items such as an image ID, image information, feature amount, product information, duplication determination, status information, or unique code. The image ID is identification information for identifying the target image TG. The image information is image information of the target image TG identified by the image ID. The feature amount is information indicating feature amounts extracted from the target image TG. The feature amount is information indicating printing characteristics of the product symbol captured in the target image TG, such as information indicating the linearity, contrast, shape, placement position, or size of the symbol's edge and outline. The product information is information indicating attributes of the product corresponding to the target image TG, such as the product's manufacturing date, the product's expiration date (if the product is food), or information indicating whether the product is eligible for a campaign. The duplicate determination is information indicating the result of determining whether the product symbol corresponding to the target image TG has been used in a duplicate application. This information indicates either that the image is being used for a first application (not a duplicate application) or that the product symbol used in a previous application has been re-imaged (a duplicate application). The status information is information indicating the status of the application, indicating either “unprocessed” or “processed.” Note that the application status may include statuses other than “unprocessed” and “processed.” For example, it may include a status indicating the process of processing, such as “preparing for registration” or “preparing for application.” Alternatively, it may indicate whether the application conditions have been met but the application has not yet been submitted, or whether the application conditions have not been met and the application has not yet been submitted. If the application conditions have not been met, it may also indicate the number of additional product purchases required to fulfill the application conditions. The status information may also include a status indicating the urgency of the application based on the number of days remaining until the application deadline. The unique code is a unique code issued in correspondence with the target image TG. For example, a unique code is issued if it is determined that the target image TG is not a duplicate application. This unique code is notified to the user terminal 20, for example.For example, when submitting an application specifying one or more registered target images TG, the user terminal 20 can use the unique code as information specifying the target image TG.

[0025] Returning to the description of FIG. 1 , the acquisition unit 101 acquires various information. For example, the acquisition unit 101 acquires a target image TG notified from the user terminal 20. In this embodiment, the user terminal 20 notifies the campaign management device 10 of the target image TG along with a processing specification. Also, in this embodiment, when an application is made by designating a registered target image TG, the registered target image TG or a unique code associated with the registered target image TG is notified to the campaign management device 10 along with the processing specification. The acquisition unit 101 acquires these notifications from the user terminal 20 via a communication unit (not shown) of the campaign management device 10. The acquisition unit 101 outputs the acquired target image TG to the feature amount determination unit 102. Also, the acquisition unit 101 outputs a processing specification corresponding to the acquired target image TG to the registration determination unit 103. Also, when a unique code is notified from the user terminal 20, the acquisition unit 101 outputs the unique code and the processing specification notified together with the unique code to the registration determination unit 103.

[0026] The feature amount determination unit 102 determines whether the feature amount extracted from the target image TG is the same as the feature amount extracted from the target image TG stored in the registration information storage unit 107. For example, the feature amount determination unit 102 extracts the feature amount from the target image TG notified by the acquisition unit 101. The feature amount determination unit 102 extracts the feature amount using an image processing technique. Based on the extracted feature amount, the feature amount determination unit 102 refers to the registration information storage unit 107 and determines whether the extracted feature amount is the same as the feature amount extracted from the target image TG stored in the registration information storage unit 107. The feature amount determination unit 102 can determine whether the feature amounts are the same using a technique such as pattern matching, for example. The feature amount determination unit 102 outputs the determination result to the registration determination unit 103. The feature amount determination unit 102 may use a machine learning algorithm, including deep learning, to extract a feature vector as a feature from the target image TG and calculate (estimate) the similarity between the extracted feature vector and a feature vector stored in the registered information storage unit 107 to determine whether the feature vectors (feature amounts) are identical. For example, the feature amount determination unit 102 may use a trained model to extract a feature vector from the target image TG and calculate (estimate) the similarity between the extracted feature vector and a feature vector stored in the registered information storage unit 107 to determine whether the feature vectors (feature amounts) are identical. The trained model may be generated by using training data indicating the correspondence between the target image TG and the feature vectors to train the correspondence between the target image TG and the feature vectors in advance using a learning device. The trained model may be stored in the campaign management device 10 or provided in an external device, such as an external server, via the network NW. In this case, minute dot defects and noise patterns on the symbol-printed surface can be extracted with higher accuracy, thereby further improving the accuracy of counterfeit detection and duplication determination.

[0027] The registration determination unit 103 determines whether or not the target image TG is to be a subject of a duplicate application. The registration determination unit 103 acquires the determination result by the feature amount determination unit 102. The registration determination unit 103 determines whether or not the target image TG is to be a subject of a duplicate application, based on the acquired determination result.

[0028] If the acquired determination result indicates "identical," the registration determination unit 103 reads out status information set for the target image TG determined to have the same feature amount from the registration information stored in the registration information storage unit 107. The registration determination unit 103 determines whether or not to treat the target image TG notified by the user terminal 20 as a target for duplicate application, depending on the relationship between the read-out status information and the processing specification notified by the user terminal 20.

[0029] If the determination result indicates "identical" and the status information read from the registration information storage unit 107 is "processed", the registration determination unit 103 treats the target image TG notified by the user terminal 20 as a target for duplicate application, regardless of whether the processing designation notified by the user terminal 20 is "apply" or "register only".

[0030] In addition, if the judgment result indicates "identical," the status information read from the registration information storage unit 107 is "unprocessed," and the processing specification notified from the user terminal 20 specifies "registration only," the registration judgment unit 103 treats the target image TG notified from the user terminal 20 as a target for duplicate application.

[0031] If the determination result indicates "identical," the registration determination unit 103 determines that the target image TG notified from the user terminal 20 should not be subject to duplicate application and changes the read status information to "processed" if the status information read from the registration information storage unit 107 is "unprocessed" and the processing specification notified from the user terminal 20 specifies "apply." The registration unit 104 changes the status information of the registration information stored in the registration information storage unit 107 to "processed" according to the determination result by the registration determination unit 103.

[0032] In this case, the registration unit 104 may store the target image TG notified from the user terminal 20 in the registration information storage unit 107. In this case, multiple target images TG are stored for the same image ID. If the target image TG (first target image) originally stored as registration information and the target image TG (second target image) notified from the user terminal 20 this time are captured under different imaging conditions, it is possible to calculate feature amounts with higher accuracy from feature amounts extracted from each image.

[0033] If the determination result indicates "non-identical," the registration determination unit 103 does not treat the target image TG notified from the user terminal 20 as a target for duplicate application, regardless of whether the process designation notified from the user terminal 20 is "apply" or "register only." In this case, the registration determination unit 103 determines to generate registration information that associates the target image TG notified from the user terminal 20 with status information corresponding to the process designation, and to store the generated registration information in the registration information storage unit 107. The registration unit 104 generates registration information in accordance with the determination result by the registration determination unit 103, and stores the generated registration information in the registration information storage unit 107.

[0034] When the registration determination unit 103 receives a unique code together with a processing specification from the user terminal 20, it reads out the status information set for the target image TG corresponding to the unique code from the registration information storage unit 107. If the read status information is set to "unprocessed," the registration determination unit 103 determines to change the status information in accordance with the content specified in the notified processing specification. In accordance with the determination result by the registration determination unit 103, the registration unit 104 changes the status information of the registration information stored in the registration information storage unit 107 to "processed."

[0035] In addition, if the judgment result indicates "same," the registration judgment unit 103 determines that the target image TG notified by the user terminal 20 is subject to duplicate application if the status information read from the registration information storage unit 107 is "unprocessed" and the processing specification notified from the user terminal 20 specifies "registration only," and determines that the target image TG that has already been registered has been registered again because the user forgot that they had registered it, and determines that the read status information should remain "unprocessed."

[0036] In this case, the registration determination unit 103 may store the target image TG notified from the user terminal 20 in the registration information storage unit 107. In this case, multiple target images TG are stored for the same image ID. Therefore, it is possible to calculate feature amounts with higher accuracy from multiple images of the same symbol.

[0037] The registration unit 104 issues a unique code associated with the target image TG. When the registration determination unit 103 determines that the target image TG notified from the user terminal 20 is not eligible for duplicate application, the registration unit 104 issues a unique code associated with the target image TG. The registration unit 104 stores the issued unique code in the registration information storage unit 107.

[0038] The management unit 105 manages the registered target images TG. The management unit 105 manages information related to campaigns corresponding to the target images TG, which are stored as registration information in the registration information storage unit 107. For example, the management unit 105 manages the application deadline for a campaign corresponding to the registered target image TG, and when the period from the current date to the application deadline falls below a threshold value (e.g., 10 days), the management unit 105 notifies the user terminal 20 via the output unit 106, which will be described later, that the application deadline is approaching. In this case, a text message such as "The application deadline is approaching" is displayed on the user terminal 20. In this case, the management unit 105 may notify the user terminal 20 of the conditions for satisfying the application conditions. In this case, a text message such as "The application deadline is approaching. If you purchase one more target product, you can apply for the campaign by combining it with the registered target image TG" is displayed on the user terminal 20.

[0039] The output unit 106 outputs the determination result by the registration determination unit 103. For example, if the registration determination unit 103 determines that the target image TG notified from the user terminal 20 is a target for duplicate application, the output unit 106 transmits that information to the user terminal 20. In this case, the user terminal 20 displays a text message such as "You have already applied." Furthermore, if the registration determination unit 103 determines that the status information of the target image TG stored in the registration information storage unit 107 as registration information should be changed to "Processed," the output unit 106 notifies the campaign server 30 of the target image TG and applies to the campaign. Alternatively, if the registration determination unit 103 determines that the target image TG notified from the user terminal 20 should be applied for, the output unit 106 notifies the campaign server 30 of the target image TG, applies to the campaign, and transmits that information to the user terminal 20. In this case, the user terminal 20 displays a text message such as "You have applied." Furthermore, when a unique code is issued by the registration unit 104, the output unit 106 transmits the unique code to the user terminal 20. In this case, a text such as "Registration completed. The code of the registered target image TG will be notified" is displayed on the user terminal 20.

[0040] The storage unit (including the registration information storage unit 107) of the campaign management device 10 is configured by a storage medium such as a hard disk drive (HDD), a flash memory, an electrically erasable programmable read-only memory (EEPROM), a random access read / write memory (RAM), or a read-only memory (ROM), or a combination of these. The storage unit of the campaign management device 10 stores programs for executing various processes to realize the functions of the campaign management device 10, and temporary data used when performing the various processes.

[0041] The functional units (including the acquisition unit 101, the feature amount determination unit 102, the registration determination unit 103, the registration unit 104, the management unit 105, and the output unit 106) of the campaign management device 10 are realized by causing a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit) provided as hardware in the campaign management device 10 to execute a program stored in a storage unit provided in the campaign management device 10. The functional units of the campaign management device 10 may also be realized by causing the CPU and GPU provided as hardware in the campaign management device 10 to execute a program stored in a storage unit provided in the campaign management device 10.

[0042] The flow of processing performed by the campaign management device 10 of the embodiment will be described with reference to FIGS.

[0043] FIG. 5 is a sequence diagram illustrating the flow of processing performed by the campaign management device 10. First, the user terminal 20 captures a target image TG (step S10). The user terminal 20 transmits the captured target image TG to the campaign management device 10 along with a processing instruction (specifying whether to "apply" or "only register") (step S11). Upon receiving information (the target image TG notified along with the processing instruction) from the user terminal 20, the campaign management device 10 extracts features from the received target image TG (step S12). The campaign management device 10 determines whether an image having the same features as the extracted features is already stored in the registration information storage unit 107 (step S13). If an image is already stored in the registration information storage unit 107, the campaign management device 10 performs processing indicated by symbol A. The processing indicated by symbol A will be described later. If no image having the same feature as the extracted feature is stored in the registration information storage unit 107, the campaign management device 10 creates new registration information corresponding to the target image TG notified from the user terminal 20 and stores the created registration information in the registration information storage unit 107 (step S14). The campaign management device 10 determines whether the process designation corresponding to the registration information created in step S14 designates "registration only" (step S15). If "registration only" is designated, the campaign management device 10 performs the process indicated by symbol B. The process indicated by symbol B will be described later. If "registration only" is not designated, that is, if an application is designated, the campaign management device 10 notifies the campaign server 30 of the application (step S16). For example, the campaign management device 10 notifies the application by transmitting the target image TG to the campaign server 30. Here, the campaign management device 10 may notify the campaign server 30 of evidence (e.g., feature) indicating that the application using the target image TG is not a duplicate application. When the campaign server 30 receives the notification from the campaign management device 10, it performs processing according to the application (step S17). The processing shown in step S17 will be described later.

[0044] 6 is a flow diagram showing the flow of the process indicated by symbol A in FIG. 5 . In step S13, if an image having the same feature values ​​as those of the target image TG notified from the user terminal 20 is already stored in the registered information storage unit 107, the campaign management device 10 reads the registered information corresponding to the image having the same feature values ​​from the registered information storage unit 107 (step S130). The campaign management device 10 determines whether the status information in the read registered information is “unprocessed” or “processed” (step S131). If the status information is “unprocessed,” the campaign management device 10 determines whether the process instruction notified from the user terminal 20 specifies “apply” (step S132). If the process instruction notified from the user terminal 20 specifies “apply,” the campaign management device 10 changes the status of the registered information read in step S130 from “unprocessed” to “processed,” stores the changed status in the registered information storage unit 107 (step S133), and proceeds to the process shown in step S16.

[0045] On the other hand, if the processing specification notified from the user terminal 20 in step S132 specifies "registration only," the campaign management device 10 determines that the target image TG notified from the user terminal 20 is a target for duplicate registration (step S134). The campaign management device 10 notifies the user terminal 20 of the determination result (step S135).

[0046] Furthermore, if the status information in the read registration information is "processed" in step S131, the campaign management device 10 determines whether the process specification notified from the user terminal 20 specifies "apply" (step S136). If the process specification notified from the user terminal 20 specifies "apply," the campaign management device 10 determines that the target image TG notified from the user terminal 20 is a target for duplicate application (step S137). The campaign management device 10 performs the process shown in step S135 and notifies the user terminal 20 of the determination result.

[0047] 7 is a flow diagram showing the flow of the process indicated by symbol B in FIG. 5. If the process designation notified from the user terminal 20 in step S15 designates "registration only," the campaign management device 10 issues a unique code (step S150). The campaign management device 10 associates the issued unique code with the target image TG notified from the user terminal 20 and stores it in the registration information storage unit 107 (step S151). The campaign management device 10 notifies the user terminal 20 of the unique code (step S152).

[0048] FIG. 8 is a flow diagram illustrating the process flow of step S17 in FIG. 5. The campaign server 30 determines the type of campaign to which the applicant has applied (step S170). If the campaign type is one in which a coupon is issued to all applicants, the campaign server 30 issues a coupon in response to the application (step S171) and notifies the user terminal 20 of the issued coupon (step S172). The user can use the coupon, for example, by presenting the user terminal 20 displaying the coupon at a store and purchasing a product. If the campaign type is one in which points are awarded to all applicants, the campaign server 30 issues points in response to the application (step S173) and notifies the user terminal 20 of the issued points (step S174). The user can, for example, award points to the point card by presenting the point card and the user terminal 20 displaying the points at a store. Alternatively, the campaign server 30 may notify the user terminal 20 of the user account to which points are to be awarded, and award points to the user account provided by the user terminal 20.

[0049] Here, let us consider a comparative example of a prize entry system. In this system, a user creates an account by registering personal information on a campaign website in advance and requests the website to issue a code (unique JAN code) for entering the prize. When purchasing a product, the user enters the prize entry by having the code (unique JAN code) issued by the website read by a code reader on a POS register installed in the store. In this type of prize entry system, entries are made via the POS register code reader, so the prize entry code (unique JAN code) must include the applicant's (user's) personal information in order to identify the applicant. In contrast, in this embodiment, a target image TG, which is a direct image of the symbol of the purchased product, is notified from the user terminal 20. This eliminates the need to use a unique JAN code containing personal information, and eliminates the need to register the applicant's personal information in preparation for entry. Only at the entry stage does the user need to disclose the minimum amount of personal information necessary depending on the campaign content, thereby reducing the opportunities for personal information disclosure and the risk of personal information being leaked.

[0050] In the above-described embodiment, a case of managing a campaign has been described as an example, but the present invention is not limited to this. This embodiment can be applied to any case in which a target image TG in which an "identification target" corresponding to a product symbol is captured and the execution of a "specific process" corresponding to a campaign for the identification target are managed. For example, as described below, if a product symbol or the like is pre-registered as an identification target, a pre-registered image in which the product symbol or the like is captured may be used to determine the authenticity of the target image TG in which the product is captured, or product traceability management may be performed by individually identifying the product captured in the target image TG.

[0051] As described above, the campaign management system 1 of the embodiment includes a registration information storage unit 107, a feature amount determination unit 102, a registration determination unit 103, and an output unit 106. The registration information storage unit 107 stores registration information. The registration information is information associating a target image TG with status information. The target image TG is an image of a product symbol (identification target). The status information is information indicating whether the target image TG has been processed or not as a status of a campaign (specific processing) for the identification target. In response to a notification of the target image TG from the user terminal 20 along with a processing specification, the feature amount determination unit 102 determines whether the feature amount extracted from the notified target image TG is the same as the feature amount extracted from the target image stored in the registration information storage unit 107. The processing specification is information specifying whether to apply for the campaign (to perform the specific processing). The registration determination unit 103 determines whether to make the target image TG notified from the user terminal 20 a target for duplicate applications (duplicate processing) in the campaign (specific processing). The registration determination unit 103 reads, from the registration information storage unit 107, registration information corresponding to the target image determined to have the same feature amount, in accordance with the determination result by the feature amount determination unit 102. The registration determination unit 103 determines whether the target image TG notified from the user terminal 20 is to be subject to duplicate application (duplicate processing) in a campaign (specific processing) in accordance with the relationship between the status information set in the read registration information and the processing specification notified from the user terminal 20. As a result, in the campaign management system 1 of the embodiment, in accordance with the processing specification from the user, when only registering the target image TG, the target image TG can be saved after confirming that it is not a duplicate registration, and when applying for a campaign, the target image TG can be applied for after confirming that it is not a duplicate application. This improves the convenience of users who use specific processing, such as applying for a campaign.

[0052] In the above-described embodiment, an example has been described in which the user terminal 20 applies for a campaign by transmitting a target image to the campaign management device 10. However, this is not limiting. When a receipt is issued at a store register, a target image may be captured by a terminal device (e.g., a POS terminal) at the store register, and the captured target image may be transmitted from the terminal device to the campaign management device 10. In this case, for example, a message such as "You have purchased a campaign-eligible product. Would you like to apply for the campaign?" may be displayed on a monitor at a store register, such as a self-service register or a manned register, during checkout. When a user looks at the monitor at the store register and performs an operation to apply for the campaign, a target image is captured and transmitted to the campaign management device 10. Furthermore, when receipts, products, etc. are collected in a collection box installed in the store, a target image may be captured by a terminal device (e.g., a terminal device that records collected receipts) installed in the receipt collection box, and the captured target image may be transmitted from the terminal device to the campaign management device 10. In this case, for example, when a receipt is placed in the receipt collection box, a message such as "Your receipt for the purchase of a campaign-eligible product has been collected. Would you like to enter the campaign?" is displayed on the monitor of the receipt collection box. When the user looks at the monitor of the receipt collection box and performs an operation to enter the campaign, an image of the target is captured and the captured image of the target is sent to the campaign management device 10.

[0053] Furthermore, in the above-described embodiment, when multiple campaigns are being conducted simultaneously, the management unit 105 may assign a campaign type or a campaign ID (campaign information) to the registration information, thereby centrally managing which of the multiple campaigns a captured target image TG is linked to (corresponding to). In this case, the registration information storage unit 107 may store the registration information and the campaign information. That is, the management unit 105 may manage information regarding the campaign corresponding to the target image TG stored as registration information in the registration information storage unit 107 among the multiple campaigns. Furthermore, when multiple target images TG are transmitted collectively from the user terminal 20 to the campaign management device 10, the campaign management device 10 may register the multiple target images TG collectively. The campaign management device 10 may determine whether to change or not change the status information of each of the registered multiple target images TG, depending on a processing specification for each of the registered multiple target images TG.

[0054] Furthermore, in the above-described embodiment, the symbol (identification target) of the product may be pre-registered. By pre-registering the symbol of the product, it is possible to determine the authenticity of the target image TG notified from the user terminal 20. Here, determining the authenticity means determining whether the target image TG is a legitimate image or an illegitimate image. A legitimate image is an image of a symbol printed on a product purchased by a user or on a product package. An illegitimate image is an image of a forged product symbol, or an image generated by processing a portion of a legitimate image, for example, by image processing. By determining the authenticity of the target image TG, it is possible to detect fraudulent applications using illegitimate images, such as an image of a forged symbol.

[0055] For example, if a specific design printed on a product or product packaging is used as a product symbol, an image of the symbol (identification target) printed on the product or product packaging is captured before the product is purchased, and the captured image is transmitted to the campaign management device 10 as a pre-registration image. For example, when the product is shipped from a factory, a terminal device at the factory captures a pre-registration image and transmits the captured pre-registration image to the campaign management device 10. Alternatively, when the product arrives at a store, a terminal device at the store may capture a pre-registration image and transmit the captured pre-registration image to the campaign management device 10. Alternatively, if a receipt issued at the time of purchase is used as a product symbol, an image of the symbol (receipt) is captured by, for example, scanning the issued receipt when the receipt is issued, and the captured image is transmitted to the campaign management device 10 as a pre-registration image. For example, at a store cash register, a POS terminal issues a receipt, captures the issued receipt as a pre-registration image, and transmits the captured pre-registration image to the campaign management device 10.

[0056] When the campaign management device 10 receives the pre-registered image, it extracts features from the received pre-registered image and stores the pre-registered image together with the extracted features in a pre-registration information storage unit (not shown).

[0057] 5, when the campaign management device 10 receives the target image TG notified from the user terminal 20, it extracts features from the received target image TG and determines whether an image having the same features as the extracted features is stored in a pre-registration information storage unit (not shown). If an image having the same features is stored in the pre-registration information storage unit, the campaign management device 10 determines that the target image TG notified from the user terminal 20 is a legitimate image. On the other hand, if an image having the same features is not stored in the pre-registration information storage unit, the campaign management device 10 determines that the target image TG notified from the user terminal 20 is an illegitimate image.

[0058] If the target image TG notified from the user terminal 20 is a legitimate image, the campaign management device 10 proceeds to the processing shown in step S12 of Fig. 5. On the other hand, if the target image TG notified from the user terminal 20 is an illegitimate image, the campaign management device 10 ends the processing without performing the processing shown in step S12 and subsequent steps of Fig. 5, that is, the processing related to determining whether or not the target image TG is to be subject to overlap processing in the identification processing. In this case, the campaign management device 10 may notify the user terminal 20 that the target image TG notified from the user terminal 20 has been determined to be an illegitimate image and that application (or only registration) is not possible.

[0059] As described above, in the campaign management system 1 of the embodiment, product symbols may be pre-registered. The campaign management device 10 further includes a pre-registration information storage unit (not shown). The pre-registration information storage unit stores pre-registered images of symbols (identification targets) corresponding to products at the time of purchase or before purchase, and feature amounts extracted from the pre-registered images. In response to notification of a target image TG from the user terminal 20, the feature amount determination unit 102 performs an authenticity determination to determine whether the feature amounts extracted from the target image TG are identical to the feature amounts extracted from the pre-registered image stored in the pre-registration information storage unit. If the registration determination unit 103 determines in the authenticity determination that the feature amounts extracted from the target image TG are not identical to the feature amounts extracted from the pre-registered image stored in the pre-registration information storage unit, the registration determination unit 103 does not determine whether to subject the target image TG to duplication processing in the identification process. This allows the campaign management system 1 of the embodiment to detect fraudulent applications using non-genuine images, such as images of counterfeit symbols.

[0060] The pre-registration information storage unit may store product-specific information (such as the product manufacturing date and time or lot number) stored by the product manufacturer on a server, linked to the pre-registration image. For example, a receipt issuing machine equipped with optional equipment (such as a scanner) that captures an image simultaneously with issuing a receipt may be used to transmit an image of a receipt (official receipt) issued upon purchase of the product to the campaign management device 10 as pre-registration information. In this case, the pre-registration information storage unit may store the product-specific information stored on the server linked to the pre-registration image (receipt image). The campaign management device 10 may also include a unique information determination unit that, in response to notification of the target image TG along with a process specification specifying whether or not to perform a specific process, determines whether the unique information of the purchased product corresponding to the identification target captured in the target image TG is identical to the unique information of the product corresponding to the identification target captured in the pre-registration image. In this case, the feature amount determination unit 102, in response to notification of the target image TG in which an identification target corresponding to the purchased product is captured, determines whether the feature amount extracted from the notified target image TG is identical to the feature amount extracted from the pre-registered image stored in the pre-registered information storage unit, and the unique information determination unit, in response to notification of the target image TG in which an identification target corresponding to the purchased product is captured, determines whether the unique information of the purchased product corresponding to the identification target captured in the target image TG is identical to the unique information of the product corresponding to the identification target captured in the pre-registered image, thereby determining the authenticity of the target image TG. Also in this case, if, in the authenticity determination, it is determined that the feature amount extracted from the target image TG is not identical to the feature amount extracted from the pre-registered image stored in the pre-registered information storage unit, or if it is determined that the unique information of the purchased product corresponding to the identification target captured in the target image TG is not identical to the unique information of the product corresponding to the identification target captured in the pre-registered image, the registration determination unit 103 does not determine whether to subject the target image TG to overlap processing in the identification process.As a result, when a user (a purchaser who has purchased a product) later applies for a campaign, the campaign management device 10 can determine whether the image of the receipt issued at the time of purchasing the product (target image TG) is a legitimate image by comparing not only the features of the target image TG and the image stored in the pre-registration information storage unit, but also the product-specific information of the target image TG and the image stored in the pre-registration information storage unit, thereby improving the accuracy of determining the authenticity of the target image TG.

[0061] The campaign management system 1 and the campaign management device 10 in the above-described embodiments may be implemented in whole or in part by a computer. In this case, a program for implementing the functions may be recorded on a computer-readable recording medium, and the program may be loaded into a computer system and executed. Note that the term "computer system" as used herein includes hardware such as an OS and peripheral devices. Furthermore, the term "computer-readable recording medium" refers to portable media such as flexible disks, optical magnetic disks, ROMs, or CD-ROMs, or storage devices such as hard disks built into a computer system. For example, a "computer-readable recording medium" refers to a non-transitory computer-readable recording medium. Furthermore, the term "computer-readable recording medium" may include media that dynamically store programs for a short period of time, such as communication lines used when transmitting programs via a network such as the Internet or a telephone line, and media that store programs for a fixed period of time, such as volatile memory within a computer system that serves as a server or client in such cases. The program may be designed to implement some of the functions described above, or may be capable of implementing the functions in combination with a program already stored in the computer system, or may be implemented using a programmable logic device such as an FPGA.

[0062] The present invention can be used in a specific process management system, a specific process management method, and a program that can improve the convenience of users who use specific processes such as applying for campaigns.

[0063] DESCRIPTION OF SYMBOLS 1... Campaign management system (specific process management system) 10... Campaign management device 101... Acquisition unit 102... Feature amount determination unit 103... Registration determination unit 104... Registration unit 105... Management unit 106... Output unit 107... Registration information storage unit 20... User terminal 30... Campaign server

Claims

1. A specific processing management system comprising: a registration information storage unit that stores registration information that associates a target image of an identification target with status information that indicates whether the target image has been processed or not as the status of the specific processing for the identification target; a feature determination unit that, in response to the target image being notified together with a processing specification that specifies whether or not the specific processing is to be performed, determines whether a feature extracted from the notified target image is identical to a feature extracted from the target image stored in the registration information storage unit; a registration determination unit that, in response to the determination result by the feature determination unit, reads out from the registration information storage unit the registration information corresponding to the target image that has been determined to have the same feature, and determines whether or not the notified target image should be subject to overlapping processing in the specific processing, in accordance with the relationship between the status information set in the read registration information and the processing specification; and an output unit that outputs the determination result by the registration determination unit.

2. The identification target is a product symbol attached to a product or an accessory of the product, and the specific processing management system according to claim 1 further comprises a pre-registration information storage unit that stores a pre-registered image of the identification target corresponding to the product at the time of purchase or before purchase and features of the pre-registered image, and the feature determination unit, in response to notification of the target image of the identification target corresponding to the product after purchase, performs an authenticity determination to determine whether the features extracted from the notified target image are identical to the features extracted from the pre-registered image stored in the pre-registration information storage unit, and if, in the authenticity determination, it is determined that the features extracted from the target image are not identical to the features extracted from the pre-registered image stored in the pre-registration information storage unit, the registration determination unit does not determine whether the target image should be subject to overlapping processing in the specific processing.

3. The specific processing management system of claim 1, wherein, when the feature determination unit determines that the target images are identical, the registration determination unit reads out the status information set for the target images whose features are determined to be identical from the registration information stored in the registration information storage unit, and when the status information read out from the registration information storage unit is unprocessed and the processing specification specifies the implementation of the specific processing, the registration determination unit determines that the target images will not be subject to overlapping processing in the specific processing, and changes the read out status information to processed.

4. The specific processing management system of claim 1, wherein, when the feature determination unit determines that the images are identical, the registration determination unit reads out the status information set for the target image whose features are determined to be identical from the registration information stored in the registration information storage unit, and determines that the image is to be subject to overlapping processing in the specific processing if the status information read out from the registration information storage unit indicates that the image has been processed, or if the status information read out from the registration information storage unit indicates that the image has not been processed and the processing specification specifies that the specific processing should not be performed.

5. The specific processing management system of claim 1, wherein if the feature determination unit determines that the target images are not identical, the registration determination unit determines that the target images will not be subject to overlapping processing in the specific processing, and determines that the registration information that associates the notified target image with the processing specification will be stored in the registration information storage unit.

6. A specific processing management system as described in claim 1, further comprising a registration unit that issues a unique code associated with the notified target image when the registration determination unit determines that the image is not to be subject to overlapping processing in the specific processing, and when the processing specification specifies that the specific processing is not to be performed, the output unit transmits the unique code issued by the registration unit together with the processing specification to the terminal that notified the target image.

7. A specific processing management system as described in claim 6, wherein the registration determination unit, in response to notification of the unique code along with the processing specification, reads out from the registration information storage unit the status information set for the target image corresponding to the notified unique code, and if the read status information is set to unprocessed, changes the status information to the content specified in the notified processing specification.

8. The identification process management system of claim 1, wherein the identification target is a product symbol attached to a product or an accessory of the product, the identification process is a process related to a campaign implemented for the product, and the feature determination unit determines the printing feature of the product symbol captured in the target image as the feature extracted from the target image.

9. The specific process management system according to claim 8, wherein the product symbol is attached to a receipt issued when the product is purchased.

10. The specific processing management system described in claim 1, wherein the feature determination unit uses a trained model to extract the feature from the target image and determine whether the extracted feature is identical to the feature stored in the registration information storage unit.

11. The feature determination unit, in response to being notified of one or more target images together with a processing specification for each of the one or more target images, determines whether or not the feature extracted from each of the notified one or more target images is the same as the feature extracted from the target image stored in the registration information storage unit; the registration determination unit, in response to the determination result by the feature determination unit for each of the one or more target images, reads out from the registration information storage unit the registration information corresponding to the one or more target images determined to have the same feature, and determines whether or not the notified one or more target images should be subject to overlapping processing in the specific processing in response to the relationship between the status information set in the read registration information and the processing specification; and further comprises a registration unit that issues a unique code associated with the notified target image when the registration determination unit determines for each of the one or more target images that they should not be subject to overlapping processing in the specific processing, 2. The specific processing management system of claim 1, wherein, when the processing specification specifies not to perform the specific processing for each of one or more of the target images, the output unit transmits the unique code issued by the registration unit together with the processing specification to the terminal that notified the target image, and the registration determination unit, in response to the unique code being notified from the terminal together with the processing specification specifying to perform the specific processing for each of one or more of the target images, reads out from the registration information storage unit the status information set for the target image corresponding to the notified unique code, and if the read status information is set to unprocessed, changes the status information to processed.

12. The identification target is a product symbol attached to a product or an accessory to the product, and the system further comprises a pre-registered information storage unit that stores a pre-registered image of the identification target corresponding to the product at the time of purchase or before purchase, feature quantities of the pre-registered image, and unique information of the product corresponding to the identification target captured in the pre-registered image, and a unique information determination unit that determines whether the unique information of the product after purchase corresponding to the identification target captured in the target image is the same as the unique information of the product corresponding to the identification target captured in the pre-registered image in response to notification of the target image together with the processing designation that specifies whether or not to perform the specific processing, the feature amount determination unit, in response to notification of the target image in which the identification target corresponding to the purchased product is captured, determines whether or not the feature amount extracted from the notified target image is identical to the feature amount extracted from the pre-registered image stored in the pre-registered information storage unit; and the unique information determination unit, in response to notification of the target image in which the identification target corresponding to the purchased product is captured, determines whether or not the unique information of the purchased product corresponding to the identification target captured in the target image is identical to the unique information of the product corresponding to the identification target captured in the pre-registered image, thereby determining the authenticity of the target image; 2. The identification processing management system of claim 1, wherein the registration determination unit does not determine whether to subject the target image to overlap processing in the identification processing when, in the authenticity determination, it is determined that the features extracted from the target image are not identical to the features extracted from the pre-registered image stored in the pre-registered information storage unit, or when it is determined that the unique information of the purchased product corresponding to the identification object captured in the target image is not identical to the unique information of the product corresponding to the identification object captured in the pre-registered image.

13. A specific processing management method performed by a computer used in a specific processing management system, comprising: a registration information storage unit storing registration information that associates a target image of an identification target with status information indicating whether the specific processing status for the identification target has been processed or not; a feature amount determination unit, in response to notification of the target image together with a processing specification specifying whether or not to perform the specific processing, determines whether or not a feature amount extracted from the notified target image is identical to a feature amount extracted from the target image stored in the registration information storage unit; a registration determination unit, in response to the determination result by the feature amount determination unit, reads out from the registration information storage unit the registration information corresponding to the target image determined to have the same feature amount, and determines whether or not to subject the notified target image to overlapping processing in the specific processing, in response to the relationship between the status information set in the read registration information and the processing specification; and an output unit outputs the determination result by the registration determination unit.

14. A program that causes a computer used in a specific processing management system to store registration information that associates a target image of an identification target with status information that indicates whether the status of the specific processing for the identification target has been processed or not, and in response to the target image being notified together with a processing specification that specifies whether or not the specific processing is to be carried out, performs a feature determination process that determines whether or not a feature extracted from the notified target image is identical to a feature extracted from the target image stored in the registration information, reads out the registration information corresponding to the target image that has been determined to have the same feature in response to the determination result of the feature determination process, and performs a registration determination process that determines whether or not the notified target image should be subject to overlapping processing in the specific processing in response to the relationship between the status information set in the read registration information and the processing specification, and outputs the determination result of the registration determination process.

Images