Registered article management method, program, and registered article management system
The registered product management system addresses the challenge of limited genuine product information by using a network of devices to calculate similarity and determine product authenticity, ensuring accurate identification and secure ownership transfer.
Patent Information
- Application Number
- PCT/JP2023/019927
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-08
- Filing Date
- 2023-05-29
- Publication Date
- 2024-11-14
AI Technical Summary
Existing methods for determining whether a product is genuine face challenges when there is limited characteristic information available, particularly when only one genuine item exists, leading to potential inaccuracies in authentication.
A registered product management system and method that uses a network of information processing devices to acquire determination information, extract feature amounts, calculate similarity between the judged product and registered products, and determine matching based on similarity, enabling accurate authentication even with limited genuine product data.
The system provides reliable determination results for various products, ensuring accurate identification of registered products without requiring extensive feature information, and supports secure ownership transfer and certification.
Smart Images

Figure JP2023019927_14112024_PF_FP_ABST
Abstract
Description
Registered product management method, program, and registered product management system
[0001] The present invention relates to a registered product management method, a program, and a registered product management system.
[0002] Patent Document 1 below discloses an evaluation device for determining authenticity. This evaluation device has a learning model that has learned characteristic information of authentic items in order to determine whether an item to be evaluated, such as a trading card (hereinafter simply referred to as an "item to be evaluated"), is authentic. When an image of the item to be evaluated is received from a user terminal connected via a network, the evaluation device determines whether the item to be evaluated is authentic based on the evaluation result of the learning model.
[0003] Patent No. 7251712
[0004] In the above-mentioned prior art, it is necessary to learn the characteristic information of the registered product to be registered as a genuine product. However, when there is only one genuine product, such as many works of art, it may be difficult to acquire sufficient characteristic information of the genuine product (registered product) for training the learning model. In other words, the determination of whether the product to be evaluated is a registered product may be limited to specific items, and there is room for improvement in this regard.
[0005] In consideration of the above-mentioned problems, the present invention has an object to make it possible to obtain a determination result as to whether or not various items to be determined are registered items.
[0006] A registered product management method according to one embodiment is a registered product management method executed by an information processing device to manage registered products, and includes a judgment information acquisition step of acquiring judgment information for determining whether a judged product matches the registered product, a feature extraction step of extracting features from the judgment information, a calculation step of calculating the similarity between the features of the judged product and the features of the registered product, a judgment step of determining whether the judged product matches the registered product based on the similarity, and a notification step of notifying the judgment result obtained by the judgment step.
[0007] A program according to one embodiment causes an information processing device for managing registered products to execute a registered product management method, including a judgment information acquisition step for acquiring judgment information for determining whether a judged product matches the registered product, a feature extraction step for extracting features from the judgment information, a calculation step for calculating the similarity between the features of the judged product and the features of the registered product, a judgment step for determining whether the judged product matches the registered product based on the similarity, and a notification step for notifying the judgment result obtained by the judgment step.
[0008] A registered product management system according to one embodiment is a registered product management system in which a plurality of information processing devices are connected via a network and which manages registered products, and which performs the following steps: a judgment information acquisition step of acquiring judgment information for determining whether a judged product matches the registered product; a feature extraction step of extracting features from the judgment information; a calculation step of calculating the similarity between the features of the judged product and the features of the registered product; a judgment step of determining whether the judged product matches the registered product based on the similarity; and a notification step of notifying the judgment result obtained by the judgment step.
[0009] According to one embodiment, it is an object to be able to obtain a determination result as to whether or not various determined products are registered products.
[0010] 1 is a schematic diagram showing an overview of a registered product management system according to a first embodiment. FIG. 1 is a block diagram showing the hardware configuration of a server according to the first embodiment. FIG. 2 is a block diagram showing the hardware configuration of a user terminal according to the first embodiment. FIG. 3 is a block diagram showing the functional configuration of a server according to the first embodiment. FIG. 4 is a schematic diagram showing an example of a screen display when assessment information is acquired on a user terminal according to the first embodiment. FIG. 5 is a schematic diagram showing an example of a screen display displayed upon receiving notification of an assessment result on a user terminal according to the first embodiment. FIG. 6 is a sequence diagram showing an example of the procedure of a registered product management method according to the first embodiment. FIG. 7 is a schematic diagram showing an overview of a registered product management system according to a second embodiment. FIG. 8 is a block diagram showing the functional configuration of a server according to the second embodiment. FIG. 9 is a schematic diagram showing an example of a screen display when ownership is transferred on a user terminal according to the second embodiment. FIG. 10 is a schematic diagram showing an example of a screen display when ownership is transferred on a user terminal according to the second embodiment. FIG. 11 is a sequence diagram showing an example of the procedure of a registered product management method according to the second embodiment. FIG. 12 is a block diagram showing the functional configuration of a server according to a third embodiment. (A) and (B) are schematic diagrams showing an example of a screen display when assessment information is acquired on a user terminal according to the third embodiment. FIG. 13 is a sequence diagram showing an example of the procedure of a registered product management method according to the third embodiment. FIG. 14 is a block diagram showing the hardware configuration of a server according to a third embodiment.
[0011] (First embodiment) A first embodiment of a registered product management system according to the present invention will be described below using Figures 1 to 8. Note that, in the description of the specification and drawings relating to each embodiment and its modifications, components having substantially the same functional configuration are designated by the same reference numerals, and redundant explanations will be omitted. Also, the dimensional proportions in the drawings have been exaggerated for the sake of explanation, and may differ from the actual proportions.
[0012] <System Overview> First, an overview of the registered item management system 10 according to this embodiment will be described. As shown in FIG. 1 , the registered item management system 10 is a system for managing information on items such as artworks. Specifically, the system is a system for registering an artwork as a registered item in the registered item management system 10 in advance, and for a user U to perform a determination process to determine whether the artwork matches the registered item. The artwork that the user U requests for determination corresponds to the "determined item" described in claim 1. Note that if the registered item is a genuine artwork, determining whether the determined item matches the registered item in the registered item management system 10 corresponds to an authenticity determination. However, the registered item management system 10 of this embodiment is not limited to simply determining authenticity, but is a system for determining whether the registered item and the determined item match in a broader sense. Furthermore, the registered item and the determined item are not limited to artworks, but may also be other items such as industrial products or consumer goods.
[0013] The registered product management system 10 acquires video image information of the judged product A captured by the user U as the judgement information, and extracts feature amounts between the video image information of the registered product that has been registered in advance and the video image information of the judged product A. Then, the system calculates the similarity between the feature amounts, determines whether the judged product A and the registered product match based on the similarity, and notifies the user of the judgment result. Details of each process will be described later.
[0014] <System Configuration> The registered item management system 10 according to this embodiment includes a server 12, a user terminal 14, and a blockchain network 16, which are connected to each other so as to be able to communicate with each other via a network N. The network N is, for example, a wired local area network (LAN), a wireless LAN, the Internet, a public line network, a mobile data communication network, or a combination thereof. In the example of FIG. 1 , the registered item management system 10 includes one server 12 and one user terminal 14, but is not limited thereto and may include two or more of each.
[0015] The server 12 is an information processing device that provides various functions, such as management and evaluation of registered products, to the user terminal 14. The server 12 may be, for example, a personal computer (PC), a smartphone, a tablet terminal, or a microcomputer, but is not limited to these. The server 12 may also be a physical computer server or a cloud-based server. For example, a virtual server implemented on a cloud computing platform such as Amazon Web Services (AWS) may be used. Below, an example of a physical computer server will be given for the server 12, and details will be provided later.
[0016] The user terminal 14 is an information processing device that transmits determination information from the user U to the server 12 and displays the determination results transmitted from the server 12. The user terminal 14 is, for example, a PC, a smartphone, a tablet terminal, or a microcomputer, but is not limited to these. The user terminal 14 will be described in detail later.
[0017] In the blockchain network (hereinafter simply referred to as "blockchain") 16, multiple blockchain control terminals distributed across the network are interconnected, and various information related to registered products is recorded. In this embodiment, the information related to the registered product includes the work title, author information, registered product category information, production date information, thumbnail image information, detailed work information, etc., and this information corresponds to the "registered product information" set forth in claim 8. This registered product information is the information recorded in a digital certificate, which will be described later.
[0018] <Hardware Configuration (Server)> Next, a description will be given of the hardware configuration of the server 12. Fig. 2 is a diagram showing an example of the hardware configuration of the server 12. As shown in Fig. 2, the server 12 includes a processor 120, a memory 122, a storage 124, a communication I / F 126, an input / output I / F 128, an output device 130, an input device 132, and a drive device 134, which are connected to each other via a bus B.
[0019] The processor 120 controls each component of the server 12 and realizes the functions of the server 12 by loading a program stored in the storage 124 into the memory 122 and executing the program. The functions of the server 12 are realized by the processor 120 executing the program. The processor 120 is, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), an ASIC (Application Specific Integrated Circuit), a DSP (Digital Signal Processor), or a combination thereof.
[0020] The memory 122 is, for example, a read-only memory (ROM), a random access memory (RAM), or a combination thereof. The ROM is, for example, a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a combination thereof. The RAM is, for example, a dynamic random access memory (DRAM), a static random access memory (SRAM), a magnetoresistive random access memory (MRAM), or a combination thereof.
[0021] The storage 124 stores programs such as an OS and various types of data. The storage 124 is, for example, a flash memory, a hard disk drive (HDD), a solid state drive (SSD), a storage class memory (SCM), or a combination thereof.
[0022] The communication I / F 126 is an interface for connecting the server 12 to an external device and controlling communication via the network N. The communication I / F 126 is, for example, an adapter compliant with Bluetooth (registered trademark), Wi-Fi (registered trademark), ZigBee (registered trademark), Ethernet (registered trademark), or optical communication (e.g., Fibre Channel), but is not limited to these.
[0023] The input / output I / F 128 is an interface for connecting an input device 132 and an output device 130 to the server 12 .
[0024] The output device 130 is a device that outputs various types of information held by the server 12. The output device 130 is, for example, a display, a projector, a printer, a speaker, a vibrator, or a combination of these.
[0025] The input device 132 is a device for receiving operations from the administrator and inputting information corresponding to the received operations to the server 12. The input device 132 is, for example, a mouse, a keyboard, a touch panel, a microphone, a scanner, a camera, various sensors, an operation button, or a combination of these.
[0026] The drive device 134 reads and writes data from and to the disk media 136. The drive device 134 is, for example, a magnetic disk drive, an optical disk drive, a magneto-optical disk drive, or a combination thereof. The disk media 136 is, for example, a compact disc (CD), a digital versatile disc (DVD), a floppy disc (FD), a magneto-optical disc (MO), a Blu-ray (registered trademark) disc (BD), or a combination thereof.
[0027] The hardware configuration of the server 12 is not limited to the above example, and the server 12 may include some of the above hardware functional configurations, or may include hardware configurations other than those described above.
[0028] In addition, the various programs may be written into memory 122 or storage 124 during the manufacturing stage of server 12, may be provided to server 12 via network N, or may be provided to server 12 via a non-transitory computer-readable recording medium such as disk media 136.
[0029] <Hardware Configuration (User Terminal)> Next, we will explain the hardware configuration of the user terminal 14. Fig. 3 is a diagram showing an example of the hardware configuration of the user terminal 14. As shown in Fig. 3, the user terminal 14 includes a processor 140, a memory 142, a storage 144, a communication I / F 146, an input / output I / F 148, an output device 152, and an input device 154, which are connected to each other via a bus B.
[0030] The processor 140 controls each component of the user terminal 14 and realizes the functions of the user terminal 14 by loading a program stored in the storage 144 into the memory 142 and executing the program. The functions of the user terminal 14 are realized by the processor 140 executing the program. The processor 140 is, for example, a CPU, an MPU, a GPU, an ASIC, a DSP, or a combination of these.
[0031] The memory 142 may be, for example, a ROM, a RAM, or a combination thereof. The ROM may be, for example, a PROM, an EPROM, an EEPROM, or a combination thereof. The RAM may be, for example, a DRAM, an SRAM, an MRAM, or a combination thereof.
[0032] The storage 144 stores programs such as an OS and various data. The storage 144 is, for example, a flash memory, an HDD, an SSD, an SCM, or a combination thereof.
[0033] The communication I / F 146 is an interface for connecting the user terminal 14 to an external device and controlling communication via the network N. The communication I / F 146 is, for example, an adapter conforming to Bluetooth (registered trademark), Wi-Fi (registered trademark), ZigBee (registered trademark), Ethernet (registered trademark), or optical communication, but is not limited to these.
[0034] The input / output I / F 148 is an interface for connecting an output device 152 and an input device 154 to the user terminal 14 .
[0035] The input device 154 is a device for receiving operations from the user U and inputting information corresponding to the received operations into the user terminal 14. The input device 154 is, for example, a mouse, a keyboard, a touch panel, a microphone, a scanner, a camera, various sensors, operation buttons, or a combination of these.
[0036] The output device 152 is a device that outputs various types of information held by the user terminal 14. The input device 154 is, for example, a display, a projector, a printer, a speaker, a vibrator, or a combination of these.
[0037] The hardware configuration of the user terminal 14 is not limited to the above example. The user terminal 14 may have a part of the above hardware functional configuration, or may have a hardware configuration other than the above.
[0038] In addition, the various programs may be written into memory 142 or storage 144 during the manufacturing stage of the user terminal 14, may be provided to the user terminal 14 via the network N, or may be provided to the user terminal 14 via a non-transitory computer-readable recording medium such as disk media 136 (see Figure 2).
[0039] <Functional Configuration (Server)> Fig. 4 is a diagram showing an example of the functional configuration of the server 12. As shown in Fig. 4, the server 12 includes a communication unit 20, a storage unit 22, and a processing unit 24.
[0040] The communication unit 20 is realized by the communication I / F 126 (see FIG. 2). The communication unit 20 transmits and receives information such as the management program 220, moving images, audio, and text to and from the user terminal 14.
[0041] The storage unit 22 is realized by a memory 122 and a storage 124 (see FIG. 2 ). The storage unit 22 stores a management program 220 executed by the processing unit 24, and also stores various types of information including a trained model 222, a registered product DB 224, an owner information DB 226, and an assessment information DB 228.
[0042] The trained model 222 is a trained model that has been trained in advance by machine learning so as to output feature quantities contained in the judgment information in response to input of the judgment information. Specifically, the trained model 222 is trained to capture local patterns and features, such as edges, textures, and shapes, within the image from the input video image information, which is the judgment information, and output these as feature quantities. Note that in this embodiment, when a video is input as the judgment information, the trained model 222 is configured to obtain output from an image from which feature quantities can be extracted most accurately among multiple images (frames) constituting the video. However, this is not limited to this. Alternatively, three-dimensional data of the judged product may be generated from the video using a technique such as depth map estimation, and feature quantities of the three-dimensional data may be output. Furthermore, when an image rather than a video is input as the judgment information, feature quantities may be extracted from the image, or three-dimensional data of the judged product may be generated from multiple images and feature quantities of the three-dimensional data may be output. Furthermore, when extracting feature quantities, not only may the output from the trained model 222 be used, but also an image processing model based on an algorithm, a mathematical technique, a rule-based method, or the like may be used. Furthermore, a configuration in which the above-mentioned image processing model and the trained model 222 are combined may be used.
[0043] The training process and re-training process of the trained model 222 are performed by, for example, the server 12, but are not limited to this. The training process and re-training process of the trained model 222 may be performed by a device other than the server 12 and provided to the server 12. The trained model 222 is, for example, a neural network such as a convolutional neural network (CNN), a deep neural network (DNN), a recurrent neural network (RNN), or a long short-term memory (LSTM), but is not limited to this. The trained model 222 may also be a trained model such as a decision tree or a support vector machine (SVM).
[0044] The registered item DB 224 is a database that stores information about registered items, which are artworks that have been registered in advance using a predetermined method. The registered item DB 224 stores, for example, unique registered item ID information, which is identification information for the registered item, identification information for the registered item information recorded on the blockchain 16, information about the owner of the registered item stored in the owner information DB 226, and identification information for the judgment information of the registered item stored in the judgment information DB 228, all of which are linked to one another. The predetermined method for registering registered items involves sending video information of a captured image of the registered item, the owner information of the registered item, and various information proving this information to the server 12 as information indicating registration, and the registered item is then registered in the server 12. However, the method is not limited to this, and registration of registered items may be performed using other methods.
[0045] The owner information DB 226 is a database that stores information about the owners of registered products. The owner information DB 226 includes, for example, unique owner ID information (login information), which is identification information of the owner registered via the user terminal 14, the owner's name, and ID information of the registered products they own. The information stored in the owner information DB 226 is not limited to these, and may include other information such as the owner's residence and the date on which ownership began.
[0046] The evaluation information DB 228 is a database that stores evaluation information for each registered product and evaluated product.
[0047] The processing unit 24 is realized by the processor 120 reading and executing the management program 220 from the memory 122 (see FIG. 2 ) and working in cooperation with other hardware components. The processing unit 24 includes an information acquisition unit 242, a feature extraction unit 244, a similarity calculation unit 246, a match determination unit 248, and a determination result notification unit 250.
[0048] The information acquisition unit 242 receives the assessment information transmitted from the user terminal 14. The received assessment information is stored in the assessment information DB 228. The information acquisition unit 242 also receives login information linked to the user U (owner). Based on the received login information, the unit acquires the registered product registered as the owner of the user U and the registered product information from the registered product DB 224 and the blockchain 16, and transmits the information so that it can be displayed on the user terminal 14 to which the user U has logged in. In other words, the owner of the registered product can view the registered product information owned by the owner by logging in. Note that in this embodiment, the registered product information is acquired from the login information, but this is not limiting and other configurations may also be used. As an example, a known object detection method may be used to detect a determined product A from the assessment information received from the user terminal 14, i.e., video image information captured by the user U, and registered products that closely match the determined product A may be searched for as candidates in the registered product DB 224.
[0049] The feature extraction unit 244 extracts feature amounts from the acquired judgment information of the judgment product A and the judgment information of the registered product corresponding to the candidate judgment product A. Here, the judgment information of the registered product is the judgment information of the registered product registered in advance in the judgment information DB 228.
[0050] The similarity calculation unit 246 calculates the similarity between the extracted feature amount of the inspected product and the feature amount of the inspection information of the registered product. The similarity is calculated using a known calculation method such as Euclidean distance or cosine similarity.
[0051] The match determination unit 248 determines whether the determined product and the registered product match based on the calculated similarity. In this determination, a match may be determined if the similarity is equal to or greater than a predetermined value, or a match may be determined only if there is a perfect match. Note that the match determination unit 248 determines whether the determined product and the registered product match, but is not limited to this. It may also output various information related to the determination result, such as an index value, that can be used to visualize the determination result.
[0052] The determination result notification unit 250 transmits information to the user terminal 14 to notify the user of the determination result.
[0053] <Functional Configuration (User Terminal)> Fig. 5 is a diagram showing an example of the functional configuration of the user terminal 14. As shown in Fig. 5, the user terminal 14 includes a communication unit 30, a storage unit 32, and a processing unit 36.
[0054] The communication unit 30 is realized by the communication I / F 146 (see FIG. 3 ). The communication unit 30 transmits and receives information such as video, audio, and text to and from the server 12.
[0055] The storage unit 32 is realized by the memory 142 and the storage 144 (see FIG. 3 ). The storage unit 32 stores various information including the management program 220 executed by the processing unit 36 and the acquired information DB 320.
[0056] The acquired information DB 320 is a database that stores determination information acquired through the user terminal 14. In this embodiment, moving image information from a camera, which is the input device 154, is stored in the acquired information DB 320.
[0057] The processing unit 36 is realized by the processor 140 reading and executing the management program 220 from the memory 142 (see FIG. 3 ) and working in cooperation with other hardware components. The processing unit 36 includes an information acquisition unit 362 and a display processing unit 364.
[0058] The information acquisition unit 362 performs the start and end operations for the user U's judgment on the judged product A, acquires the judgment information for the judged product A, sends it to the server 12, and controls the user terminal 14 itself, as well as controls the sending and receiving of various information between the server 12 and the server 12, including notifications sent from the server 12.
[0059] The display processing unit 364 displays the notification and various information received from the server 12 on the output device 152 of the user terminal 14. As an example, as shown in Fig. 7, the display processing unit 364 displays the judgment result R notified from the server 12 on the screen, and also displays the registered product information as part of the image DI generated as a digital certificate. In addition, various information related to visualization of the judgment result transmitted from the server 12 may also be displayed.
[0060] <Processing Executed by the Registered Product Management System> Next, the operation of the registered product management system 10 will be described. Figure 8 is a sequence diagram showing an example of the flow of the evaluation process for evaluated product A by the registered product management system 10. The processors 120, 140 read the management program 220 stored in the storages 124, 144, and execute the program by loading it into the memories 122, 142, thereby performing the evaluation process. Although not shown, when the processors 120, 140 receive operation information to terminate the operation of the registered product management system 10 or operation termination information from the user terminal 14 during the evaluation process being executed (these will be referred to simply as "termination operations"), the processors 120, 140 terminate the processing based on the management program 220 that is currently being executed.
[0061] When the processor 140 of the user terminal 14 detects the input of login information for using the registered product management system 10, the processor 140 transmits the login information to the server 12 (step S100).
[0062] When the processor 120 of the server 12 receives login information from the user terminal 14, it queries the owner information DB 226 to determine whether the user U corresponds to the owner of the registered product based on the login information (step S102). If the user U linked to the login information is the owner of the registered product, it queries the blockchain 16 to obtain registered product information for the registered product of which the user U is the owner (step S104). Although not shown, if the login information does not correspond to the owner of the registered product in step S102, the processor 120 transmits information to the user terminal 14 to display information indicating that there is no registered product identified as the owner in the login information.
[0063] When the control terminal of the blockchain 16 receives information regarding an inquiry about registered product information from the server 12, it acquires the registered product information and transmits it to the server 12 (step S106).
[0064] The processor 120 transmits the registered product information obtained from the blockchain 16 to the user terminal 14 (step S108).
[0065] When the processor 140 acquires the registered product information from the server 12, the processor 140 displays the registered product information as part of the image DI generated as a digital certificate (step S110, see DI in FIG. 7).
[0066] When the processor 140 detects an input of a judgment start operation by the user U to judge the judged product A (step S112), the processor 140 displays a screen on which the judged product A can be photographed (step S114) as shown in Fig. 6. Note that, although step S114 is a process of photographing the judged product A, it is not limited to this, and the process may be a process of selecting and acquiring video information that has been photographed in advance.
[0067] The processor 140 determines whether or not video information of the judged product A has been acquired (step S116). If video information has not been acquired (step S116: NO), the processor 140 proceeds to step S114. On the other hand, if video information has been acquired (step S116: YES), the processor 140 transmits the video information to the server 12 (step S118). The processes from step S112 to step S118 described above correspond to the "judgment information acquisition step" set forth in claim 1.
[0068] When the processor 120 of the server 12 receives the video information from the user terminal 14, it stores the judgment information in the judgment information DB 228 (step S120) and extracts features from the judgment information and the corresponding acquired judgment information of the registered product (step S122). Note that step S122 corresponds to the "feature extraction step" recited in claim 1.
[0069] The processor 120 calculates the similarity from the extracted feature amount (step S124), and determines whether the test item A matches the registered item based on the similarity (step S126). Note that step S124 corresponds to the "calculation step" and step S126 corresponds to the "determination step" of claim 1.
[0070] The processor 120 notifies the user terminal 14 of the result of the determination as to whether or not the determined product A matches the registered product (step S128). This step S128 corresponds to the "notification step" recited in claim 1.
[0071] When the processor 140 receives a notification from the server 12, it determines whether the notification indicates a match with the registered product (step S130). If the notification does not indicate a match with the registered product (step S130: NO), the processor 140 displays on the display of the output device 130 a message indicating that the inspected product A does not match the registered product (step S132). On the other hand, if the notification indicates a match with the registered product (step S130: YES), the processor 140 displays the inspection result R indicating a match, as shown in FIG. 7 (step S134).
[0072] (Operations and Effects of First Embodiment) Next, operations and effects of this embodiment will be described.
[0073] According to the registered product management system 10 of this embodiment, a user terminal 14 and a server 12 are connected via a network to manage registered products. The system performs the following steps: a judgment information acquisition step for acquiring judged product information, which is information about judged product A; a feature extraction step for extracting features from the judgment information; a calculation step for calculating the similarity between the features of the judged product and the features of the registered product; a determination step for determining whether the judged product matches the registered product based on the similarity; and a notification step for notifying the result of the determination step. That is, whether judged product A matches the registered product is determined based on the similarity calculated from features extracted from at least one of the video information and image information, which are the judgment information. Therefore, a sufficient amount of feature information is not required to train a learning model for matching. In other words, even if there is only one genuine registered product and not much feature information about the genuine product is available, it is possible to determine whether judged product A matches the registered product. This allows determination results to be obtained for various judged products as to whether they are registered products.
[0074] Furthermore, the evaluation information in the registered product management system 10 is at least one of image information and video information of the evaluated product A, and the feature values are image feature values, so the evaluation information can be easily acquired using the image capture function of the user terminal 14, and highly accurate feature values can be obtained based on abundant visual information. This makes it possible to easily acquire highly accurate evaluation results.
[0075] Furthermore, in the registered product management system 10, registered product information, which is information relating to registered products, is recorded on a blockchain 16 in which multiple blockchain control terminals are interconnected. Therefore, it is possible to prevent tampering with the registered product information, and it is possible to present highly reliable certification information that includes the registered product information.
[0076] Furthermore, since the owner information, which is information about the owner of the registered product, is stored on the server 12, it is easier and less costly to change the owner information when ownership is transferred through buying and selling, etc., compared to when it is recorded on the blockchain 16.
[0077] Furthermore, since the evaluation information of registered products is stored in the server 12, a larger amount of information can be stored compared to when it is recorded in the blockchain 16. In other words, since a larger amount of evaluation information can be stored, a larger number of feature quantities can be extracted based on this, and the accuracy of the evaluation can be improved.
[0078] Second Embodiment Next, a registered product management system 60 according to a second embodiment of the present invention will be described with reference to Figures 9 to 13. The registered product management system 60 according to the second embodiment shown in Figure 9 has the same basic configuration as the first embodiment, and is characterized in that the owner information of a registered product can be changed when a predetermined operation for changing the owner information is performed.
[0079] That is, as shown in Fig. 9, the registered item management system 60 according to this embodiment transfers the ownership of a registered item and updates the changed owner information by performing a predetermined operation using the user terminal 14 used by each of a plurality of users U. Details of the operation will be described later. In Fig. 9, the user U who is the current owner of the registered item is shown as user UO, and the user U who is the new owner to whom the ownership is transferred is shown as user UN.
[0080] <Functional Configuration (Server)> Fig. 10 is a diagram showing an example of the functional configuration of the server 62. As shown in Fig. 10, the server 62 includes a communication unit 20, a storage unit 64, and a processing unit 66. The storage unit 64 is substantially the same as the storage unit 22 in the first embodiment, except that a management program 650 is stored in place of the management program 220.
[0081] The processing unit 66 is realized by the processor 120 (see FIG. 2 ) reading and executing the management program 650 from the memory 122 and cooperating with other hardware components. The processing unit 66 includes an information acquisition unit 242, a feature extraction unit 244, a similarity calculation unit 246, a match determination unit 248, a determination result notification unit 250, and a relocation control unit 660.
[0082] The transfer control unit 660 transfers the ownership of registered items between multiple users U and updates the owner information. Specifically, when the current owner of a registered item (user UO, omitted below) specifies a new owner (user UN, omitted below) to whom the ownership is to be transferred on his or her own user terminal 14 and applies for the ownership transfer procedure, an ownership transfer notification is sent to the user terminal 14 of the new owner. Then, when the new owner accepts the transfer in response to the ownership transfer notification, a notification of acceptance is sent to the server 62, and the owner information of the registered item is updated and stored in the owner information DB 226. The above operations are examples of predetermined operations for changing owner information, but are not limited to these.
[0083] <Processing Executed by the Registered Product Management System> Next, the operation of the registered product management system 60 will be described. FIG. 13 is a sequence diagram showing an example of the flow of ownership transfer processing by the registered product management system 60. The processors 120 and 140 read out the management program 650 stored in the storages 124 and 144, and then load and execute the program in the memories 122 and 142, thereby performing the ownership transfer processing. Note that the determination processing performed by the registered product management system 60 is the same as that in the first embodiment, and therefore a description thereof will be omitted. Furthermore, although not shown, when the processors 120 and 140 receive an operation to terminate the registered product management system 60, they terminate the processing based on the management program 650 that is currently being processed.
[0084] When the processor 140 of the current owner's user terminal 14 detects an input of a transfer start operation for transferring the ownership of the registered item by the current owner, the processor 140 transmits the information to the server 62 (step S200).
[0085] When the processor 120 of the server 62 receives the input information for the transfer start operation, it notifies the user terminal 14 of the current owner of the registered item to input the transfer information required for the transfer of ownership (step S202).
[0086] When the processor 140 of the current owner's user terminal 14 receives the notification of the transfer information input request from the server 62, it displays an input screen for inputting the transfer information on the display, which is the output device 152 (step S204, see FIG. 11). Note that the transfer information includes, for example, information related to the new owner, such as the transfer destination information and the transfer date.
[0087] When the current owner inputs the transfer information and inputs the transfer execution operation (transfer procedure application), the processor 140 of the current owner's user terminal 14 transmits the information to the server 62 (step S206).
[0088] When the processor 120 of the server 62 receives the transfer information and the transfer execution operation input information, it notifies the new owner's user terminal 14 to input consent information regarding the ownership transfer based on the transfer information (ownership transfer notification) (step S208).
[0089] When the processor 140 of the new owner's user terminal 14 receives a notification from the server 62 requesting input of consent information, it displays an input screen on the display, which is the output device 152, for inputting whether or not the user consents to the transfer of ownership of the registered item to the new owner (step S210, see Figure 12).
[0090] When the new owner inputs operational information indicating whether or not he / she consents to the transfer of ownership, the processor 140 of the new owner's user terminal 14 transmits information related to the operation to the server 62 (step S212).
[0091] When the processor 120 of the server 62 receives the information related to consent to the ownership transfer, it determines from the information whether the new owner consented to the ownership transfer (step S213). If the new owner did not consent (step S213: NO), the processor 120 proceeds to step S218, which will be described later. On the other hand, if the new owner consented (step S213: YES), the processor 120 changes the information related to the owner of the registered item to the new owner (step S214), updates the history information, which is information showing the previous owners of the registered item in chronological order (step S216), and, after these processes are completed, notifies the user terminals 14 of the current and new owners that the processes have been completed (step S218).
[0092] When the user terminal 14 of each of the current owner and new owner receives notification from the server 62 that the processing has been completed, the user terminal 14 displays a message on the display of the output device 130 indicating that the processing has been completed (steps S220 and S222).
[0093] (Operations and Effects of Second Embodiment) Next, operations and effects of the second embodiment will be described.
[0094] The above configuration is similar to the registered product management system 10 of the first embodiment, except that the owner information of a registered product can be changed by performing a predetermined operation to change the owner information, and therefore provides the same effects as the first embodiment. Furthermore, the registered product management system 60 stores owner information of registered products in the server 62. When the current owner of a registered product performs a predetermined operation to apply for ownership transfer procedures from their own user terminal 14, an ownership transfer notice is sent to the user terminal 14 of the new owner. When the new owner accepts the transfer in response to the ownership transfer notice, a notice of acceptance is sent to the server 62, and the owner information of the registered product is changed. This allows the current and new owners to confirm their mutual intentions before recording the transfer of ownership.
[0095] Furthermore, because the owner information is stored in the server 62, the cost of changing the owner information can be reduced compared to when the owner information is recorded on the blockchain 16. This makes it easier to carry out transactions and management that involve the transfer of ownership.
[0096] 14 to 16, a registered product management system 70 according to a third embodiment of the present invention will be described. The registered product management system 70 according to the third embodiment has the same basic configuration as the first embodiment, and is characterized in that when the user terminal 14 acquires the determination information, the user is notified of the acquisition method. The acquisition method will be described later.
[0097] 14 is a diagram showing an example of the functional configuration of the server 72 constituting a part of the registered product management system 70. The server 72 includes a communication unit 20, a storage unit 74, and a processing unit 76.
[0098] The storage unit 74 is realized by the memory 122 and the storage 124 (see FIG. 2 ). The storage unit 74 stores a management program 740 executed by the processing unit 76, and also stores various types of information including a trained model 222, a registered product DB 224, an owner information DB 226, and an assessment information DB 228.
[0099] The processing unit 76 is realized by the processor 120 reading and executing a management program 740 from the memory 122 (see FIG. 2 ) and working in cooperation with other hardware components. The processing unit 76 includes an information acquisition unit 242, a feature extraction unit 244, a similarity calculation unit 246, a match determination unit 248, a determination result notification unit 250, and an acquisition method generation unit 760.
[0100] When starting the evaluation of the evaluated product A, the acquisition method generation unit 760 analyzes the evaluation information of the registered product to be evaluated selected and input by the user U and extracts feature quantities from the evaluation information. Information regarding the acquisition method for obtaining evaluation information that provides feature quantities corresponding to the feature quantities of the registered product is generated and notified to the user terminal 14. Here, the acquisition method specifically indicates the orientation, shooting position, angle of view, and lighting conditions of at least one of the evaluated product A and the user terminal 14 when photographing the evaluated product A with the user terminal 14. In other words, the information regarding the acquisition method is notified to the user terminal 14 as a shooting guide when photographing the evaluated product A. By photographing the evaluated product A according to the information regarding the acquisition method, the user U can easily calculate the similarity between the feature quantities extracted from the video information (evaluation information) and the feature quantities extracted from the evaluation information of the registered product. This allows for stable evaluation results. As an acquisition method, a video identical to the evaluation information of the registered product from which feature quantities were most accurately extracted may be superimposed on a preview image when photographing the evaluated product A.
[0101] <Processing Executed by the Registered Product Management System> Next, the operation of the registered product management system 70 will be described. Figure 16 is a sequence diagram showing an example of the flow of the determination process by the registered product management system 70. The processors 120, 140 read out the management program 740 stored in the storages 124, 144, and execute it by loading it into the memories 122, 142, thereby performing the determination process. Note that the same processes as those in the first embodiment are denoted by the same reference numerals, and their description will be omitted.
[0102] After processing step S112, the processor 140 of the user terminal 14 displays a screen where the registered items that have already been registered and are to be evaluated can be selected in a list format (step S300), and transmits information about the registered items selected and input by the user U from this screen to the server 72 (step S302).
[0103] The processor 120 of the server 72 extracts the evaluation information related to the registered product selected by the user U from the evaluation information DB 228 and analyzes it to extract the feature amount (step S304).
[0104] The processor 120 generates information regarding an acquisition method for obtaining judgment information corresponding to the feature quantities of the registered product (step S306) and notifies the user terminal 14 (step S308). That is, as an example, if judgment can be made effectively by using feature quantities of the registered product that can be obtained from an image of the registered product taken from diagonally below, the processor 120 generates "taking a picture of the product A to be judged from diagonally below" as the acquisition method and notifies the user terminal 14. Similarly, if judgment can be made effectively by using feature quantities of the registered product that can be obtained from an image of the registered product taken from diagonally to the right, the processor 120 generates "taking a picture of the product A to be judged from diagonally to the right" as the acquisition method and notifies the user terminal 14. Note that step S308 corresponds to the "acquisition method notification step" recited in claim 5.
[0105] When the processor 140 of the user terminal 14 receives notification of the acquisition method from the server 72, it displays a shooting guide so that the user U can shoot according to the acquisition method (step S310). Specifically, as shown in FIG. 15(A), for example, when the acquisition method is set to "taking a photo of the judged product A from diagonally below," an image reproducing the object OB resembling the judged product A as seen from diagonally below is superimposed on the preview of the shooting screen. Similarly, as shown in FIG. 15(B), when the acquisition method is set to "taking a photo of the judged product A from diagonally to the right," an image reproducing the object OB resembling the judged product A as seen from diagonally to the right is superimposed on the preview of the shooting screen. Thereafter, as shown in FIG. 16, the processor 140 proceeds to processing of step S114.
[0106] (Operations and Effects of Third Embodiment) Next, operations and effects of the third embodiment will be described.
[0107] The above configuration is similar to the registered product management system 10 of the first embodiment, except that the acquired information is notified when the evaluation information is acquired by the user terminal 14, and therefore the same effects as those of the first embodiment can be obtained. Furthermore, the registered product management system 70 performs an acquisition method notification step of notifying information regarding an acquisition method for acquiring evaluation information that allows calculation of similarity with the feature quantities of the registered product. This makes it easier to calculate the similarity between the feature quantities extracted from the evaluation information of evaluated product A and the feature quantities extracted from the evaluation information of the registered product. In other words, the evaluation results can be stabilized.
[0108] The registered product management system 70 of this embodiment has a basic configuration similar to that of the first embodiment, and is characterized in that the acquisition method is notified when the judgment information is acquired by the user terminal 14, but is not limited to this, and the acquisition method may also be notified as in the second embodiment.
[0109] (Variation 1) In the first to third embodiments described above, the determination information is moving image information, but this is not limited thereto. The determination information may also be point cloud information. That is, the user terminal (not shown) in Variation 1 is provided with a point cloud information acquisition device as an input device. Specific examples of this point cloud information acquisition information include, but are not limited to, LIDAR, a stereo vision camera, and a 3D scanner using a structured light method. Point cloud information of the surface of the product A to be determined is acquired as the determination information by this point cloud information acquisition device.
[0110] In the first modification, a server (not shown) receives the acquired point cloud information from the user terminal and extracts point cloud features from the point cloud information as features of the product to be evaluated A. Here, the point cloud features are features obtained by processing information such as the three-dimensional coordinate information of each point obtained from the point cloud information and the color of each point. Similarity is calculated from the point cloud features of the product to be evaluated A and the three-dimensional information of the registered product that has been registered in advance, and a determination is made as to whether the product to be evaluated matches the registered product. In other words, according to this configuration, a determination is made as to whether the product to be evaluated A matches the registered product based on the point cloud features. This enables a determination to be made using determination information that more accurately captures the shape and position of the product to be evaluated A. Furthermore, because point cloud features are less susceptible to the effects of lighting conditions and obstructions, the identification and determination of the product to be evaluated A can be made more robustly. These factors improve the accuracy of the determination and reduce the effects of the environment in which the product to be evaluated A is placed.
[0111] Furthermore, in this configuration, the acquisition method may be notified as in the third embodiment. In this case, the acquisition method is information such as the orientation and position of the point cloud information acquisition device relative to the product A to be determined, but is not limited to this and may be other information.
[0112] (Variation 2) Unlike the above-described Variation 1, the judgment information may be acoustic information. That is, the user terminal (not shown) in Variation 2 is provided with an acoustic information acquisition device as an input device. Specific examples of this point cloud information acquisition information include, but are not limited to, the above-described microphone, a laser Doppler vibrometer, an acoustic camera, and the like. The acoustic information acquisition device acquires acoustic information of the item A to be judged as judgment information. Specifically, the acoustic information of the item A to be judged may be, for example, a sound emitted when a specific position on the item A to be judged is lightly tapped if the item A to be judged is ceramic. However, the acoustic information may be, for example, a sound emitted by the item A to be judged when it is vibrated, or other acoustic information.
[0113] In Modification 2, when a server (not shown) receives the acquired acoustic information from the user terminal, it extracts acoustic features from the acoustic information as features of the product to be evaluated A. A similarity is calculated between the acoustic features of the product to be evaluated A and the acoustic information of a registered product that has been registered in advance, and it is determined whether the product to be evaluated matches the registered product. In other words, according to this configuration, it is determined whether the product to be evaluated A matches the registered product based on the acoustic features. This makes it possible to obtain evaluation information without being affected by the lighting environment in which the product to be evaluated A is placed. Furthermore, it is also possible to perform evaluation on registered products that have distinctive internal configurations.
[0114] Furthermore, in this configuration, similarly to Modification 1, the acquisition method may be notified as in the third embodiment. In this case, the acquisition method is information such as the position to strike the product to be judged A, the strength of the strike, the timing of the strike, and the operation method such as shaking the product to be judged A as a specific method of acquiring acoustic information from the product to be judged A, but is not limited to this and may be other information.
[0115] As a modification example, the determination information is point cloud information or acoustic information, but is not limited to these, and other information such as text information or position information may also be used.
[0116] (Modification 3) In addition, in the first to third embodiments described above, the owner information is configured to be stored in the servers 12, 64, and 72, but this is not limiting, and the owner information may be recorded on the blockchain 16. That is, as shown in FIG. 17 , a server 82 in a registered product management system 80 of Modification 3 includes a communication unit 20, a storage unit 84, and a processing unit 86.
[0117] The storage unit 84 is realized by the memory 122 and the storage 124 (see FIG. 2). The storage unit 84 stores a management program 840 executed by the processing unit 86, as well as various types of information including a trained model 222, a registered product DB 224, and an assessment information DB 228. That is, the storage unit 84 does not have the owner information DB 226 (see FIG. 4) as compared to the storage unit 22 of the first embodiment.
[0118] The processing unit 86 is realized by the processor 120 reading and executing the management program 840 from the memory 122 (see FIG. 2 ) and working in cooperation with other hardware components. The processing unit 86 includes an information acquisition unit 242, a feature extraction unit 244, a similarity calculation unit 246, a match determination unit 248, a determination result notification unit 250, and an owner information control unit 860.
[0119] The owner information control unit 860 stores, updates, and acquires information about the owner of the registered product on the blockchain 16. As an example, if it is determined that the registered product matches the determined product A, the match determination unit 248 acquires the registered product information from the blockchain 16, and the owner information control unit 860 acquires the owner information from the blockchain 16 and transmits it to the user terminal 14. Furthermore, if a predetermined procedure for transferring ownership is carried out, the owner information control unit 860 updates the owner information.
[0120] According to the registered product management system 80 in Modification 3, not only registered product information but also owner information is stored on the blockchain 16, making it possible to prevent tampering with the owner of the registered product and, in turn, ownership. Note that in Modification 3, registered product information is recorded on the blockchain 16 as in the first to third embodiments described above, but this is not limiting and the registered product information may also be stored on the servers 12, 64, and 72. This allows more registered product information to be stored than when it is recorded on the blockchain 16, making it possible to enrich the certification information presented, including the registered product information.
[0121] Furthermore, in Modification 3, the judgment information is stored in the server 82 (judgment information DB 228), but this is not limiting, and the judgment information may also be stored on the blockchain 16. This makes it possible to prevent tampering with the judgment information, resulting in an even more secure system.
[0122] (Modification 4) On the other hand, the registered product information, owner information, and evaluation information may all be stored in a server. That is, as shown in Fig. 18 , a server 92 in a registered product management system 90 of Modification 4 includes a communication unit 20, a storage unit 94, and a processing unit 96.
[0123] The storage unit 94 is realized by the memory 122 and the storage 124 (see FIG. 2 ). The storage unit 94 stores a management program 940 executed by the processing unit 96, and also stores various information including a trained model 222, a registered product DB 224, an owner information DB 226, an assessment information DB 228, and a registered product information DB 942.
[0124] The registered item information DB 942 is a database that stores information on registered items, which are artworks that have been registered in advance using a predetermined method. The registered item information DB 942 stores, for example, unique registered item ID information, which is identification information for the registered item, registered item information, information about the owner of the registered item stored in the owner information DB 226 and the evaluation information DB 228, and evaluation information for the registered item, all of which are linked to each other.
[0125] The processing unit 96 is realized by the processor 120 reading and executing a program from the memory 122 (see FIG. 2 ) and working in cooperation with other hardware components. The processing unit 96 includes an information acquisition unit 242, a feature extraction unit 244, a similarity calculation unit 246, a match determination unit 960, and a determination result notification unit 962.
[0126] The match determination unit 960 determines whether the determined product and the registered product match based on the calculated similarity. In this determination, a match may be determined if the similarity is equal to or greater than a predetermined value, or a match may be determined only if there is a perfect match. Furthermore, if the determination result is "match," the match determination unit 248 obtains registered product information for the matching registered product from the registered product information DB 942.
[0127] The determination result notification unit 962 transmits information to notify the user terminal 14 of the determination result. If the determination result is "match," the determination result notification unit 962 also transmits the registered product information acquired by the match determination unit 248 from the registered product information DB 942 to the user terminal 14.
[0128] According to the registered product management system 90 of the above-mentioned variant example 4, management of all information is achieved by managing information stored on the server 92, making it easier to build the system and increasing scalability.
[0129] In addition to the configurations described in the above-mentioned Modifications 3 and 4, the following combinations may be used for the recording destinations of the assessment information, owner information, and registered product information. That is, the assessment information may be recorded on the blockchain 16, and the owner information and registered product information may be stored on a server. In this case, it is possible to simultaneously suppress tampering with the assessment information, change the owner information at low cost, and enhance the certification information presented, including the registered product information.
[0130] Furthermore, the assessment information and registered product information may be recorded on the blockchain 16, and the owner information may be stored on the server. In this case, it is possible to both prevent tampering with the assessment information and registered product information and change the owner information at low cost.
[0131] Furthermore, the assessment information and owner information may be recorded on the blockchain 16, and the registered product information may be stored on the server. In this case, it is possible to both prevent tampering with the assessment information and owner information and enrich the certification information presented, including the registered product information.
[0132] In addition, the configurations of the above-mentioned first to third embodiments and variants 1 to 4 include at least a server and a user terminal that are connected to each other so that they can communicate with each other via a network N, but this is not limited to this, and the configuration may also be such that only the server itself performs the process from obtaining the judgment information to displaying the judgment results.
[0133] <Additional Notes> This embodiment includes the following disclosure.
[0134] (Supplementary Note 1) A registered product management method executed by an information processing device to manage registered products, the registered product management method includes: a judgment information acquisition step of acquiring judgment information for determining whether a judged product matches the registered product; a feature extraction step of extracting features from the judgment information; a calculation step of calculating the similarity between the features of the judged product and the features of the registered product; a judgment step of determining whether the judged product matches the registered product based on the similarity; and a notification step of notifying the judgment result obtained by the judgment step.
[0135] (Supplementary Note 2) The registered product management method according to Supplementary Note 1, wherein the evaluation information is at least one of image information and video information of the evaluated product, and the feature amount is an image feature amount.
[0136] (Supplementary Note 3) The registered product management method according to Supplementary Note 1, wherein the evaluation information is point cloud information obtained by measuring the evaluation product, and the feature amount is a point cloud feature amount.
[0137] (Supplementary Note 4) The registered product management method according to Supplementary Note 1, wherein the evaluation information is acoustic information emitted by the evaluated product, and the feature amount is an acoustic feature amount.
[0138] (Supplementary Note 5) The registered product management method according to Supplementary Note 1, wherein the information processing device performs an acquisition method notification step of notifying information about an acquisition method for acquiring the judgment information that allows calculation of similarity with the feature amount of the registered product.
[0139] (Supplementary Note 6) The registered item management method described in Supplementary Note 1, wherein the information processing device stores owner information, which is information about the owner of the registered item, and when a predetermined operation for changing the owner information is performed, the owner information is changed.
[0140] (Supplementary Note 7) The registered item management method according to Supplementary Note 6, wherein the predetermined operation is an operation of accepting the transfer of ownership performed in response to an ownership transfer notice sent to a new owner to whom the ownership of the registered item is to be transferred.
[0141] (Supplementary Note 8) The registered product management method according to Supplementary Note 1, wherein the registered product information, which is information relating to the registered product, is recorded on a blockchain network in which multiple blockchain control terminals are interconnected.
[0142] (Supplementary Note 9) The registered product management method according to Supplementary Note 1, wherein owner information, which is information relating to an owner of the registered product, is stored in the information processing device.
[0143] (Supplementary Note 10) The registered item management method according to Supplementary Note 1, wherein owner information, which is information relating to the owner of the registered item, is recorded on a blockchain network in which multiple blockchain control terminals are interconnected.
[0144] (Supplementary Note 11) The registered product management method according to Supplementary Note 1, wherein the evaluation information of the registered product is stored in the information processing device.
[0145] (Supplementary Note 12) The registered product management method according to Supplementary Note 1, wherein the assessment information of the registered product is recorded on a blockchain network in which a plurality of blockchain control terminals are interconnected.
[0146] (Appendix 13) A program for causing an information processing device for managing registered products to execute a registered product management method, the program comprising: a judgment information acquisition step for acquiring judgment information for determining whether a judged product matches the registered product; a feature extraction step for extracting features from the judgment information; a calculation step for calculating the similarity between the features of the judged product and the features of the registered product; a judgment step for determining whether the judged product matches the registered product based on the similarity; and a notification step for notifying the judgment result obtained by the judgment step.
[0147] (Supplementary Note 14) A registered product management system for managing registered products, in which multiple information processing devices are connected via a network, the registered product management system performs the following steps: a judgment information acquisition step for acquiring judgment information for determining whether a judged product matches the registered product; a feature extraction step for extracting features from the judgment information; a calculation step for calculating the similarity between the features of the judged product and the features of the registered product; a judgment step for determining whether the judged product matches the registered product based on the similarity; and a notification step for notifying the judgment result obtained by the judgment step.
[0148] The embodiments disclosed herein are illustrative in all respects and should not be considered limiting. The scope of the present invention is defined by the claims, not by the above meaning, and is intended to include all modifications within the meaning and scope of the claims. Furthermore, the present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present invention.
[0149] 10 Registered product management system 12 Server 14 User terminal (information processing device) 16 Blockchain (blockchain network) 60 Registered product management system 62 Server (information processing device) 70 Registered product management system 72 Server (information processing device) 80 Registered product management system 82 Server (information processing device) 90 Registered product management system 92 Server (information processing device) A Determining product
Claims
1. A registered product management method executed by an information processing device to manage registered products, comprising: a judgment information acquisition step of acquiring judgment information for judging whether a judged product matches the registered product; a feature extraction step of extracting features from the judgment information; a calculation step of calculating the similarity between the features of the judged product and the features of the registered product; a judgment step of judging whether the judged product matches the registered product based on the similarity; and a notification step of notifying the judgment result obtained by the judgment step.
2. The registered product management method according to claim 1, wherein the evaluation information is at least one of image information and video information of the evaluated product, and the features are image features.
3. The registered product management method according to claim 1, wherein the judgment information is point cloud information obtained by measuring the judged product, and the feature amount is a point cloud feature amount.
4. The registered product management method according to claim 1, wherein the judgment information is acoustic information emitted by the judged product, and the feature is an acoustic feature.
5. The registered product management method according to claim 1, wherein the information processing device performs an acquisition method notification step of notifying information regarding an acquisition method for acquiring the judgment information that enables calculation of similarity with the feature amount of the registered product.
6. The registered item management method according to claim 1, wherein the information processing device stores owner information relating to the owner of the registered item, and when a predetermined operation for changing the owner information is performed, the owner information is changed.
7. The registered item management method according to claim 6, wherein the predetermined operation is an operation of accepting the transfer of ownership, which is performed in response to a notice of transfer of ownership notified to a new owner to whom the ownership of the registered item is to be transferred.
8. The registered product management method according to claim 1, wherein the registered product information, which is information relating to the registered product, is recorded on a blockchain network in which multiple blockchain control terminals are interconnected.
9. The registered item management method according to claim 1, wherein owner information, which is information relating to an owner of the registered item, is stored in the information processing device.
10. The registered item management method according to claim 1, wherein owner information, which is information relating to the owner of the registered item, is recorded on a blockchain network in which multiple blockchain control terminals are interconnected.
11. The registered product management method according to claim 1, wherein the judgment information of the registered product is stored in the information processing device.
12. The registered product management method according to claim 1, wherein the judgment information of the registered product is recorded on a blockchain network in which multiple blockchain control terminals are interconnected.
13. A program for causing an information processing device for managing registered products to execute a registered product management method, the program including: a judgment information acquisition step for acquiring judgment information for judging whether a judged product matches the registered product; a feature extraction step for extracting features from the judgment information; a calculation step for calculating the similarity between the features of the judged product and the features of the registered product; a judgment step for judging whether the judged product matches the registered product based on the similarity; and a notification step for notifying the judgment result obtained by the judgment step.
14. A registered product management system for managing registered products, in which a plurality of information processing devices are connected via a network, the registered product management system performs the following steps: a judgment information acquisition step for acquiring judgment information for judging whether a judged product matches the registered product; a feature extraction step for extracting features from the judgment information; a calculation step for calculating the similarity between the features of the judged product and the features of the registered product based on the similarity; a judgment step for judging whether the judged product matches the registered product based on the similarity; and a notification step for notifying the judgment result obtained by the judgment step.
Citation Information
Patent Citations
Apparatus and method for identifying the original author of a work of art
JP2012527665A
Article information management apparatus, system, method and program
JP2018173692A
Authentication server and creator terminal
JP2022165801A
Article judgment system and article judgment method
WO2009044826A1
Device employed in veracity determination system
WO2014003030A1
