Information processing system

The information processing system addresses the heavy workload and accuracy issues in generating learning models by clustering, cleansing, and focusing on high-sales products, efficiently producing models for product identification on display shelves.

JP2024168365AActive Publication Date: 2024-12-05MARKETVISION CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2023084948
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-23
Publication Date
2024-12-05
Estimated Expiration
2043-05-23

AI Technical Summary

Technical Problem

Existing systems for generating learning data in machine learning, such as those described in Patent Documents 1 and 2, impose a heavy workload on workers and require extensive preparation of labeled image databases, making it difficult to efficiently generate learning models for product identification on display shelves.

Method used

An information processing system that includes a classification processing unit for clustering object image information, a temporary identification information processing unit for associating groups with temporary identification information, a model generation processing unit for generating learning models using machine learning, and a recognition processing unit for outputting temporary identification information, along with a cleansing process to exclude erroneous image information.

Benefits of technology

The system efficiently generates learning models by reducing the workload and improving accuracy through clustering, cleansing, and focusing on high-sales products, enabling effective product identification on display shelves.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024168365000001_ABST
    Figure 2024168365000001_ABST
Patent Text Reader

Abstract

To provide an information processing system related to generation of a learning model (a network) in machine learning.SOLUTION: An information processing system executes processing related to a learning model to be used by machine learning. The information processing system includes a classification processing part for classifying image information of a plurality of objects, a temporary identification information processing part for associating a classified group with temporary identification information, a model generation processing part for executing learning processing of the machine learning to generate a learning model by using learning data including the image information of objects included in the group and the temporary identification information, a recognition processing part for outputting the temporary identification information by inputting sample information receiving an input into the learning model, and an output processing part for associating the outputted temporary identification information with object identification information corresponding to the sample information.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an information processing system for generating a learning model (network) in machine learning. [Background technology]

[0002] In recent years, machine learning has become widely used as a method of image analysis using computers. In machine learning, a learning data set (learning data) is created in advance, and the computer is then loaded with the data to execute a specific learning process.

[0003] However, preparing learning data in advance itself is a heavy workload. To address this issue, systems such as those shown in Patent Documents 1 and 2 below have been disclosed.

[0004] In the invention of Patent Document 1, a product image is photographed, and a code attached to the product is read, whereby the product image is created and labeled, thereby generating learning data.

[0005] Furthermore, in the invention of Patent Document 2, a classification of an object contained in image data is selected from an image database in which image data including objects that have been labeled with information relating to the classification in advance is stored, and the object is extracted from the image data to generate a template image, thereby generating learning data that is labeled with the template image. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] JP 2020-095537 A [Patent Document 2] Patent Publication No. 2022-076296 Summary of the Invention [Problem to be solved by the invention]

[0007] In the case of the invention of Patent Document 1, the product is prepared, photographed, and the code attached to the product is read by a code reader to generate learning data, which places a heavy burden on the worker. If there are many products to be read as learning data, the amount of work becomes enormous.

[0008] In the case of the invention of Patent Document 2, the processing cannot be performed unless an image database is prepared in which image data including objects labeled with information relating to their classification is stored in advance.

[0009] In retail stores and the like, it is extremely important for a company's marketing strategy to recognize products displayed on shelves and understand their display status, etc. Therefore, there is a demand to know the status of a company's own products or competitors' products displayed on shelves in retail stores.

[0010] There is a system that takes pictures of retail store shelves and identifies products displayed on the shelves, and machine learning is used to identify the products. In this machine learning, as in the above, learning processing is performed using learning data, but a wide variety of products are displayed on the shelves. In this case, too, a learning model was generated using learning data in which the displayed products are associated with their identification information as labels.

[0011] However, even in this case, the burden of preparing the learning data is large, and the burden of generating the learning model is also large. [Means for solving the problem]

[0012] In view of the above problems, the present inventors have invented an information processing system that efficiently generates a learning model for use in machine learning.

[0013] A first invention is an information processing system that executes processing related to a learning model used in machine learning, and includes a classification processing unit that classifies image information of a plurality of objects, a provisional identification information processing unit that associates the classified groups with provisional identification information, a model generation processing unit that executes a machine learning learning process using learning data including image information of objects included in the groups and the provisional identification information to generate a learning model, a recognition processing unit that inputs sample information that has been accepted as input into the learning model, thereby outputting provisional identification information, and an output processing unit that associates the output provisional identification information with object identification information corresponding to the sample information.

[0014] By configuring as in the present invention, it is possible to efficiently generate a learning model used in machine learning.

[0015] In the above-mentioned invention, the information processing system can be configured as an information processing system that inputs image information to be the subject of the identification process into the learning model, and outputs object identification information corresponding to the provisional identification information output by the learning model as an output value.

[0016] With the configuration of the present invention, when image information of an identification target is input to the learning model, object identification information can be output.

[0017] In the above-mentioned invention, the information processing system can be configured as an information processing system having a cleansing processing unit that executes a cleansing process to remove object image information that may contain errors from image information of objects included in the classified group.

[0018] By performing a cleansing process as in the present invention, it is possible to remove object image information contained in a group that may contain errors, thereby improving the accuracy of image classification.

[0019] In the above-mentioned invention, the cleansing processing unit can be configured as an information processing system that determines image information of objects to be excluded using an information distance from a reference value calculated using an index value of image information of the objects included in the group.

[0020] In the above-mentioned invention, the cleansing processing unit can be configured as an information processing system that calculates a reference value using an index value of image information of objects included in the group, calculates an information distance using the reference value and the index value of the image information of the objects, and if there is a deviation of the information distance by a predetermined threshold value or more or a predetermined ratio or more, determines the image information of the object to be image information of an object to be excluded.

[0021] In the above-mentioned invention, the cleansing processing unit can be configured as an information processing system that determines image information of objects to be excluded using a similarity of image information of objects included in the group.

[0022] In the above-mentioned invention, the cleansing processing unit can be configured as an information processing system that calculates a similarity between image information of an object included in the group and image information of other objects included in the group, and if a predetermined condition using the similarity is satisfied, determines the image information of that object as image information of an object to be excluded.

[0023] The cleansing process can be carried out as in these inventions.

[0024] In the above-mentioned invention, the object is a product displayed on a display shelf, and the classification processing unit can be configured as an information processing system that cuts out image information of the displayed product from image information of the display shelf and extracts it as object image information, compares the similarity of the object image information of the adjacent products, and if the similarity satisfies certain conditions, classifies the object image information of the adjacent products into the same group.

[0025] Products of the same type are often displayed adjacent to each other on a display shelf. Therefore, when the object is a product displayed on a display shelf, the object image information of adjacent products may be classified as the same type, i.e., into the same group. Therefore, it is preferable to compare the similarity of the object image information of adjacent products and classify them into the same group if the similarity satisfies the conditions.

[0026] In the above-mentioned invention, the target object is a product displayed on a display shelf, and the recognition processing unit can be configured as an information processing system that inputs sample information of products corresponding to the sales amount received as input into the learning model and outputs provisional identification information corresponding to the sample information received by the learning model.

[0027] In the case of a learning model that identifies products on a shelf, the number of products can be in the thousands or even tens of thousands. In such cases, it is a heavy burden to input sample information for all products.

[0028] Generally, a small number of best-selling items account for the majority of sales. And it is highly likely that best-selling items are displayed on display shelves. Therefore, if best-selling items that are likely to be identified are input as sample information, even if it is not possible to identify all items displayed on display shelves, it is possible to recognize many items based on sales amount, and a system that is sufficient for practical purposes can be constructed.

[0029] In the above-mentioned invention, the target object is a product displayed on a display shelf, and the recognition processing unit can be configured as an information processing system that inputs sample information of products for each organizational entity that receives input into the learning model and outputs provisional identification information corresponding to the sample information received by the learning model.

[0030] When using the present invention for marketing, there are cases where a specific organization such as a specific company wants to know the display status of its own or its competitors' products. Therefore, by inputting sample information of products for each organization as in the present invention, even if it is not possible to identify all the products displayed on the shelves, it is possible to obtain important marketing information for that organization, and a system that is sufficient for practical purposes can be constructed.

[0031] The first invention can be realized by loading the program of the present invention into a computer and executing it. That is, the information processing program causes a computer to function as a classification processing unit that classifies image information of a plurality of objects, a tentative identification information processing unit that associates the classified groups with tentative identification information, a model generation processing unit that uses learning data including image information of objects included in the groups and the tentative identification information to execute a machine learning learning process to generate a learning model, a recognition processing unit that inputs input sample information to the learning model to output tentative identification information, and an output processing unit that associates the output tentative identification information with object identification information corresponding to the sample information. Effect of the Invention

[0032] By using the information processing system of the present invention, a learning model for use in machine learning can be efficiently generated. [Brief description of the drawings]

[0033] [Figure 1] FIG. 2 is a diagram showing an example of a conceptual diagram of processing in the information processing system of the present invention. [Diagram 2] FIG. 2 is a diagram showing an example of a conceptual diagram of processing in the information processing system of the present invention. [Diagram 3] 1 is a block diagram illustrating an example of a configuration of an information processing system according to the present invention. [Figure 4] FIG. 2 is a block diagram illustrating an example of a hardware configuration of a computer used in the information processing system of the present invention. [Diagram 5]4 is a flowchart showing an example of an entire processing process in the information processing system of the present invention. [Figure 6] FIG. 11 is a diagram showing an example of image information obtained by photographing a display shelf. [Figure 7] FIG. 13 is a diagram showing an example of a state in which object image information is extracted from image information obtained by photographing a display shelf. [Figure 8] 11 is a diagram showing an example of a state in which object image information is classified in an image classification processing unit; FIG. [Figure 9] 11 is a diagram showing an example of a state in which temporary identification information is associated in a temporary identification information processing unit; FIG. [Figure 10] 11 is a diagram showing an example of a state in which sample information is input to a learning model and tentative identification information is output as an output value. FIG. [Figure 11] FIG. 11 is a diagram showing an example of a state in which temporary identification information and object identification information are linked to each other. [Figure 12] FIG. 11 is a diagram illustrating an example of a configuration of an information processing system according to a second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0034] An example of a conceptual diagram of processing of the information processing system 1 of the present invention is shown in Fig. 1 and Fig. 2. Also, an example of a processing function of the information processing system 1 of the present invention is shown in a block diagram in Fig. 3. The information processing system 1 is a system that generates a model that recognizes objects such as products displayed on a display shelf from image information using a machine learning model. The object will be described using products displayed on a display shelf, but is not limited to this.

[0035] The management terminal 2 in the information processing system 1 is realized by using a computer. An example of the hardware configuration of a computer is shown in Fig. 4. The computer has a CPU that executes the arithmetic processing of a program, a storage device 71 such as a RAM or a hard disk that stores information, a display device 72 such as a display that displays information, an input device 73 such as a keyboard or a mouse that can input information, and a communication device 74 that transmits and receives the processing results of the arithmetic device 70 and the information stored in the storage device 71 via a network such as the Internet or a LAN.

[0036] In the case where the computer is equipped with a touch panel display, the display device 72 and the input device 73 may be integrally configured. Touch panel displays are often used in portable communication terminals such as tablet computers and smartphones, but are not limited to these.

[0037] The touch panel display is a device that integrates the functions of the display device 72 and the input device 73 in that input can be made directly on the display by a predetermined input device (such as a touch panel pen) or a finger.

[0038] The functions of the various means in the present invention are only logically distinct, and may be physically or practically the same area. The order of the processes in the various means of the present invention may be changed as appropriate. In addition, some of the processes may be omitted.

[0039] The management terminal 2 has a classification processing unit 20 , a tentative identification information processing unit 21 , a model generation processing unit 22 , a specimen information reception processing unit 23 , a recognition processing unit 24 , and an output processing unit 25 .

[0040] The classification processing unit 20 classifies the object image information by clustering processing or the like from image information of an object (object image information) captured in image information of, for example, a display shelf. When the object is a commodity displayed on a display shelf, the object image information may be image information of the commodity, for example, image information obtained by cutting out an area including the displayed commodity, which is the object, from image information of the display shelf. In this case, the cutout may be a rectangle, or the image information may be cut out in any shape according to the outer shape of the commodity.

[0041] Identification information of the object shown in the object image information (object identification information), for example, if the object is a product, its product name or code such as JAN code, does not need to be known.

[0042] A classification processing unit 20 executes clustering processing on a plurality of pieces of object image information using a known method, and classifies the image information into a plurality of groups.

[0043] Although the classification processing unit 20 classifies the object image information using clustering processing in the above description, the object image information may be classified using a method other than clustering processing.

[0044] The temporary identification information processing unit 21 associates temporary identification information (temporary identification information) with each group classified by the image classification processing unit 20. The temporary identification information may be automatically generated, or input temporary identification information may be associated by a predetermined operation. Then, the temporary identification information associated with the object image information classified into each group is associated as a label to form a data set, which is used as learning data.

[0045] The model generation processing unit 22 performs machine learning using the learning data by a known method to generate a learning model. That is, since the object image information is associated with provisional identification information for each classified group, the learning model is generated using learning data that uses a data set in which the object image information and its label are provisional identification information.

[0046] The specimen information reception processing unit 23 receives input of image information to be input to the model generation processing unit 22. The image information received as input here is object image information for which object identification information for identifying the object is known. For example, it is image information of a product that may be displayed on a display shelf, and is image information for which product identification information (object identification information) such as the product name, JAN code, or other code corresponding to the product is known. The image information input here is referred to as specimen information.

[0047] The recognition processing unit 24 inputs the image information (sample information) received by the sample information receiving processing unit 23 into the learning model generated by the model generation processing unit 22, and outputs tentative identification information. In this case, when sample information is input into a learning model in which the weighting coefficients between neurons in each layer of a neural network consisting of multiple intermediate layers are optimized, tentative identification information is output as an output value. When multiple output values ​​are output together with their probabilities, the output value with the highest probabilities is adopted.

[0048] The output processing unit 25 links the provisional identification information, which is the output value output by the recognition processing unit 24, with the object identification information of the sample information used for its input. Then, the output processing unit 25 outputs the object identification information linked to the provisional identification information output by the recognition processing unit 24 as the recognition result of the recognition processing unit 24.

[0049] In addition, instead of outputting object identification information linked to the provisional identification information output by the recognition processing unit 24, the output processing unit 25 may replace the provisional identification information associated with the group output by the image classification processing unit 20 with the object identification information and perform the machine learning learning process again in the model generation processing unit 22.

[0050] Furthermore, if the accuracy of the provisional identification information output by the recognition processing unit 24 is equal to or lower than a predetermined threshold, the processing of the output processing unit 25 does not need to be executed.

[0051] By performing the above-described processing, a learning model for use in machine learning can be efficiently generated. EXAMPLES

[0052] Next, an example of the processing of the information processing system 1 of the present invention will be described with reference to the flowchart in Fig. 5. In the following description, a case will be described in which products displayed on a display shelf are identified from image information obtained by photographing the display shelf. In this case, the target objects are the products displayed on the display shelf, and the target identification information is the product identification information.

[0053] First, image information of a display shelf on which products are displayed in a store or the like is corrected so that the products are positioned in a frontal position. In this case, various known methods can be used for the correction process, such as keystone correction. If the image information of the display shelf is image information taken from a frontal position, correction process does not need to be performed. In this case, the image information may be an image information of the entire display shelf, or may be an image information of a part of the display shelf, for example, an area of ​​one or more shelves. FIG. 6 shows an example of image information of the shelf area of ​​a display shelf corrected to a frontal position.

[0054] Then, from the corrected image information or the image information of the display shelf (image information to be processed), the area of ​​the displayed product is cut out by a known method and extracted as object image information. For example, from the corrected image information or the image information of the display shelf, the product area is identified by identifying thin and narrow shadows between products, identifying a repeating pattern of the image, identifying a step on the upper side of the package, identifying a partition position based on a constraint such as the product width being the same, and so on. As another method, the product area may be identified using machine learning such as deep learning. In this case, image information of the area to be processed, for example, the display shelf or shelf area, may be input to a learning model in which the weighting coefficient between neurons in each layer of a neural network consisting of many intermediate layers is optimized, and the product area may be identified based on the output value. In addition, as the learning model, the image information of various areas to be processed, for example, the display shelf or shelf area, to which the product area is given as correct answer data may be used.

[0055] Fig. 7 shows an example of image information obtained by extracting object image information from image information of the shelf area of ​​the display shelf in Fig. 6. At this point, since object image information has only been extracted from image information showing the display shelf, the product identification information of the product, which is the object shown in the object image information, does not need to be known.

[0056] Then, the image classification processing unit 20 uses the object image information to perform a known clustering process or the like to group similar image information together and classify the image information into a plurality of groups (S100). This state is shown diagrammatically in FIG.

[0057] The temporary identification information processing unit 21 associates temporary identification information with each group classified by the classification processing unit 20 (S110). For example, arbitrary temporary identification information such as "a123", "b456", "c789", and "d012" is associated with each group. This state is shown in FIG. 9. In this way, the temporary identification information is associated as a label with the object image information of each group. A data set using this object image information and the labels of the temporary identification information is used as learning data.

[0058] When the classification processing unit 20 associates the provisional identification information with each group classified, the model generation processing unit 22 performs machine learning using a known method as learning data (S120) and generates a learning model (S130).

[0059] Next, the specimen information reception processing unit 23 receives input of specimen information, which is image information for which object identification information is known, and inputs the received input of the specimen information to the learning model generated in S130 (S140). The recognition processing unit 24 receives input of the specimen information, and outputs an output result based on machine learning using the learning model. As the output result, tentative identification information is output (S150). This is shown diagrammatically in FIG.

[0060] The specimen information is image information for which object identifying information, such as product identifying information, is known in advance. Therefore, the tentative identifying information output by the recognition processing unit 24 is considered to correspond to the object identifying information of the specimen information input to the learning model. Therefore, the output processing unit 25 links the output tentative identifying information with the object identifying information of the input specimen information (S160). For example, as shown in FIG. 11,

[0061] This linking makes it possible to associate the provisional identification information with the object identification information. Therefore, by storing this association, the provisional identification information output by the recognition processing unit 24 can be replaced with the corresponding object identification information and output. In this way, when image information to be subjected to the identification process is input to the learning model, the object identification information can be output as the output value of the learning model. EXAMPLES

[0062] The classification process performed by the image classification processing unit 20 may be less accurate than classification process performed by a human being. Therefore, errors may be mixed in. Therefore, a cleansing processing unit 26 may be provided that performs a cleansing process on the image information (target image information) of each group classified by the image classification processing unit 20, removes target image information that may contain errors from the image information classified into the groups, and reduces the amount of target image information used as learning data for the model generation processing unit 22. An example of the configuration of the information processing system 1 in this case is shown in FIG. 12.

[0063] That is, when the image classification processing unit 20 classifies the object image information into groups, index values ​​such as feature quantities that indicate the characteristics of the image information in the group are calculated. Then, in the group, the information distance from a reference value such as the median or average value of the index values ​​for each object image information is calculated (a value calculated using a predetermined formula as the deviation from the reference value to the index value for each image information), and object image information whose information distance deviates by a certain value or a certain ratio or more may be excluded from the group.

[0064] In addition to using the information distance as the cleansing process, the similarity of the image information may be used. In this case, the similarity between the image information in the group is quantified, and if the number of the image information with a certain degree of similarity is equal to or greater than a predetermined value, the image information is retained as the object image information, and if the number is less than the predetermined value, the image information is excluded from the object image information.

[0065] For example, if a group contains five pieces of target image information (image information 1 to image information 5), the similarity between each of the five pieces of image information and the other pieces of image information is calculated. That is, the similarity between image information 1 and image information 5 is calculated, between image information 2 and image information 5, between image information 2 and image information 5, between image information 3 and image information 5, between image information 3 and image information 5, and between image information 4 and image information 5. This allows the similarity between each piece of image information to be calculated.

[0066] For image information 1, the similarity with image information 2 is 0.9, the similarity with image information 3 is 0.95, the similarity with image information 4 is 0.3, and the similarity with image information 5 is 0.8; for image information 2, the similarity with image information 3 is 0.8, the similarity with image information 4 is 0.2, and the similarity with image information 5 is 0.6; for image information 3, the similarity with image information 4 is 0.4 and the similarity with image information 5 is 0.9; and for image information 4, the similarity with image information 5 is 0.5.

[0067] Here, if the similarity of the reference image information is 0.75 and the number of pieces of image information below the reference level is three, then for image information 1, one piece of image information 4 is below the reference similarity, for image information 2, two pieces of image information 4 and 5 are below the reference similarity, for image information 3, one piece of image information 4 is below the reference similarity, for image information 4, four pieces of image information 1, 2, 3, and 5 are below the reference similarity, and for image information 5, two pieces of image information 2 and 4 are below the reference similarity.

[0068] Therefore, the cleansing processing unit 26 excludes image information 4, which has three or more pieces of image information below the standard similarity, from the group, and executes processing by the provisional identification information processing unit 21 with four pieces of object image information for the group, namely image information 1, image information 2, image information 3, and image information 5.

[0069] By excluding the deviated image information from the grouped object image information as in this embodiment, the grouped object image information can be narrowed down, leading to improved accuracy. EXAMPLES

[0070] When extracting object image information by cutting out products displayed on a display shelf, generally, the same products are often placed adjacent to each other in either the top, bottom, left or right direction.

[0071] Therefore, after extracting object image information from image information photographed of the display shelves, the image classification processing unit 20 may compare the similarity of the object image information of adjacent products, and if it satisfies certain conditions, for example if the similarity is equal to or greater than a predetermined threshold, it may determine that the objects are of the same type, and classify the object image information of the adjacent products into the same group. EXAMPLES

[0072] When targeting products displayed on shelves, it is preferable to generate learning models of products that may be displayed in advance. However, in this case, the target products may be hundreds to thousands, or even tens of thousands. In this case, if a learning model capable of recognizing a learning model for thousands to tens of thousands is used, the sample information input by the sample information reception processing unit 23 will be in the thousands to tens of thousands, and although the amount of work is reduced compared to conventional learning models, the workload is still large.

[0073] On the other hand, it is known in marketing that generally about 10% of product types tend to account for about 90% of the sales of their classification. Therefore, products with high sales may be used as the specimen information to be input to the specimen information reception processing unit 23. In this case, products provided by a marketing company or the like may be used.

[0074] This allows recognition of about 90% of products based on sales, which is sufficient for practical purposes as output of object identification information. When a product with low sales is input to the learning model, the object identification information is not linked to the provisional identification information, so the output processing unit 25 outputs the provisional identification information as is. When the output processing unit 25 outputs provisional identification information that does not have a correspondence between the provisional identification information and the object identification information, a predetermined display such as "no correspondence information" may be displayed.

[0075] Furthermore, if it is sufficient to recognize only the products of a particular company or other organization, image information of the company's products may be input as sample information to the sample information reception processing unit 23. This allows object identification information to be output for the products of the particular company. On the other hand, when a product of a company other than the particular company is input, as in the above case, the object identification information is not linked to the provisional identification information, so the output processing unit 25 outputs the provisional identification information as is. When the output processing unit 25 outputs provisional identification information that does not correspond to the provisional identification information and the object identification information, a predetermined display such as "no correspondence information" may be displayed. EXAMPLES

[0076] For the learning model generated as in the first to fourth embodiments, the learning model may be reconstructed again for the purpose of improving accuracy. In this case, new sample information may be inputted, and object identification information may be newly linked to tentative identification information to which no object identification information is linked, or the classification process may be performed in the classification processing unit 20 using object image information of a new object so that the new object can be recognized. EXAMPLES

[0077] In the above-mentioned first to fifth embodiments, a learning model is generated for identifying products displayed on a display shelf from image information obtained by photographing the display shelf, but the present invention can be applied to other cases as well. In particular, the present invention is useful for automating the identification of many types of objects from image information.

[0078] As an example, the target may be an animal. For example, the method may be applied to a case where a large number of animals such as sea lions and fur seals live in a place where people cannot approach, and the type and number of animals living there are to be efficiently grasped. In this case, the habitat is photographed from the sky using a drone or the like, and object image information is cut out for each individual. The object image information for each individual is subjected to image classification processing by the image classification processing unit 20, and grouped. Then, the model generation processing unit 22 performs machine learning using learning data generated by the provisional identification information processing unit 21 by associating provisional identification information with each group, and generates a learning model. Then, the specimen information reception processing unit 23 receives input of specimen information by type, and the recognition processing unit 24 inputs the received specimen information as an input value into the learning model, and outputs provisional identification information. This allows the output processing unit 25 to output the object identification information by linking the provisional identification information with the object identification information (such as the scientific name of the animal) corresponding to the input specimen information.

[0079] As in the above, the target object may be a bird or a plant. Even in the case of a bird or a plant, the processing can be performed in the same manner as for the above-mentioned animal, and the processing can be performed by replacing "animal" with "bird" or "plant". [Industrial Applicability]

[0080] By using the information processing system 1 of the present invention, a learning model used in machine learning can be efficiently generated. [Explanation of symbols]

[0081] 1: Information processing system 2: Management terminal 20: Classification processing unit 21: Provisional identification information processing unit 22: Model generation processing unit 23: Specimen information reception processing unit 24: Recognition processing section 25: Output processing section 26: Cleansing processing section 70: Arithmetic device 71:Storage device 72:Display device 73: Input device 74:Communication equipment

Claims

1. An information processing system for performing processing related to a learning model used in machine learning, A classification processing unit that classifies image information of a plurality of objects; a temporary identification information processing unit that associates the classified groups with temporary identification information; a model generation processing unit that executes a machine learning learning process using learning data including image information of the objects included in the group and the provisional identification information to generate a learning model; a recognition processing unit that outputs provisional identification information by inputting the received sample information into the learning model; an output processing unit that associates the output tentative identification information with object identification information corresponding to the specimen information; An information processing system comprising:

2. The information processing system includes: inputting image information to be subjected to the identification process into the learning model, thereby outputting, as an output value, object identification information corresponding to provisional identification information output by the learning model; 2. The information processing system according to claim 1 .

3. The information processing system includes: a cleansing processing unit that executes a cleansing process to remove object image information that may contain errors from the image information of the objects included in the classified groups; 2. The information processing system according to claim 1, further comprising:

4. The cleansing processing unit includes: determining image information of an object to be excluded using an information distance from a reference value calculated using an index value of image information of the object included in the group; 4. The information processing system according to claim 3.

5. The cleansing processing unit includes: calculating a reference value using index values ​​of image information of objects included in the group; Calculating an information distance using the reference value and an index value of the image information of the object; If the information distance is equal to or greater than a predetermined threshold value or equal to or greater than a predetermined ratio, the image information of the object is determined to be image information of an object to be excluded.

5. The information processing system according to claim 4.

6. The cleansing processing unit includes: determining image information of an object to be excluded using a similarity of image information of the objects included in the group; 4. The information processing system according to claim 3.

7. The cleansing processing unit includes: Calculating a similarity between image information of the object included in the group and image information of other objects included in the group; When a predetermined condition using the similarity is satisfied, the image information of the object is determined as image information of an object to be excluded.

7. The information processing system according to claim 6.

8. The object is a commodity displayed on a display shelf, The classification processing unit includes: Image information of displayed products is extracted from the image information of the display shelves as object image information; Comparing the similarity of the object image information of the adjacent products; If the similarity satisfies a certain condition, the object image information of adjacent products is classified into the same group.

2. The information processing system according to claim 1 .

9. The object is a commodity displayed on a display shelf, The recognition processing unit is inputting sample information of products corresponding to the received input sales amount into the learning model, and outputting provisional identification information corresponding to the sample information received by the learning model; 2. The information processing system according to claim 1 .

10. The object is a commodity displayed on a display shelf, The recognition processing unit is inputting sample information of products for each organization that has received the input into the learning model, and outputting provisional identification information corresponding to the sample information received by the learning model; 2. The information processing system according to claim 1 .

11. Computer, a classification processing unit that classifies image information of a plurality of objects; a temporary identification information processing unit that associates the classified groups with temporary identification information; a model generation processing unit that executes a machine learning learning process using learning data including image information of the objects included in the group and the provisional identification information to generate a learning model; a recognition processing unit that outputs provisional identification information by inputting the received sample information into the learning model; an output processing unit that associates the output tentative identification information with object identification information corresponding to the specimen information; An information processing program characterized by causing the program to function as follows.

Citation Information

Patent Citations

  • Label addition device, label addition method, and program

    JP2013161295A

  • Image classifier, image classification method and computer program

    JP2020181404A

  • Image recognition support apparatus, image recognition support method, and image recognition support program

    JP2022190289A

  • Semi-supervised price tag detection

    US20180068180A1

  • Learning dataset automatic generation system, server, and learning dataset automatic generation program

    JP2020095537A