Storage container, information processing method, and program

Abstract

To reduce load on development of a program for performing management related to recovery of resources.SOLUTION: A terminal device is provided for a storage container that houses collected articles to be collected. The terminal device includes: a user identification information acquisition unit that acquires user identification information for identifying a user who puts a collected article into the storage container; an acquisition unit that acquires a collected article image which represents an image of the collected article; a first storage unit that stores information related to a collection target article being collected; a determination unit that determines whether or not the collected article is the collection target article on the basis of the information related to the collection object article and the collected article image; a placing detection unit that detects whether or not the collected article has been placed in a placing path of the storage container; and a second storage unit that stores the user identification information and a detection result of the placing detection unit.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a container, an information processing method, and a program. [Background technology]

[0002] Some packaging materials for products such as food and detergents are made from recyclable materials. These packaging materials can be collected after users have used the products and reused as resources. A system for managing the history of discarded and collected packaging materials has also been devised (see, for example, Patent Document 1). In this system, various modules, such as a scanner module for scanning tags, a camera module, and an RF reader module, are installed in a mobile terminal such as a smartphone or tablet terminal owned by a user, and when collecting packaging materials, the tags of the items to be collected are scanned and images are taken with a camera. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-131620 Summary of the Invention [Problem to be solved by the invention]

[0004] However, when various modules are installed in a mobile terminal to manage the history of collection, it is necessary to develop an application program compatible with the hardware of the mobile terminal. The model of the mobile terminal used by a user varies from user to user. Therefore, the OS (operating system) and the version of the OS installed vary depending on the model of the mobile terminal. Therefore, the service provider needs to prepare application programs corresponding to the type and version of the OS, and when the version of the OS is updated, it is necessary to prepare application programs corresponding to the updated version. Furthermore, application programs may differ depending on the model of the mobile terminal. Therefore, the burden of developing a program to manage the collection of resources increases. Furthermore, the application program must be downloaded by the user, and when an update to the application program is made, the updated application program must be downloaded.

[0005] The present invention has been made in consideration of the above circumstances, and its purpose is to provide a storage container, an information processing method, and a program that can reduce the burden associated with developing a program that performs management related to resource collection. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems, one aspect of the present invention is a storage container that includes a terminal device for storing collection items to be collected, the terminal device having a user identification information acquisition unit that acquires user identification information identifying a user who inserts the collection item into the storage container, an acquisition unit that acquires a collection item image representing an image of the collection item, a first memory unit that stores information about the collection item that is the subject of collection, a determination unit that determines whether the collection item is the collection item based on the information about the collection item and the collection item image, an insertion detection unit that detects whether the collection item has been inserted into the insertion path of the storage container, and a second memory unit that stores the user identification information and the detection result of the insertion detection unit.

[0007] Another aspect of the present invention is an information processing method to be executed by a computer which is a terminal device provided in a storage container that contains collection items to be collected, the information processing method including: acquiring user identification information that identifies a user who places the collection item in the storage container; acquiring a collection item image representing an image of the collection item; referencing a first memory unit that stores information about collection items that are subject to collection; determining whether the collection item is a collection item based on the information about the collection item and the collection item image; detecting whether the collection item has been placed into the insertion path of the storage container; and storing the user identification information and the determination result of whether the collection item has been placed into the insertion path of the storage container in a second memory unit.

[0008] Another aspect of the present invention is a program to be executed by a computer that is a terminal device provided in a storage container that contains collection items to be collected, the program including: acquiring user identification information that identifies a user who places the collection item in the storage container; acquiring a collection item image that represents an image of the collection item; referencing a first memory unit that stores information about the collection item to be collected; determining whether the collection item is the collection item based on the information about the collection item and the collection item image; detecting whether the collection item has been placed into the insertion path of the storage container; and storing the user identification information and the determination result of whether the collection item has been placed into the insertion path of the storage container in a second memory unit. Effect of the Invention

[0009] As described above, according to the present invention, it is possible to reduce the burden involved in developing a program for managing the collection of resources. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a perspective view illustrating an appearance of a storage container 10 according to an embodiment of the present invention. [Diagram 2] 2 is a cross-sectional view of the storage container 10 as viewed from the side. [Diagram 3] 1 is an external view showing an article P which is an example of a target object. [Figure 4] 1 is a system configuration diagram showing the configuration of a recycle management system S including a storage container 10. FIG. [Diagram 5] 2 is a schematic functional block diagram illustrating functions of devices provided in the storage container 10. FIG. [Figure 6] FIG. 2 is a sequence diagram illustrating the operation of the recycle management system S. [Figure 7] FIG. 2 is a sequence diagram illustrating the operation of the recycle management system S. [Figure 8] FIG. 2 is a sequence diagram illustrating the operation of the recycle management system S. [Figure 9] 5 is a flowchart showing an example of a collection determination process in the collection determination device according to the present embodiment. [Figure 10] 2 is a diagram showing an example of a display screen of the tablet terminal 11 according to the present embodiment. FIG. [Figure 11] 13 is a diagram showing another example of the display screen of the tablet terminal 11 according to the present embodiment. FIG. [Figure 12] 13 is a diagram showing another example of the display screen of the tablet terminal 11 according to the present embodiment. FIG. [Figure 13] 13 is a diagram showing another example of the display screen of the tablet terminal 11 according to the present embodiment. FIG. [Figure 14] 13 is a diagram showing another example of the display screen of the tablet terminal 11 according to the present embodiment. FIG. [Figure 15] 13 is a diagram showing another example of the display screen of the tablet terminal 11 according to the present embodiment. FIG. [Figure 16] 13 is a diagram showing another example of the display screen of the tablet terminal 11 according to the present embodiment. FIG. [Figure 17] 13 is a diagram showing another example of the display screen of the tablet terminal 11 according to the present embodiment. FIG. [Figure 18] 13 is a diagram showing another example of the display screen of the tablet terminal 11 according to the present embodiment. FIG. [Figure 19] 13 is a diagram showing another example of the display screen of the tablet terminal 11 according to the present embodiment. FIG. [Figure 20] 13 is a diagram showing another example of the display screen of the tablet terminal 11 according to the present embodiment. FIG. [Figure 21] FIG. 2 is a diagram showing an example of a display screen in the collection determination device according to the present embodiment. [Figure 22] 13 is a diagram showing another example of the display screen in the collection determination device according to the present embodiment. FIG. [Diagram 23] 13 is a diagram showing another example of the display screen in the collection determination device according to the present embodiment. FIG. [Figure 24] 13 is a diagram showing another example of the display screen in the collection determination device according to the present embodiment. FIG. [Diagram 25] FIG. 11 is a block diagram showing an example of the configuration of a collection determination device according to a second embodiment of the present invention. [Figure 26] 10 is a flowchart showing an example of an output process in the collection determination device according to the present embodiment. [Figure 27] FIG. 2 is a diagram showing an example of a display screen in the collection determination device according to the present embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, a recycle management system using a storage container according to one embodiment of the present invention will be described with reference to the drawings. (First embodiment) FIG. 1 is a perspective view showing the appearance of a storage container 10 according to an embodiment of the present invention. The storage container 10 stores objects to be collected. The objects to be collected are, for example, items made of recyclable materials. The objects are, for example, packaging materials, containers, cosmetics, stationery, electrical appliances, consumables, etc. Examples of packaging materials include food and beverage packages, containers for toiletry products, containers for refilling detergents, etc., and plastic may be used in part as a material. In addition to items made of recyclable materials, the objects to be collected may also be items (for example, products) that are subject to reuse, recall, voluntary collection, collection of used items, etc. In this embodiment, an example in which the items to be collected are cosmetics will be described.

[0012] The container is a container for storing food or beverages, and may be made partly from plastic. Cosmetics include eye shadow, powder foundation, powder type blush, eyeliner, eyebrow pencil, lipstick, etc. The stationery may be a ballpoint pen, a felt-tip pen, etc., and may be made partly of plastic as a material. Such stationery may be other than a writing instrument. In this embodiment, the collected items do not have item identification information attached thereto. The item identification information is information for identifying the item and is represented by a barcode. The item identification information may be information that can identify the item individually, or, if the item is a product, information that can identify the product, and may be, for example, a JAN (Japanese Article Number) code.

[0013] Some products have item identification information attached to them, or to the packaging containers or stickers that contain the products, but the item identification information may be removed from the products during the process of using the products. For example, some condiments such as mayonnaise and ketchup are used by opening a packaging container with the product identification information attached thereto and taking out the product itself. In this case, the packaging container with the product identification information attached thereto may be recycled or discarded separately from the product itself. In addition, the product identification information is printed on the outer box of the cosmetic product, and the product itself is removed from the outer box when it is used. In this case, the outer box with the product identification information attached thereto may be recycled or discarded separately from the product itself. In addition, stationery items such as ballpoint pens, felt-tip pens, glue, and adhesives may have a sticker with item identification information printed on it affixed to them, which is peeled off during use, or may be stored in a packaging container on which item identification information is printed and which is removed from the packaging container before use.

[0014] In this way, when an item is sold, the item identification information is attached, but when the item identification information is removed during use, it is difficult to identify the item using the item identification information. However, by collecting items that do not have such item identification information attached, the material can be regenerated into a reusable state and recycled. Even for items that have item identification information attached, there are cases where part of the area where the item identification information is printed or the like is cut off, or the printed item identification information cannot be read using a camera or the like due to scratches, dirt, or the like. In such cases, even if the item has item identification information attached, or even if the item identification information cannot be obtained from outside, the item may be subject to collection in this embodiment. Furthermore, even if an item is accompanied by item identification information, if the item is collected using equipment that is not equipped with a camera or the like, the item identification information cannot be used. However, even if an item is collected, it may still be subject to collection in this embodiment.

[0015] At least one such storage container 10 is installed at a collection center where the target objects are collected. The collection center is a base where the storage container 10 is installed, and may be, for example, any of a store, a commercial facility, a public facility, etc. A single storage container 10 may store different types of products, or a different storage container 10 may be installed for each type of product, and the products may be stored in the storage container 10 according to their type. The type may be a unit by which products are separated according to material, etc., when recycling.

[0016] The tablet terminal 11 is provided on the upper surface 10a, which is located above the middle level in the height direction of the container 10, via a columnar support member 10b. The tablet terminal 11 is attached above the upper surface 10a at an inclination angle different from that of the upper surface 10a. For example, the tablet terminal 11 is attached at an incline so that the upper end of the display screen of the tablet terminal 11 is located above the lower end of the display screen. The display screen of the tablet terminal 11 is attached so as to be located on the surface opposite to the surface facing the support member 10b. Here, the display screen of the tablet terminal 11 is visible to a user in the vicinity of the container 10. In addition, the inclination angle of the display screen of the tablet terminal 11 may be fixed or may be attached so as to be changeable. In addition, the length of the support member 10b in the height direction may be changeable, so that the position of the tablet terminal 11 in the height direction may be changeable.

[0017] The insertion slot 12 is disposed on the top surface 10a, closer to the user than the position where the tablet terminal 11 is disposed. The longitudinal direction of the insertion slot 12 is disposed along the water side of the top surface 10a. The longitudinal length and lateral length of the insertion slot 12 are determined to be any size, and here, are set to a size that allows the insertion of the object to be stored. By inserting objects to be stored through the insertion port 12, the objects are accumulated inside the storage container 10.

[0018] A door 13 is provided on a surface continuing from the top surface 10a at the end opposite to the end where the notice unit 14 is attached. The door 13 is locked and can be unlocked and opened by a collection person of the collection company using a key carried by the collection person. By opening the door 13, the objects accumulated inside the storage container 10 can be collected. Further, the door 13 is provided with a window 13a. The window is made of a transparent material, and the objects stored in the storage container 10 can be viewed from outside the storage container 10.

[0019] A notice section 14 is provided on a surface continuing from the upper end of the top surface 10a. The main surface of the notice section 14 is attached along the vertical direction, and notices posted on the notice section 14 can be seen by users of the storage container 10. Notices may be attached to the notice section 14 with an adhesive or a sticky material, or the notice content may be printed directly on the notice surface.

[0020] FIG. 2 is a cross-sectional view of the storage container 10 as viewed from the side. The inclination angle of the touch panel 11a of the tablet terminal 11 is set so that the upper end of the touch panel 11a is higher than the lower end of the touch panel 11a. The tablet terminal 11 is provided with a camera 11b. The imaging range of the camera 11b is set so as to capture an image of the upper part of the storage container 10. The camera 11b is provided on the same surface as the display screen of the touch panel 11a. Here, by adjusting the inclination angle of the tablet terminal 11 and the length of the support member 10b, it is possible to reduce or prevent anything other than the target object from being captured by the camera 11b. For example, it is possible to reduce or prevent the face of a user standing near the storage container 10 and using the tablet terminal 11 from being captured.

[0021] Guide member 12a is provided so as to be continuous with insertion port 12 and to be inclined downward inside storage container 10. Guide member 12a transports an object inserted from insertion port 12 along the inclination of guide member 12a and drops from an end of guide member 12a into storage section 17. Guide member 12a regulates the path along which the object inserted from insertion port 12 is transported.

[0022] The optical sensor 15 is provided on the lower surface side of the guide member 12a and detects whether or not the inserted object has passed over the guide member 12a. A hole is provided in a part of the guide member 12a, and the emitted light passes from the lower surface side to the upper surface side of the guide member 12a by passing through the hole. When the object has not passed, the optical sensor 15 does not receive the reflected light of the emitted light, and therefore detects that the object has not passed. On the other hand, when the object is transported along the upper surface of the guide member 12a and reaches the position of the optical sensor 15, the light emitted from the optical sensor 15 is reflected by the object. The optical sensor 15 detects that the object has passed by receiving this reflected light.

[0023] A weight sensor 16 is provided on the bottom surface of storage container 10. Weight sensor 16 detects the weight of the object stored in storage section 17. Weight sensor 16 detects the amount of the object stored in storage section 17 by detecting the weight. Since the weight of each piece of packaging material accumulated in storage section 17 may be about a few grams, the measurement with a relatively high measurement accuracy of weight sensor 16 allows for measurements with a smaller error.

[0024] 3 is an external view showing an example of an object, an item P. The item P is, for example, an eyeshadow, which is an example of cosmetics.

[0025] FIG. 4 is a system configuration diagram showing the configuration of a recycle management system S including the storage container 10. The recycling management system S includes a tablet terminal 11, a user terminal 20, a benefit management server 30, an SNS server 40, a product information management server 50, a distribution server 60, a collection management server 70, a gift server 80, and a distribution server 90, which are connected to each other via a network N so that they can communicate with each other. The item P is placed into the storage container 10. The network N includes at least one of the Internet, 4G, 5G, etc. The network N is connected by wire, but at least a part of the network N may be connected by wireless.

[0026] The tablet terminal 11 is provided in the container 10. The tablet terminal 11 has a first storage unit that stores information about the collection target item to be collected, and has a function of acquiring a collection target item image representing an image of the collection target item to be collected, and judging whether or not the collection target item is a collection target item based on the information about the collection target item and the collection target item image. The tablet terminal 11 functions as a collection judgment device. The user terminal 20 is a terminal device owned by a user, such as a smartphone or a tablet terminal. The reward management server 30 stores user information of a user who puts an item P into the container 10. The user information has a user information storage unit that stores information about the user (user identification information, name, address, telephone number, email address used to log in to the SNS server 40, password, etc.) in association with rewards (points, etc.) granted to the user. The privilege management server 30 also includes an update unit that updates the privilege information stored in the user information storage unit based on the privilege data received from the terminal device (the tablet terminal 11). The benefit management server 30 may utilize an existing server that provides services such as campaign application management and point management, and realize its functions as the benefit management server 30 by adding the necessary functions to the recycle management system S.

[0027] The SNS server 40 provides a communication service for exchanging messages between multiple user terminals 20. Messages are exchanged in at least one of chat format, voice call, and the like. The SNS server 40 downloads mobile messenger application software in response to a request from the user terminal 20, and allows messages to be sent and received between the multiple user terminals 20 on which this application software is installed. The SNS server 40 may be, for example, a server that provides an SNS (Social Networking Service).

[0028] The product information management server 50 stores product information. The product information (hereinafter also referred to as collection item data) is information that identifies collection items, and is information in which the JAN code, product code, product name, model number, color, manufacturer name, product image, information on whether the product is collection item, and the like are associated with each product. The information on collection items may be a stock keeping unit (SKU) that subdivides the product by size, design, color, and the like, information on the status of the collection item such as the presence and degree of dirt or damage, information on the remaining contents of the collection item, and the like. The information on collection items may include information used for sorting, such as a sorting method for collection items.

[0029] The product images include at least one of images of the product in an unused state, images of the product in use (also referred to as a state where use has been discontinued or a state where it has been partially used), and images of the product in a used state. The product images may include images that include part or all of the product, images of the product taken from different angles, images of the product depending on the state of the product, such as the presence or absence and degree of dirt or damage, images of the product including remaining contents, etc.

[0030] A recalled product is a product that is to be recalled, i.e., an item that is in the possession of a user and is to be recalled. In other words, a recalled product is a product that may be recalled, i.e., a product that is in the possession of a user and is to be determined as to whether it is a recalled product.

[0031] The collected item image is an image of the collected item photographed (scanned) by the user. The collected item image may be a still image or a moving image.

[0032] The distribution server 60 stores product information. The distribution server 60 receives and stores a product code from a terminal device or a server of the manufacturer of the product P. When a new product is released, the distribution server 60 additionally receives and stores the product information.

[0033] The collection management server 70 receives a detection result transmitted from the tablet terminal 11, which detects the amount of objects (items P) placed in the storage container 10. When the amount of the items P stored in the storage container 10 exceeds a reference value based on the detection result, the collection management server 70 transmits an instruction to collect the items P from the storage container 10, together with the installation location of the storage container 10, to a terminal device owned by the collection company. The collection management server 70 stores the installation location of the storage container 10 in association with a tablet ID, which is identification information of the tablet terminal 11, and is capable of identifying the installation location based on the tablet ID of the tablet terminal 11, which is the source of the detection result. The collection management server 70 also receives and stores collection request data from the tablet terminal 11. An input device such as a keyboard and a mouse, and a display device are connected to the collection management server 70, and in response to a viewing instruction input from the administrator to the input device, various information corresponding to the collection request data is displayed on the display device. The collection management server 70 is used by the manager.

[0034] In response to a request from the user terminal 20, the gift server 80 transmits a digital benefit corresponding to the number of points to be exchanged to the user terminal 20. The digital benefit is points, coupons, etc. that can be used as electronic money.

[0035] The distribution server 90 distributes various messages to the SNS server 40. The distribution server 90 can perform various inputs from a management terminal of an administrator who manages the accounts held by the privilege management server 30 in the SNS server 40. For example, a content distribution request can be made to a user's account that can send messages to and from the privilege management server 30 account after specifying distribution conditions. This allows content to be distributed to the accounts of users that meet the distribution conditions among many user accounts. For example, a range of remaining points held can be specified, and content according to the number of points (e.g., content introducing exchangeable benefits, etc.) can be distributed. Content can also be distributed by specifying user attributes as conditions.

[0036] FIG. 5 is a schematic functional block diagram illustrating the functions of the devices provided in the storage container 10. As shown in FIG. In the container 10, the tablet terminal 11 is communicatively connected to an optical sensor 15 and a weight sensor 16. This connection may be wireless or wired. The tablet terminal 11 has a communication unit 110, a memory unit 111, an input unit 112, a camera 113, a user identification information acquisition unit 114, an entry unit 115, a target product determination unit 116, a questionnaire presentation unit 117, a learning unit 118, an input detection unit 119, a bonus granting unit 120, a control unit 121, and an output unit 122. The communication unit 110 communicates with each of the optical sensor 15 and the weight sensor 16. The communication unit 110 also communicates with the user terminal 20, the benefit management server 30, the product information management server 50, and the collection management server 70 via the network N. The communication unit 110 transmits the detection result of the weight sensor 16 to the collection management server.

[0037] The storage unit 111 stores various types of data. For example, the storage unit 111 stores information on collection items that are to be collected (a function as a first storage unit). The storage unit 111 stores the user identification information and the detection result of the insertion detection unit 119 (functions as a second storage unit). The user identification information may be any information capable of identifying the user of the user terminal 20, and may be, for example, any one of an email address used to log in to the SNS server 40, an individual identification number assigned to the user terminal 20, a user ID assigned to each user by the benefit management server 30, a member ID, etc.

[0038] The storage unit 111 may also store collection target product data, collection request data, questionnaire data, and a learning model.

[0039] The withdrawal item data is information related to the withdrawal item. This withdrawal item data may be obtained by acquiring product information (recall item data) stored in the product information management server 50 and storing it.

[0040] The collection request data is information on a collection request. The collection request information includes a collection item image, additional information, a collection list, and determination information. The determination information is information in which a collection item image, a collection item candidate, a flag, and a selection result are associated with each other. The collection list, collection item candidate, flag, and selection result will be described later.

[0041] The questionnaire data is for each recalled product. The questionnaire data includes information such as the connection destination of the questionnaire answering site, questionnaire items, etc. The questionnaire data may be for each classification such as the type or manufacturer of the recalled product.

[0042] The learning model is a model generated by learning the correspondence between product images and information indicating whether the product is a recalled product. When a recalled product image is input, the learning model 124 outputs information indicating whether the product is a recalled product.

[0043] The storage unit 111 is configured with a storage medium, for example, a hard disk drive (HDD), a flash memory, an electrically erasable programmable read only memory (EEPROM), a random access read / write memory (RAM), a read only memory (ROM), or any combination of these storage media. The storage unit 111 may be, for example, a non-volatile memory.

[0044] The input unit 112 receives various data. The input unit 112 is a touch panel and receives input according to the operation content of the user. The input unit 112 outputs an operation signal to the control unit 121 according to the operation input. Camera 113 captures an image of an object to be inserted through insertion slot 12. Here, before inserting object P into insertion slot 12, a user holds the object P over camera 113 so that area Pa of object P is included within the imaging range of camera 113, and camera 113 captures an image of the range including area Pa. Camera 113 is camera 11b in FIG. 2.

[0045] The user identification information acquisition unit 114 acquires user identification information for identifying a user who puts an object into the container 10. The user identification information acquisition unit 114 may acquire user identification information transmitted from the benefit management server 30, or may acquire user identification information transmitted from the user terminal 20.

[0046] The entry unit 115 causes the output unit 122 to display a two-dimensional barcode for entry.

[0047] The target item determination unit 116 determines whether or not a collection item is a collection target. The target product determining unit 116 will be described more specifically. The target product determining unit 116 includes an image acquiring unit 1161 , a candidate extracting unit 1162 , a candidate presenting unit 1163 , and a collection receiving unit 1164 .

[0048] The image acquisition unit 1161 acquires, from the camera 113, an image of a collected item that is brought close to the imaging range of the camera 113 of the storage container 10. The image acquisition unit 1161 outputs the acquired collected item image to the candidate extraction unit 1162.

[0049] When a collection item image is input, the candidate extraction unit 1162 judges whether the collection item image is appropriate. Specifically, the candidate extraction unit 1162 judges whether the collection item image is appropriate based on whether the collection item image is of a quality equal to or higher than a predetermined condition. The predetermined condition is a condition for judging whether the collection item image can be used to judge whether the collection item image is a collection item, such as the resolution and image quality of the collection item image. If the collection item image does not meet the predetermined condition, the candidate extraction unit 1162 causes the image acquisition unit 1161 to reacquire the collection item. On the other hand, if the collection item image meets or exceeds the predetermined condition, the candidate extraction unit 1162 uses the collection item image to extract a collection item candidate corresponding to the collection item. Specifically, the candidate extraction unit 1162 inputs the collection item image to a learning model stored in the storage unit 111 to extract one or more collection item candidates corresponding to the collection item. The candidate extraction unit 1162 outputs information on the extracted one or more collection item candidates to the candidate presentation unit 1163. On the other hand, when the candidate extraction unit 1162 cannot extract one or more candidates for collection items corresponding to the collection item, it acquires information on the collection item from the collection item data stored in the storage unit 111 and outputs the information to the candidate presentation unit 1163. The information on the collection item is, for example, information such as the product name, manufacturer name, color, and model number of the collection item.

[0050] When the candidate presentation unit 1163 receives information on one or more candidates for collection items from the candidate extraction unit 1162, the candidate presentation unit 1163 generates a presentation image that presents one or more product images included in the information on the one or more candidates for collection items in order of highest degree of match, and outputs the image to the user terminal 20. When the candidate presentation unit 1163 receives information on a collection item from the candidate extraction unit 1162, the candidate presentation unit 1163 generates a presentation image that prompts the user to reacquire a collection item image or to select which collection item is to be collected from the information on the collection item, and outputs the presentation image to the user terminal 20. The candidate presentation unit 1163 receives from the user terminal 20 the result of the user's selection for the presentation image that prompts the user to select which collection item is to be collected from the information on the collection item. The candidate presentation unit 1163 outputs the selection result to the collection reception unit 1164.

[0051] The collection acceptance unit 1164 generates a collection list in which collection item images are associated with collection item data of the selected collection item candidate based on the selection of one or more collection item candidates corresponding to the collection item as the collection item, and stores the list as collection request data in the storage unit 111. The collection acceptance unit 1164 also acquires incidental information from the user terminal 20, associates the incidental information with the collection list, and stores the list as collection request data in the storage unit 111.

[0052] The collection reception unit 1164 presents one or more candidate items for collection, and based on the user's re-acquisition of the collection item image, associates the collection item image before re-acquisition with information on one or more candidate items for collection, and a re-acquisition flag, and stores them in the memory unit 111 as collection request data.

[0053] The collection acceptance unit 1164 presents one or more candidates for collection items, and based on the user's selection of which item is the collection item from the information of the collection item, associates a collection item image, a selection result, and a no candidate flag, and stores them as collection request data in the storage unit 111, generates a collection list that associates the collection item image with the selection result, and stores it as collection request data in the storage unit 111. The collection acceptance unit 1164 also acquires incidental information from the user terminal 20, associates the incidental information with the collection list, and stores it as collection request data in the storage unit 111.

[0054] When a collection item image is determined to be inappropriate a predetermined number of times, for example, multiple times, for example, three or more times, and the user selects which collection item is the collection item from the information of the collection item, the collection acceptance unit 1164 associates the latest inappropriate collection item image with the selection result and an inappropriate collection item image flag, and stores them as collection request data in the storage unit 111, generates a collection list that associates the latest inappropriate collection item image with the selection result, and stores them as collection request data in the storage unit 111. The collection acceptance unit 1164 also acquires incidental information from the user terminal 20, associates the incidental information with the collection list, and stores them as collection request data in the storage unit 111.

[0055] If the collection reception unit 1164 determines that the collection item image is not a collection item, it does not accept the collection request and associates information indicating that the item is not a collection item with the collection item image and information regarding the collection item, and stores them in the memory unit 111 as collection request data.

[0056] In this way, the recycle management system S can efficiently collect items to be collected. In addition, it is possible to determine whether or not an item to be collected is an item to be collected before the item is collected. In addition, even if a JAN code or the like is not attached to the item to be collected, it is possible to determine whether or not the item to be collected is an item to be collected, thereby improving user convenience.

[0057] In addition, the recycle management system S stores information regarding items to be collected including whether or not they are eligible for collection, acquires images of the items to be collected that represent an image of the items to be collected, determines whether or not the items to be collected are eligible for collection based on the information regarding the items to be collected and the images of the items to be collected, accepts a request for collection of the items to be collected if the items to be collected are eligible for collection, and does not accept a request for collection of the items to be collected if the items to be collected are not eligible for collection, and stores the images of the items to be collected and information regarding the items to be collected in association with each other in a memory unit.

[0058] By doing this, even if the collected item is not subject to collection, the usage status of the collected item can be understood from the collected item image, which can be used for marketing purposes by the manufacturer that produced the collected item, for example.

[0059] The questionnaire presentation unit 117 reads out the questionnaire data from the storage unit 111 based on the fact that the target product determination unit 116 has accepted the collection request, i.e., based on the fact that the collection list has been generated and the accompanying information has been acquired, and generates a presentation image for encouraging the user to answer the questionnaire. The questionnaire presentation unit 117 causes the user terminal 20 to output the generated presentation image.

[0060] The learning unit 118 generates a learning model by learning the correspondence between the product image and the information indicating whether the product is a recalled product, using the product image and the information indicating whether the product is a recalled product as a data set. The learning unit 118 stores the generated learning model in the storage unit 111. Here, when a recalled product image is input, the learning model generated by the learning unit 118 outputs information indicating whether the product is a recalled product. In addition, the learning unit 118 reinforces learning of the learning model stored in the memory unit 111 based on collection request data in which the latest inappropriate collection item image stored in the memory unit 111 is associated with a selection result and an inappropriate collection item image flag, collection request data in which the collection item image is associated with a selection result and a no candidate flag, and collection request data in which the collection item image before re-acquisition is associated with information on one or more candidate collection items and a re-acquisition flag.

[0061] The input detector 119 detects whether or not an article has been input into the input path of the storage container. The article is, for example, an object to be collected. For example, based on the detection result from the optical sensor 15, the input detection unit 119 determines that an object has not passed when a detection signal indicating that reflected light of light emitted from the optical sensor 15 has not been received is obtained, and determines that an object has not passed when a detection signal indicating that reflected light has been received is obtained. Note that the determination as to whether an object has passed may be performed by the input detection unit 119, or may be performed by the optical sensor 15, and the input detection unit 119 may acquire the determination result.

[0062] When the item to be collected is identified and the detection result of the insertion detection unit 119 indicates that the item has been inserted, the reward granting unit 120 transmits reward granting data indicating that a reward will be granted to the user identification information. The reward granting unit 120 transmits the specified granting data to the reward management server 30. When transmitting the benefit granting data to the benefit management server 30, the benefit granting unit 120 may transmit the benefit granting data after storing the user identification information, the selection result, and the detection result of the insertion detection unit 119 in the memory unit 111. This allows a log of the insertion status of the item P by the user to be stored in the tablet terminal 11.

[0063] The control unit 121 controls each unit of the tablet terminal 11 .

[0064] The output unit 122 outputs various types of information. For example, the output unit 122 is a display panel, and displays the various types of information on the display panel based on instructions from the control unit 121. The output unit 122 and the input unit 112 may be configured by a touch panel. In this case, the touch panel may be, for example, the touch panel 11a in FIG.

[0065] In the tablet terminal 11, the functions of the communication unit 110, input unit 112, user identification information acquisition unit 114, entry unit 115, questionnaire presentation unit 117, learning unit 118, input detection unit 119, reward granting unit 120, control unit 121, and output unit 122 may be configured by a processing unit such as a CPU (central processing unit) or a dedicated electronic circuit.

[0066] Here, tablet terminal 11 is used and optical sensor 15 and weight sensor 16 are communicatively connected, so that the functions of storage container 10 can be realized with a simple configuration. In particular, a general-purpose product can be used as the tablet terminal, and the functions required for recycle management system S can be implemented by installing application programs for performing various processes on the tablet terminal. Even when multiple storage containers 10 are provided, it is possible to prevent an increase in the number of types of application programs to be developed by preparing tablet terminals of the same model or a range of several models and providing them in the storage containers 10. This eliminates the need to develop many types of application programs to achieve the same functions, thereby reducing the burden of updating and managing application programs.

[0067] 6 to 8 are sequence diagrams for explaining the operation of the recycle management system S. The flow of member registration and point acquisition will be explained with reference to FIG.

[0068] Membership Registration The user operates the user terminal 20 to input an instruction to access the privilege management server 30. For example, the user terminal 20 accesses the URL (Uniform Resource Locator) of a web page published by the privilege management server 30 based on the instruction from the user (step S101). Here, user information for identifying the user terminal 20 (here, for example, an email address and password for logging in to the SNS server 40) is also sent to the privilege management server 30. The user's email address and password may be registered in advance in the privilege management server 30 from the user terminal 20 at the stage when the use of the recycle management system S is started.

[0069] In response to the access from the user terminal 20, the benefit management server 30 transmits the email address and password of the user terminal 20 and a registration request to the SNS server 40 (step S102).

[0070] When the SNS server 40 receives the email address, password, and registration request from the benefit management server 30, it performs a member registration process for using the SNS server 40 and sends a notification of the completion of the member registration to the benefit management server 30 (step S103). The member registration is, for example, a process of registering the account of the user of the user terminal 20, which is separately registered in the SNS server 40, and the account in the SNS server 40, which is assigned to the benefit management server 30, as parties with which messages can be exchanged. As a result, the user terminal 20 is registered as a user who can receive a benefit from the benefit management server 30 in response to putting the item P into the storage container 10.

[0071] Earn points In a standby state, tablet terminal 11 displays a two-dimensional barcode for entry on the display screen (step S110). The user accumulates the items P after using the purchased products, brings them to the base where the storage container 10 is installed, activates the camera function of the user terminal 20, and captures an image of the two-dimensional barcode for entry displayed on the display screen of the tablet terminal 11 of the storage container 10 (step S111). The user terminal 20 analyzes the captured two-dimensional barcode to extract a container ID assigned to the container 10 displaying the two-dimensional barcode and the URL of the benefit management server 30 (step S112). A container ID may be assigned to each container 10, or a tablet ID assigned to a tablet terminal 11 provided in the container 10 may be used as the container ID.

[0072] The user terminal 20 accesses the SNS server 40 using a string including the extracted URL and the container ID as a URL, and also using the user information assigned to the user terminal 20 (an email address and a password for logging in to the SNS server 40) (step S113). The benefit management server 30 temporarily stores the container ID and the user information. This makes it possible to grasp the relationship between the container 10 and the user terminal 20. In other words, it is possible to identify the location where the container 10 is installed and the user who uses the container at that location.

[0073] In response to the access from the user terminal 20, the privilege management server 30 accesses the SNS server 40 based on the email address and password (step S114). As a result, a chat screen capable of sending and receiving messages between the account of the user terminal 20 and the account of the privilege management server 30 is displayed on the user terminal 20, and the privilege management server 30 becomes capable of sending messages to the user terminal 20. When the privilege management server 30 receives a response to the login from the SNS server 40 (step S115), it transmits the temporarily stored user information to the tablet terminal 11 contained in the container 10 to which the container ID is assigned, based on the temporarily stored container ID (step S116).

[0074] When the control unit 121 of the tablet terminal 11 acquires the user information from the benefit management server 30 (step S117), it switches the operation screen and starts the camera 113 (step S118). As a result, for example, a message such as "Please hold the item to be inserted over the camera" is displayed on the display screen of the tablet terminal 11.

[0075] Following the message displayed on the tablet terminal 11, the user brings the outer circumferential surface of the article P close to the imaging range of the camera 113 to have an image taken (step S119). The camera 113 of the tablet terminal 11 captures an image of the outer peripheral surface of the item P. The image acquisition unit 1161 of the tablet terminal 11 acquires image data captured by the camera 113 (step S120), and the candidate extraction unit 1162 performs a query process based on the captured image data with respect to the product information management server 50 (step S121), thereby extracting candidates for collection item images, which are images of one or more collection items corresponding to the image data, from the product information management server 50 (step S122). Here, the extraction of the candidates may be performed by the product information management server 50, or the collection reception unit 1164 may input the collection product image into a learning model and obtain a determination result as to whether or not the product is a collection target product from the learning model. Here, if there is one candidate corresponding to the collection product image, that one candidate is output, and if there are multiple products similar to the collection product image, each of the multiple products can be obtained as a candidate from the learning model. When the candidates are extracted, the candidate presentation unit 1163 reads out one or more candidates for collection items corresponding to the extracted collection item images from the product information management server 50 (step S123), and displays them on the display screen of the output unit 122 (step S124). Alternatively, the candidate presentation unit 1163 may display the candidates for collection items obtained from the learning model on the display screen of the output unit 122. In this way, potential collection items can be presented to the user.

[0076] The user selects and inputs the item that the user has brought from among the candidates for collection items displayed on the display screen of the tablet terminal 11 by touching an image corresponding to the item. The input unit 112 accepts the input of the selection result based on the operation input from the user (step S125). Then, the target item determination unit 116 obtains the product information such as the JAN code of the item corresponding to the selection result by reading it from the product information management server 50 (step S126) (step S127). The product information management server 50 stores the product information and the candidates to be read by the candidate extraction unit 1162 in association with each other, and when the selection result is obtained, the tablet terminal 11 can read the product information corresponding to the candidate corresponding to the selection result. As a result, the tablet terminal 11 obtains the product information corresponding to the selection result as the inquiry result, and stores the product information, the member ID obtained in step S117, the photographed image, and the selection result in the storage unit 111. The product information stored here may be data for all items included in the product information, or may be information that can identify the collection target item (for example, the JAN code).

[0077] When the control unit 121 of the tablet terminal 11 receives a query result from the product information management server 50 indicating that product information corresponding to the selection result is registered, the control unit 121 switches the light sensor 15 to the on state by sending an activation signal to the light sensor 15 (step S128). Then, the control unit 121 displays the message "Reading completed. Please insert the container to be inserted into the insertion slot" on the display screen.

[0078] The user follows the message displayed on the tablet terminal 11 and inserts the item P into the insertion slot 12 (step S129). When the optical sensor 15 receives the reflected light by the inserted article P, it outputs a detection result that the article P has been inserted to the tablet terminal 11. When the control unit 121 of the tablet terminal 11 obtains the detection result indicating that the article P has been inserted, it counts up the quantity (number) of the articles P inserted (step S130).

[0079] When the control unit 121 counts up the number of items inserted, it outputs to the reward granting unit 120 a reference result indicating that product information corresponding to the inserted collection item is registered and a detection result indicating that the item P has been inserted. When the reward granting unit 120 obtains a detection result indicating that the product information corresponding to the inserted collection item is registered and that the item P has been inserted, the reward granting unit 120 transmits reward granting data indicating that a reward is granted to the user identification information to the reward management server 30 (steps S131 and S132). Here, when the reward granting unit 120 obtains a detection result indicating that the product information corresponding to the inserted collection item is registered and that the item P has been inserted, the reward granting unit 120 may store the user identification information, the product information, and the detection result indicating that the item P has been inserted in the storage unit 111. This allows the tablet terminal 11 as well as the reward granting unit 120 to store the history of items inserted by the user. Furthermore, the process of storing the user identification information, the product information, and the detection result indicating that the item P has been inserted in the memory unit 111 may be performed by the collection reception unit 1164. Furthermore, when storing the user identification information, the product information, and the detection result indicating that the item P has been inserted in the memory unit 111, the stored product information may be data on all items included in the product information, or may be information that can identify the item to be collected (for example, a JAN code).

[0080] When the privilege management server 30 receives the privilege granting data from the tablet terminal 11, the privilege management server 30 updates the number of points associated with the user information by adding the number of granted points (step S133).

[0081] Next, the flow of weight management will be described with reference to FIG.

[0082] <Weight management> When a storage container 10 is installed at a base, the collection management server 70 acquires the tablet ID of the tablet terminal 11 of the installed storage container 10, and stores the tablet ID in a memory unit within the collection management server 70 as the storage container ID of the storage container 10. As a result, the tablet terminal 11 to be managed is registered in the collection management server 70 (step S201). When the time arrives to transmit the detection result of the weight sensor 16, the tablet terminal 11 acquires the detection result of the weight detection from the weight sensor 16 (step S202) and transmits the detection result and the tablet ID to the collection management server 70 (step S203). Here, the tablet terminal 11 may transmit collection request data in addition to transmitting the detection result and the tablet ID to the collection management server 70. The collection request data will be described later. When the collection management server 70 receives the detection result of the weight detection and the tablet ID, the collection management server 70 stores the detection result of the weight detection and the tablet ID in association with each other (step S204).

[0083] Here, the timing for transmitting the detection result of the weight sensor 16 may be the timing when the item P is inserted, the timing when a predetermined time has arrived, or the timing when a predetermined time interval has arrived.

[0084] Next, the flow of point management and distribution will be described with reference to FIG.

[0085] <Points Management> The user operates the user terminal 20 and inputs an instruction to access My Page of the privilege management server 30. Based on the instruction from the user, the user terminal 20 accesses the URL of the privilege management server 30 and transmits user information (email address and password for logging in to the SNS server 40) and a request to view My Page (step S301). When the privilege management server 30 receives the request to view the My Page together with the user information from the user terminal 20, it accesses the SNS server 40 based on the user information and transmits a My Page login request based on the user information (step S302). The SNS server 40 performs user authentication based on the login request, and if login is permitted, transmits the requested My Page data to the benefit management server 30 (step S303).

[0086] When the privilege management server 30 acquires the data of MyPage corresponding to the user information from the SNS server 40, the privilege management server 30 transmits the acquired data of MyPage to the user terminal 20 that issued the request (step S304). When the user terminal 20 receives the data of My Page from the benefit management server 30, it displays the screen of My Page on the display screen (step S305). The user of the user terminal 20 refers to his / her personal page and inputs the number of points to be exchanged and data specifying the benefit to be exchanged within the number of points owned by the user. The user terminal 20 transmits a point exchange request to the benefit management server 30 based on the point exchange request input by the user (step S306). The point exchange request includes, for example, point usage data indicating the number of points to be exchanged and benefit specification data specifying the benefit to be exchanged. Upon receiving the point usage data and benefit specification data from the user terminal 20, the benefit management server 30 transmits the point usage data and benefit specification data to the gift server 80 together with the point exchange request (step S307).

[0087] When the gift server 80 receives a request for point exchange from the benefit management server 30, it transmits the digital benefit to be exchanged to the benefit management server 30 based on the used point data and benefit designation data transmitted together with the request for point exchange (step S308). When the benefit management server 30 receives (obtains) the digital benefit from the gift server 80 (step S308), it subtracts the number of points corresponding to the used point data from the number of points stored in association with the user identification information of the user terminal 20 that made the exchange request (step S309).The benefit management server 30 then transmits the digital benefit to the user terminal 20 (step S310). This allows the user terminal 20 to obtain the benefit and display it on the screen.

[0088] <delivery> When the distribution conditions and the content to be distributed are specified from the administrator's management terminal, the distribution server 90 transmits the specified distribution conditions and the content to the SNS server 40 (step S350). When the SNS server 40 receives the distribution conditions and content from the distribution server 90, it extracts users who meet the distribution conditions from among the user accounts associated with the account of the privilege management server 30, and delivers the content to the extracted accounts (step S351). As a result, the content is distributed to the user terminal 20 of the user who matches the specified distribution conditions from the distribution server 90. For example, it is possible to distribute different contents depending on the user.

[0089] According to the above-described embodiment, the tablet terminal 11 extracts candidates for collection items corresponding to image data obtained by imaging the outer circumferential surface of the item P, and identifies a collection item from among the candidates based on an instruction from the user, so that the user terminal 20 does not need to be equipped with a function for acquiring a barcode of the item P. In addition, since the tablet terminal 11 acquires product information corresponding to the collection item or checks whether product information exists, it is not necessary for the user terminal 20 to acquire product information corresponding to the item P or check whether product information exists. This eliminates the need to install functions used when using the recycle management system S in the user terminal 20, and therefore eliminates the need to develop different application programs for each OS and model of the user terminal 20. Here, it is sufficient to prepare application programs according to the functions to be installed in the tablet terminal 11, and therefore the burden of developing application programs can be reduced. For example, if one tablet terminal 11 is provided in the storage container 10 and an application program is installed on that one device, it can be used by multiple users. Therefore, it is not necessary to prepare application programs according to the OS and model of the user terminal 20 of each of the multiple users who use one storage container 10.

[0090] In the above embodiment, the two-dimensional barcode for entry is displayed on the display screen of the tablet terminal 11, but the two-dimensional barcode for entry may be printed on a print medium and affixed to any position on the container 10 (for example, the notice board 14). This eliminates the need for the tablet terminal 11 to constantly display the two-dimensional barcode for entry while on standby, since it is sufficient to have the user terminal 20 capture an image of the two-dimensional barcode for entry printed on the print medium.

[0091] In addition, in the above-described embodiment, a two-dimensional barcode for entry is displayed on the display screen of tablet terminal 11, but user identification information may be displayed on user terminal 20 and an image may be captured by camera 113 on tablet terminal 11, so that user identification information acquisition unit 114 accepts the user's login and acquires the user identification information.

[0092] In the above-described embodiment, the amount of storage is detected using the weight sensor 16, but other sensors may be used as long as they function as an amount detection unit that detects the amount of storage. For example, an ultrasonic sensor may be used as the amount detection unit to detect the amount of storage. When an ultrasonic sensor is used, it is attached to the upper side of the storage section 17 of the storage container 10. The ultrasonic sensor transmits ultrasonic waves in a direction toward the bottom surface of the storage container 10 and receives the reflected waves to measure the distance L to an object present on the bottom side of the storage container 10. The distance L is detected to be the longest when nothing is stored in the storage container 10. The more items P are accumulated in the storage section 17, the higher the height of the top of the items P becomes because the items P are piled up. Therefore, the more the amount of items P stored increases, the shorter the distance L measured by the ultrasonic sensor is detected. By measuring the distance L, the distance sensor can detect the storage capacity, which indicates the extent to which the items P are stored in the storage container 10.

[0093] In the embodiment described above, the user terminal 20 can accumulate points and receive benefits by accessing the benefit management server 30 using a URL. Therefore, even when using the user terminal 20 in the recycle management system S, there is no need to have a special application program installed. As a result, the operator of the recycle management system S only needs to manage the application programs of the tablet terminal 11, and therefore does not need to develop different application programs depending on the OS or model of the user terminal 20.

[0094] In addition, in the above-described embodiment, the user identification information is stored in correspondence with an image of the collection item (or product information corresponding to the image of the collection item) taken when the collection item is placed into the storage container, so that the correspondence between the user who placed the collection item and the collection item that was placed can be understood.

[0095] Next, the above-described collection determination process (steps S119 to S127) in which the tablet terminal 11 identifies which product an item is from an image of the item will be further described.

[0096] FIG. 9 is a flowchart showing an example of the collection determination process in the tablet terminal 11 according to the present embodiment. In step S201, the tablet terminal 11 acquires a collection item image capturing an external view of an item that has been brought close by a user to the imaging range of the camera 113. After that, the tablet terminal 11 executes the process of step S202.

[0097] In step S202, the tablet terminal 11 determines whether the collected item image is appropriate. Specifically, the tablet terminal 11 determines whether the collected item image is of a quality that meets or exceeds a predetermined condition. If the collected item image is of a quality that meets or exceeds the predetermined condition (step S202 YES), the tablet terminal 11 executes the process of step S203. On the other hand, if the collected item image is of a quality that falls below the predetermined condition (step S202 NO), the tablet terminal 11 executes the process of step S213.

[0098] In step S203, the tablet terminal 11 extracts one or more candidates for collection items corresponding to the collection item image. The collection reception unit 1164 can extract the candidates by inputting the collection item image into a learning model and obtaining a determination result as to whether or not the item is a collection item from the learning model. Here, if there is only one candidate corresponding to the collection item image, that one candidate is output, and if there are multiple products similar to the collection item image, each of the multiple products can be obtained as a candidate from the learning model. The tablet terminal 11 displays one or more collection target item candidates corresponding to the extracted collection item image on the display screen of the tablet terminal 11, thereby presenting them to the user.

[0099] In step S204, the tablet terminal 11 determines whether or not a user selection result for one or more candidate collection items corresponding to the collection item image has been acquired from the input unit 112. When a user selection result for one or more candidate collection items corresponding to the collection item image has been acquired from the user terminal 20, that is, when a collection item candidate has been selected (step S204 YES), the tablet terminal 11 executes the process of step S205. On the other hand, if the user's selection result for one or more candidate collection items corresponding to the collection item image is not obtained from the user terminal 20, i.e., if no collection item candidate is selected (step S204 NO), the tablet terminal 11 executes the processing of step S208.

[0100] In step S205, the tablet terminal 11 generates a collection list in which the collection item image is associated with the user's selection result for one or more collection item candidates corresponding to the collection item image. After that, the tablet terminal 11 executes the process of step S206.

[0101] In step S206, the tablet terminal 11 associates the member ID acquired in step S117 with the selection result and stores it in the storage unit 111. Thereafter, the collection determination device 100 executes the process of step S207.

[0102] In step S207, the tablet terminal 11 completes the acceptance of the collection request, and ends the collection determination process in FIG.

[0103] In step S208, the tablet terminal 11 accepts a selection according to a user operation as to whether or not to reacquire the collected item image. If the user selects to reacquire the collected item image (step S208 YES), the tablet terminal 11 executes the process of step S209. On the other hand, if the user does not select to reacquire the collected item image (step S208 NO), or if the user selects which item is the collected item from the information of the collected item, the tablet terminal 11 executes the process of step S210.

[0104] In step S209, the tablet terminal 11 stores the collection item image, one or more collection item candidates corresponding to the collection item image, and the reacquisition flag in the storage unit 111. After that, the tablet terminal 11 executes the process of step S201.

[0105] In step S210, the tablet terminal 11 generates a presentation image for allowing the user to select, for example, in a pull-down format, which of the items is the item to be collected from the information on the items to be collected, displays it on the display screen of the tablet terminal 11, and allows the user to input the selection via a touch panel, etc. Thereafter, the tablet terminal 11 executes the process of step S211.

[0106] In step S211, the tablet terminal 11 judges whether or not a selection result indicating that the user has selected which of the collection items is to be collected from the information on collection items has been acquired. If the user has selected which of the collection items is to be collected from the information on collection items (step S211 YES), the tablet terminal 11 executes the process of step S212. On the other hand, if the user has not selected which of the collection items is to be collected from the information on collection items (step S211 NO), the tablet terminal 11 ends the collection judgment process in FIG. 4.

[0107] In step S212, the tablet terminal 11 stores the collection item image, a selection result indicating which item is selected by the user from the information of the collection items, and a no candidate flag in the storage unit 111. After that, the tablet terminal 11 executes the process of step S205.

[0108] In step S213, the tablet terminal 11 determines whether the number of times that the collected item image has been determined to be inappropriate is three or more. If the number of times that the collected item image has been determined to be inappropriate is three or more (step S213: YES), the tablet terminal 11 executes the process of step S214. On the other hand, if the number of times that the collected item image has been determined to be inappropriate is less than three (step S213: NO), the tablet terminal 11 executes the process of step S201.

[0109] In step S214, the tablet terminal 11 generates a presentation image for allowing the user to select, for example, in a pull-down format, which of the items is the item to be collected from the information on the items to be collected, displays the image on the display screen of the tablet terminal 11, and allows the user to input the selection via a touch panel, etc. After that, the tablet terminal 11 executes the process of step S215.

[0110] In step S215, the tablet terminal 11 judges whether or not a selection result indicating that the user has selected which of the collection items is to be collected from the information on collection items has been acquired. If the user has selected which of the collection items is to be collected from the information on collection items (step S215 YES), the tablet terminal 11 executes the process of step S216. On the other hand, if the user has not selected which of the collection items is to be collected from the information on collection items (step S215 NO), the tablet terminal 11 ends the collection judgment process in FIG. 4.

[0111] In step S216, the tablet terminal 11 stores the latest inappropriate (inappropriate) collection item image, a selection result indicating which item is selected by the user from the information of the collection item, and an inappropriate (inappropriate) collection item image flag in the storage unit 111. After that, the tablet terminal 11 executes the process of step S205.

[0112] Next, examples of images displayed on the tablet terminal 11 will be described.

[0113] FIG. 10 is a diagram showing an example of a display screen in the tablet terminal 11 according to the present embodiment. FIG. 11 is a diagram showing another example of a display screen in the tablet terminal 11 according to the present embodiment. FIG. 12 is a diagram showing another example of a display screen in the tablet terminal 11 according to the present embodiment. FIG. 13 is a diagram showing another example of a display screen in the tablet terminal 11 according to the present embodiment. FIG. 14 is a diagram showing another example of a display screen in the tablet terminal 11 according to the present embodiment. FIG. 15 is a diagram showing another example of a display screen in the tablet terminal 11 according to the present embodiment. FIG. 16 is a diagram showing another example of a display screen in the tablet terminal 11 according to the present embodiment. FIG. 17 is a diagram showing another example of a display screen in the tablet terminal 11 according to the present embodiment. FIG. 18 is a diagram showing another example of a display screen in the tablet terminal 11 according to the present embodiment. FIG. 19 is a diagram showing another example of a display screen in the tablet terminal 11 according to the present embodiment. FIG. 20 is a diagram showing another example of a display screen in the tablet terminal 11 according to the present embodiment.

[0114] The example shown in FIG. 10 is an example of a presentation image displayed on the tablet terminal 11 at a stage before accepting the insertion of an item from a user. In the illustrated example, a "request collection" operator and an "inquiry" operator are displayed selectable. In the illustrated example, when the "request collection" operator is selected by the user, a transition to the example display image shown in FIG. 10 occurs. Also, in the illustrated example, when the "inquiry" operator is selected by the user, a transition to the example display screen shown in FIG. 20 occurs.

[0115] The example shown in FIG. 11 is displayed when the "request collection" operator is operated in FIG. 10. In the illustrated example, a message instructing the user to "register collection items", an operator for "+Register collection items", and an operator for "Proceed to basic information input" are displayed. Note that in the illustrated example, since no collection items have been registered, the operator for "Proceed to basic information input" is displayed as unselectable. In the illustrated example, when the operator for "+Register collection items" is selected, the display transitions to the example display screen shown in FIG. 12.

[0116] The example shown in FIG. 12 is displayed when the "+ Register collection item" operator is selected in FIG. 11. In the illustrated example, an icon encouraging image capture, a warning message "Caution - Products not subject to collection cannot be determined. - Even if the product is subject to collection, automatic determination may fail. If the determination is not successful, please scan again. - If scanning fails three consecutive times, it will switch to manual registration," a "Cancel" operator, and a "Scan" operator are displayed. In the illustrated example, when the "Cancel" operator is selected, the display screen example shown in FIG. 11 is displayed. In the illustrated example, when the "Scan" operator is selected, a scanned (photographed) image of the collection item is displayed in the display area of ​​the icon encouraging image capture.

[0117] Here, when the "Scan" button is selected, if the image is not an appropriate collection item image, a notification message stating "Determination failed. Please scan again" will be displayed in the display area of ​​the icon prompting image acquisition, as shown in Figure 13.

[0118] Here, when the "scan" operator is selected, if the image is appropriate, the scanned (photographed) image of the collection item is displayed in the display area of ​​the icon prompting image acquisition, as shown in Fig. 14. Also, in the example shown in Fig. 14, one or more candidates for collection items corresponding to the collection item image are displayed in the "candidate list" display area. In the illustrated example, one or more candidates for collection items corresponding to the collection item image are displayed in descending order of degree of match from the left. In the illustrated example, for example, the candidate for the collection item with the highest degree of match is displayed in a provisionally selected state in the "candidate list." In this figure, the image of the provisionally selected collection item is shown to have a larger area than the images of collection items that are not provisionally selected, but the outline of the image of the provisionally selected collection item may be displayed in a color different from the images of the other collection items. In the illustrated example, the "Product Name" corresponding to the provisionally selected candidate for collection item is displayed as "XXX Eye Shadow △□△□". In the illustrated example, the provisional selection can be changed by selecting one of the images of the candidate for collection item. Here, when the "Add to List" operator is selected, the provisionally selected candidate for collection item is confirmed and selected, and is registered in the collection item list as shown in FIG. 16. When the "If no corresponding item is found in the candidates>" operator is selected, the display screen transitions to the example shown in FIG. 15. When the "Rescan" operator is selected, the display screen transitions to the example shown in FIG. 12.

[0119] The example shown in Fig. 15 is an example of a display screen that is displayed when the operator "If there is no corresponding product in the candidates>" is selected. The example shown in the figure is an example of a display screen that allows the user to manually select, for example, in a pull-down menu, which product is to be collected from the information of the product to be collected. "Product name" displays the product name of the recalled product in a pull-down format in the selection window so that information on the recalled product can be selected. "Color" displays the color of the recalled product that corresponds to the "product name" of the recalled product in a pull-down format so that information on the recalled product can be selected in the selection window. The area at the bottom of the "Color" selection window displays an image of the product that corresponds to the "product name" and "color" selected by the user in the selection window.

[0120] The example shown in Fig. 16 is an example of a case where a list of collected items is displayed. In the illustrated example, for example, in the examples shown in Fig. 14 and Fig. 15, an operator for "add to list" is selected to add an item to the list of collected items shown in Fig. 16. In the illustrated example, an operator that allows each item to be edited is displayed, for example an icon for deleting a collection item registered in the collection list. Also in the illustrated example, a "+Register collection item" operator and a "Proceed to basic information input" operator are displayed as selectable operators. When the "+Register collection item" operator is selected, the display screen transitions to the example shown in FIG. 12. When the "Proceed to basic information input" operator is selected, the display screen transitions to the example shown in FIG. 17.

[0121] The example shown in FIG. 17 is an example of a display screen displayed when the operator "Proceed to input of basic information" is selected in FIG. 16. The display screen example is an example of a display screen that allows a user to input basic information (additional information). In the example shown in the figure, a selection window in which "gender" can be selected, a selection window in which "age" can be selected, an input window for inputting an "email address", and an input window for "email address (confirmation)" for confirming and inputting the "email address" are displayed. Also, in the example shown in the figure, an operator "Back" and an operator "Proceed to confirmation screen" are displayed selectably. When the operator "Back" is selected, a transition is made to the example of a display screen shown in FIG. 16. When the operator "Proceed to confirmation screen" is selected, a transition is made to the example of a display screen shown in FIG. 18. Here, the user can use the user terminal 20 to execute the processing of steps S101 to S103 in FIG. 6 and register as a member, thereby registering basic information in advance at home or the like without using the tablet terminal 11. However, even if the user has not registered as a member in advance, the user may register as a member by registering basic information at the store where the tablet terminal 11 is installed.

[0122] The example shown in FIG. 18 is an example of a display screen that is displayed when the "Proceed to confirmation screen" operator is selected in the example shown in FIG. 17. In the example shown, the basic information entered in FIG. 17 and the list of collected items shown in FIG. 16 are displayed so that they can be confirmed. In the example shown, a "Back" operator and an "Apply with the above details" operator are displayed so that they can be selected. When the "Back" operator is selected, the display screen transitions to the example display screen shown in FIG. 17. When the "Apply with the above details" operator is selected, the display screen transitions to the example display screen shown in FIG. 19.

[0123] The example shown in FIG. 19 is an example of a display screen that is displayed when the "Apply with the above details" operator is selected in FIG. 18. In the example shown, a message is displayed indicating completion of the application, stating "Your application has been completed. Please check the completion email that you have received. Please answer the survey." Also, in the example shown, a "Survey (external site)" operator and a "Return to TOP" operator are displayed as selectable operators. When the "Survey (external site)" operator is selected, the screen transitions to the survey response site. When the "Return to TOP" operator is selected, the screen transitions to the example display screen shown in FIG. 10.

[0124] The example shown in FIG. 20 is an example of a display screen that is displayed when the "Inquiry" operator is selected in FIG. 10. In the illustrated example, an "Email address" input window, a "Category" selection window indicating the category of the inquiry, and an "Inquiry content" input window are displayed. Also, in the illustrated example, a "Send" operator is displayed selectably. When the "Send" operator is selected, the input / selected content is sent to the tablet terminal 11.

[0125] Next, an example of a display screen in the collection determination device 100 will be described.

[0126] Fig. 16 is a diagram showing an example of a display screen in the collection management server 70 according to this embodiment. Fig. 17 is a diagram showing another example of a display screen in the collection management server 70 according to this embodiment. Fig. 18 is a diagram showing another example of a display screen in the collection management server 70 according to this embodiment. Fig. 19 is a diagram showing another example of a display screen in the collection management server 70 according to this embodiment. Fig. 20 is a diagram showing another example of a display screen in the collection management server 70 according to this embodiment.

[0127] 16 is an example of a display screen that can be confirmed by the administrator of the collection management server 70 in the collection management server 70. The example shown in the figure is an example of a display screen when collection requests for collection items accepted by the collection management server 70 from the user terminal 20 are displayed in a list. Each record in the list display is generated by a user terminal 20 making a collection request for a collection item, as in the examples shown in Figures 10 to 19. In the example shown in the figure, the "application date", "application ID", "quantity" of the collection item, "receipt status" of the collection item, "receipt registration date" of the collection item, "gender" of the user, "age" of the user, etc. are displayed. The "application date" is the date on which a collection request for an item to be collected was generated. The application date may be the date on which an image of the item to be collected was captured on the tablet terminal 11. The "application ID" is identification information that identifies a collection request for an item to be collected. A different application ID may be issued by the tablet terminal 11 each time an image of an item to be collected is captured by the tablet terminal 11 and the item is inserted. The "received status" is information that indicates whether an item for which collection has been requested is "not received" or "received." When an item to be collected has been photographed but not yet inserted, "not received" may be assigned, and when an item to be collected has been photographed and inserted, "received" may be assigned. The "receipt registration date" is the date on which the item to be collected was photographed and deposited. The "gender" and "age" of the user may be determined by using the member information corresponding to the member ID received by the tablet terminal 11 from the user terminal 20 or the benefit management server 30 before the image of the item to be collected was captured. In the illustrated example, when a record is selected, a transition is made to an example display screen in which a collection request for the collection item corresponding to the record is displayed in detail.

[0128] The example shown in Figure 22 is an example of a detailed display screen that is displayed by selecting the records "Application Date" (YYYY / MM / DD), "Application ID" (123456789), "Quantity" (5), "Receipt Status" (Not Received), "Receipt Registration Date" (-), "Gender" (Male), and "Age" (24) in the list display shown in Figure 21. The display area for "basic information" includes display areas for "application date", "application ID", "received status", "gender", "age", and "receipt registration date". The display area for "receipt registration image" displays an image of the received collection item, an image of the received collection kit, and the like. Here, the "receipt registration image" may be, for example, an image captured by the camera 113 when the collection target is put into the storage container 10. The display area for "collection item list" displays collection items registered in the collection request. The display area for "collection item list" includes display areas for "No." which is identification information for identifying the collection item, "registered image" which is the collection item image, "category" of the collection item, "item name" of the collection item, "color" of the collection item, and "material" which is the main material of the collection item. Note that the display area for "collection item list" may display the contents constituting the collection item and the material of each component. For example, if the collection item is eyeshadow, in addition to the eyeshadow (color material) which is the content, the specifications of each component such as the case, lid, plate, and brush (ABS resin, stainless steel, paper, etc.) may be displayed. Data on the items "category," "item name," "color," and "material" corresponding to the identified collection target item may be obtained from the distribution server 60.

[0129] The example shown in FIG. 23 is an example of a display screen that displays the withdrawal target products registered in the withdrawal target product data.

[0130] 24 is an example of a display screen on which the administrator can confirm collection request data in which the latest inappropriate collection item image stored in the storage unit 111 is associated with a selection result and an inappropriate collection item image flag, collection request data in which the collection item image, the selection result and a no candidate flag are associated with each other, and collection request data in which the collection item image before reacquisition, information on one or more collection item candidates and a reacquisition flag are associated with each other. In this display screen example, the administrator confirms and modifies each collection request data, and the confirmed and modified collection request data is used for reinforcement learning.

[0131] Thus, the recycling management system S of this embodiment includes a memory unit 111 that stores information (product information) regarding collection items that are subject to collection, an acquisition unit (image acquisition unit 1161) that acquires collection item images that represent images of the collection items to be collected, and a determination unit (collection reception unit 1164) that determines whether or not a collection item is a collection item based on the information regarding the collection item and the collection item image.

[0132] In this way, the recycle management system S can efficiently collect items to be collected. In addition, it is possible to determine whether or not an item to be collected is an item to be collected before the item is collected. In addition, even if a JAN code or the like is not attached to the item to be collected, it is possible to determine whether or not the item to be collected is an item to be collected, thereby improving user convenience.

[0133] In the recycle management system S, the information about the collection items includes at least one of an image showing a used state of the collection item and an image showing a state where the use of the collection item has been discontinued.

[0134] In this way, the recycle management system S can determine whether or not an item is eligible for collection based on images of the item in an unused state, an image of the item in a state in which it is in use (also referred to as a state in which it has ceased to be used or a state in which it is partially used), an image of the item in a used state, and an image of the item to be collected, thereby improving the accuracy of the determination.

[0135] In the above-mentioned recycle management system S, the learning unit 118 generates a learning model that learns the correspondence between at least one of an image showing a used state of a collection item and an image showing a state in which the use of a collection item has been discontinued, and information showing whether or not the item is a collection item, and stores the model in the memory unit 111. Then, the determination unit (collection reception unit 1164) reads out the learning model stored in the memory unit 111, and inputs the collection item image into the read learning model to determine whether or not the item is a collection item.

[0136] In this manner, the recycle management system S can accurately determine whether or not a collection item is eligible for collection.

[0137] In addition, the tablet terminal 11 of this embodiment is equipped with a memory unit 111 that stores information regarding collection items to be collected, an acquisition unit (image acquisition unit 1161) that acquires collection item images representing images of the collection items to be collected, and a determination unit (collection reception unit 1164) that determines whether or not the collection item is a collection item based on the information regarding the collection item and the collection item image.

[0138] In this way, the tablet terminal 11 can efficiently collect collection items. Also, it is possible to determine whether or not a collection item is a collection item before collection. Even if a JAN code or the like is not attached to a collection item, it is possible to determine whether or not the collection item is a collection item, thereby improving user convenience.

[0139] In the above embodiment, the reward granting unit 120 grants a reward to the user identification information of the user who has deposited the collected item, but if the storage container 10 is installed in a store and can accept collected items from different manufacturers, the entity that grants the reward (issuer) may be the store. If the storage container 10 is installed in a store or a manufacturer's base and can accept items from a specific manufacturer as items to be deposited in one storage container, the issuer of the reward may be the manufacturer that accepts the items. The benefit may be given according to the storage capacity, the number of collected items, or the material amount of the collected items, or may be calculated by any means. The benefit may be a prize, and the progress information regarding the collection of the collected items may include the timing of the benefit (incentive) such as the scheduled shipping date of the prize, and may be made visible to the user by notifying the user terminal 20 or the like. In this way, by offering benefits to users, it is possible to prevent the disposal of not only finished products, but also unused products, products whose use has been discontinued, and half-used products, and to increase the collection rate of these products, thereby contributing to the creation of a recycling-oriented society.

[0140] Second Embodiment A second embodiment of the present invention will now be described with reference to the drawings. In the second embodiment, an example of visualizing the collection status of collected items will be described. In the second embodiment, the differences from the first embodiment will be mainly described, and the description of the other parts will be omitted, with the explanation of the first embodiment being used. Here, the recycle management system S according to the second embodiment is suitable for cases where collected items are reused and recycled, but is not limited thereto.

[0141] FIG. 25 is a block diagram showing an example of the configuration of a recycle management system S according to the second embodiment of the present invention. The tablet terminal 11 is composed of a communication unit 110, a memory unit 111, an input unit 112, a camera 113, a user identification information acquisition unit 114, an entry unit 115, a target product determination unit 116, a questionnaire presentation unit 117, a learning unit 118, an input detection unit 119, a bonus granting unit 120, a control unit 121, an output unit 122, and an output information generation unit 123. The target product determining unit 116 includes an image acquiring unit 1161 , a candidate extracting unit 1162 , a candidate presenting unit 1163 , and a collection receiving unit 1164 .

[0142] The output information generating unit 123 generates output information at a predetermined cycle, for example. The predetermined cycle may be every two hours, every day, every week, every month, or every time a receipt of a collection item is registered. Specifically, the output information generating unit 123 performs statistics on the amount of collection items that have been collected or are scheduled to be collected for each predetermined division, and the amount of collection items that have been collected or are scheduled to be collected for each material of the collection items, based on the collection request data stored in the storage unit 111. The predetermined division may be, for example, for each collection item, for each category of collection items, for each manufacturer of collection items, for each age of a user who has requested collection, or for each gender of a user who has requested collection. The predetermined division may be selectable by an administrator. The output information generating unit 123 generates output information using the statistical results.

[0143] In addition, the output information generation unit 123 may refer to collection item data corresponding to the collection items and generate output information used to sort the collection items, such as output information presenting a method for sorting the collection items, location information and collection locations of the collection items from the time the user accepts the collection items to the time they are sent in a collection kit and sorted, or output information presenting the amount of carbon dioxide reduction that would be achieved by reusing or recycling the items rather than discarding them, taking into account the materials and quantities of the collected items.

[0144] Next, the output process in the tablet terminal 11 will be described.

[0145] FIG. 26 is a flowchart showing an example of output processing in the tablet terminal 11 according to the present embodiment. In step S301, the tablet terminal 11 acquires the product information in step S127 of FIG.

[0146] In step S302, the tablet terminal 11 executes the receipt registration of the collected item based on the selection result obtained. After that, the collection determination device 100 executes the process of step S303. The receipt registration process is, for example, a process in which the control unit 121 writes the obtained product information and the member ID obtained in step S117 of FIG. 6 as collection request data in association with the "application date" on which the item to be collected was photographed and issued in response to the item being photographed and inserted, the "application ID" issued in response to the item being inserted, the "quantity" of the collected item, the "receiving status" of the collected item, the "receipt registration date" of the collected item, the "gender" of the user, and the "age" of the user. The collection request data may include image data of the image of the item. The collection request data may include all of these items, or may include at least one of these items. Here, the control unit 121 may write the collection request data in the storage unit 111, and may also transmit the collection request data to the collection management server 70, where it is stored.

[0147] In step S303, the tablet terminal 11 generates output information by referring to the collection request data stored in the storage unit 111. After that, the output process in Fig. 22 is terminated. The collection management server 70 may be provided with an output information generation unit 123, and the collection management server 70 may perform the process of generating the output information.

[0148] Next, an example of a display screen for output information will be described.

[0149] Fig. 27 is a diagram showing an example of a display screen in the collection determination device 100 according to this embodiment. The display process for outputting the display screen shown in Fig. 27 may be performed by the collection management server 70 based on the operation contents input from an input device connected to the collection management server 70, and the processing result may be displayed on a display device connected to the collection management server 70. In the illustrated example, a display area for "Collection amount (daily cumulative)," a display area for "Collection amount (monthly cumulative)," a display area for "Collection amount (cumulative)," a display area for "Gender," and a display area for "Amount of cosmetics collected per age group" are displayed. In the display area of ​​"Collected amount (daily cumulative)", the collected amount of each material of the collected items is displayed for each day for a predetermined period. The "collection amount (monthly cumulative)" display area displays the quantity of collected items for the specified month for each material of the items requested to be collected. The "collection amount (monthly cumulative)" display area may also display the quantity of collected items relative to the quantity of items scheduled to be collected for the specified month. The "collection amount (cumulative)" display area displays the quantity of collected items for the entire period for each material of the items requested to be collected. The "collection amount (cumulative)" display area may display the quantity of collected items relative to the quantity of items scheduled to be collected for the entire period. The "gender" display area displays the gender ratio of users who have made collection requests. The display area for "amount of collected cosmetics per age group" displays the amount of collected products by category of collected products for each age group of users who have made collection requests.

[0150] In addition to the above-mentioned "amount collected" and "gender," the display screen of the tablet terminal 11 may also display, for example, location information and collection location of the collected items from the time the user accepts them for collection to the time they are sent in a collection kit and sorted, or it may display the amount of carbon dioxide reduction that would be achieved by reusing or recycling the collected items rather than discarding them, taking into account the material and amount of the collected items.

[0151] Thus, the recycling management system S of this embodiment includes a memory unit 111 that stores information regarding collection items to be collected, an acquisition unit (image acquisition unit 1161) that acquires collection item images representing images of the collection items to be collected, and a determination unit (collection reception unit 1164) that determines whether or not a collection item is a collection item based on the information regarding the collection item and the collection item image.

[0152] In this way, the recycle management system S can efficiently collect items to be collected. It can also determine whether an item is eligible for collection before it is collected. Even if the item does not have a JAN code or the like attached, it can be determined whether the item is eligible for collection, improving user convenience. It can also prevent secondary distribution of cosmetics and other items to be collected at auctions, flea markets, and the like, thereby preventing skin problems caused by the use of partially used cosmetics and the like.

[0153] In the recycle management system S, the information about the collection items includes at least one of an image showing a used state of the collection item and an image showing a state in which the use of the collection item has been discontinued.

[0154] In this way, the recycle management system S can determine whether or not an item is eligible for collection based on images of the item in an unused state, an image of the item in a state in which it is in use (also referred to as a state in which it has ceased to be used or a state in which it is partially used), an image of the item in a used state, and an image of the item to be collected, thereby improving the accuracy of the determination.

[0155] In addition, in the above-mentioned recycling management system S, the judgment unit (recycling reception unit 1164) judges whether or not an item is eligible for recycling by inputting an image of the item to be recycled into a learning model that has learned the correspondence between at least one of an image showing a used state of the item to be recycled and an image showing a state in which the use of the item to be recycled has been discontinued, and information indicating whether or not the item is eligible for recycling.

[0156] In this manner, the recycle management system S can accurately determine whether or not a collection item is eligible for collection.

[0157] In addition, the tablet terminal 11 of this embodiment is equipped with a memory unit 111 that stores information regarding collection items to be collected, an acquisition unit (image acquisition unit 1161) that acquires collection item images representing images of the collection items to be collected, and a determination unit (collection reception unit 1164) that determines whether or not the collection item is a collection item based on the information regarding the collection item and the collection item image.

[0158] In this way, the tablet terminal 11 can efficiently collect collection items. Also, it is possible to determine whether or not a collection item is a collection item before collection. Even if a JAN code or the like is not attached to a collection item, it is possible to determine whether or not the collection item is a collection item, thereby improving user convenience.

[0159] In addition, the recycling management system S of this embodiment includes a recycling reception unit 1164 that receives recycling requests for items to be collected for reuse or recycling, and a generation unit (output information generation unit 123) that generates progress information regarding the collection of the items based on the recycling requests and the collection status of the items.

[0160] In this way, the recycle management system S can visualize the collection status of collected items, making it possible to grasp the collection status of collected items. In addition, the collection status can be shared among reuse and recycling companies, logistics companies, and the like, improving the efficiency of work related to the collection of collected items.

[0161] In addition, the above-mentioned recycling management system S further includes a memory unit 111 that stores information regarding the collection item including whether or not it is a collection item, and an acquisition unit (image acquisition unit 1161) that acquires a collection item image representing an image of the collection item to be collected, and the collection acceptance unit 1164 determines whether or not the collection item is a collection item based on the information regarding the collection item and the collection item image, and accepts a collection request for the collection item if the collection item is a collection item, and does not accept a collection request for the collection item if the collection item is not a collection item, and stores the collection item image and information regarding the collection item in association with each other in the memory unit 111.

[0162] In this way, even if the product is not subject to collection, it is possible to understand how the user is using the product based on the collected product image, which can be used for marketing purposes. Also, the efficiency of work during and after collection can be improved.

[0163] In the recycle management system S, the collection status of collected items is the collection amount of collected items.

[0164] In this way, the recycle management system S can grasp the collection status, that is, how many of the collected items have been collected.

[0165] In the recycle management system S, the information on the items to be collected includes information used for sorting the items to be collected.

[0166] In this way, the recycle management system S can show how to separate collected items after collection, improving work efficiency after collection. In addition, since collected items can be properly separated, it can contribute to the formation of a recycling-oriented society.

[0167] In addition, the tablet terminal 11 in this embodiment is equipped with a collection reception unit that accepts collection requests for collection items that are to be collected for reuse or recycling, and a generation unit that generates progress information regarding the collection of the collection items based on the collection request and the collection status of the collection items.

[0168] In this way, the tablet terminal 11 can visualize the collection status of the collected items, so that the collection status of the collected items can be grasped. In addition, the collection status can be shared with reuse and recycling companies, logistics companies, and the like, so that the efficiency of work related to the collection of collected items can be improved.

[0169] Although the embodiment of the present invention has been described in detail above with reference to the drawings, the specific configuration is not limited to the above, and various design changes, etc. are possible within the scope that does not deviate from the gist of the present invention.

[0170] For example, the tablet terminal 11 may provide an incentive to the user based on the user's acquisition of the collected item image and the subsequent shipping of the collected item. The types of incentives include, for example, points, coupons, and prizes that can be used when purchasing a product related to the collected item. The calculation of the incentive to be provided, such as points, may be based on, for example, the quantity of collected items or the amount of materials of the collected items, or may be calculated by any means. In addition, the progress information regarding the collection of the above-mentioned collected items may include, for example, the timing of the awarding of benefits (incentives), such as the scheduled shipping date of the prize, and may be made visible to the user by notifying the user terminal 20, etc. In this way, by providing incentives to users, it is possible to prevent the disposal of not only finished products, but also unused products, products whose use has been discontinued, and half-used products, and to increase the collection rate of these products, thereby contributing to the formation of a recycling-oriented society.

[0171] For example, in the above-described embodiment, an example configured with the tablet terminal 11 has been described, but one aspect of the present invention may be realized by a plurality of devices including another device capable of realizing a part of the tablet terminal 11.

[0172] The functions of the user terminal 20, the tablet terminal 11, and the collection management server 70 in the above-mentioned embodiment may be realized by a computer. In that case, a program for realizing the functions may be recorded in a computer-readable recording medium, and the program recorded in the recording medium may be read into a computer system and executed to realize the functions. The term "computer system" as used herein includes hardware such as an OS and peripheral devices. The term "computer-readable recording medium" refers to portable media such as flexible disks, optical magnetic disks, ROMs, and CD-ROMs, and storage devices such as hard disks built into a computer system. The term "computer-readable recording medium" may also include a medium that dynamically holds a program for a short period of time, such as a communication line when a program is transmitted via a network such as the Internet or a communication line such as a telephone line, and a medium that holds a program for a certain period of time, such as a volatile memory inside a computer system that is a server or client in that case. The above-mentioned program may be a program for realizing a part of the above-mentioned functions, or may be a program that can realize the above-mentioned functions in combination with a program already recorded in the computer system, or may be a program that is realized using a programmable logic device such as an FPGA (Field Programmable Gate Array).

[0173] In addition, the program that runs on the tablet terminal 11 in one aspect of the present invention may be a program that controls one or more processors such as a CPU (Central Processing Unit) so as to realize the functions shown in the above-mentioned embodiments and modified examples related to one aspect of the present invention (a program that makes a computer function). The computer here also includes a quantum computer. The information handled by each of these devices is temporarily stored in a RAM (Random Access Memory) during processing, and then stored in various storage devices such as a flash memory or an HDD (Hard Disk Drive), and may be read, modified, or written by the CPU or the like as necessary.

[0174] Note that a part or all of the tablet terminal 11 in each of the above-described embodiments and modified examples may be realized by a computer having one or more processors. In that case, the control function may be realized by recording a program for realizing the control function on a computer-readable recording medium, and reading and executing the program recorded on the recording medium into a computer system.

[0175] Also, a part or all of the tablet terminal 11 in each of the above-mentioned embodiments and modifications may be realized as an LSI, which is typically an integrated circuit, or may be realized as a chip set. Also, each functional block of the collection determination device 100 in each of the above-mentioned embodiments and modifications may be individually formed into a chip, or may be integrated into a chip in part or in whole. Also, the integrated circuit method is not limited to LSI, and may be realized by a dedicated circuit and / or a general-purpose processor. Also, when an integrated circuit technology that replaces LSI appears due to the advancement of semiconductor technology, it is possible to use an integrated circuit based on that technology.

[0176] Although the embodiments and modifications have been described above in detail with reference to the drawings as one aspect of the present invention, the specific configuration is not limited to the embodiments and modifications, and includes design changes within the scope of the gist of the present invention. In addition, one aspect of the present invention can be modified in various ways within the scope of the claims, and embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present invention. In addition, configurations in which elements described in the above embodiments and modifications are replaced with elements that have the same effect are also included. [Explanation of symbols]

[0177] 10...container, 10a...top, 11...tablet terminal, 11a...touch panel, 11b...camera, 12...insertion port, 12a...guide member, 13...door, 13a...window section, 14...display section, 15...light sensor, 16...weight sensor, 17...storage section, 20...user terminal, 30...benefit management server, 40...SNS server, 50...product information management server, 60...distribution server, 70...collection management server, 80...gift server, 90...distribution server, 110 ...Communication unit, 111...Memory unit, 112...Input unit, 113...Camera, 114...User identification information acquisition unit, 115...Entry unit, 116...Target product determination unit, 117...Questionnaire presentation unit, 118...Learning unit, 119...Input detection unit, 120...Benefit granting unit, 121...Control unit, 122...Output unit, 123...Output information generation unit, 1161...Image acquisition unit, 1162...Candidate extraction unit, 1163...Candidate presentation unit, 1164...Return reception unit, S...Cycle management system

Claims

1. A terminal device is provided in a container that contains the items to be collected, The terminal device A user identification information acquisition unit that acquires user identification information that identifies a user who puts the collection item into the collection container; an acquisition unit that acquires a collection item image representing an image of the collection item; A first storage unit that stores information regarding a collection target product that is a collection target; a determination unit that determines whether the collection item is a collection item based on information about the collection item and the collection item image; an insertion detection unit that detects whether the collected item has been inserted into the insertion path of the storage container; a second storage unit that stores the user identification information and a detection result of the input detection unit; A containment vessel having:

2. The information on the recalled product includes at least one of an image showing a used state of the recalled product and an image showing a state where use of the recalled product has been discontinued. The storage container according to claim 1 .

3. The determination unit is determining whether the item is a recalled item by inputting the recalled item image into a learning model that has learned a correspondence between at least one of an image showing a used state of the recalled item and an image showing a state in which the use of the recalled item has been discontinued and information showing whether the item is a recalled item; The storage container according to claim 1 or 2.

4. a collection reception unit that receives a collection request for a collection item to be collected for reuse or recycling; a generating unit that generates progress status information regarding the collection of the collection item based on the collection request and a collection status of the collection item; Equipped with The storage container according to claim 1 .

5. The collection reception unit includes: determining whether the collection item is a collection item based on information about the collection item and the collection item image, and accepting the collection request for the collection item if the collection item is a collection item; if the collection item is not the collection target item, the collection request for the collection item is not accepted, and the collection item image and information regarding the collection target item are stored in the second storage unit in association with each other. The storage container according to claim 4.

6. The recovery status of the recovered product is the amount of the recovered product. The storage container according to claim 4.

7. The information regarding the items to be collected includes information used to separate the items to be collected. The storage container according to claim 5 .

8. The terminal device a privilege granting section that transmits privilege granting data indicating that a privilege is to be granted to the user identification information to a privilege management server that stores the user identification information and privilege information indicating a granted privilege in association with the user identification information when the collected item is determined to be the item to be collected and the detection result of the insertion detection section indicates that the collected item has been inserted. The storage container according to claim 1 ,

9. The storage container has a storage amount detection unit that detects the storage amount of the collected items placed in the storage container; a communication unit that transmits a detection result of the storage amount detection unit to a collection management server; The storage container according to claim 8 ,

10. The second storage unit stores the user identification information, the detection result of the insertion detection unit, and product information corresponding to the collected product. The storage container according to claim 1 ,

11. The terminal device is a tablet terminal. The storage container according to claim 1 .

12. An information processing method to be executed by a computer that is a terminal device provided in a storage container that stores collected items, comprising: Obtaining user identification information that identifies a user who puts the collected items into the storage container; obtaining a collection item image representing an image of the collection item; referring to a first storage unit that stores information about a collection target product that is a collection target, and determining whether or not the collection target product is a collection target product based on the information about the collection target product and the collection target product image; Detecting whether the collected item has been inserted into the insertion path of the storage container; The user identification information and a determination result as to whether the collected item has been inserted into the insertion path of the storage container are stored in a second storage unit. An information processing method comprising the steps of:

13. A program to be executed by a computer that is a terminal device provided in a storage container that stores collected items, Obtaining user identification information that identifies a user who puts the collected items into the storage container; obtaining a collection item image representing an image of the collection item; referring to a first storage unit that stores information about a collection target product that is a collection target, and determining whether or not the collection target product is a collection target product based on the information about the collection target product and the collection target product image; Detecting whether the collected item has been inserted into the insertion path of the storage container; The user identification information and a determination result as to whether the collected item has been inserted into the insertion path of the storage container are stored in a second storage unit. A program that includes:

Images