Artificial intelligence and iot-based garbage collection apparatus, and system using same

Abstract

A garbage collection apparatus, according to one embodiment, may comprise: a main module for recognizing garbage to be currently collected on the basis of artificial intelligence which has been pretrained on the basis of images, and determining a collection path; a plurality of first submodules which are predetermined so as to collect garbage according to the characteristics thereof; and a second submodule for performing postprocessing on the garbage to be currently collected.

Description

AI and IoT-based waste collection device and system using the same

[0001] The present invention relates to an artificial intelligence and IoT-based waste collection device and a system using the same.

[0002] In modern society, waste generation is continuously increasing due to rapid urbanization and industrialization. Under these circumstances, the proper separation and efficient management of waste are emerging as key challenges for environmental protection and resource recycling.

[0003] Existing waste disposal and management systems rely primarily on manual labor or simple mechanical separation methods, resulting in inefficiency in sorting, limitations in monitoring waste volume, and problems such as environmental pollution and resource waste.

[0004] To address the problems of the existing system, methods are required to improve the efficiency of waste separation, effectively monitor waste output, and implement appropriate resource allocation to mitigate environmental pollution.

[0005] Methods are required to improve the efficiency of separate waste collection, effectively monitor waste generation, and implement appropriate resource allocation to mitigate environmental pollution.

[0006] A waste collection device according to one embodiment may include: a main module that recognizes waste currently to be collected based on an image-based artificial intelligence and determines a collection path; a plurality of first sub-modules predetermined to collect waste according to the characteristics of the waste; and a second sub-module that performs post-processing on the waste currently to be collected.

[0007] According to one embodiment, the main module includes an image acquisition unit for acquiring an image of waste currently to be collected; and a processor for inputting the image into a pre-trained artificial intelligence model to determine the category and characteristics of the waste currently to be collected, and the processor may generate control information to collect the waste currently to be collected in different ways according to the determined category.

[0008] According to one embodiment, the processor determines a first sub-module for collecting the waste currently to be collected when the waste currently to be collected is determined to be in a first category corresponding to a single characteristic that does not require post-processing, and generates and provides first control information for controlling the determined first sub-module; determines a plurality of first sub-modules corresponding to the two characteristics when the waste currently to be collected is determined to be in a second category including waste having two different characteristics that does not require post-processing, and generates and provides first control information for controlling the determined plurality of first sub-modules; and when the waste currently to be collected is determined to be in a third category requiring post-processing, generates and transmits second control information for post-processing through the second sub-module.

[0009] According to one embodiment, the main module may further include a display unit that provides guide information on a waste collection method.

[0010] According to one embodiment, the main module, the first sub-module, and the second sub-module may be provided in a modularized manner.

[0011] According to one embodiment, the main module may further provide analysis information analyzing the trend of collected waste.

[0012] A waste collection method performed by a waste collection device according to one embodiment may include: a step of acquiring an image of waste currently to be collected; a step of determining the category and characteristics of the waste currently to be collected based on an analysis of the image; and a step of collecting the waste currently to be collected in different ways according to the determined category.

[0013] Through embodiments of the present invention, means for automatically classifying and discharging waste can be provided.

[0014] FIG. 1 is a drawing for explaining the structure of an artificial intelligence and IoT-based waste collection device according to the present invention.

[0015] FIG. 2 is a drawing for explaining the structure of a main module (110) according to one embodiment.

[0016] FIG. 3 is a drawing for explaining the structure of a first sub-module (120) according to one embodiment.

[0017] FIG. 4 is a drawing for explaining the structure of a second sub-module (130) according to one embodiment.

[0018] FIG. 5 is a flowchart illustrating the operation method of an artificial intelligence and IoT-based waste collection device according to one embodiment.

[0019] FIGS. 6 and 7 are drawings illustrating an exemplary example of an artificial intelligence and IoT-based waste collection device according to one embodiment.

[0020] FIG. 8 is a drawing illustrating an example of an interface provided through a display unit according to one embodiment.

[0021] Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings.

[0022] The embodiments of the present invention described below are provided to more clearly explain the present invention to those skilled in the art, and the scope of the present invention is not limited by the following embodiments, and the following embodiments may be modified in various other forms.

[0023] The terms used herein are for describing specific embodiments and are not intended to limit the invention. Terms used herein in the singular form may include plural forms unless the context clearly indicates otherwise. Additionally, the terms “comprise” and / or “comprising” used herein specify the presence of the mentioned features, steps, numbers, actions, components, elements, and / or groups thereof, and do not exclude the presence or addition of one or more other features, steps, numbers, actions, components, elements, and / or groups thereof. Furthermore, the term “connected” used herein means not only that components are directly connected, but also includes the concept of indirectly connecting components through the interposition of additional components between them.

[0024] Furthermore, when a component is described in this specification as being located "on" another component, this includes not only cases where a component is in contact with another component, but also cases where another component exists between the two components. The term "and / or" as used in this specification includes any one of the listed items and all combinations of one or more thereof. Additionally, terms of degree such as "about" and "substantially" as used in this specification are used to mean a range of numerical values ​​or degrees or approximate values, taking into account inherent manufacturing and material tolerances, and are used to prevent an infringer from unfairly exploiting the disclosures in which precise or absolute figures provided to aid in understanding this specification are mentioned.

[0025] Embodiments of the present invention will be described in detail below with reference to the attached drawings. The sizes or thicknesses of the areas or parts depicted in the attached drawings may be slightly exaggerated for the clarity of the specification and convenience of explanation. Throughout the detailed description, the same reference numerals indicate the same components.

[0026] FIG. 1 is a drawing for explaining the structure of an artificial intelligence and IoT-based waste collection device according to the present invention.

[0027] Referring to FIG. 1, an artificial intelligence and IoT-based waste collection device (100) according to one embodiment may include a main module (110) that recognizes waste to be collected based on an image-based artificial intelligence and determines a collection path, a plurality of first sub-modules (120-1, 120-2, 120-4) that collect waste according to characteristics, and a second sub-module (130) that collects liquid contained in the waste. According to an embodiment, the artificial intelligence and IoT-based waste collection device (100) may further include a third sub-module (not shown) that collects food waste and a fourth sub-module (not shown) that collects disposable cups, and according to an embodiment, may further include additional modules that collect various types of waste.

[0028] A main module (110) according to one embodiment may include an image acquisition unit (111) for acquiring an image of the waste currently to be collected, a user input unit (112) for receiving a predetermined user input, and a display unit (113) for providing guidance information related to waste collection.

[0029] The main module (110) can acquire an image of the waste currently to be collected through an image acquisition unit (111) and determine the category of the waste currently to be collected based on the AI-based recognition result of the acquired image through a built-in processor. For example, the category may be divided into a first category corresponding to the case where the waste currently to be collected consists of waste of a single characteristic that does not require separate post-processing (e.g., waste made of a single plastic material), a second category corresponding to the case where the waste currently to be collected consists of waste of different characteristics that does not require separate post-processing (e.g., waste composed of multiple material elements such as paper boxes and plastic bottles), and a third category corresponding to the case where the waste requires post-processing (e.g., plastic bottles containing liquids, plastic containers containing food waste, etc.).

[0030] To this end, the main module (110) can determine the characteristics (e.g., material (plastic, can, paper, etc.), contamination level (high, medium, low, or percentage, etc.), name (brand or product name), etc.) and category (the first to third categories described above) of the waste currently to be collected by inputting the acquired image into a pre-trained artificial intelligence model. More specifically, the pre-trained artificial intelligence model can be trained to output the characteristics and category of the waste for the input image of the waste currently to be collected, based on training data corresponding to waste images labeled with the type and category of the waste. For example, the artificial intelligence model may include a deep neural network.인공지능 모델은 CNN(Convolutional Neural Network), RNN(Recurrent Neural Network), 퍼셉트론(perceptron), 다층 퍼셉트론(multilayer perceptron), FF(Feed Forward), RBF(Radial Basis Network), DFF(Deep Feed Forward), LSTM(Long Short Term Memory), GRU(Gated Recurrent Unit), AE(Auto Encoder), VAE(Variational Auto Encoder), DAE(Denoising Auto Encoder), SAE(Sparse Auto Encoder), MC(Markov Chain), HN(Hopfield Network), BM(Boltzmann Machine), RBM(Restricted Boltzmann Machine), DBN(Depp Belief Network), DCN(Deep Convolutional Network), DN(Deconvolutional Network), DCIGN(Deep Convolutional Inverse Graphics Network), GAN(Generative Adversarial Network), LSM(Liquid State Machine), ELM(Extreme Learning Machine), ESN(Echo State Network), DRN(Deep Residual Network), DNC(Differentiable Neural Computer), NTM(Neural Turning Machine), CN(Capsule Network), KN(Kohonen Network), AN(Attention Network) 및 SplitNN(Split Neural Network) 및 NoPeekNN(NoPeek Neural Network)를 포함할 수 있다.

[0031] According to one embodiment, when the main module (110) determines that the waste currently to be collected is in the first category, it can determine one of the first sub-modules (120-1, 120-2, 120-4) to collect the waste currently to be collected according to the characteristics of the determined waste currently to be collected. Each of the first sub-modules (120-1, 120-2, 120-4) may have the characteristics of the waste to be collected determined in advance. For example, based on the material of the waste, the first sub-module (120-1) may be determined in advance as a waste bin that collects waste corresponding to plastic material, the first sub-module (120-2) may be determined in advance as a waste bin that collects waste corresponding to paper material, the first sub-module (120-3) may be determined in advance as a waste bin that collects waste corresponding to vinyl material, and the first sub-module (120-4) may be determined in advance as a waste bin that collects waste corresponding to aluminum material. The main module (110) may determine a first sub-module (120-1) corresponding to the current waste subject to collection, which is plastic, as the first sub-module for collecting the current waste subject to collection. The main module (110) may generate first control information for collecting waste through the determined first sub-module (120-1) and transmit it to the first sub-module (120-1). The first sub-module (120-1) may provide a predetermined notification through the received first control information, as described below, and proceed with the collection procedure.

[0032] In the previously presented embodiment, the characteristics of the waste collected in each first sub-module (120-1, 120-2, 120-4) were described as being determined based on the material of the waste; however, in other embodiments, the characteristics of the waste may be distinguished according to the degree of contamination of the waste, and the characteristics of the waste to be collected corresponding to each of the first sub-modules (120-1, 120-2, 120-4) may be determined. In other embodiments, the characteristics of the waste may be predetermined so that a certain group of first sub-modules (120-1, 120-2, 120-3) collects waste that does not require recycling, and the characteristics of the waste may be predetermined so that a remaining group of first sub-modules (120-4) collects waste that requires recycling.

[0033] According to one embodiment, when the current waste to be collected is determined to be in a second category, the main module (110) may determine a plurality of first sub-modules (120-1, 120-2, 120-4) to collect the current waste to be collected according to a plurality of characteristics corresponding to the determined current waste to be collected. For example, when the current waste to be collected is determined to be in a second category including paper waste and plastic waste, the main module (110) may determine a first sub-module (120-2) predetermined to collect paper waste and a first sub-module (120-1) predetermined to collect plastic waste as the first sub-modules for collecting the current waste to be collected. The main module (110) can generate first control information for collecting waste through the determined first sub-modules (120-1, 120-2) and transmit it to the first sub-modules (120-1, 120-2). Additionally, the main module (110) can provide guide information through the display unit (113) that indicates the location of the first sub-modules (120-1, 120-2) corresponding to each of the plurality of characteristics and what kind of waste should be disposed of to each of the first sub-modules (120-1, 120-2) corresponding to each location.

[0034] According to one embodiment, when the current waste to be collected is determined to be in the third category, the main module (110) can provide guidance on the post-processing method through the display unit (113) and, at the same time, generate second control information for post-processing and transmit it to the corresponding sub-module. For example, when the current waste to be collected corresponds to a plastic bottle containing liquid, the main module (110) can provide guidance on the method of collecting the liquid contained in the plastic bottle through the control of the second sub-module (130) described below via the display unit (113), and at the same time, generate second control information for controlling the second sub-module (130) and transmit it to the second sub-module (130). The second sub-module (130) can provide the notification described below through the received second control information and, at the same time, perform the operation described below for collecting the liquid. When the main module (110) determines that liquid collection is completed through the second sub-module (130), it can generate first control information to control the first sub-module (120-1) that is predetermined to collect plastic, and transmit it to the first sub-module (120-1).

[0035] According to an additional example, if the waste currently to be collected corresponds to a plastic container containing food, the main module (110) can provide a guide on how to collect the food through a separate module (e.g., a fourth sub-module) via the display unit (113), and at the same time, generate / transmit second control information to control the fourth sub-module to collect the food. When the collection of food is completed, the main module (110) can generate first control information to drive the first sub-module to support the collection of the plastic container.

[0036] In addition, when the waste currently to be collected is a plastic container with a vinyl label attached, the main module (110) can provide a guide on how to remove the vinyl label and collect it separately through the display unit (113), and at the same time, support the simultaneous collection of vinyl and plastic by distinguishing between them through a first control signal that simultaneously controls a first sub-module for collecting vinyl and a first sub-module for collecting plastic.

[0037] According to one embodiment, the main module (110) can provide a series of membership services based on user identification (e.g., login). For example, the main module (110) can identify a user by i) recognizing the user's terminal based on Bluetooth (login processing), ii) receiving an ID / PW based on the user input unit (112) (login processing), or iii) identifying the user through a predetermined QR code (login processing), and can provide a series of membership services to the identified user.

[0038] A predetermined membership service may include i) a service for charging the cost in the case of waste that has been determined to be charged for the collection of recognized waste, ii) a service for awarding points to the user for each round using the artificial intelligence and IoT-based waste collection device (100), and iii) an analysis service for the collected waste. The points awarded in the preceding ii) process may also be additionally used to pay the cost charged in the i) process.

[0039] According to one embodiment, the main module (110) can provide a means to facilitate the process of emptying waste by monitoring the amount of waste collected in each sub-module in real time and providing a notification to the administrator terminal when the amount of waste collected exceeds a predetermined threshold.

[0040] Additionally, the main module (110) can analyze the trend of collected waste and provide sub-module placement recommendation information. For example, the main module (110) can monitor the amount of waste collected from each of the multiple first sub-modules (120-1, 120-2, 120-4) and provide information on the statistical amount to the user by reporting it. In addition, the main module (110) can provide sub-module placement recommendation information based on the aforementioned monitoring results. For example, in the case of a specific area A, if the trend is analyzed to show that the amount of paper waste is negligible while the amount of plastic waste is very large, the main module (110) may provide sub-module placement recommendation information to the administrator terminal, such as suggesting the additional placement of a first sub-module corresponding to plastic, or miniaturizing the first sub-module corresponding to paper while increasing the size / number of the first sub-modules corresponding to plastic.

[0041] In addition, the main module (110) can generate an analysis report analyzing the amount of waste generated by each product / brand through the analysis of trends in collected waste, and provide this to companies requesting it as marketing material. By monitoring the amount of waste generated in this way, a means to derive regional product / brand marketing strategies can be provided.

[0042] The main module (110) can provide recommendations for sub-module placement by region. For example, if a recycling company for a specific material exists at a location below a predetermined threshold from the region where the main module (110) is placed, a first sub-module corresponding to that material is placed separately; however, if a recycling company for a specific material does not exist at a location below the predetermined threshold, recommendations for sub-module placement can be provided so that a separate first sub-module corresponding to the waste of that material is not placed and the waste is collected as general waste. This provides a means to reduce distribution costs and improve recyclability.

[0043] Additionally, as previously described, if the main module (110) determines that the current waste to be collected is in a third category subject to post-processing, it may determine the first sub-module to collect the current waste to be collected based on the recyclability after post-processing is completed based on the second control information. For example, the main module (110) can re-acquire an image of the current waste subject to collection after post-processing (e.g., a plastic bottle from which internal liquid has been discharged), calculate the contamination level of the current waste subject to collection after post-processing based on the acquired image (e.g., calculate transparency based on the acquired image), and if the contamination level is below a predetermined threshold based on the calculation result (e.g., if transparency is above a predetermined threshold), the waste can be collected through a first sub-module corresponding to the current waste subject to collection (e.g., collected through a first sub-module corresponding to plastic), and if the contamination level is above a predetermined threshold based on the calculation result (e.g., if transparency is below a predetermined threshold), the main module (110) can generate first control information to collect the current waste subject to collection through a first sub-module corresponding to general waste. Although the method for calculating the contamination level has been described exemplarily as calculating image-based transparency, a person skilled in the art will understand that the contamination level can also be calculated by determining whether the proportion of dirt present in an image exceeds a predetermined threshold, or by relying on expert systems (algorithms based on pre-learned empirical / theoretical knowledge and inference (statistical) models) or additional sensors such as odor meters.

[0044]

[0045] The structure of each of the plurality of first sub-modules (120-1, 120-2, 120-4) according to one embodiment is described based on the first sub-module (120-1). The first sub-module (120-1) according to one embodiment may include a first input unit (121-1) for inputting waste currently to be collected, a first notification unit (121-2) for providing a notification that it corresponds to a first sub-module for collecting waste currently to be collected, a first storage unit (not shown) for storing waste currently to be collected input through the first input unit (121-1), and a first opening / closing unit (121-3).

[0046] According to one embodiment, each of the plurality of first sub-modules (120-1, 120-2, 120-4) may correspond to a trash can predetermined to collect waste according to the type of waste to be collected (e.g., plastic, general waste, paper, aluminum, vinyl, etc.). For example, the first sub-module (120-1) may be predetermined to collect plastic, the first sub-module (120-2) to collect general waste, the first sub-module (120-3) to collect paper, and the first sub-module (120-4) to collect aluminum. If, through the process described above, the main module (110) determines that the first sub-module (120-1) among the plurality of first sub-modules (120-1, 120-2, 120-4) collects the waste currently to be collected based on the image of the waste currently to be collected, the first sub-module (120-1) may provide a notification to the outside through the notification unit (121-2) based on the first control information transmitted through the main module (110). For example, the notification may be the lighting of a built-in LED, but the embodiment is not limited thereto and may include any notification such as a notification using sound, which will be understood by a person skilled in the art. Through the above notification, the user can recognize that the waste currently to be collected is being collected through the first sub-module (120-1) to which the notification was provided. The first sub-module (120-1) can control the first input section (121-1) by providing a predetermined notification and opening the input section (121-1) so that the user can insert the waste currently to be collected into the first sub-module (120-1) through the first input section (121-1). The first input section (121-1) can be implemented in any form in which opening and closing can be controlled, and a person skilled in the art will understand that the first input section (121-1) can be implemented in any form in which opening and closing can be controlled, such as a form in which opening and closing is controlled through a hinge structure, or a form in which opening and closing is controlled in the form of a slide door.Waste introduced through the first input section (121-1) can be stored in a storage section (not shown), and subsequently, the waste stored in the first storage section (not shown) can be discharged to the outside by opening the first opening / closing section (121-3). To this end, the structure of the first opening / closing section (121-3) may be implemented, for example, in the form of a lid of a cube-shaped first sub-module (120-1) so that the opening / closing is controlled, but it will be understood by a person skilled in the art that it may be implemented in any form capable of controlling the opening / closing.

[0047] A second sub-module (130) according to one embodiment may include a second notification unit (131) that provides a notification indicating that it is a module for liquid collection, a second opening / closing unit (132), a second input unit (not shown) that is exposed when the second opening / closing unit (132) is opened and for inputting a liquid contained in the waste currently to be collected, and a second storage unit (not shown) for storing the liquid input through the second input unit.

[0048] According to one embodiment, a plurality of second sub-modules (130) may correspond to a predetermined trash can for collecting liquid contained in waste to be collected. When the main module (110) determines, based on an image of the waste to be collected, that there is liquid inside the waste to be collected (when the waste to be collected described above is determined to be in the third category), before generating first control information for controlling the first sub-modules (120-1, 120-2, 120-4), it may generate second control information to control the second sub-modules (130) to perform post-processing by controlling them to collect the liquid contained in the waste to be collected first, and transmit this information to the second sub-modules (130). Based on the second control information transmitted through the main module (110), the second sub-modules (130) may provide a notification to the outside through the second notification unit (131). For example, the notification may be the illumination of a built-in LED, but the embodiment is not limited thereto and may include any notification, such as a notification using sound, which will be understood by a person skilled in the art. Through the above notification, the user can recognize that the waste currently subject to collection is being collected through the second sub-module (130) provided with the notification. In addition to providing a specific notification, the second sub-module (130) may open the second opening / closing part (132) so that the user can inject the liquid contained in the waste currently subject to collection into the second sub-module (130) through the second input part (not shown). The second opening / closing part (132) may be implemented in the form of a lid of the cube-shaped second sub-module (130) so that the opening / closing is controlled, but it will be understood by a person skilled in the art that it may be implemented in any form capable of controlling the opening / closing.Additionally, a person skilled in the art will understand that the second input section (not shown) may be implemented in a curved shape capable of collecting liquid, but the structure of the second input section (not shown) is not limited thereto and may be implemented in any structure capable of collecting liquid. Although not shown in the drawings, a person skilled in the art will understand that the second sub-module (130) may further include an additional opening / closing part for discharging liquid stored in the second storage section (not shown) to the outside.

[0049] According to one embodiment, the main module (110), a plurality of first sub-modules (120-1, 120-2, 120-4), and the second module (130) may be implemented in a modular manner so as to be expandable / reducible according to needs. To this end, the main module (110), a plurality of first sub-modules (120-1, 120-2, 120-4), and the second module (130) may be implemented as cube-shaped blocks that facilitate mutual connection, and may include convex / concave fitting connections to provide ease of connection between them. The fitting structure is presented as an example, and the implementation of the module is not limited thereto; it will be understood by a person skilled in the art that it may be implemented in any structure that provides ease of connection.

[0050] The main module (110), a plurality of first sub-modules (120-1, 120-2, 120-4), and second module (130) are provided in a modular manner, thereby providing a high degree of freedom of expansion. For example, in FIG. 1, it is exemplarily illustrated as being implemented with four first sub-modules (120-1, 120-2, 120-4) and one second sub-module (130), but according to the embodiment, in areas with relatively high general waste discharge, it may be implemented so that additional first sub-modules are added, and the same number of modules may be combined in different forms according to needs, which will be understood by a person skilled in the art.

[0051] In the example presented, a plurality of first sub-modules (120-1, 120-2, 120-4) are exemplified as being implemented in the same shape and size, but the embodiment is not limited thereto, and it will be understood by a person skilled in the art that each first sub-module can be implemented in any size and shape.

[0052] FIG. 2 is a drawing for explaining the structure of a main module (110) according to one embodiment.

[0053] Referring to FIG. 2, the main module (110) may include an image acquisition unit (111), a user input unit (112), a display unit (113), a processor (114), a communication unit (115), and a memory (116).

[0054] The image acquisition unit (111) according to one embodiment may be any device capable of acquiring a two-dimensional image (or image), and may be implemented, for example, as a camera. A person skilled in the art will understand that, depending on the embodiment, the image acquisition unit (111) may be implemented as a device capable of acquiring information of two dimensions or more.

[0055] According to one embodiment, the user input unit (112) may be implemented in the form of a keypad and may be implemented as a device capable of inputting characters / numbers. Depending on the embodiment, it will be understood by a person skilled in the art that the user input unit (112) may support touch input and may be implemented as any device that supports various user inputs.

[0056] The processor (114) can, for example, execute software (e.g., a program) to control at least one other component (e.g., a hardware or software component) of the main module (110) connected to the processor (114) and perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (114) can store instructions or data received from other components (e.g., memory (116) or communication unit (115)) in volatile memory, process the instructions or data stored in volatile memory, and store the resulting data in non-volatile memory. According to one embodiment, the processor (114) may include a main processor (e.g., a central processing unit or an application processor) or an auxiliary processor (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can be operated independently or together with the main processor. For example, if the main module (110) includes a main processor and an auxiliary processor, the auxiliary processor may be configured to use less power than the main processor or to be specialized for a specified function. The auxiliary processor may be implemented separately from the main processor or as part of it.

[0057] The processor (114) can control a series of operations of the main module (110) described above.

[0058] The communication unit (115) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the main module (110) and an external electronic device (e.g., user terminal, first sub-module to fourth sub-module, etc.), and the performance of communication through the established communication channel. The communication unit (115) may include one or more communication processors that operate independently of the processor (114) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication unit (115) may include a wireless communication module (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (e.g., LAN (local area network) communication module, or power line communication module). Among these communication modules, the corresponding communication modules can communicate with external electronic devices (e.g., control hubs, external sensing devices, etc.) through a first network (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips).

[0059] According to various embodiments, the memory (116) may store various data used by at least one component of the main module (110) (e.g., a communication unit (115) or a processor (114)). The data may include, for example, software (e.g., a program) and input data or output data for related commands. The memory (116) may include volatile memory or non-volatile memory.

[0060]

[0061] FIG. 3 is a drawing for explaining the structure of a first sub-module (120) according to one embodiment.

[0062] Referring to FIG. 3, the first sub-module (120) may include a first input unit (121 (121-1 of FIG. 1)), a first notification unit (122 (121-2 of FIG. 1)), a first opening / closing unit (123 (121-3 of FIG. 1)), a processor (124), a communication unit (125), a memory (126), and a first storage unit (127).

[0063] A person skilled in the art will understand that the first input section (121) according to one embodiment may correspond to an inlet for inputting waste and may be implemented with any structure capable of opening and closing (e.g., a hinge structure, a slide door structure, a push door structure, etc.). The first input section (121) is opened in conjunction with a notification from the first notification section (122) described below, thereby providing a means for the user to easily identify the first sub-module (120) that is the target for waste collection.

[0064] According to one embodiment, the first notification unit (122) may provide a means of providing a predetermined notification when the characteristics (e.g., material) of the waste currently to be collected correspond to characteristics that the first sub-module (120) is to collect, by emitting light from a built-in light-emitting means (e.g., LED) or generating a predetermined audio signal, thereby notifying the user that the waste currently to be collected must be disposed of in the first sub-module (120). It will be understood by a person skilled in the art that the type of notification of the first notification unit (122) is not limited to the presented examples, and any means that can be used as a notification may be utilized.

[0065] A first opening / closing part (123) according to one embodiment is a means for blocking the first storage part (127) inside the first sub-module (120) from the outside by opening / closing, and, for example, may be implemented in the form of a lid of a cube-shaped first sub-module (120), but it will be understood by a person skilled in the art that it may be implemented in any structure capable of blocking the first storage part (127) from the outside by opening / closing. A user can empty the waste collected in the first storage part (127) by opening / closing the first opening / closing part (123).

[0066] A processor (124) according to one embodiment may, for example, execute software (e.g., a program) to control at least one other component (e.g., a hardware or software component) of a first submodule (120) connected to the processor (124) and perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (114) may store instructions or data received from other components (e.g., memory (126) or communication unit (125)) in volatile memory, process the instructions or data stored in volatile memory, and store the resulting data in non-volatile memory. According to one embodiment, the processor (124) may include a main processor (e.g., a central processing unit or an application processor) or an auxiliary processor (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can be operated independently or together with it. For example, if the first sub-module (120) includes a main processor and an auxiliary processor, the auxiliary processor may be configured to use less power than the main processor or to be specialized for a designated function. The auxiliary processor may be implemented separately from the main processor or as part thereof.

[0067] The processor (124) can control a series of operations of the first submodule (120) described above.

[0068] The communication unit (125) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the first sub-module (120) and an external electronic device (e.g., user terminal, main module, second sub-module to fourth sub-module, etc.), and the performance of communication through the established communication channel. The communication unit (125) may include one or more communication processors that operate independently of the processor (124) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication unit (125) may include a wireless communication module (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (e.g., LAN (local area network) communication module, or power line communication module). Among these communication modules, the corresponding communication modules can communicate with external electronic devices (e.g., control hubs, external sensing devices, etc.) through a first network (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips).

[0069] According to various embodiments, the memory (126) may store various data used by at least one component of the first submodule (120) (e.g., a communication unit (125) or a processor (124)). The data may include, for example, software (e.g., a program) and input data or output data for related commands. The memory (126) may include volatile memory or non-volatile memory.

[0070] A first storage unit (127) according to one embodiment is a means for storing waste collected through a first input unit (121), and can be implemented in any structure capable of storing waste that is input.

[0071] FIG. 4 is a drawing for explaining the structure of a second sub-module (130) according to one embodiment.

[0072] Referring to FIG. 4, the second sub-module (130) may include a second notification unit (131), a second opening / closing unit (132), a second storage unit (133), a processor (134), a communication unit (135), a memory (136), and a second input unit (not shown).

[0073] According to one embodiment, the second notification unit (131) is a means for providing a predetermined notification indicating that the second sub-module (130) is a means for collecting liquid when it is determined that liquid is present inside the waste currently to be collected. This notification may be provided by emitting light from a built-in light-emitting means (e.g., LED) or by generating a predetermined audio signal, thereby providing a means for notifying the user that the liquid currently present inside the waste to be collected must be disposed of in the second sub-module (130). It will be understood by a person skilled in the art that the type of notification of the second notification unit (131) is not limited to the presented example, and any means that can be used as a notification may be utilized.

[0074] According to one embodiment, the second opening / closing part (132) is a means for blocking the internal area of ​​the second sub-module (130) from the outside as it opens / closes. For example, liquid can be collected through a second input part (not shown) that is exposed as the second opening / closing part (132) opens. The opening / closing of the second opening / closing part (132) can be controlled through a processor (134) described below, and this control can be performed based on the second control information described above. For example, the second opening / closing part (132) can be implemented in the form of a lid of the cube-shaped second sub-module (130), but it will be understood by a person skilled in the art that it can be implemented in any structure capable of blocking the internal area of ​​the second sub-module (130) from the outside as it opens / closes. A user can dispose of liquid into the interior of the second sub-module (130) by opening / closing the second opening / closing part (132).

[0075] A second storage unit (133) according to one embodiment is a means for storing liquid collected through a second input unit (not shown), and can be implemented in any structure capable of storing the input liquid.

[0076] The processor (134) can, for example, execute software (e.g., a program) to control at least one other component (e.g., a hardware or software component) of the second submodule (130) connected to the processor (134) and perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (134) can store instructions or data received from other components (e.g., memory (136) or communication unit (135)) in volatile memory, process the instructions or data stored in volatile memory, and store the resulting data in non-volatile memory. According to one embodiment, the processor (134) may include a main processor (e.g., a central processing unit or an application processor) or an auxiliary processor (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can be operated independently or together with it. For example, if the second sub-module (130) includes a main processor and an auxiliary processor, the auxiliary processor may be configured to use less power than the main processor or to be specialized for a designated function. The auxiliary processor may be implemented separately from the main processor or as part of it.

[0077] The processor (134) can control a series of operations of the second submodule (130) described above.

[0078] The communication unit (135) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the second sub-module (130) and an external electronic device (e.g., user terminal, main module, first sub-module, third sub-module and fourth sub-module, etc.), and the performance of communication through the established communication channel. The communication unit (135) may include one or more communication processors that operate independently of the processor (134) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication unit (135) may include a wireless communication module (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (e.g., LAN (local area network) communication module, or power line communication module). Among these communication modules, the corresponding communication modules can communicate with external electronic devices (e.g., control hubs, external sensing devices, etc.) through a first network (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips).

[0079] According to various embodiments, the memory (136) may store various data used by at least one component of the second submodule (130) (e.g., a communication unit (135) or a processor (134)). The data may include, for example, software (e.g., a program) and input data or output data for related commands. The memory (136) may include volatile memory or non-volatile memory.

[0080] FIG. 5 is a flowchart illustrating the operation method of an artificial intelligence and IoT-based waste collection device according to one embodiment.

[0081] Referring to FIG. 5, an artificial intelligence and IoT-based waste collection device (100) according to one embodiment can acquire an image of the waste currently to be collected in step (510). The artificial intelligence and IoT-based waste collection device (100) can acquire an image of the waste currently to be collected through an image acquisition unit in the form of a built-in camera.

[0082] The AI ​​and IoT-based waste collection device (100) can determine the category of waste currently to be collected based on the analysis of the image in step (520). The AI ​​and IoT-based waste collection device (100) can determine the category of waste currently to be collected based on pre-trained image recognition AI. More specifically, the AI ​​and IoT-based waste collection device (100) can determine the waste currently to be collected as one of the first to third categories, as described above.

[0083] The artificial intelligence and IoT-based waste collection device (100) can collect the waste currently to be collected in a predetermined manner according to the category determined in step (530).

[0084] When the waste collection device (100) based on artificial intelligence and IoT determines that the waste currently to be collected is in a first category corresponding to a single characteristic that does not require post-processing, it can determine a first sub-module to collect the waste currently to be collected, generate first control information for controlling the notification unit and opening / closing of the first sub-module, and transmit it to the first sub-module. Based on the received first control information, the first sub-module can provide a predetermined notification and, at the same time, open the input unit to collect the waste currently to be collected.

[0085] When the current waste to be collected is determined to be in a second category containing waste with two different characteristics that does not require post-processing, the AI ​​and IoT-based waste collection device (100) can determine a plurality of first sub-modules predetermined to collect waste with each of the two different characteristics, and can generate first control information to control the determined first sub-modules and transmit it to the first sub-modules. The first sub-module can collect the current waste to be collected by opening the input section while simultaneously providing a predetermined notification through the received first control information. Along with the first control information, the AI ​​and IoT-based waste collection device (100) can provide the location of the determined first sub-module and guide information on what characteristics of waste should be disposed of in each first sub-module through a built-in display.

[0086] When the current waste to be collected is determined to be a third category requiring post-processing, the AI ​​and IoT-based waste collection device (100) can generate and transmit second control information for post-processing and simultaneously provide guide information on the post-processing method through a display. For example, if the current waste to be collected corresponds to a plastic bottle containing liquid, the AI ​​and IoT-based waste collection device (100) can generate second control information to control a second sub-module for collecting liquid and transmit it to the second sub-module, and simultaneously provide guide information on the method of disposing of the liquid through the second sub-module through a display. The second sub-module can collect the liquid present in the current waste to be collected by providing a predetermined notification unit through the second control information and simultaneously opening the opening / closing unit. After the collection of the liquid is completed, the AI ​​and IoT-based waste collection device (100) can determine a first sub-module for collecting the current waste to be collected, generate first control information to control it, and transmit it to the first sub-module. The first sub-module can collect the waste currently targeted for collection based on the received first control information.

[0087] FIGS. 6 and 7 are drawings illustrating an exemplary example of an artificial intelligence and IoT-based waste collection device according to one embodiment.

[0088] Referring to FIG. 6, the AI ​​and IoT-based waste collection device may include a main module, a first sub-module, and a second sub-module, and each module may be modularized to provide free expandability. As shown in the example presented, the main module may provide guide information through a predetermined display, and, for example, may provide guide information on how much waste is currently collected in the first sub-module and the second sub-module.

[0089] Referring to FIG. 7, when the main module determines that the waste currently to be collected corresponds to a third category, it can provide second control information to control the second sub-module, thereby opening the opening / closing part of the second sub-module. When post-processing is completed through the second sub-module, it can generate first control information (control information for controlling the first sub-module) to collect the waste currently to be collected, so that the first sub-module corresponding to the waste currently to be collected is controlled and the waste currently to be collected can be collected.

[0090] FIG. 8 is a drawing illustrating an example of an interface provided through a display unit according to one embodiment.

[0091] Referring to FIG. 8, an interface corresponding to certain guide information may be provided through the display unit of the main module. For example, the interface may include information on how much waste is currently filled, information for guiding waste in front of the camera to facilitate image acquisition by the image acquisition unit, information guiding the characteristics of the currently collected waste acquired in the image (e.g., plastic, can, paper, etc.), information requesting the input of certain information for login (e.g., a request to enter a phone number), information indicating that the collection of the currently collected waste is complete, information indicating that it is currently in a waste state, and the category of the currently collected waste and corresponding collection guide information (e.g., mixed and processing guide information corresponding to the third category, composite and processing guide information corresponding to the second category). The presented interface is merely exemplary and will be understood by a person skilled in the art that it may include any guide information related to the operation performed by the artificial intelligence and IoT-based waste collection device described above.

[0092] This specification discloses preferred embodiments of the present invention. Although specific terms have been used, they are used merely in a general sense to facilitate the explanation of the technical content of the invention and to aid in understanding the invention, and are not intended to limit the scope of the invention. It is obvious to those skilled in the art that, in addition to the embodiments disclosed herein, other variations based on the technical concept of the present invention are possible. For example, those skilled in the art will understand that the AI-based waste collection device according to the embodiments described with reference to FIGS. 1 to 8 can be modified in various ways. Therefore, the scope of the invention should not be determined by the described embodiments but by the technical concept described in the claims.

Claims

1. In a waste collection device, A main module that recognizes waste currently to be collected based on image-based pre-trained artificial intelligence and determines the collection route; A plurality of first sub-modules predetermined to collect waste according to its characteristics; and A second sub-module that performs post-processing on the aforementioned currently collected waste. A waste collection device including 2. In Paragraph 1, The above main module is, An image acquisition unit that acquires an image of the waste currently to be collected; A processor that inputs the above video into a pre-trained artificial intelligence model to determine the category and characteristics of the currently collected waste. Includes, The above processor is, A waste collection device that generates control information to collect the currently targeted waste in different ways according to a determined category.

3. In Paragraph 2, The above processor is, If the above-mentioned currently collected waste is determined to be in a first category corresponding to a single characteristic that does not require post-processing, Determining a first sub-module that collects the aforementioned current waste subject to collection, Generates and provides first control information for controlling the first sub-module determined above, and If the above-mentioned currently collected waste is determined to be a second category comprising waste with two different characteristics that does not require post-processing, Determining a plurality of first sub-modules corresponding to the two characteristics above, and Generating and providing first control information for controlling a plurality of first sub-modules determined above, and A waste collection device that, when the above-mentioned current waste to be collected is determined to be a third category requiring post-processing, generates and transmits second control information for post-processing through the above-mentioned second sub-module.

4. In Paragraph 3, The above main module is, A display unit that provides guide information on waste collection methods A waste collection device that includes additional components.

5. In Paragraph 4, The main module, the first sub-module, and the second sub-module are, A modular waste collection device.

6. In Paragraph 5, The above main module is, A waste collection device that provides additional analysis information on the trends of collected waste.

7. A waste collection method performed by a waste collection device, Step of acquiring an image of the waste currently to be collected; A step of determining the category and characteristics of the currently collected waste based on an analysis of the above video; and A step of collecting the currently collectible waste in different ways according to the above-determined category A waste collection method including

Images