Spectral image-based food condition tracking method, food management method, and food management device supporting these methods

Abstract

The present invention relates to a food condition tracking method based on a spectral image, a food management method, and a food management device supporting the methods. The present invention may provide a method for tracking a food condition based on a spectral image, the method comprising the steps in which a processor of a food management device: forms a communication channel with a storage warehouse in which food is stored; receiving, from the storage warehouse, food-related information on food stored in the storage warehouse; acquiring spectral images of the food product at regular intervals using a spectral camera arranged to be able to capture the spectral images of the food product; and monitoring a change in the condition of the food product by analyzing the obtained spectral image. The invention also provides a food management device supporting the method.

Description

Technical Field

[0001] The present invention relates to food condition tracking and management, and more particularly, to a technology that supports more accurate tracking of food changes or adaptive processing of mature food management using spectral images. Background Art

[0002] Food after production and processing can be stored until it reaches the consumer's table. In order to prevent food from deforming or spoiling, warehouses for storing food are designed to keep the temperature at a certain level or lower so that items such as food and beverages can be stored for a long time without spoiling.

[0003] Typically, a storage warehouse capable of storing items such as food may include a refrigerator for refrigerated storage of items and a freezer for frozen storage. The storage warehouse may maintain the temperature of the storage chamber at a set target temperature by repeatedly performing a cooling cycle including compression, condensation, expansion, and evaporation of a refrigerant. In other words, the storage warehouse supplies air cooled by an evaporator provided corresponding to each storage chamber (refrigerator and / or freezer) to each storage chamber based on the target temperature of each storage chamber, so that the temperature of the storage chamber is maintained at the target temperature.

[0004] Recently, refrigerators have been developed to provide users with a graphical user interface through a display for indicating the temperature of a storage chamber and an operation mode of the refrigerator, which allows the user to easily obtain refrigerator-related information and / or food-related information.

[0005] However, even in the same storage environment, the food stored in the storage warehouse may show different quality conditions depending on its type or size. For example, in the case of some fruits, relatively small fruits may maintain freshness better than relatively large fruits in the same environment. In addition, the change in the freshness of the fruit may vary depending on the type, origin or cultivation period of the fruit. Therefore, it is necessary to properly manage each item stored in the storage warehouse, but it is difficult for managers to manually check all stored items, and the accuracy also varies from person to person, which makes it difficult to manage the stored items (especially food).

[0006] In addition, among the foods stored in the storage warehouse, in the case of foods that need to mature (ripen), it is usually not easy to check the maturity. In particular, the experience of experts is required to accurately check the maturity, and even experts may make different judgments on the maturity according to individual conditions or situations. In addition, even if the same storage warehouse and storage environment are provided, the maturity completion date of the food may also be different according to the conditions when the food is stored in the storage warehouse for maturity or the storage environment of the storage warehouse. Therefore, even if the food is stored in the storage warehouse and shipped out after a specified period of time, there is also a problem of uneven maturity of the food. Summary of the invention

[0007] Technical issues

[0008] The present invention aims to provide a food condition tracking method based on spectral images and a food management device supporting the method, which collects and observes spectral images of food during the process of storing and preserving food, provides food condition tracking information, and allows the freshness of the food to be properly maintained based on the information.

[0009] The present invention also aims to provide a food management method based on spectral images and an apparatus supporting the method, which can provide a stable and uniform food ripening function by enabling a desired ripeness related to the ripening of food to be uniformly achieved.

[0010] However, the objects of the present invention are not limited to the above objects, and other objects not mentioned can be clearly understood from the following description.

[0011] Technical Solution

[0012] In order to achieve the above-mentioned object, a food management device supporting food condition tracking based on spectral images may include: at least one spectral camera, the at least one spectral camera is used to obtain spectral images of food stored in a storage warehouse; and a processor, the processor is functionally connected to the at least one spectral camera. The processor may be configured to: receive food-related information of the stored food from the storage warehouse, obtain the spectral images of the food at regular intervals by activating the at least one spectral camera, and monitor changes in the condition of the food by analyzing the obtained spectral images.

[0013] Specifically, the processor may be configured to: identify a location of the stored food from the food-related information, and activate the spectral camera disposed at the location of the food.

[0014] Specifically, the processor may be configured to, when a message regarding a shipment of the food product is received from the storage warehouse, deactivate the spectral camera disposed at the location.

[0015] Specifically, the processor may be configured to acquire an initial spectral image when the food is stored, and track changes in the condition of the food by comparing the initial spectral image with the spectral images acquired at regular intervals thereafter.

[0016] Specifically, the processor may be configured to notify a designated terminal of the change in the state of the food if the change in the state of the food is greater than or equal to a predefined reference value.

[0017] Specifically, the processor can be configured to: if the change in the condition of the food is greater than or equal to a predefined reference value, collect information about the storage environment corresponding to the changed condition of the food, create change information for changing the storage environment of the food based on the collected information, and transmit the change information to the storage warehouse.

[0018] Specifically, the processor may be configured to create the change information for changing at least one of temperature, humidity, and light amount in the storage environment of the food.

[0019] According to an embodiment of the present invention, a food status tracking method based on spectral images may include the following steps: a processor of a food management device that manages the storage of food establishes a communication channel with a storage warehouse that stores the food; receives food-related information about the food stored in the storage warehouse from the storage warehouse; acquires spectral images of the food at regular intervals by using a spectral camera configured to capture spectral images of the food; and monitors changes in the status of the food by analyzing the acquired spectral images.

[0020] Specifically, the step of acquiring the spectral image may include: identifying a location of the stored food from the food-related information; and activating the spectral camera disposed at the location of the food.

[0021] Specifically, the method may further include the following steps: receiving a message regarding the shipment of the food from the storage warehouse; and deactivating the spectral camera disposed at the location.

[0022] Specifically, the step of monitoring changes in the condition of the food may include at least one of the following: if the change in the condition of the food is greater than or equal to a predefined reference value, notifying a designated terminal of the change in the condition of the food; and if the change in the condition of the food is greater than or equal to a predefined reference value, collecting information about the storage environment corresponding to the changed condition of the food, creating change information for changing the storage environment of the food based on the collected information, and transmitting the change information to the storage warehouse.

[0023] In addition, a food management device supporting a food management function based on spectral images according to the present invention may include: at least one spectral camera, the at least one spectral camera being used to obtain a spectral image of mature food stored in a storage warehouse; and a processor, the processor being functionally connected to the at least one spectral camera. The processor may be configured to: when the mature food is stored at a location of the storage warehouse, activate the spectral camera configured to photograph the location of the storage warehouse, obtain a spectral image of the mature food through the activated spectral camera, detect a mature state of the mature food by comparing the spectral image with a pre-stored reference model, and output a message according to the mature state.

[0024] Specifically, the processor may be configured to check a current maturity through comparison between the detected maturity status and the reference model, and output a message based on completion of maturity if the maturity is within a target reference range.

[0025] Specifically, the processor may be configured to output a message including at least one of a message indicating an under-mature condition and a remaining time until maturity is completed, if the maturity is lower than the reference range.

[0026] Specifically, the processor may be configured to: if the storage environment of the storage warehouse needs to be changed based on the under-mature status, create change information related to the change of the storage environment, and transmit the change information to the storage warehouse.

[0027] Specifically, the processor may be configured to output a message indicating an over-mature condition if the maturity exceeds the reference range.

[0028] A food management method based on spectral images according to an embodiment of the present invention may include the following steps: a processor of a food management device receives food-related information related to the storage of mature food from a storage warehouse; based on the food-related information, activates a spectral camera configured to photograph the location of the storage warehouse; acquires a spectral image of the mature food through the activated spectral camera; detects the maturity status of the mature food by comparing the spectral image with a pre-stored reference model; and outputs a message based on the maturity status.

[0029] Specifically, the step of detecting the maturity status of the mature food may include: checking the current maturity by comparing the detected maturity status with the reference model; and if the maturity is within the target reference range, outputting a message based on the completion of maturity, if the maturity is lower than the reference range, outputting a message including at least one of a message indicating an under-mature condition and a remaining time until the maturity is completed, or if the maturity exceeds the reference range, outputting a message indicating an over-mature condition.

[0030] Specifically, the method may further include the following steps: if the storage environment of the storage warehouse needs to be changed based on the under-mature state, creating change information related to the change of the storage environment, and transmitting the change information to the storage warehouse.

[0031] A food management device supporting a food management function based on a spectral image according to an embodiment of the present invention may include: a server communication circuit that establishes a communication channel with a storage warehouse and the food management device; and a server processor that is functionally connected to the server communication circuit. The server processor may be configured to: request a spectral image of the mature food from the food management device when receiving a message about the storage of mature food from the storage warehouse, the food management device controls a spectral camera disposed at a location where the mature food is stored, and when receiving the spectral image from the food management device, detect the maturity status of the mature food by comparing the spectral image with a pre-stored reference model, and output a message based on the detected maturity status.

[0032] Specifically, the server processor may be configured to check a current maturity by comparing the detected maturity status with the reference model, and output a message based on completion of maturity if the maturity is within a target reference range, output a message including at least one of a message indicating an under-mature status and a remaining time until maturity is completed if the maturity is below the reference range, or output a message indicating an over-mature status if the maturity exceeds the reference range.

[0033] Beneficial Effects

[0034] According to the present invention, a food condition tracking method based on spectral images and a food management device supporting the method can easily support food condition tracking based on spectral images of food, and also support more effective and appropriate food management based on food condition tracking.

[0035] Furthermore, according to the present invention, the food management method based on spectral images and the apparatus supporting the method can systematically check the maturity of food based on spectral images, and also support uniform maturity management and precise shipment management of food.

[0036] Furthermore, various effects other than the above-described effects may be disclosed directly or implicitly in the detailed description of the embodiments according to the present invention to be described later. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] Figure 1 is a diagram showing an example of a system environment supporting a food status tracking function according to a first embodiment of the present invention.

[0038] Figure 2 1 is a diagram showing an example of components of a storage warehouse capable of storing foods according to a first embodiment of the present invention.

[0039] Figure 3 1 is a diagram showing an example of components of the food management device according to the first embodiment of the present invention.

[0040] Figure 4 1 is a diagram showing an example of components of a processor among components of the food management device according to the first embodiment of the present invention.

[0041] Figure 5 : is a diagram showing an example of components of a server device according to the first embodiment of the present invention.

[0042] Figure 6 1 is a diagram showing an example of a food status tracking method of the food management device according to the first embodiment of the present invention.

[0043] Figure 7 : is a diagram showing an example of a food management method based on food status tracking according to the first embodiment of the present invention.

[0044] Figure 8 is a diagram showing an example of a system environment supporting a food management function according to a second embodiment of the present invention.

[0045] Fig. 9 2 is a diagram showing an example of components of a storage warehouse capable of storing foods according to a second embodiment of the present invention.

[0046] Fig.10 2 is a diagram showing an example of components of a food management device according to a second embodiment of the present invention.

[0047] Fig.11 : is a diagram showing an example of components of a processor among components of the food management device according to the second embodiment of the present invention.

[0048] Fig.12 : is a diagram showing an example of components of a server device according to the second embodiment of the present invention.

[0049] Fig.13 1 is a diagram showing an example of a food management method of the food management device according to the second embodiment of the present invention.

[0050] Fig.14 2 is a diagram showing an example of the operation of the server device related to the food management method according to the second embodiment of the present invention. DETAILED DESCRIPTION

[0051] Embodiments of the present invention will now be described in detail with reference to the accompanying drawings.

[0052] However, in the following description and the accompanying drawings, well-known functions and components may not be described or shown in detail to avoid obscuring the subject matter of the present invention. In addition, throughout the accompanying drawings, the same components are represented by the same reference numerals as much as possible.

[0053] The terms or words used in the following description and the accompanying drawings should not be interpreted as being limited to their common or dictionary meanings, but should be interpreted as being consistent with the meaning and concept of the technical concept of the present invention based on the principle that the inventor can appropriately define the concept of the term to best describe his or her invention. Therefore, the embodiments described herein are only the most preferred embodiments of the present invention and do not represent all technical concepts of the present invention. Therefore, it should be understood that when submitting this application, various equivalents and modified examples may be used to replace this embodiment.

[0054] In addition, the terms including ordinal numbers such as first, second, etc. are only used to describe various elements, and their purpose is to distinguish one element from another element, and are not used to limit these elements. For example, without departing from the scope of the present invention, the second element can be named as the first element, and similarly, the first element can also be called the second element.

[0055] In addition, the terms used herein are only used to describe specific embodiments and are not intended to limit the present disclosure. Unless the context clearly indicates otherwise, singular expressions include plural expressions. In addition, terms such as "include" and "comprise" used herein are intended to specify the presence of features, quantities, steps, operations, elements, parts, or combinations thereof disclosed herein, and should not be interpreted as precluding the possibility of the presence or addition of other features, quantities, steps, operations, elements, parts, or combinations thereof.

[0056] In addition, terms such as "unit" and "module" used in this document refer to a unit that processes at least one function or operation, and can be implemented in hardware, software, or a combination of hardware and software. In addition, unless the context clearly indicates otherwise, in the context of describing the present invention (especially in the context of the following claims), the terms "a", "an", "the", "this" and similar terms may be used as both singular and plural meanings.

[0057] In addition to the above-mentioned terms, specific terms used in the following description are provided to help understanding of the present invention, and the use of these specific terms may be changed into other forms without departing from the technical meaning of the present invention.

[0058] In addition, embodiments within the scope of the present invention include computer-readable media having computer-executable instructions or data structures stored on computer-readable media. Such computer-readable media can be any available media accessible by a general or special-purpose computer system. For example, such computer-readable media can include, but are not limited to, RAM, ROM, EPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other physical storage medium that can be used to store or transmit certain program codes formed by computer-executable instructions, computer-readable instructions or data structures and can be accessed by a general or special-purpose computer system.

[0059] [First embodiment]

[0060] Hereinafter, in the present invention, a system environment supporting a food status tracking function and a food management function based thereon and the type and role of each component included therein will be described.

[0061] Figure 1 is a diagram showing an example of a system environment supporting a food status tracking function according to a first embodiment of the present invention.

[0062] Reference Figure 1, the system environment 10 supporting food status tracking function and status management of the present invention may include at least one food 50 (e.g., fruit, vegetable, processed food, etc.), a storage warehouse 300 in which the food 50 is stored, a food management device 100, and a server device 200 capable of supporting the food management device 100. In the example of the system environment 10, a communication channel is formed between the food management device 100 and the server device 200, and the server device 200 supports the food management device 100. However, the present invention is not limited to this. For example, the food management device 100 can be configured to support the status tracking and storage management of the food 50 based on an embedded program without the server device 200. In this case, the server device 200 can be omitted from the system environment 10.

[0063] At least one food 50 may include at least one of various agricultural, animal husbandry and fishery products that can be stored in the storage warehouse 300. For example, as a storage product that can be stored in the storage warehouse 300, the food 50 may include at least one type of agricultural products, fishery products and animal husbandry products or at least one type of processed agricultural products food, processed fishery products food and processed animal husbandry products food. In the example, the food 50 may include fruits such as strawberries, melons, watermelons, apples, pears, bananas and oranges and grains such as rice or barley. In addition, the food 50 may include various fish, shellfish, crustaceans, etc. The food 50 may be stored in different forms according to its type, and even if it is the same type, the storage form may be different according to its size or shape. Therefore, according to at least one of the standards of the type, size and shape in the storage warehouse 300, the food 50 may be stored in different storage environments.

[0064] The storage warehouse 300 may have at least one space in which food 50 can be stored. The storage warehouse 300 may be built in a fixed form at a specified location, or may be built in a mobile form. The storage warehouse 300 may also be built in a form in which a variety of foods 50 may be stored. In this case, the storage warehouse 300 may be provided with partitions or isolated from adjacent spaces so that the foods 50 may be stored separately by type, size or shape. The external shape or construction material of the storage warehouse 300 may vary. For example, the storage warehouse 300 may be set to a rectangular parallelepiped shape, a dome shape or an underground facility. The storage warehouse 300 may control the storage environment (e.g., temperature, humidity, light, etc.) under the control of the food management device 100 or the server device 200 to maintain and manage the stored foods 50.

[0065] The food management device 100 may be arranged to obtain a spectral image of at least one food 50. For example, the food management device 100 may collect spectral images of the food 50 by using at least one spectral camera arranged at a specific location in the storage warehouse 300 where at least one food 50 is arranged. In this regard, the spectral camera may be arranged to photograph the food 50 stored at a certain location (e.g., a shelf) in the storage warehouse 300. The food management device 100 may activate the arranged spectral camera according to predefined schedule information or a specified time interval under a specified storage environment, obtain a plurality of spectral images of the food 50 by using the activated spectral camera, and analyze the obtained plurality of spectral images to track the condition of the food 50. Additionally, the food management device 100 may collect storage management information about specific condition management of the food 50 through the server device 200. The food management device 100 may transmit control information for controlling the storage environment of the corresponding food 50 to the storage warehouse 300 according to the specific condition storage management information of the food 50. After receiving the control information, the storage warehouse 300 may adjust at least some elements (e.g., temperature, humidity, light) of the storage environment. If the change in the condition of the stored food 50 exceeds a predefined reference value, the food management apparatus 100 may output guidance information therefor.

[0066] The server device 200 may establish a communication channel with the food management device 100. The server device 200 may receive information related to the food 50 (e.g., at least one spectral image taken from the food 50 and information about the storage environment of the food 50) from the food management device 100, generate condition guidance information of the food 50 or control information for changing the storage environment of the food 50 according to the received information, and transmit the generated information to the storage warehouse 300 directly or through the food management device 100. Here, the server device 200 is a component that receives and analyzes the spectral image related to the food 50 from the food management device 100, and if the food management device 100 is designed to directly perform condition analysis of the food 50 and storage environment control, the server device 200 may be omitted.

[0067] As described above, the system environment 10 supporting the food condition tracking and management function according to the first embodiment of the present invention can obtain a spectral image related to the food 50 by placing the food management device 100 configured to obtain the spectral image of the food 50 in the storage warehouse 300 in which the food 50 is stored. In the system environment 10, the food management device 100 can perform condition tracking of the food 50 by analyzing the obtained spectral image, and also support the freshness of the food 50 to be properly maintained for a long time by applying specific condition storage management of the food 50.

[0068] Figure 2 1 is a diagram showing an example of components of a storage warehouse capable of storing foods according to a first embodiment of the present invention.

[0069] Reference Figure 2 The storage warehouse 300 may include a warehouse communication circuit 310 , a storage environment adjustment module 320 , a warehouse memory 330 , a sensor unit 340 , and a warehouse control processor 350 .

[0070] The warehouse communication circuit 310 may form a communication channel of the storage warehouse 300. For example, the warehouse communication circuit 310 may form a communication channel with at least one of the food management device 100 and the server device 200, and transmit operation information related to the operation of the storage warehouse 300 to the food management device 100 or the server device 200. The operation information of the storage warehouse 300 may include, for example, at least some of the types of food 50 stored, information about the storage environment of each food 50, the storage date of the food 50, and the expected shipping date of the food 50. The warehouse communication circuit 310 may receive storage environment change information related to the food 50 (for example, setting information for changing the condition of the storage environment) from the food management device 100 or the server device 200.

[0071] The storage environment adjustment module 320 may include a module that adjusts the environment of at least some areas of the storage warehouse 300 or areas in which the food 50 is stored. For example, the storage environment adjustment module 320 may include at least one of a temperature adjustment device capable of adjusting the temperature of a specific area in which the food 50 is placed, a humidity adjustment device capable of adjusting the humidity, and a light irradiation device capable of adjusting the light irradiation amount. The storage environment adjustment module 320 may adjust at least one of the temperature, humidity, and light irradiation under the control of the warehouse control processor 350 to maintain the freshness of the food 50 for a long time.

[0072] The warehouse memory 330 may store various data and programs required for the operation of the storage warehouse 300. For example, the warehouse memory 330 may include a program for operating and controlling at least one adjustment device included in the storage environment adjustment module 320. In addition, the warehouse memory 330 may store at least one program for operating and controlling the sensor unit 340 arranged in the storage warehouse 300. The warehouse memory 330 may store information about the type of food 50 stored in the storage warehouse 300, the storage date of the food 50, the location information in the storage warehouse 300 where the food 50 is placed, the storage days of the food 50, the expected shipping date of the food 50, etc. In addition, the warehouse memory 330 may store the current storage environment setting information of the food 50.

[0073] The sensor unit 340 may be placed in at least some areas of the storage warehouse 300, and collect various sensor information related to the food 50. For example, the sensor unit 340 may include at least one of a position detection sensor capable of identifying a position in which the food 50 is placed and a sensor capable of sensing a storage environment in which the food 50 is placed (e.g., at least one of a temperature sensor, a humidity sensor, and a light detection sensor). The sensor unit 340 may collect sensing information about the area in which the food 50 is placed under the control of the warehouse control processor 350, and transmit the collected sensing information to the warehouse control processor 350.

[0074] The warehouse control processor 350 may perform various operation controls required for operating the storage warehouse 300. For example, the warehouse control processor 350 may adjust at least some of the temperature, humidity, and light amount of a specific area of ​​the storage warehouse 300 according to the storage warehouse setting information. In this operation, the warehouse control processor 350 may control the sensor unit 340 to sense the temperature, humidity, and light amount of a specific area in which the food 50 is placed, and adjust the temperature, humidity, and light amount to correspond to the values ​​set in the setting information. In an example, when the food 50 is received and the storage warehouse setting information is determined, the warehouse control processor 350 may transmit the type of the food 50, the location information in which the food 50 is placed, the expected shipping date of the food 50, and the current storage environment setting information of the area in which the food 50 is placed to the food management device 100 or the server device 200. After receiving the storage environment change information from the food management device 100 or the server device 200, the warehouse control processor 350 may adjust at least some of the temperature, humidity, and light amount of the storage environment in response to the received storage environment change information. When food 50 is shipped out, warehouse control processor 350 may transmit information about the shipment of food 50 to food management device 100 or server device 200, and control sensor unit 340 and storage environment adjustment module 320 at the area where food 50 is placed to be turned off.

[0075] Figure 3 is a diagram showing an example of components of a food management device according to a first embodiment of the present invention, and Figure 4 1 is a diagram showing an example of components of a processor among components of the food management device according to the first embodiment of the present invention.

[0076] First, refer to Figure 3, the food management device 100 according to the first embodiment of the present invention may include a communication circuit 110, a spectral camera 120, a memory 130, and a processor 150. Additionally, the food management device 100 may further include a mounting structure for mounting the spectral camera 120, so that the spectral camera 120 can photograph an area in which at least one food 50 is placed. In addition, the food management device 100 may further include a power source (e.g., a permanent power source or a battery) required for the operation of at least one of the above-mentioned components (e.g., the communication circuit 110, the spectral camera 120, the memory 130, and the processor 150).

[0077] The communication circuit 110 can establish a communication channel with the storage warehouse 300 or the server device 200. If the server device 200 is designed to perform the calculations required for the food status tracking and management function according to the first embodiment of the present invention, the communication circuit 110 can transmit at least one spectral image collected by the spectral camera 120 to the server device 200. On the other hand, the food status tracking and management function can be independently performed by the food management device 100. In this case, the communication circuit 110 can directly transmit the manager notification message or the user notification message generated during the operation of the food status tracking and management function to the terminal device of the manager or the user. Alternatively, the communication circuit 110 can transmit the notification message to the server device 200 in response to the control of the processor 150.

[0078] The communication circuit 110 may receive information related to the storage of the food 50 (e.g., information on the type of food 50 stored in the storage warehouse 300, the storage date of the food 50, location information in the storage warehouse 300 where the food 50 is placed, the number of days the food 50 is stored, the expected shipping date of the food 50, etc.) from the storage warehouse 300. The communication circuit 110 may transmit change information related to the change of the storage environment of the food 50 to the storage warehouse 300 in response to the control of the processor 150.

[0079] The spectral camera 120 may be arranged to capture a spectral image of at least one food 50. Alternatively, a plurality of spectral cameras 120 may be arranged in a plurality of areas of the storage warehouse 300 to capture spectral images of the food 50 located within the storage warehouse 300. In an example, when the food 50 is stored at a certain location in the storage warehouse 300 (e.g., a food shelf where the food 50 may be placed), the spectral camera 120 may collect a spectral image of the food 50 under the control of the processor 150. In addition, the spectral camera 120 may collect spectral images of the food 50 over time. In addition, when the condition of the storage environment changes or when the storage environment (e.g., at least one of temperature, humidity, and light amount) changes, the spectral camera 120 may collect spectral images under the control of the processor 150.

[0080] The memory 130 may store at least one program or data required for the operation of the food management device 100. For example, the memory 130 may store a control program required to operate the spectral camera 120 and a plurality of spectral images acquired by the spectral camera 120. For example, the memory 130 may store a spectral image captured when the food 50 is stored in the storage warehouse 300, a spectral image captured each time a specified time period has passed since the food 50 was stored, and a spectral image captured each time the storage environment changes.

[0081] The processor 150 may perform at least one of transmission and processing of signals required for the operation of the food management device 100 and storage and output of processing results. For example, the processor 150 may control the acquisition of spectral images related to the food 50 using the spectral camera 120 in response to at least one of a predefined event, guidance information from the storage warehouse 300 (e.g., information notifying that new food 50 has arrived, information notifying that the storage environment of the food 50 has changed), or a request from the server device 200. The processor 150 may track the condition of the food 50 based on at least one acquired spectral image, and perform output of designated information according to changes in the condition. In this regard, the processor 150 may include, for example, Figure 4 The parts shown in .

[0082] Reference Figure 4 The processor 150 may include a spectral image collector 151 , a spectral image analyzer 152 , a food status notifier 153 , and a warehouse controller 154 .

[0083] The spectral image collector 151 may control the acquisition of spectral images using the spectral camera 120. For example, after receiving guidance information (or a message) about the arrival of a new food 50 from the storage warehouse 300, the spectral image collector 151 may process the acquisition of spectral images for the newly arrived food 50. In this process, the spectral image collector 151 may receive the location information of the food 50 from the storage warehouse 300, and control the spectral camera 120 placed at the corresponding location to acquire an initial spectral image for the food 50. Thereafter, the spectral image collector 151 may periodically acquire spectral images for the food 50 within a specified time period. Alternatively, the spectral image collector 151 may control the collection of spectral images for the food 50 in response to a request from an administrator of the food management device 100 or a request from the server device 200. When the spectral image collector 151 receives guidance information (or a guidance message) indicating that at least a portion of the storage environment of a specific food 50 will be changed from the storage warehouse 300, the spectral image collector 151 may acquire a spectral image of the food 50 at the time of the change of the storage environment. When the food 50 at a specific location is transported out, the spectral image collector 151 may control the spectral camera 120 positioned to photograph the location where the food 50 is placed to be deactivated.

[0084] The spectral image analyzer 152 may analyze at least one spectral image collected by the spectral image collector 151, and store the analysis result in the memory 130. For example, the spectral image analyzer 152 may check whether a spectral image in which a change greater than a reference value has occurred is collected based on an initial spectral image. In this process, the spectral image analyzer 152 may perform clustering model learning on the spectrum of the initial spectral image, store the spectrum as a cluster, and compare the spectrum of the subsequently acquired spectral image with the stored cluster to check whether it is outside a reference range (e.g., the mean value of the cluster + K*standard deviation (K is a constant)). If the centroid of the spectrum of the subsequently acquired spectral image is outside the reference range, identification information corresponding to the spectral image may be transmitted to the food status notifier 153. Next, the spectral image analyzer 152 may set the spectral image outside the reference range as a new reference spectral image, and compare the spectral image acquired thereafter with the new reference spectral image to determine whether it is outside the predefined new reference range. As described above, the spectral image analyzer 152 may continuously analyze the spectral image of the food 50, and whenever the condition of the food 50 changes beyond the reference range, the spectral image analyzer 152 may transmit an alarm about such change to the food condition notifier 153 and the warehouse controller 154.

[0085] When the food status notifier 153 receives an alarm about a change in the status of the food 50 from the spectral image analyzer 152, it can collect information about the food 50 for which the alarm has occurred. For example, the food status notifier 153 can collect the storage date, the degree of change, the expected shipping date, etc. of the food 50 for which the alarm has occurred, and transmit the collected information related to the food 50 to the terminal device of the manager of the food management device 100 or the designated user. Alternatively, the food status notifier 153 can output the information related to the food 50 for which the alarm has occurred through an output device. In this regard, the food management device 100 may include at least one of a display or an audio output device. The manager can identify the storage status of the food 50 by checking the information about the food 50 that has changed beyond a predefined reference range through an output device such as a display, and adjust the storage environment or the expected shipping date.

[0086] The warehouse controller 154 may control the change of the storage environment of the food 50 for which an alarm has been received from the spectral image analyzer 152. In this regard, the warehouse controller 154 may collect storage environment setting information for each condition of a specific food 50. For example, the warehouse controller 154 may identify the current condition of the food 50 and the expected shipping date of the food 50, and determine storage environment setting information (e.g., at least one of temperature, humidity, and light intensity) for optimally maintaining the current condition before the expected shipping date of the food 50. In this regard, information for maintaining the freshness of the food 50 for each condition may be acquired from a designated external server device. Alternatively, the food management device 100 may store and provide a database of setting information to be changed in the memory 130 for maintaining freshness according to the change in the condition of the food 50. The warehouse controller 154 may obtain new storage environment change information according to the change in the condition of the food 50, and provide the storage environment change information to the storage warehouse 300. Based on the received storage environment change information, the storage warehouse 300 may change the storage environment of the food 50 whose condition has changed. For example, based on the storage environment change information, the storage warehouse 300 may increase the humidity of the food 50 and reduce the amount of light compared to the previous storage environment. Meanwhile, the storage environment change information may vary according to the type of food 50 or the condition of the food 50, and such information may be accumulated and stored based on experience, or acquired from a designated external server device. When the same food 50 is stored, the storage management information of the food 50 accumulated and stored based on experience may be used to better maintain the freshness of the food 50.

[0087] As described above, the food management device 100 according to the first embodiment of the present invention can support monitoring of changes in the condition of the food 50 by collecting and analyzing the spectral images of the food 50 set and stored at one or more locations of the storage warehouse 300 over time or the occurrence of an event. Therefore, the food management device 100 of the present invention can support predicting the condition of the food in the future and optimize inventory management based on the food monitoring data over time. In addition, the food management device 100 of the present invention can support better maintaining the freshness of the food 50 by providing control information for a more optimized storage environment according to the change in the condition of the food 50. Additionally, when the change in the condition of a specific food 50 exceeds a predefined risk standard, the food management device 100 can suggest discarding or immediately shipping the food 50 to reduce the resources required to store unnecessary food 50 and prevent damage to other foods caused by spoiled food 50. For example, when it is determined that the food has deteriorated based on the spectral image analysis, the food management device 100 according to the first embodiment of the present invention can backtrack to the previous condition (calculate the estimated value in reverse order of the time flow) so that it can be used to explore future management measures for the product.

[0088] Meanwhile, in the above description, the food management device 100 is described as monitoring the condition of the food 50 stored in the storage warehouse 300 and directly controlling the change of the storage environment according to the change of the condition of the food 50, but the present invention is not limited thereto. For example, the food management device 100 may be designed to only control the spectral camera 120 to collect the spectral image of the food 50 and transmit the collected spectral image to the server device 200. In this case, the server device 200 may monitor the food 50 based on the conditions of the food 50. Figure 5 The components shown in support the functions of monitoring and managing the condition of food 50.

[0089] Figure 5 As described above, if the food management device 100 is designed to perform the food status tracking function and the food management function according to the first embodiment of the present invention, the server device 200 may be omitted.

[0090] Reference Figure 5 The server device 200 of the present invention may include a server communication circuit 210 , a server memory 230 , and a server processor 250 .

[0091] The server communication circuit 210 may directly form a communication channel with the food management device 100. Additionally, the server communication circuit 210 may form a communication channel with the storage warehouse 300, or communicate with the storage warehouse 300 via the food management device 100. The server communication circuit 210 may receive at least one spectral image from the food management device 100 in response to a specified time period or the occurrence of a predefined event. Additionally, the server communication circuit 210 may receive at least one food-related information from the storage warehouse 300. The server communication circuit 210 may transmit storage environment change information to the storage warehouse 300 in response to the control of the server processor 250.

[0092] The server memory 230 may store at least one program or data required for the operation of the server device 200. For example, the server memory 230 may store at least one food-related information 231 received from the storage warehouse 300. In addition, the server memory 230 may store a plurality of spectral images 233 related to the specific food 50 provided by the food management device 100.

[0093] The server processor 250 may control the transmission and processing of signals required to operate the server device 200, the storage or transmission of results, or the transmission of messages corresponding to the results. In this regard, the server processor 250 may include a data collector 251, a food condition estimator 252, and a warehouse control supporter 253.

[0094] The data collector 251 may receive food-related information from the storage warehouse 300. In this regard, the data collector 251 may form a communication channel with the storage warehouse 300, and when new food 50 is received in the storage warehouse 300 or the food 50 being stored is shipped out, the data collector 251 may receive food-related information from the storage warehouse 300. The data collector 251 may temporarily or semi-permanently store the received food-related information 231 in the server memory 230. After receiving the food-related information from the storage warehouse 300, the data collector 251 may request a spectral image corresponding to the food from the food management device 100. The data collector 251 may receive spectral images captured at regular time intervals from the initial time when the food 50 is placed in the storage warehouse 300 from the food management device 100. The spectral image 233 captured about the food 50 may be stored in the server memory 230. The operation of collecting the spectral image 233 and storing it in the server memory 230 may be repeatedly performed at regular intervals until the food 50 is shipped out of the storage warehouse 300 or until a request is issued by a manager of the food management device 100 or the server device 200 .

[0095] The food condition estimator 252 may analyze the initial spectral image received from the food management device 100 when the food related information 231 is collected, thereby determining the freshness of the corresponding food 50. For example, the food condition estimator 252 may compare the spectrum of the initial spectral image of the food 50 with the spectrum of the spectral image when the corresponding food 50 has the best freshness, thereby determining the freshness of the food 50 stored in the storage warehouse 300. The spectral image of the food 50 with the best freshness may be received from a designated external server device, or may be designated by the manager of the server device 200. The food condition estimator 252 may analyze the spectral image 233 acquired at regular intervals to determine how much change has occurred from the initial spectral image, and estimate the change in the freshness of the corresponding food 50. If the analysis of the spectral image 233 indicates that the condition of the food 50 has changed to a predefined reference value or more, the food condition estimator 252 may output an alarm. The alarm may be transmitted to at least one of the terminal of the manager of the food management device 100, the terminal of the operator of the server device 200, and the terminal of the manager of the storage warehouse 300. Additionally, when the food management apparatus 100 includes a separate display device, the food status estimator 252 may output an alarm through the display of the food management apparatus 100. Furthermore, when the status of the food 50 changes to a predefined value or more, the food status estimator 252 may transmit the corresponding change to the warehouse control supporter 253.

[0096] After receiving the change in the condition of the food 50 from the food condition estimator 252, the warehouse control supporter 253 may create storage environment change information about the corresponding food 50, and transmit the created storage environment change information to the storage warehouse 300. In this regard, the server device 200 may store and manage a table storing storage environment setting information according to the condition of the food 50. The warehouse control supporter 253 may identify the food related information 231, identify an environmental factor (e.g., at least one of temperature, humidity, and light intensity) that needs to be changed according to the current condition of the food 50, create storage environment change information requesting a change in the corresponding environmental factor, and transmit the storage environment change information to the storage warehouse 300.

[0097] Figure 6 1 is a diagram showing an example of a food status tracking method of the food management device according to the first embodiment of the present invention.

[0098] Reference Figure 6In the method of operating the food management device 100 related to the food status tracking method according to the first embodiment of the present invention, in step 601, the processor 150 of the food management device 100 may receive food related information. In this regard, the food management device 100 may establish a communication channel with the storage warehouse 300, and when a new food 50 is stored in the storage warehouse 300, the storage warehouse 300 may transmit the food related information to the food management device 100. Here, the food related information may include at least some of the name of the food 50, the storage date of the food 50, the placement location of the food 50, and the expected shipping date of the food 50.

[0099] When the processor 150 of the food management device 100 receives the food-related information, it may collect a spectral image of the food 50 in step 603. In this process, the food management device 100 may check the food-related information to identify the location of the food 50, identify the spectral camera 120 that is set to be able to photograph the corresponding location, and collect spectral images at regular intervals from the time when the food 50 is stored by using the spectral camera 120. In relation to this function, the food management device 100 may store and manage location information about a plurality of spectral cameras that are set to photograph a plurality of locations where the food 50 may be placed in the storage warehouse 300 and about an area that each of the spectral cameras may photograph.

[0100] In step 605, the processor 150 of the food management device 100 may analyze the collected spectral images to analyze the change in the condition of the food 50. For example, the processor 150 may perform a spectral comparison between the spectral image obtained when the food 50 was originally stored and the spectral image obtained at the current time. Alternatively, the processor 150 may perform a spectral comparison between the captured spectral image of the food 50 having a predetermined specific freshness and the spectral image obtained at the current time.

[0101] In step 607, the processor 150 may determine whether the spectrum comparison result is greater than or equal to the reference value. If it is less than the reference value, the processor 150 may return to step 603 and perform food spectrum image collection. If the spectrum comparison result shows that the change is greater than or equal to the reference value, the processor 150 may notify the change above the reference value and indicate the change of the storage environment in step 609. Alternatively, the processor 150 may only perform notification of the change above the reference value, or only indicate the change of the storage environment. The notification of the change above the reference value may be output to, for example, a terminal of the manager of the storage warehouse 300, a display device connected to the food management device 100, or a terminal of the manager of the food management device 100. With respect to changing the storage environment, the processor 150 may generate control information including a value of an environmental factor (e.g., at least one of temperature, humidity, and light intensity) for changing the storage environment, and transmit the control information to the storage warehouse 300.

[0102] Next, the food management device 100 can return to step 603 and re-execute subsequent operations. In this way, the food management device 100 can adaptively change the storage environment as the condition of the food 50 changes, thereby supporting the freshness of the food 50 to be maintained within a certain range for a long time. At the same time, when new food 50 is stored, the food management device 100 can return to step 601 and re-execute subsequent operations. In addition, the food management device 100 can repeatedly re-execute the above operations 603 to 609 until the corresponding food 50 is transported out.

[0103] Figure 7 : is a diagram showing an example of a food management method based on food status tracking according to the first embodiment of the present invention.

[0104] Reference Figure 7 In step 701, the server processor 250 of the server device 200 may check whether the food-related information is received. In this regard, the server device 200 may maintain a communication channel with the storage warehouse 300. If the food-related information is not received, the server processor 250 may perform a designated function in step 703. For example, the server processor 250 may perform management of the food 50 previously registered for food monitoring.

[0105] When the food-related information is received, the server processor 250 may request spectral image collection in step 705. In this regard, the server device 200 may form a communication channel with the food management device 100, and request the food management device 100 to collect spectral images corresponding to the received food-related information. In this operation, the server device 200 may provide the food management device 100 with information about the location of the food 50 in the storage warehouse 300. The food management device 100 may identify a spectral camera mapped to the location information of the food 50 in the storage warehouse 300, activate the identified spectral camera to acquire a spectral image of the newly stored food 50, and transmit the acquired spectral image to the server device 200.

[0106] In step 707, the server processor 250 may check whether a spectral image is received, and if the spectral image is not received within a specified time, the server processor 250 may re-execute step 705. Meanwhile, the server processor 250 may request to collect spectral images more than a predefined number of times, and if the spectral image is not received in response, it is determined that a failure has occurred in the food management device 100. The server processor 250 may then take relevant measures (e.g., notifying a management terminal that manages the food management device 100 of the failure).

[0107] When receiving the spectral image, the server processor 250 may perform spectral image analysis in step 709. In this regard, the server processor 250 may store an initial spectral image when the food 50 is stored, and perform a comparative analysis based on the initial spectral image and the spectral image acquired thereafter. Alternatively, the server processor 250 may acquire and store a reference spectral image of a specific food 50 having a freshness greater than or equal to a predefined value from a designated external server device, and perform a spectral comparison between the stored reference spectral image and the currently acquired spectral image.

[0108] In step 711, the server processor 250 may determine whether the change value detected by the spectrum comparison analysis is greater than or equal to the reference value. If the spectrum comparison analysis result shows that the value is less than the reference value, the server processor 250 may return to step 705 and re-execute the subsequent operation. Alternatively, the server processor 250 may return to step 705 and re-execute the subsequent operation after a specified time has passed.

[0109] If the spectrum comparison analysis result shows that the value is greater than or equal to the reference value, the server processor 250 may execute at least one of the change notification and the storage environment change instruction in step 713. Regarding the change notification, the server processor 250 may provide text or an image corresponding to the change notification to at least one of the manager terminal of the storage warehouse 300, the display of the food management device 100, or the manager terminal of the food management device 100. Additionally, the server processor 250 may create change information for changing the storage environment to optimize for the current changed condition according to the change in the condition of the food 50, and transmit the created change information to the storage warehouse 300. Additionally, if the server processor 250 of the server device 200 determines that the food has deteriorated based on the spectral image analysis, it may trace back to the previous condition (calculate the estimated value in reverse order of the time flow) to collect and store information about the deterioration time and information about the storage environment, thereby allowing it to be used to explore future management measures for the corresponding product.

[0110] [Second Embodiment]

[0111] Hereinafter, in the present invention, a system environment supporting a food condition detection function and a food management function based thereon and the type and role of each component included therein will be described.

[0112] Figure 8 is a diagram showing an example of a system environment supporting a food management function according to a second embodiment of the present invention.

[0113] Reference Figure 8 , the system environment 10 supporting the food management function of the present invention may include at least one mature food 50a (e.g., fruit, vegetable, meat, processed food, etc.), a storage warehouse 300 in which the mature food 50a is stored, a food management device 100, and a server device 200 capable of supporting the food management device 100. In the example of the system environment 10, a communication channel is formed between the food management device 100 and the server device 200, and the server device 200 supports the food management device 100. However, the present invention is not limited to this. For example, the food management device 100 may be configured to support condition detection, storage management, and shipping management of the mature food 50a based on an embedded program without the server device 200. In this case, the server device 200 may be omitted from the system environment 10.

[0114] At least one mature food 50a may include at least one of various agricultural, animal husbandry and fishery products that can be stored in the storage warehouse 300. For example, as a storage product that can be stored in the storage warehouse 300, the mature food 50a may include at least one type of agricultural products, fishery products and animal husbandry products or at least one type of processed agricultural products, processed fishery products and processed animal husbandry products. In the example, the mature food 50a may include fruits that need to be ripened, such as bananas, melons, dragon fruits, oranges and mangoes. Additionally, the mature food 50a may include fish, shellfish, crustaceans, etc. that need to be ripened. Additionally, the mature food 50a may include animal husbandry products that need to be ripened. The mature food 50a may be stored in different forms and environments according to its type, and even for the same type, the degree of maturity may also vary according to the intended use. Therefore, according to at least one of the standards in the type, purpose and storage period in the storage warehouse 300, the mature food 50a may be stored in different storage environments.

[0115] The storage warehouse 300 may have at least one space of a specific size in which mature food 50a may be stored. The storage warehouse 300 may be built in a fixed form at a designated location, or may be built in a movable form. The storage warehouse 300 may also be built in a form in which a variety of mature foods 50a may be stored. In this case, the storage warehouse 300 may be provided with partitions or isolated from adjacent spaces so that the mature foods 50a may be stored separately by type, purpose or storage period. The external shape or building material of the storage warehouse 300 may be changed. For example, the storage warehouse 300 may be set to a rectangular parallelepiped shape, a dome shape or an underground facility. The storage warehouse 300 may control the storage environment (e.g., temperature, humidity, light, etc.) under the control of the food management device 100 or the server device 200 to maintain and manage the stored mature foods 50a.

[0116] The food management device 100 may be arranged to obtain a spectral image of at least one mature food 50a. For example, the food management device 100 may collect spectral images of mature food 50a by using at least one spectral camera, which is arranged at a certain location in the storage warehouse 300 where at least one mature food 50a is arranged. In this regard, the spectral camera may be arranged to photograph mature food 50a stored at a certain location (e.g., a shelf) in the storage warehouse 300. The food management device 100 may activate the arranged spectral camera according to predefined schedule information or a specified time interval under a specified storage environment, obtain at least one spectral image of the mature food 50a by using the activated spectral camera, and analyze the obtained at least one spectral image to detect the mature food 50a. Through this, the food management device 100 can provide information on whether the target maturity of the mature food 50a has been completed, the degree of maturity progress, and the additional remaining time required for maturity.

[0117] Additionally, the food management device 100 may collect setting information (e.g., at least one of temperature, humidity, and light intensity) about the storage environment required for management according to the type, purpose, and storage period of the mature food 50a through the server device 200. The food management device 100 may transmit control information for controlling the storage environment of the mature food 50a to the storage warehouse 300 according to the storage environment setting information for each mature food 50a. For example, in the case of a specific mature food 50a, there is a case where the mature environment must be set differently according to the degree of maturity. In this case, the food management device 100 may detect the mature condition of the mature food 50a, generate control information for controlling the mature environment according to the mature condition (e.g., information for adjusting at least some of the temperature, humidity, and light intensity of the storage environment), and transmit the control information to the storage warehouse 300.

[0118] The server device 200 may establish a communication channel with the food management device 100. The server device 200 may provide the food management device 100 with setting information for adjusting a necessary storage environment according to the type or purpose or storage period of the mature food 50a. In another example, when the food management device 100 is configured to collect only a spectral image about the mature food 50a, the server device 200 may perform control about the mature condition detection and storage environment adjustment for the mature food 50a while controlling the food management device 100. In this regard, the server device 200 may receive information related to the mature food 50a, such as at least one spectral image taken from the mature food 50a and information about the storage environment of the mature food 50a, from the food management device 100, generate control information for detecting the mature condition of the mature food 50a and changing the storage environment of the mature food 50a based on the received information, and transmit the generated information to the storage warehouse 300 directly or through the food management device 100. Meanwhile, if the food management apparatus 100 is designed to directly perform the status analysis and storage environment control of the mature food 50 a , the server apparatus 200 may be omitted from the system environment 10 .

[0119] As described above, the system environment 10 supporting the food management function according to the second embodiment of the present invention can obtain a spectral image related to the mature food 50a by placing the food management device 100 configured to obtain the spectral image of the mature food 50a in the storage warehouse 300 in which the mature food 50a is stored. In the system environment 10, the food management device 100 can detect the ripening state of the mature food 50a by analyzing the obtained spectral image, so that the ripening state can be easily confirmed and the marketability of the food is prevented from being deteriorated or the food is discarded due to ripening failure. The system environment 10 of the present invention can even support managers who are inexperienced or not good at food ripening to manage the ripening state of the food. In addition, the system environment 10 of the present invention can support easy detection of the ripening state of the food without the manager having to directly visually inspect or taste the mature food 50a or without using a separate measuring device.

[0120] Fig. 9 2 is a diagram showing an example of components of a storage warehouse capable of storing foods according to a second embodiment of the present invention.

[0121] Reference Fig. 9The storage warehouse 300 includes a warehouse building that forms a specific space in which the mature food 50a can be stored. In order to detect the ripening state of the mature food 50a and control the storage when the mature food 50a is stored in the warehouse building, the storage warehouse 300 may include a warehouse communication circuit 310, a storage environment adjustment module 320, a warehouse memory 330, a sensor unit 340 and a warehouse control processor 350.

[0122] The warehouse communication circuit 310 may form a communication channel of the storage warehouse 300. For example, the warehouse communication circuit 310 may form a communication channel with at least one of the food management device 100 and the server device 200, and transmit operation information related to the operation of the storage warehouse 300 to the food management device 100 or the server device 200. For example, the operation information of the storage warehouse 300 may include at least some of the types of mature foods 50a stored, information about the storage environment of each mature food 50a, the storage date of the mature food 50a, and the expected shipping date of the mature food 50a. The warehouse communication circuit 310 may receive storage environment change information related to the mature food 50a (e.g., setting information for changing the status of the storage environment) from the food management device 100 or the server device 200.

[0123] The storage environment adjustment module 320 may include a module that adjusts the environment of at least some areas of the storage warehouse 300 or the areas in which the mature food 50a is stored. For example, the storage environment adjustment module 320 may include at least one of a temperature adjustment device capable of adjusting the temperature of a specific area in which the mature food 50a is placed, a humidity adjustment device capable of adjusting the humidity, and a light irradiation device capable of adjusting the light irradiation amount. The storage environment adjustment module 320 may adjust at least one of the temperature, humidity, and light irradiation under the control of the warehouse control processor 350 to maintain the freshness of the mature food 50a for a long time.

[0124] The warehouse memory 330 may store various data and programs required for the operation of the storage warehouse 300. For example, the warehouse memory 330 may include a program for operating and controlling at least one adjustment device included in the storage environment adjustment module 320. In addition, the warehouse memory 330 may store at least one program for operating and controlling the sensor unit 340 arranged in the storage warehouse 300. The warehouse memory 330 may store information about the type of mature food 50a stored in the storage warehouse 300, the storage date of the mature food 50a, the location information in the storage warehouse 300 where the mature food 50a is placed, the storage days of the mature food 50a, the expected shipping date of the mature food 50a, etc. In addition, the warehouse memory 330 may store current storage environment setting information of the mature food 50a.

[0125] The sensor unit 340 may be placed in at least some areas of the storage warehouse 300 and collect various sensor information related to the mature food 50a. For example, the sensor unit 340 may include at least one of a position detection sensor capable of identifying a position where the mature food 50a is placed and a sensor capable of sensing a storage environment where the mature food 50a is placed (e.g., at least one of a temperature sensor, a humidity sensor, and a light detection sensor). The sensor unit 340 may collect sensing information about the area where the mature food 50a is placed under the control of the warehouse control processor 350 and transmit the collected sensing information to the warehouse control processor 350.

[0126] The warehouse control processor 350 may perform various operation controls required for operating the storage warehouse 300. For example, the warehouse control processor 350 may adjust at least some of the temperature, humidity, and light amount of a specific area of ​​the storage warehouse 300 according to the storage warehouse setting information. In this operation, the warehouse control processor 350 may control the sensor unit 340 to sense the temperature, humidity, and light amount of a specific area in which the mature food 50a is placed, and adjust the temperature, humidity, and light amount to correspond to the values ​​set in the setting information. In an example, when the mature food 50a is received and the storage warehouse setting information is determined, the warehouse control processor 350 may transmit the type of the mature food 50a, the location information in which the food 50 is placed, the expected shipping date of the mature food 50a, and the current storage environment setting information of the area in which the mature food 50a is placed to the food management device 100 or the server device 200. After receiving the storage environment change information from the food management device 100 or the server device 200, the warehouse control processor 350 may adjust at least some of the temperature, humidity, and light amount of the storage environment in response to the received storage environment change information. When the mature food 50a is shipped out, the warehouse control processor 350 may transmit information about the shipment of the mature food 50a to the food management device 100 or the server device 200, and control the sensor unit 340 and the storage environment adjustment module 320 at the area where the mature food 50a is placed to be turned off.

[0127] Fig.10 is a diagram showing an example of components of a food management device according to a second embodiment of the present invention, and Fig.11 : is a diagram showing an example of components of a processor among components of the food management device according to the second embodiment of the present invention.

[0128] First, refer to Fig.10, the food management device 100 according to the second embodiment of the present invention may include a communication circuit 110, at least one spectral camera 120, a memory 130, and a processor 150. Additionally, the food management device 100 may also include a mounting structure for mounting at least one spectral camera 120, so that at least one spectral camera 120 can photograph an area in which at least one mature food 50a is placed. In addition, the food management device 100 may also include a power source (e.g., a permanent power source or a battery) required for the operation of at least one of the above-mentioned components (e.g., the communication circuit 110, at least one spectral camera 120, the memory 130, and the processor 150).

[0129] The communication circuit 110 may establish a communication channel with the storage warehouse 300 or the server device 200. If the server device 200 is designed to perform the calculations required for the food management function according to the second embodiment of the present invention, the communication circuit 110 may transmit at least one spectral image collected by at least one spectral camera 120 to the server device 200. On the other hand, the food management function may be independently performed by the food management device 100. In this case, the communication circuit 110 may transmit a message including ripening-related information generated during the operation of the food management function (e.g., whether ripening is completed, maturity, remaining time until target ripening, and at least one of ripening environment adjustment) to the manager terminal of the food management device 100 or a designated user terminal device in response to the control of the processor 150. Alternatively, the communication circuit 110 may output (or transmit) the message to the server device 200 in response to the control of the processor 150. If the food management device 100 includes a separate output device (e.g., a display or an audio device), the message may be output through the output device.

[0130] The communication circuit 110 may receive food-related information of the mature food 50a (e.g., information on the type of the mature food 50a stored in the storage warehouse 300, the storage date of the mature food 50a, location information in the storage warehouse 300 where the mature food 50a is placed, the number of days the mature food 50a is stored, and at least one of the expected shipping date of the mature food 50a) from the storage warehouse 300. The communication circuit 110 may transmit change information for changing the storage environment of the mature food 50a to the storage warehouse 300 in response to the control of the processor 150.

[0131] At least one spectral camera 120 may be arranged to capture a spectral image of at least one mature food 50a. The at least one spectral camera 120 may include a plurality of spectral cameras, and the plurality of spectral cameras 120 may be arranged in a plurality of areas of the storage warehouse 300 to respectively capture spectral images of a plurality of mature foods 50a located in the storage warehouse 300. In an example, when the mature food 50a is stored at a certain location in the storage warehouse 300 (e.g., a food shelf where the mature food 50a may be arranged), the spectral camera 120 arranged at the location may be activated in response to the control of the processor 150, and then the spectral image of the mature food 50a may be collected.

[0132] The memory 130 may store at least one program or data required for the operation of the food management device 100. For example, the memory 130 may store a control program required to operate the at least one spectral camera 120 and a first spectral image 133 acquired by the at least one spectral camera 120. For example, the memory 130 may store a first reference model 131 corresponding to the target maturity of the mature food 50a. The first reference model 131 may vary according to the type and target maturity of the mature food 50a. Therefore, when multiple types of mature foods 50a are stored in the storage warehouse 300, the first reference model 131 may include models corresponding to the number of the multiple mature foods 50a. In addition, even for the same type, the target maturity of the mature food 50a may be different. Therefore, the first reference model 131 may include models for the corresponding target maturity of the mature food 50a.

[0133] The processor 150 may perform at least one of transmission and processing of signals required for the operation of the food management device 100 and storage and output of processing results. For example, the processor 150 may control the acquisition of spectral images related to the mature food 50a using at least one spectral camera 120 in response to at least one of guidance information from the storage warehouse 300 (e.g., information notifying that new mature food 50a has arrived) or a request from the server device 200. The processor 150 may detect the condition of the mature food 50a based on the acquired at least one spectral image, determine whether it corresponds to a predefined maturity, and output a corresponding notification. In this regard, the processor 150 may include a processor such as Fig.11 The parts shown in .

[0134] Reference Fig.11 , the processor 150 may include at least one of a food information collector 151a, a spectrum image collector 152a, a food condition inspector 153a, and a warehouse controller 154a.

[0135] The food information collector 151a can collect information about the mature food 50a from the storage warehouse 300. In this regard, the food information collector 151a can maintain a communication channel with the warehouse communication circuit 310 of the storage warehouse 300. After receiving the mature food related information from the storage warehouse 300, the food information collector can store the received information in the memory 130 and request the spectral image collector 152a to collect a spectral image. In this process, the food information collector 151a can extract the location information about the stored food from the mature food related information provided by the storage warehouse 300, and transmit the extracted location information to the spectral image collector 152a.

[0136] The spectral image collector 152a may control the collection of spectral images using at least one spectral camera 120. For example, when the spectral image collector 152a receives the position information of the newly stored mature food 50a from the food information collector 151a, it may process the collection of the spectral image of the newly stored mature food 50a. In this process, the spectral image collector 152a may control the spectral camera 120 placed at the position of the mature food 50a to obtain the spectral image of the mature food 50a. The spectral image collector 152a may provide the acquired spectral image to the food condition checker 153a. The spectral image collector 152a may collect the spectral image at a time requested by the food condition checker 153a or according to a predefined time period, and notify the food condition checker 153a of the spectral image collection. In this operation, the spectral image collector 152a may store the collected spectral image as the first spectral image 133 in the memory 130. When the ripe food 50a at a certain location is transported out, the spectral image collector 152a may control the spectral camera 120 placed to photograph the location where the ripe food 50a is placed to be deactivated.

[0137] After receiving the notification of spectral image collection from the spectral image collector 152a, the food condition checker 153a may perform a ripening condition detection on the ripe food 50a based on the analysis of the first spectral image 133 stored in the memory 130. For example, the food condition checker 153a may compare the first spectral image 133 with the first reference model 131 previously stored in the memory 130. For example, the food condition checker 153a may compare the spectrum of the first spectral image 133 with the spectrum of the first reference model 131 to determine whether it is within a specified similarity range. For example, the first reference model 131 may include a model corresponding to the maturity of a specific ripe food 50a. For example, the device providing the first reference model 131 may collect a plurality of spectral images of meat aged for a certain period of time (e.g., 30 days, 90 days, 120 days, etc.) under specified conditions (e.g., low temperature aging conditions), perform cluster modeling on the spectra of the collected spectral images through an artificial neural network, and generate the first reference model 131 based on the average value (e.g., centroid) and standard deviation of the cluster model. The first reference model 131 may be received by the food management apparatus 100 from, for example, an external server apparatus that provides a reference model, or may be directly generated by the food management apparatus 100 through confirmation of professional human resources and the cycle and condition of the ripe food 50a stored in the storage warehouse 300. When a new first spectral image 133 is acquired, the food condition checker 153a may determine whether the current condition of the ripe food 50a is the target optimal condition (or ripening completion condition) by machine learning using the acquired first spectral image 133. For example, the food condition checker 153a may perform spectral analysis on the first spectral image 133 to determine the similarity with the first reference model 131. With respect to the detection of the current ripening condition of the ripe food 50a, the food condition checker 153a may add information about the storage environment in which the ripe food 50a is stored. The storage environment information may include at least one of temperature, humidity, and illumination (or light amount).

[0138] The food condition checker 153a may calculate the remaining time until the target maturity completion time based on the current maturity condition of the mature food 50a. In this regard, the first reference model 131 may include a model for each period of the mature food 50a. For example, the food condition checker 153a may calculate the remaining period by checking the period difference between the specific period model matched with the currently detected first spectral image 133 and the target model. Additionally or alternatively, the storage environment of each maturity period of the mature food 50a may need to be changed. Therefore, the food condition checker 153a may check whether the storage environment needs to be changed according to the current maturity condition of the mature food 50a. In this regard, the memory 130 may store information about the change of the storage environment for each maturity period. If the maturity period of the detected mature food 50a changes, the food condition checker 153a may check the storage environment corresponding to the changed maturity period according to the information about the storage environment of each maturity period previously stored in the memory 130, and if the change is necessary, the change information is generated and transmitted to the warehouse controller 154a.

[0139] In addition, the food condition checker 153a may notify a designated user of the analysis result regarding the first spectral image 133. For example, the food condition checker 153a may provide a message to a designated user (e.g., a manager terminal of the storage warehouse 300, a manager terminal of the food management apparatus 100, etc.), the message including at least one of information regarding the current maturity of the mature food 50a, the target maturity of the mature food 50a, the remaining time until the current target maturity, the expected shipping date of the mature food 50a, and the current storage environment of the mature food 50a. Alternatively, the food condition checker 153a of the food management apparatus 100 including an output device (e.g., a display) may provide a message to the output device.

[0140] The warehouse controller 154a may receive change information for changing the storage environment from the food condition checker 153a. The warehouse controller 154a may create a control message including the received change information, and transmit the created control message to the storage warehouse 300. For example, the control message may include information requesting adjustment of at least some of the temperature, humidity, and light amount of the area of ​​the storage warehouse 300 in which the specific mature food 50a is placed.

[0141] As described above, the food management device 100 according to the second embodiment of the present invention can collect and analyze the spectral image of the ripe food 50a stored in at least one place of the storage warehouse 300 to check whether the condition of the ripe food 50a corresponds to the specified condition, and provide a relevant message or control the storage warehouse 300. In this way, the food management device 100 can support even workers who have no prior knowledge or experience in ripe food 50a to manage the maturity of ripe food 50a, and can support stable ripening of ripe food 50a by allowing workers without professional knowledge to check whether the ripening of ripe food 50a is complete.

[0142] Meanwhile, in the above description, the food management device 100 is described as detecting the condition of the mature food 50a stored in the storage warehouse 300 to notify whether the mature food 50a is fully matured and the degree of maturity, and directly controlling the change of the storage environment as needed, but the present invention is not limited thereto. For example, the food management device 100 may be designed to only control the spectral camera 120 to collect the spectral image of the mature food 50a, and transmit the collected spectral image to the server device 200. In this case, the server device 200 may be based on the spectral camera 120. Fig.12 The components shown in support the condition detection and management functions of the mature food 50a.

[0143] Fig.12 2 is a diagram showing an example of components of a server device according to the second embodiment of the present invention. As described above, if the food management device 100 is designed to perform the management function of the mature food 50a according to the second embodiment of the present invention, the server device 200 may be omitted.

[0144] Reference Fig.12 The server device 200 of the present invention may include a server communication circuit 210 , a server memory 230 , and a server processor 250 .

[0145] The server communication circuit 210 may directly form a communication channel with the food management device 100. Additionally, the server communication circuit 210 may form a communication channel with the storage warehouse 300, or communicate with the storage warehouse 300 via the food management device 100. The server communication circuit 210 may receive at least one spectral image from the food management device 100 in response to the occurrence of a specified period or a predefined event. Additionally, the server communication circuit 210 may receive at least one food-related information from the storage warehouse 300. The server communication circuit 210 may transmit storage environment change information to the storage warehouse 300 in response to the control of the server processor 250.

[0146] The server memory 230 may store at least one program or data required for the operation of the server device 200. For example, the server memory 230 may store at least one of the second spectral image 233a collected and transmitted by the food management device 100, the second reference model 231a for comparison with the second spectral image 233a, and the food-related information 235a stored in the storage warehouse 300. The second spectral image 233a may be an image corresponding to the above-mentioned first spectral image 133 in the food management device 100. For example, the second spectral image 233a may include a spectral image currently acquired for checking the ripeness status of the ripe food 50a. The second reference model 231a may correspond to the first reference model 131 of the above-mentioned food management device 100. The food-related information 235a is information about the mature food 50a provided by the storage warehouse 300, and may include at least some of the type of mature food 50a, the storage date of the mature food 50a, the expected shipping date of the mature food 50a, the target maturity of the mature food 50a, and the storage environment information of the mature food 50a (for example, at least one of temperature, humidity, and light amount).

[0147] The server processor 250 may control the transmission and processing of signals required for the operation of the server device 200, the storage or transmission of a result, or the transmission of a message corresponding to the result. In this regard, the server processor 250 may include a data collector 251a, a food condition detector 252a, and a warehouse control supporter 253a.

[0148] The data collector 251a may receive food related information from the storage warehouse 300. In this regard, the data collector 251a may form a communication channel with the storage warehouse 300, and when a new mature food 50a is received in the storage warehouse 300, or when the mature food 50a being stored is transported out, the data collector 251 may receive food related information from the storage warehouse 300. The data collector 251a may temporarily or semi-permanently store the received food related information 235a in the server memory 230. After receiving the food related information from the storage warehouse 300, the data collector 251a may request a spectral image corresponding to the food from the food management device 100. After the mature food 50a is placed in the storage warehouse 300, the data collector 251a may request and receive a spectral image from the food management device 100 according to the occurrence of a specified event (e.g., the occurrence of an event requesting to check the mature state of the mature food 50a). Alternatively, the data collector 251a may receive a spectral image of the mature food 50a from the food management device 100 at regular time intervals. After receiving the spectral image, the data collector 251 a may store it in the server memory 230 as a second spectral image 233 a .

[0149] When the food condition detector 252a is notified to collect the second spectral image 233a from the data collector 251a, it can analyze the second spectral image 233a stored in the server memory 230. For example, the food condition detector 252a can compare the spectrum of the second spectral image 233a with the second reference model 231a corresponding to the target maturity of the corresponding mature food 50a to determine whether the ripening of the mature food 50a stored in the storage warehouse 300 is complete or determine the maturity. In this regard, the second reference model 231a may include a completion model corresponding to the ripening completion time of the mature food 50a or a model indicating the progress of the ripening time of the mature food 50a. The second reference model 231a may be generated by the food management device 100 or received from a separate external server device that provides a reference model. Alternatively, the server device 200 may accumulate and store the spectral images of the mature food 50a by time period, and generate a reference model based on the accumulated spectral images. In this process, the server device 200 may also store storage environment information to ensure a reference model of how the ripening of the mature food 50a is performed in which environment.

[0150] The food condition detector 252a may provide information based on the comparison result between the second spectral image 233a and the second reference model 231a to a designated terminal device. For example, the food condition detector 252a may provide at least one of whether the ripening of the ripe food 50a is complete, the current maturity of the ripe food 50a, and the estimated remaining period until the target ripening of the ripe food 50a to the terminal device of the manager of the storage warehouse 300, the terminal device of the manager of the food management device 100, the terminal device of the manager who requests to check the ripening information of the ripe food 50a, or the output device (e.g., display device) connected to the server device 200. If the ripe food 50a is a food that needs to change the storage environment according to the ripening period, the food condition detector 252a may generate change information for changing the storage environment and transmit it to the warehouse control supporter 253a. In this regard, the server storage 230 may store and manage information on the storage environment according to the maturity of the ripe food 50a.

[0151] When the warehouse control supporter 253a receives the change information for changing the storage environment of the mature food 50a from the food condition detector 252a, the warehouse control supporter 253a may transmit storage environment change information requesting the change of the storage environment to the storage warehouse 300 based on the change information. In this process, the warehouse control supporter 253a may check the food related information 235a to identify the environmental factors (e.g., at least one of temperature, humidity, and light intensity) that need to be changed based on the current storage environment of the mature food 50a, create storage environment change information requesting the change of at least one of the storage environment factors, and transmit the created information to the storage warehouse 300.

[0152] Fig.13 1 is a diagram showing an example of a food management method of the food management device according to the second embodiment of the present invention.

[0153] Reference Fig.13 In the method of operating the food management apparatus 100 related to the food management method according to the second embodiment of the present invention, the processor 150 of the food management apparatus 100 may check whether the food related information is received in step 601a. ​​In this regard, the food management apparatus 100 may establish a communication channel with the storage warehouse 300, and when a new mature food 50a is stored in the storage warehouse 300, the storage warehouse 300 may transmit the food related information to the food management apparatus 100. Here, the food related information may include at least some of the name of the mature food 50a, the storage date of the mature food 50a, the placement location of the mature food 50a, and the expected shipping date of the mature food 50a. If the food related information is not received, the processor 150 of the food management apparatus 100 may perform a specified function in step 603a. For example, the food management apparatus 100 may perform a management function on the previously registered mature food 50a, and check whether the mature food 50a being managed has reached the target maturity. Alternatively, the food management device 100 may receive a reference model regarding the newly stored mature food 50a from an external server device and store / manage it.

[0154] After receiving the food-related information from the storage warehouse 300, in step 605a, the processor 150 of the food management device 100 may collect a spectral image of the mature food 50a. In this process, the food management device 100 may check the food-related information to identify the location of the mature food 50a, identify the spectral camera 120 that is set to be able to photograph the corresponding location, and activate the spectral camera 120 at the location. The processor 150 may control the activated spectral camera 120 to collect spectral images at a specific event occurrence time or a predefined regular period from the time when the mature food 50a is stored. In relation to this function, the food management device 100 may store and manage location information about a plurality of spectral cameras that are set to photograph a plurality of locations where the mature food 50a may be placed in the storage warehouse 300, and location information about an area that each of the spectral cameras may photograph.

[0155] In step 607a, the processor 150 of the food management device 100 may analyze the collected spectral image to detect the ripeness of the ripe food 50a. For example, the processor 150 may compare the spectrum of the spectral image of the ripe food 50a with the reference model pre-stored in the memory 130 to determine which reference model corresponds to the spectrum of the spectral image. The reference model may include a model generated by clustering and modeling at least one spectral image acquired each time according to the maturity of the ripe food 50a. The processor 150 may detect the ripeness of the ripe food by referring to the reference model with the most similar cluster.

[0156] In step 609a, the processor 150 may check whether the detected ripe condition value is within the target reference range. If the detected ripe condition value is within the target reference range, the processor 150 may return to step 611a and perform notification according to ripening completion. For example, the processor 150 may transmit a ripening completion message of the ripe food 50a to a pre-specified manager terminal device. After the ripening completion is notified, if the ripe food 50a is shipped out of the storage warehouse 300, the food management function of the ripe food 50a may be terminated. If the ripe food 50a is not shipped out, the processor 150 may repeat the operation after step 605a until the ripe food 50a is shipped out.

[0157] If the maturity status value exceeds the reference range in step 609a, the processor 150 of the food management device 100 may provide a notification about the maturity in step 613a. Here, if the maturity is less than the reference range, the processor 150 may create a message about the under-maturity status and transmit it to a pre-designated manager terminal device (e.g., at least one of the terminal device of the manager of the storage warehouse 300, the terminal device of the manager of the food management device 100, or the terminal device of the designated manager who must confirm the maturity report). Additionally or alternatively, the processor 150 may compare the currently identified maturity time with the target maturity time, calculate the remaining time until the maturity target time, and transmit the calculated remaining time information to the designated manager terminal device. In addition, when it is necessary to change the storage environment according to the change in the maturity stage of the mature food 50a, the processor 150 may generate change information for changing at least some factors of the storage environment and provide the change information to the storage warehouse 300.

[0158] Meanwhile, if the ripe condition value exceeds the reference range, that is, in the case of over-maturity, the processor 150 of the food management device 100 may notify the over-maturity condition of the mature food 50a to the manager terminal that should receive the report on the over-maturity condition of the mature food 50a. In this process, the processor 150 may provide a message to the designated manager terminal device, suggesting that the mature food 50a be moved or discarded according to the over-maturity. Alternatively, the processor 150 may provide a change information requesting a change in the storage environment of the over-maturity food to the designated manager terminal device or the storage warehouse 300. The above operation may be repeatedly performed until the mature food 50a is shipped out of the storage warehouse 300.

[0159] Fig.14 2 is a diagram showing an example of the operation of the server device related to the food management method according to the second embodiment of the present invention.

[0160] Reference Fig.14 In step 701a, the server processor 250 of the server device 200 may check whether the food related information is received. In this regard, the server device 200 may maintain a communication channel with the storage warehouse 300. If the food related information is not received, the server processor 250 may perform a designated function in step 703a. For example, the server processor 250 may perform ripening status management on the previously registered ripe food 50a.

[0161] When receiving the food-related information, the server processor 250 may request the food management device 100 to collect a spectral image in step 705a. In this regard, the server device 200 may establish a communication channel with the food management device 100 and request the food management device 100 to collect a spectral image corresponding to the received food-related information. In this operation, the server device 200 may provide the food management device 100 with the location information of the mature food 50a in the storage warehouse 300. The food management device 100 may identify the spectral camera mapped to the location information of the mature food 50a in the storage warehouse 300, activate the corresponding spectral camera to acquire a spectral image of the newly received mature food 50a, and transmit the acquired spectral image to the server device 200.

[0162] In step 707a, the server processor 250 may check whether a spectral image is received, and if the spectral image is not received within a specified time, the server processor 250 may re-execute step 705a. At the same time, the server processor 250 may request to collect spectral images more than a predefined number of times, and if the spectral image is not received in response, it is determined that a fault has occurred in the food management device 100. The server processor 250 may then take relevant measures (e.g., notifying the management terminal that manages the food management device 100 of the fault).

[0163] When receiving the spectral image, the server processor 250 may perform spectral image analysis in step 709a. In this regard, the server processor 250 may compare the currently collected spectral image with a reference model of the mature food 50a.

[0164] In step 711a, the server processor 250 may check whether the detected ripening status value of the ripe food 50a is within the target reference range through spectrum comparison analysis. If the spectrum comparison analysis result is within the reference range, the server processor 250 may return to step 713a and notify the designated manager terminal device that the ripening is completed. Thereafter, if the server processor 250 receives a shipping message of the ripened food 50a that has been ripened from the storage warehouse 300, the server processor 250 may terminate the food management function of the ripened food 50a. If the shipping message is not received, the server processor 250 may re-execute the operation after step 705a.

[0165] If the spectrum comparison analysis result shows that the maturity status value exceeds the reference range, the server processor 250 may notify the progress in step 715a according to whether it is below or above the reference range. For example, if the maturity status is below the reference range, the server processor 250 may transmit a message to a designated manager terminal device, the message including at least one of a message indicating an under-mature status, the remaining time until maturity is completed, current storage environment setting information, and change information for changing the storage environment according to the under-mature period. If the maturity status exceeds the reference range, the server processor 250 may provide a message to the manager terminal device or the storage warehouse 300, the message including at least one of a message indicating an over-mature status and storage environment change information.

[0166] As described above, the food management method according to the second embodiment of the present invention can determine the optimal condition (or optimal ripe condition, target ripe condition) of the food based on the spectral image taken of the ripe food. In addition, the food management method of the present invention can estimate the timing of the optimal ripe condition or the target ripe condition based on the information about the current ripe condition of the ripe food.

[0167] While this description contains many specific implementation details, these should not be construed as limitations on the scope of the disclosure or of what may be claimed, but rather as descriptions of features specific to particular implementations of particular disclosures.

[0168] In addition, although the description has been described with reference to the accompanying drawings to perform operations in a predefined order, it should not be interpreted as requiring an order or performing operations in a predefined order (shown in order to obtain preferred results), or requiring to perform all operations shown. In some cases, multitasking and parallel processing can be advantageous. In addition, it should not be understood that various system components need to be divided in all types of implementations. It should be understood that described program components and systems are usually integrated into a single software product or packaged into multiple software products.

[0169] This specification illustrates the best mode of the present disclosure, and provides examples to illustrate the present disclosure and enable those skilled in the art to make and use the present disclosure. The present disclosure is not limited by the specific terms used herein. Based on the above-mentioned embodiments, those of ordinary skill in the art may modify, change or alter the embodiments without departing from the scope of the present disclosure.

[0170] Therefore, the scope of the present disclosure should not be limited by the described embodiments, but should be defined by the appended claims.

[0171] [reference numerals]

[0172] 10: System environment

[0173] 50: Food

[0174] 50a: mature food

[0175] 100: Food management device

[0176] 110: Communication circuit

[0177] 120: Spectral Camera

[0178] 130: Memory

[0179] 140: Sensor unit

[0180] 150: Processor

[0181] 200: Server device

[0182] 210: Server communication circuit

[0183] 230: Server storage

[0184] 250: Server processor

[0185] 300: Storage Warehouse

[0186] 310: Warehouse communication circuit

[0187] 320: Warehouse Storage

[0188] 330: Storage environment adjustment module

[0189] 340: Sensor unit

Claims

1. A food management device, the food management device supports food status tracking based on spectral images, the food management device comprising: at least one spectral camera, the at least one spectral camera being used to acquire spectral images of food stored in the storage warehouse; as well as a processor functionally connected to the at least one spectral camera, The processor is configured to: receiving food-related information of the stored food from the storage warehouse, acquiring the spectral image of the food at regular intervals by activating the at least one spectral camera, and The change of the condition of the food is monitored by analyzing the acquired spectral image.

2. The food management device according to claim 1, wherein: The processor is configured to: identifying the location of the stored food from the food-related information, and The spectral camera disposed at the location of the food product is activated.

3. The food management device according to claim 2, wherein: The processor is configured to: When a message regarding a shipment of the food product is received from the storage warehouse, the spectral camera disposed at the location is deactivated.

4. The food management device according to claim 1, wherein: The processor is configured to: When the food is stored, an initial spectral image is acquired, and Changes in the condition of the food product are tracked by comparing the initial spectral image with spectral images acquired thereafter at regular intervals.

5. The food management device according to claim 1, wherein: The processor is configured to: If the change in the condition of the food is greater than or equal to a predefined reference value, a designated terminal is notified of the change in the condition of the food.

6. The food management device according to claim 1, wherein: The processor is configured to: If the change in the condition of the food is greater than or equal to a predefined reference value, information about the storage environment corresponding to the changed condition of the food is collected, change information for changing the storage environment of the food is created based on the collected information, and the change information is transmitted to the storage warehouse.

7. The food management device according to claim 6, wherein: The processor is configured to: The change information for changing at least one of temperature, humidity, and light amount in the storage environment of the food is created.

8. A food status tracking method based on spectral images, the food status tracking method comprising the following steps: A processor of a food management device for managing storage of food, Establishing a communication channel with a storage warehouse storing the food; receiving, from the storage warehouse, food-related information about the food stored in the storage warehouse; acquiring the spectral image of the food at regular intervals by using a spectral camera configured to capture the spectral image of the food; and The change of the condition of the food is monitored by analyzing the acquired spectral image.

9. The food status tracking method according to claim 8, wherein: The step of acquiring the spectral image comprises: identifying the location of the stored food from the food-related information; and The spectral camera disposed at the location of the food product is activated.

10. The food status tracking method according to claim 9, further comprising the following steps: receiving a message from the storage warehouse regarding a shipment of the food product; as well as The spectral camera disposed at the location is deactivated.

11. The food status tracking method according to claim 8, wherein: The step of monitoring a change in the condition of the food product comprises at least one of: If the change in the condition of the food is greater than or equal to a predefined reference value, notifying a designated terminal of the change in the condition of the food; as well as If the change in the condition of the food is greater than or equal to a predefined reference value, information about the storage environment corresponding to the changed condition of the food is collected, change information for changing the storage environment of the food is created based on the collected information, and the change information is transmitted to the storage warehouse.

12. A food management device, the food management device supporting a food management function based on spectral images, the food management device comprising: at least one spectral camera, the at least one spectral camera being used to acquire spectral images of mature food stored in a storage warehouse; as well as a processor functionally connected to the at least one spectral camera, The processor is configured to: When the ripe food is received at one location in the storage warehouse, activating a spectral camera configured to photograph said location of said storage warehouse, Acquiring a spectral image of the mature food by means of the activated spectral camera, detecting the ripeness status of the ripe food by comparing the spectral image with a pre-stored reference model, and A message is outputted according to the maturity status.

13. The food management device according to claim 12, wherein: The processor is configured to: checking the current maturity by comparing the detected maturity status with the reference model, and If the maturity is within the target reference range, a message is output based on the completion of the maturity.

14. The food management device according to claim 13, wherein: The processor is configured to: If the maturity is lower than the reference range, a message including at least one of a message indicating an under-mature condition and a remaining time until maturity is completed is output.

15. The food management device according to claim 14, wherein: The processor is configured to: If the storage environment of the storage warehouse needs to be changed based on the under-mature state, change information related to the change of the storage environment is created and the change information is transmitted to the storage warehouse.

16. The food management device according to claim 13, wherein: The processor is configured to: If the maturity exceeds the reference range, a message indicating an over-mature condition is output.

17. A food management method based on spectral images, the food management method comprising the following steps: By the processor of the food management device, receiving food-related information from a storage warehouse related to the storage of mature food; Based on the food-related information, activating a spectral camera configured to photograph the location of the storage warehouse; Acquiring a spectral image of the mature food through the activated spectral camera; detecting the ripeness status of the ripe food by comparing the spectral image with a pre-stored reference model; as well as A message is outputted according to the maturity status.

18. The food management method according to claim 17, wherein: The step of detecting the maturity status of the mature food comprises: checking the current maturity by comparing the detected maturity status with the reference model; and If the maturity is within a target reference range, a message is output based on completion of maturity, if the maturity is below the reference range, a message including at least one of a message indicating an under-mature condition and a remaining time until maturity is completed is output, or if the maturity exceeds the reference range, a message indicating an over-mature condition is output.

19. The food management method according to claim 18, further comprising the following steps: If the storage environment of the storage warehouse needs to be changed based on the under-mature state, change information related to the change of the storage environment is created and the change information is transmitted to the storage warehouse.

20. A food management device, the food management device supporting a food management function based on spectral images, the food management device comprising: A server communication circuit that establishes a communication channel with the storage warehouse and the food management device; as well as a server processor, the server processor being functionally connected to the server communication circuit, The server processor is configured to: When a message regarding storage of mature food is received from the storage warehouse, a spectral image of the mature food is requested from the food management device, and the food management device controls a spectral camera provided at a location where the mature food is stored. When the spectral image is received from the food management device, the ripeness condition of the ripe food is detected by comparing the spectral image with a pre-stored reference model, and A message is output based on the detected maturity condition.

21. The food management device according to claim 20, wherein: The server processor is configured to: checking the current maturity by comparing the detected maturity status with the reference model, and If the maturity is within the target reference range, outputting a message based on the completion of maturity, If the maturity is lower than the reference range, outputting a message including at least one of a message indicating an under-mature condition and a remaining time until maturity is completed, or If the maturity exceeds the reference range, a message indicating an over-mature condition is output.

Images