System and method for managing raw material labeling items
The raw material labeling management system addresses the challenge of managing raw material information by generating and comparing standard data from labeling images, ensuring accurate and rapid verification, thus preventing accidents and ensuring quality in raw material processing.
Patent Information
- Application Number
- PCT/KR2024/006261
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-05-09
- Filing Date
- 2024-05-09
- Publication Date
- 2024-11-14
AI Technical Summary
Companies processing raw materials, such as food manufacturing companies, face challenges in systematically managing information about incoming raw materials, leading to potential quality deterioration and errors due to inadequate information sharing and labeling issues.
A raw material labeling management system that captures and generates standard information from labeling images, allowing for independent verification and rapid comparison with stored data to detect changes, thereby preventing accidents and ensuring accurate material verification.
The system effectively prevents accidents and ensures accurate, quick verification of raw materials by creating a database of standard information and enabling real-time comparison, reducing errors and quality issues.
Smart Images

Figure KR2024006261_14112024_PF_FP_ABST
Abstract
Description
Raw material labeling management system and method
[0001] The present invention relates to a system and method for managing raw material labeling information, and more particularly, to a system and method for generating standard information based on an image of labeling information attached to a raw material when the raw material is received, and comparing the labeling information of the received raw material with the previously generated standard information when the raw material is received thereafter, thereby enabling appropriate follow-up measures to be taken based on the comparison results.
[0002] Companies that receive and process raw materials, such as food manufacturers and processors, need to systematically manage information about their incoming raw materials. However, many companies fail to do so. This situation can lead to numerous problems and accidents. For example, if there are changes in the raw materials provided by suppliers, the supplier may not be able to smoothly share information about these changes, which can lead to quality degradation in the processed product or errors in labeling.
[0003] The present invention relates to a system and method for fundamentally preventing problems arising from failure to systematically manage information on raw materials.
[0004] The purpose of the present invention is to systematically create a database of standard information on raw materials from the labeling information of the raw materials.
[0005] In addition, the present invention aims to implement an environment in which accurate and rapid verification of additional raw materials is possible by utilizing databased reference information.
[0006] Meanwhile, the technical problems of the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by those skilled in the art from the description below.
[0007] A method for managing raw material labeling information by a management server in a raw material labeling information management system according to one embodiment of the present invention may include a step of receiving raw material labeling information photographed by an inspector terminal and a step of generating first reference information based on the received raw material labeling information.
[0008] A raw material labeling management system according to one embodiment of the present invention may include a management server that, when receiving raw material labeling captured by an inspector terminal, an administrator terminal, and the inspector terminal, generates first reference information based on the received raw material labeling, shares the generated first reference information with the administrator terminal, and, when receiving approval for the shared first reference information from the administrator terminal, registers the first reference information for which the approval has been received, and, when receiving second reference information including raw material labeling different from the shared first reference information from the administrator terminal, changes the first reference information to the second reference information and stores it.
[0009] According to the present invention, even if there is a change in the raw material received from the raw material supplier and this has not been shared, a system is established that can independently verify information about the raw material, thereby preventing accidents caused by the raw material in advance.
[0010] In addition, according to the present invention, there is an effect that enables verification of raw materials to be performed accurately and quickly.
[0011] Meanwhile, the effects of the present invention are not limited to those mentioned above, and other technical effects not mentioned will be clearly understood by those skilled in the art from the description below.
[0012] Figure 1 conceptually illustrates a raw material labeling management system according to the present invention.
[0013] FIG. 2 is a flowchart illustrating an operation of generating reference information for a specific raw material in a raw material labeling information management system according to one embodiment of the present invention.
[0014] FIG. 3 is a flowchart illustrating an operation for verifying raw materials received in a raw material labeling management system according to one embodiment of the present invention.
[0015] FIG. 4 is a flowchart illustrating an operation of capturing a raw material labeling image in a raw material labeling management system according to a first additional embodiment of the present invention.
[0016] FIG. 5 is a flowchart illustrating an operation of capturing a raw material labeling image in a raw material labeling management system according to a second additional embodiment of the present invention.
[0017] FIG. 6 is a diagram illustrating a configuration of a raw material inquiry interface in a raw material inquiry interface according to one embodiment of the present invention.
[0018] FIG. 7 is a diagram illustrating the configuration of a raw material list inquiry interface in a raw material inquiry interface according to one embodiment of the present invention.
[0019] FIG. 8 is a diagram illustrating the configuration of a raw material information confirmation interface in a raw material inquiry interface according to one embodiment of the present invention.
[0020] FIG. 9 is a diagram illustrating the configuration of a verification shooting interface in a raw material inquiry interface according to one embodiment of the present invention.
[0021] FIG. 10 is a diagram illustrating the configuration of a verification result confirmation interface in a raw material inquiry interface according to one embodiment of the present invention.
[0022] Figure 11 is a diagram illustrating the configuration of a raw material standard information management DB according to the present invention.
[0023] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the attached drawings. The advantages and features of the present invention, and methods for achieving them, will become clear with reference to the embodiments described in detail below together with the attached drawings. However, the present invention is not limited to the embodiments disclosed below, but can be implemented in various different forms. These embodiments are provided only to ensure that the disclosure of the present invention is complete and to fully inform those skilled in the art of the scope of the invention, and the present invention is defined only by the scope of the claims. Like reference numerals refer to like elements throughout the specification.
[0024] Unless otherwise defined, all terms (including technical and scientific terms) used herein may be used in a sense commonly understood by those of ordinary skill in the art to which the present invention pertains. Furthermore, terms defined in commonly used dictionaries are not to be interpreted ideally or excessively unless explicitly and specifically defined otherwise. The terminology used herein is for the purpose of describing embodiments and is not intended to limit the present invention. In this specification, singular forms also include plural forms, unless specifically stated otherwise.
[0025] As used herein, the terms “comprises” and / or “comprising” do not exclude the presence or addition of one or more other components, steps, operations and / or elements.
[0026] Figure 1 conceptually illustrates a raw material labeling management system according to the present invention.
[0027] Referring to FIG. 1, the raw material labeling management system (hereinafter referred to as the “management system”) according to the present invention may include a management server (100), an inspector terminal (200), and an administrator terminal (300).
[0028] The management server (100) is a device that can transmit and receive various data while communicating with an inspector terminal or an administrator terminal through a network.
[0029] When looking at the management server (100) from a hardware perspective, the management server (100) is a device that includes a central processing unit and memory. The central processing unit may also be called a controller, a microcontroller, a microprocessor, a microcomputer, etc. In addition, the central processing unit may be implemented by hardware, firmware, software, or a combination thereof. When implemented using hardware, the central processing unit may be implemented using an application specific integrated circuit (ASIC), a digital signal processor (DSP), a digital signal processing device (DSPD), a programmable logic device (PLD), a field programmable gate array (FPGA), etc., and when implemented using firmware or software, the firmware or software may be configured to include modules, procedures, or functions that perform the functions or operations described above. In addition, the above-described operation unit (30) may also include memory, and the memory may be implemented as a ROM (Read Only Memory), a RAM (Random Access Memory), an EPROM (Erasable Programmable Read Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), a flash memory, a SRAM (Static RAM), an HDD (Hard Disk Drive), an SSD (Solid State Drive), etc.
[0030] When looking at the management server (100) from a functional perspective, the management server (100) can be understood as a device capable of generating reference information on raw materials and verifying additional raw materials when they are received. Each function of the management server (100) will be described in more detail later with reference to FIGS. 2 and 3.
[0031] The inspector terminal (200) is a terminal that can be carried by a user, i.e., an inspector, who inspects received raw materials. At this time, the inspector terminal (200) can be utilized to execute both of the two main functions of the management server (100) mentioned above. That is, the inspector terminal (100) can be utilized to create reference information for the raw material when the raw material is first received, and can also be utilized in the process of comparing the labeling information of the raw material with the previously created reference information when additional raw materials are received thereafter.
[0032] The above-mentioned inspector terminal (200) may preferably be a portable device, and for example, a scanner or smartphone that can easily take pictures of raw materials in a packaged state may function as the inspector terminal (200).
[0033] The administrator terminal (300) is a terminal that receives result information from the management server (100), and is a terminal that can be carried by an administrator who is another user other than the inspector. The administrator terminal (300) may be equipped with a function that can send commands toward the management server (100) or the inspector terminal (200), and in particular, when a specific action must be taken based on the result information shared from the management server (100), a control command can be directly transmitted to the management server (100), thereby preventing a larger accident in advance when it is determined that there is a problem with the raw material.
[0034] Also, for reference, it is understood that although the inspector terminal (200) and the administrator terminal (300) are conceptually distinguished as different devices within this detailed description, in reality they may be the same device carried by the same user (a person who is both an inspector and an administrator).
[0035] To give an easy example to help understand the invention, the raw material labeling information management system according to the present invention can be understood as a management system that allows a food manufacturing and processing company to easily check whether there are any changes in the labeling information on the surface of raw materials that are periodically delivered from a raw material supplier.
[0036] As a specific example, by using the management system according to the present invention, the Korean labeling information (labeling information according to the Act on Labeling and Advertising of Food, etc.) attached to raw materials received by each food manufacturing and processing company can be photographed with an inspector terminal, text data within the image can be extracted, and compared with the standard information for the raw material in the raw material standard information management DB already registered in the management server (100), thereby checking whether there are any changes. In addition, if a change is confirmed during this process, the corresponding information can be immediately registered in the management server (100) and the administrator terminal (300) can be notified of this, so that additional measures can be taken.
[0037] FIG. 2 is a flowchart illustrating an operation of generating reference information for a specific raw material in a raw material labeling information management system according to one embodiment of the present invention.
[0038] Referring to FIG. 2, the process of executing the function of generating reference information may include a step (S101) in which the inspector terminal (200) photographs the raw material labeling information, a step (S102) in which the photographed image is transmitted to the management server (100), and a step (S103) in which the management server (100) generates first reference information, which is a draft of reference information for the corresponding raw material, as essential steps, and further may include a step (S104) in which the reference information is approved by the administrator terminal (300), and a step (S105) in which the approved reference information is registered in the management server (100).
[0039] According to one embodiment of the present invention, during the process of generating reference information, the management server (100) may extract text contained in an image captured by the inspector terminal (200) and output the extracted text as text data. Thereafter, the management server (100) may compare the output text data with first reference information in text form to determine whether it matches.
[0040] Steps S101 and S102 are steps in which a user (inspector or administrator) takes an image of the raw material labeling information, which is an area related to raw materials among the Korean labeling information written on the surface or packaging of a specific raw material product, and transmits the image to the management server (100). This step may be performed by an inspector terminal (200) or an administrator terminal (300). In this detailed description, in order to help understand the invention, it will be explained on the premise that the inspector terminal (200) takes a picture of the raw material labeling information and transmits it to the management server (100). However, it is to be understood that this step may also be performed in the same manner through an administrator terminal (300).
[0041] Step S103 is a step in which the management server (100) receives the raw material labeling information photographed from the inspector terminal (200) and then generates first reference information about the raw material. In this step, optical character recognition (OCR) technology can be utilized, and further, a machine learning algorithm can be utilized to improve the character recognition rate. The machine learning algorithm can be implemented to identify characters according to the background color and font situation by learning a plurality of raw material labeling images, and can also learn about food type names determined by organizations (e.g., the Ministry of Food and Drug Safety, etc.), thereby enabling more accurate character recognition from the raw material labeling image in the form of image data.
[0042] According to one embodiment of the present invention, the management server (100) can verify information included in the reference information during the first reference information generation step. For example, the information included in the first reference information includes most of the information included in the raw material labeling, and may include various information related to the raw material, such as the product name, manufacturer name, raw material name, country of origin, allergies, and product report number.
[0043] For reference, step S103 may include an additional process to increase the character recognition rate by receiving additional input from the inspector terminal (200). For example, the character recognition rate may be increased by allowing the user to directly designate areas requiring character recognition and areas without character recognition among the raw material labeling information through touch input, or by first extracting text using optical character recognition technology and machine learning algorithms, then showing the results to the administrator and having the administrator directly correct and input characters with errors.
[0044] Meanwhile, in step S103, a process of formatting text information acquired through character recognition may also be performed simultaneously. The format of raw material labeling may vary depending on the company and food, and thus, the terminology, units, etc. used to indicate the raw material labeling may vary. However, the management server (100) according to the present invention may, when generating reference information on raw materials, categorize information that can be extracted from images, such as “raw material name (or type name)”, “type”, and “manufacturer”, into items and construct a formatted database. In this process, the management server (100) may be implemented to perform labeling arbitrarily, if necessary.
[0045] Step S104 is a step for allowing a user, preferably an administrator, to confirm the reference information for a raw material generated in step S103, and then confirm the reference information after confirmation. After the management server (100) generates reference information for a specific raw material, it can transmit it to the administrator terminal (300) so that the administrator can confirm it, and the administrator can confirm the reference information by inputting “confirm” through his / her administrator terminal after confirming the reference information. In step S104, in addition to simply allowing the administrator terminal (300) to “confirm,” an input interface can be provided so that the administrator can directly modify the content of the reference information. Among the information extracted from the raw material labeling image, there may be incorrect names due to errors, and incorrect classifications may occur during the data formatting process, and the administrator can correct this using the input interface.
[0046] According to one embodiment of the present invention, the interface may be implemented in the form of a web page or application program containing URL information. For example, when the terminal (200) accesses a specific web page, the management server (100) may determine whether a pre-designated program for capturing raw material labeling information is installed on the terminal (200). Thereafter, if the program is not installed on the terminal (200), the management server (100) may transmit to the terminal (200) a file or URL information that can install the program.
[0047] According to one embodiment of the present invention, the management server (100) can determine, in the standard information approval step, whether the standard information of a specific raw material has been extracted by satisfying the established criteria. For example, the management server (100) can set the standard information extraction criteria for the raw material with various values, such as the type of information to be extracted from the standard information of each raw material or the minimum number / amount of information. Thereafter, if the extracted standard information does not satisfy the preset extraction criteria, the management server (100) can repeatedly perform the standard information extraction operation until the extracted standard information satisfies the preset extraction criteria.
[0048] In step S105, the management server (100) can register the confirmed standard information as raw material standard information in a designated system (e.g., CJQMS). As this step is executed, the standard information can be used as a comparison target for subsequently received raw materials.
[0049] FIG. 3 is a flowchart illustrating an operation for verifying raw materials received in a raw material labeling management system according to one embodiment of the present invention.
[0050] Referring to FIG. 3, the process of verifying incoming raw materials may necessarily include a step (S201) in which an inspector searches for and selects a raw material list through an inspector terminal (200), a step (S202) in which the inspector takes an image of the actual raw material received, a step (S203) in which the inspector converts the raw material image transmitted to the management server (100) into text data, and a step (S204) in which the inspector compares the raw material labeling information with the previously generated first reference information to check for changes (hereinafter, third reference information) that are different from the first reference information. In addition, a step (S205) in which an inspector (or a person in charge of receiving) performs an additional review through an inspector terminal (200), and a step (S206) in which an alarm message is transmitted to an administrator terminal (300) may be further included.
[0051] Step S201 is a step in which an inspector uses his / her inspector terminal (200) to search and select which raw material to verify when the raw material is received. In this regard, a raw material search interface such as that shown in STEP1 to STEP3 of FIGS. 6 to 8 may be provided.
[0052] According to one embodiment of the present invention, the step S201 may include a step (S211) in which an inspector confirms receipt of raw materials through an inspector terminal (200), a step (S212) in which a RIMS app is run through the inspector terminal (200), and a step (S213) in which raw material standard information corresponding to the received raw material is specified among the raw material standard information management DB stored in the RIMS.
[0053] Referring to STEP 1 of Fig. 6, the raw material search interface allows the user to input the expected arrival date as a required search condition, and the inspector can search for raw materials that meet the conditions by additionally selecting desired search items such as raw material code, raw material name, and order number. In addition, referring to STEP 2 of Fig. 7, when the inspector presses the 'Search' button, a raw material list can be retrieved, and the inspector can find and select the raw material he or she wishes to verify from the list. After selection, raw material information such as the output screen of STEP 3 of Fig. 8 can be displayed.
[0054] Step S202 is a step in which the inspector uses his / her inspector terminal (200) to take a picture of the raw material labeling information displayed on the outer surface or packaging of the received raw material and transmits it to the management server (100). STEP4 of FIG. 9 illustrates a photographing interface provided to enable taking a picture of the raw material labeling information for any raw material. It should be noted that the taken raw material labeling image may be shared with an analysis server provided separately from the management server (100), and this may be subject to change depending on the system design.
[0055] Meanwhile, Korean labeling information is written on the surface or packaging of raw materials. Even if the Korean labeling information is written on the raw materials in a standardized form, the font size of the raw materials labeling information in the Korean labeling information may vary depending on the shape of the raw materials product, the user's grip condition of the raw materials product, or the shooting settings, which may lower the character recognition rate. Accordingly, the present invention can control the Korean labeling information or raw materials labeling information of the raw materials product so that it is captured at a certain size. A related explanation will be provided below with reference to FIGS. 3 and 4.
[0056] FIG. 4 is a flowchart illustrating an operation of capturing a raw material labeling image in a raw material labeling management system according to a first additional embodiment of the present invention.
[0057] According to a first additional embodiment of the present invention, step S202 of FIG. 3 may include a step of learning a raw material labeling image whose suitability has been determined (S221), a step of confirming shooting settings for shooting the raw material labeling image (S222), and a step of controlling the raw material labeling image to be shot according to the confirmed shooting settings (S223).
[0058] Referring to FIG. 4, in step S221, the management server (100) may use a machine learning algorithm to perform learning on images of raw material labels previously judged as “suitable” or “unsuitable.” Accordingly, in step S222, the management server (100) may check the shooting settings, such as the area size, area shape, resolution, and brightness of the raw material labels in the images judged as “suitable.”
[0059] According to a first additional embodiment of the present invention, when a function for capturing a raw material labeling image is executed on the inspector terminal (200), the management server (100) can perform communication with the inspector terminal (200) to receive the raw material labeling image captured by the inspector terminal (200) in real time. Thereafter, in step S223, the management server (100) can control the inspector terminal (200) to output shooting command information that causes the raw material labeling image to be captured according to the shooting settings. For example, the shooting command information can include information requesting the user of the inspector terminal (200) to capture the raw material labeling image from close up or far away, information requesting to capture at a specific level of resolution or brightness, or a guide area indication that causes the raw material labeling to be captured within a designated area, and can be processed into various forms of data (e.g., voice or image) and output from the inspector terminal (200).
[0060] According to a first additional embodiment of the present invention, when the management server (100) receives a raw material labeling image captured according to the confirmed shooting settings from the inspector terminal (200), the management server (100) can convert the first raw material labeling information of the raw material labeling image into second text data. Thereafter, the management server (100) can re-compare the converted second text data with the first reference information.
[0061] According to a first additional embodiment of the present invention, the management server (100) determines that the first reference information is appropriate when the second text data and the first reference information match as a result of the re-comparison, and if the second text data and the first reference information do not match, the management server (100) can transmit a first message notifying that the second text data and the first reference information do not match to the inspector terminal (200) or the administrator terminal (300).
[0062] According to a first additional embodiment of the present invention, when the management server (100) receives a second message notifying that the first reference information is determined to be unsuitable from the inspector terminal (200) or the administrator terminal (300) in response to the first message, the management server (100) may generate third reference information based on the second text data, and change the first reference information to the third reference information and store it.
[0063] According to the first additional embodiment of the present invention, the management server (100) controls the inspector terminal (200) to capture raw material labeling images according to optimal shooting settings, thereby improving the recognition rate of raw material labeling and reducing unnecessary image capturing operations in the inspector terminal (200) while managing reference information.
[0064] FIG. 5 is a flowchart illustrating an operation of capturing a raw material labeling image in a raw material labeling management system according to a second additional embodiment of the present invention.
[0065] According to a second additional embodiment of the present invention, step S202 of FIG. 2 may include a step (S231) of checking a raw material labeling image received in real time to determine the description form of the raw material labeling, a step (S232) of checking that the raw material labeling is described in a three-dimensional form on the raw material product as a result of performing step S231, and a step (S233) of controlling the raw material labeling image to be captured using a panoramic photo shooting function.
[0066] Referring to FIG. 5, in step S231, the management server (100) receives a raw material labeling image captured in real time by an inspector or an administrator from an inspector terminal (200) or an administrator terminal (300), and can check the received raw material labeling image to determine the description form of the raw material labeling included in the raw material labeling image.
[0067] According to a second additional embodiment of the present invention, the description form of the raw material labeling information may include a two-dimensional plane or a three-dimensional solid shape (e.g., a bag, a sphere, a cylinder) depending on the form of the raw material product.
[0068] At step S232, the management server (100) can determine that the raw material labeling information is described in a three-dimensional form on the raw material product. For example, the management server (100) can project the area corresponding to the raw material labeling information in the received raw material labeling image onto a preset reference shape to determine whether the raw material labeling information is described in a flat or three-dimensional form.
[0069] As a result of performing the above-described step S232, if it is determined that the raw material labeling information is written in a three-dimensional form on the raw material product, in step S233, the management server (100) can control the inspector terminal (200) to execute a panoramic photo shooting function. The management server (100) can execute the panoramic photo shooting function to capture raw material labeling information of a specific raw material product from various angles to acquire multiple images, and synthesize the overlapping parts between the multiple images and previously captured raw material labeling images so that they match each other to output a single panoramic photo.
[0070] According to a second additional embodiment of the present invention, the management server (100) can control a mark (e.g., an arrow) indicating a specific angle or position to capture an area not captured in a previously captured raw material labeling image so that it is superimposed on the image being captured by the inspector terminal (200). Accordingly, the management server (100) can obtain a raw material labeling image so that some of the raw material labeling is not missed by having the user of the inspector terminal (200) move the inspector terminal (200) using the mark to capture the raw material labeling image.
[0071] Step S203 is a step in which the management server (100) extracts text information from the captured raw material labeling image. In this step, the optical character reading technology and machine learning algorithm previously mentioned in step S103 can be utilized.
[0072] Step S204 can be understood as a step of comparing the text information extracted in step S203 with the reference information confirmed and registered in step S105, and finding changes, or in other words, third reference information that has changed compared to the reference information, through the comparison.
[0073] In step S204, a comparison is basically made between text data, and if the text data matches 100% as a result of the judgment, a “match” result value is output, and if even one character does not match, a “non-match” result value is output.
[0074] Meanwhile, according to a third additional embodiment of the present invention, the management server (100) can perform learning on raw material labeling images previously judged as "suitable" or "unsuitable" using a machine learning algorithm. As a result of the learning, the management server (100) can check the font size and standard deviation of the font size of the letters in the raw material labeling images judged as "suitable" as reference values.
[0075] Specifically, according to the third additional embodiment of the present invention, if the management server (100) determines that specific text data is “mismatched” as a result of performing step S204, the management server (100) can calculate the standard deviation of the font size in the raw material labeling information image including the text data determined to be “mismatched.” Thereafter, if the calculated standard deviation is a value within a range specified from the reference value, the management server (100) can perform step S205.
[0076] Meanwhile, if the calculated standard deviation is a value exceeding a range specified from the reference value, the management server (100) may process the raw material labeling image so that the size of the letters in the raw material labeling is set to a font size according to the reference value. Thereafter, the management server (100) may re-judge whether there is a “match” or “mismatch” in step S204 based on the processed image, thereby increasing the probability of outputting a “match” result value.
[0077] According to a third additional embodiment of the present invention, the management server (100) processes the image of the raw material labeling information determined to be “mismatched” before transmitting the image to the inspector terminal (200) so that the probability of outputting the “matched” result value increases, thereby reducing the number of “mismatched” result values that the user of the administrator terminal (300) must additionally review, thereby reducing the workload of the user of the administrator terminal (300).
[0078] If the result of performing the aforementioned step S204 is a “non-match” result, in step S205, the management server (100) can notify the inspector terminal (200) or administrator terminal (300) that there is a difference between the information extracted from the raw material labeling information of the received raw material and the previously generated standard information. At this time, the inspector or administrator can use their inspector terminal (200) to check the cause of the “non-match” and then make a final “conformance” or “non-conformance” judgment. For example, if the “non-match” is due to a simple typo, spacing error, parenthesis or symbol error, the inspector or administrator can complete the verification by judging it as “conformance” even if it is a “non-match”, thereby ensuring that there is no particular problem with the raw material.
[0079] Conversely, in cases where the actual first reference information needs to be changed, a display change is required, a return is required, etc., an inspector or manager can determine that it is “unsuitable” and an alarm message can be transmitted to the subsequent manager (S206). For reference, STEP 5 of FIG. 10 illustrates an interface displayed on the inspector terminal (200) when the text data from the comparison results in step S204 matches and when they do not.
[0080] FIG. 6 is a diagram illustrating a configuration of a raw material inquiry interface in a raw material inquiry interface according to one embodiment of the present invention.
[0081] According to one embodiment of the present invention, when step S212 is performed and the RIMS app is launched, the RIMS main screen (600) may be displayed on the inspector terminal (200).
[0082] Referring to FIG. 6, the management server (100) can control the verification results for incoming raw materials performed for a certain period of time by the inspector terminal (200) and the incoming raw material inquiry button (601) to be displayed on the RIMS main screen (600).
[0083] Thereafter, when the raw material inquiry button (601) is selected by the user of the inspector terminal (200), the management server (100) can control the RIMS main screen (600) to be switched to and displayed as a raw material inquiry interface (610).
[0084] According to one embodiment of the present invention, a user of an inspector terminal (200) can input the expected arrival date as a required search condition through the raw material inquiry interface (610), and can additionally select desired search items such as raw material code, raw material name, and order number. Thereafter, when the search button (611) of the raw material inquiry interface (610) is selected through the inspector terminal (200), the management server (100) can search for raw materials that meet the entered conditions in a previously stored raw material standard information management DB.
[0085] FIG. 7 is a diagram illustrating the configuration of a raw material list inquiry interface in a raw material inquiry interface according to one embodiment of the present invention.
[0086] According to one embodiment of the present invention, the management server (100) can control the inspector terminal (200) so that the search result through the raw material search interface (610) of FIG. 6 is displayed through the raw material list search interface (700).
[0087] Referring to FIG. 7, the management server (100) can classify the searched raw material standard information according to each raw material name and display it in the raw material list inquiry interface (700). For example, in the raw material list inquiry interface (700), the raw material name, raw material code, receipt date, and order number for each raw material standard information can be selectively displayed.
[0088] According to one embodiment of the present invention, the management server (100) can search for raw material reference information having the same raw material code (e.g., '543210'). At this time, the management server (100) can control raw material reference information having the corresponding raw material code to be displayed on the raw material list inquiry interface (700). Thereafter, when one of the raw material reference information having the corresponding raw material code is selected, the management server (100) can control the inspector terminal (200) to display the same raw material code inquiry interface (710) including the raw material reference information list having the corresponding raw material code.
[0089] FIG. 8 is a diagram illustrating the configuration of a raw material information confirmation interface in a raw material inquiry interface according to one embodiment of the present invention.
[0090] Referring to FIG. 8, when specific raw material standard information is selected from the search results displayed in the raw material list inquiry interface (700), the management server (100) can control the inspector terminal (200) to display a raw material information confirmation interface (800) including detailed information about the corresponding raw material standard information.
[0091] According to one embodiment of the present invention, the raw material information confirmation interface (800) may display information on a specific raw material (e.g., Sanmaeul pickled cabbage) and a button (801) for taking a verification photo of the raw material. For example, the raw material information may include various information related to the raw material, such as the raw material code, manufacturer, food type, raw material name, allergy, and item report number.
[0092] FIG. 9 is a diagram illustrating the configuration of a verification shooting interface in a raw material inquiry interface according to one embodiment of the present invention.
[0093] According to one embodiment of the present invention, when the verification shooting button (801) of the raw material information confirmation interface (800) is selected, the camera function may be activated on the inspector terminal (200) and the verification shooting interface (900) may be displayed.
[0094] Referring to FIG. 9, the verification shooting interface (900) may display a preview area where a raw material labeling image to be captured by the camera of the inspector terminal (200) is displayed, and a button for capturing the image displayed in the preview area may be displayed. Thereafter, when a raw material labeling image is captured by the verification shooting interface (900), the captured raw material labeling image may be shared or stored on an analysis server provided separately from the management server (100).
[0095] FIG. 10 is a diagram illustrating the configuration of a verification result confirmation interface in a raw material inquiry interface according to one embodiment of the present invention.
[0096] According to one embodiment of the present invention, when a raw material labeling image is captured through the verification shooting interface (900), the management server (100) can perform step S204 of FIG. 3. Thereafter, as a result of performing step S204, the management server (100) can determine whether the text data converted from the raw material labeling image and the previously stored raw material standard information 'match' or 'mismatch', and display the determination result on the verification result confirmation interface (1000).
[0097] Referring to FIG. 10, if the converted date data and the stored raw material standard information are judged to be ‘mismatched’, the management server (100) can display the item (1010) judged to be mismatched among the detailed items of the raw material standard information and the final result input button (1011) for entering the final result of the inspector for the above item on the verification result confirmation interface (1000).
[0098] According to one embodiment of the present invention, when the final result save button (1021) is selected, the management server (100) can display a mismatch verification item input interface (1020) that can modify information about the corresponding mismatched raw material on the verification result confirmation interface (1000). Thereafter, when the user of the inspector terminal (200) modifies and inputs the corresponding item and selects the final result save button (1021) of the mismatch verification item input interface (1020), the management server (100) can control the inspector terminal (200) to display an action interface (1030) for inputting a mismatch action for the corresponding raw material.
[0099] According to one embodiment of the present invention, the action interface (1030) is ultimately used to determine whether the reference information of a specific raw material is suitable or unsuitable, and an item of 'suitable' or 'unsuitable' may be displayed. Thereafter, if the 'suitable' item is selected by the user of the inspector terminal (200), the raw material reference information for the corresponding raw material may be determined to be properly stored. In addition, if the 'unsuitable' item is selected by the user of the inspector terminal (200), the management server (100) may determine that the raw material reference information for the corresponding raw material is unsuitably stored, and may transmit an alarm message notifying the unsuitably stored raw material reference information to the administrator terminal (300).
[0100] Figure 11 is a diagram illustrating the configuration of a raw material standard information management DB according to one embodiment of the present invention.
[0101] Referring to Fig. 11, the management server (100) can construct a raw material standard information management database within its internal system. For example, raw material standard information can be stored in the raw material standard information management database by classifying it into various categories related to raw materials, such as raw material tree, raw material name, food type, and raw material name for each raw material. Thereafter, some of the specifications of the stored raw materials can be changed by the user of the inspector terminal (200) or the administrator terminal (300). At this time, the management server (100) can reflect the changed specifications of the raw materials in the previously stored first standard information and generate second standard information.
[0102] However, this is only a preferred embodiment for achieving the purpose of the present invention, and it is obvious that some steps may be added or deleted as needed, and one step may be included in another step and performed.
[0103] Although embodiments of the present invention have been described with reference to the attached drawings, those skilled in the art will appreciate that the present invention can be implemented in other specific forms without altering the technical concept or essential features thereof. Therefore, the embodiments described above should be understood to be illustrative in all respects and not restrictive.
Claims
1. In the raw material labeling information management system, in the method in which the management server manages raw material labeling information, A step of receiving raw material labeling information captured by an inspector terminal; and A step of generating first reference information based on the raw material labeling information received above; including; How to manage raw material labeling information.
2. In paragraph 1, Further comprising a step of sharing the first reference information generated above to an administrator terminal; How to manage raw material labeling information.
3. In paragraph 2, A step of receiving approval for the shared first reference information from the administrator terminal; and Further comprising a step of registering the first reference information for which the above approval has been received in the management server; How to manage raw material labeling information.
4. In paragraph 2, A step of receiving second reference information including raw material labeling information different from the shared first reference information from the administrator terminal; and A step of changing the first reference information to the second reference information and storing it; further comprising; How to manage raw material labeling information.
5. In paragraph 1, A step of receiving an image of raw material labeling information for a raw material product from the above administrator terminal; and A step of converting the first raw material labeling information included in the received raw material labeling information image into first text data; further comprising; How to manage raw material labeling information.
6. In paragraph 5, further comprising a step of comparing the first text data with the first reference information; How to manage raw material labeling information.
7. In paragraph 6, As a result of performing the above comparison step, if the first text data and the first reference information match, A step of determining that the first reference information is suitable; further comprising: How to manage raw material labeling information.
8. In paragraph 6, In addition, if the first text data and the first reference information do not match as a result of performing the above comparison step, a step of confirming the learned shooting settings using a pre-specified machine learning algorithm is included. How to manage raw material labeling information.
9. In paragraph 8, The above learned shooting settings are, It is characterized in that it includes command information that learns the raw material labeling images previously determined to be suitable, so that the font size of the letters in the first raw material labeling is photographed at a designated value, or the raw material labeling image is photographed at a designated value of resolution or brightness. How to manage raw material labeling information.
10. In paragraph 9, A step of controlling the inspector terminal so that the raw material labeling image is captured according to the confirmed shooting settings; further comprising; How to manage raw material labeling information.
11. In paragraph 10, A step of converting the first raw material labeling information of the first raw material labeling information image taken according to the above-mentioned confirmed shooting settings into second text data; and Further comprising a step of re-comparing the converted second text data and the first reference information; How to manage raw material labeling information.
12. In paragraph 11, A step of determining that the first reference information is suitable when the second text data and the first reference information match as a result of performing the re-comparison step; further comprising; How to manage raw material labeling information.
13. In paragraph 11, A step of transmitting a first message notifying that the second text data and the first reference information do not match to the inspector terminal or the administrator terminal when the second text data and the first reference information do not match as a result of performing the re-comparison step is further included; How to manage raw material labeling information.
14. In paragraph 13, In response to the first message, a step of receiving a second message from the inspector terminal or the administrator terminal notifying that the first reference information is determined to be unsuitable; and Further comprising a step of generating third reference information based on the second text data upon receiving the second message; How to manage raw material labeling information.
15. In paragraph 14, A step of changing the first reference information to the third reference information and storing it; further comprising; How to manage raw material labeling information.
16. In the raw material labeling information management system, Inspector terminal; Administrator terminal; and When receiving the raw material labeling information captured by the above inspector terminal, first reference information is generated based on the received raw material labeling information, Share the first reference information generated above to the administrator terminal, When receiving approval for the shared first reference information from the above administrator terminal, register the first reference information for which the approval has been received, A management server that, when receiving second reference information including raw material labeling information different from the shared first reference information from the administrator terminal, changes the first reference information to the second reference information and stores it; Raw material labeling management system.
17. In paragraph 16, The above management server, When receiving a raw material labeling image for a raw material product from the above administrator terminal, converting the first raw material labeling information included in the received raw material labeling image into first text data is performed, Compare the first text data and the first reference information, As a result of the above comparison, if the first text data and the first reference information match, the first reference information is determined to be suitable, As a result of the above comparison, if the first text data and the first reference information do not match, a first message notifying that the first text data and the first reference information do not match is transmitted to the inspector terminal or the administrator terminal, In response to the first message, a second message is received from the inspector terminal or the administrator terminal, notifying that the first reference information is determined to be unsuitable. Upon receiving the second message, a management server is included that generates third reference information based on the first text data and changes the first reference information to the third reference information and stores it. Raw material labeling management system.
Citation Information
Patent Citations
System
KR1020220032234A
Ice tray, ice maker, and home applicance including the same
KR1020240162185A
Non-Perforated Wall-Mounted TV Fixture
KR102563949B1
System and method to monitor and control workflow
US20180330287A1
Method for providing photographed image-related information to user, and mobile system therefor
WO2008107876A1
