Method and apparatus for providing online inspection of required descriptions of artwork for a product package

Abstract

The method of the present invention processes an image of a product package to extract a plurality of blocked information from the image, identifies which item among the previously designated mandatory information items corresponds to each of the extracted plurality of blocked information items, inspects whether the set of the identified mandatory information items complies with the display guidelines for mandatory information set by one or more designated countries based on the package type confirmed for the image, and then creates one or more pages containing information on the inspection results and presents them to a terminal device. The confirmed package type may be a first type corresponding to a package for directly accommodating the contents of a product, or a second type corresponding to a package for accommodating the package of the first type.

Description

Technology Field

[0001] The present invention relates to a technology for providing results of an online inspection to determine whether the information that must be indicated on the labeling surface, such as the container, packing box, or packaging of a product, when selling cosmetics used on human skin or hair, products to be drunk or ingested, or pharmaceuticals to be applied or taken, complies with the regulations set forth by the country where the product is to be sold. Background Technology

[0002] For products containing contents that are ingested, drunk, taken, or applied to the skin or hair, etc., in order to satisfy the consumer's right to know and to enable prompt identification of the cause and response, either personally or publicly, in the event of side effects, information on all ingredients contained in the contents, instructions for use, precautions for use, and expiration date must be indicated on the container, packaging, insert, or packaging box (hereinafter collectively referred to as 'package').

[0003] Therefore, a person who manufactures, produces, or sells a type of product to which such labeling obligations apply must inspect whether the mandatory labeling information (hereinafter referred to as "mandatory information") for that type of product is displayed on the package in accordance with the labeling guidelines. This inspection is generally carried out during the design phase of the package. In the case of products such as cosmetics, the design material (1) for the package, as exemplified in FIG. 1, is commonly referred to as "artwork" in the industry. When the artwork is completed with the full ingredients (2a), usage method (2b), and precautions for use (2c), a separate person specializing in inspecting the mandatory information, rather than the designer of the artwork, inspects whether the content displayed on the artwork complies with the established labeling guidelines. Among the items corresponding to these mandatory information (hereinafter referred to as "mandatory items"), the inspection of the labeling, particularly the full ingredients item, takes a considerable amount of time.

[0004] In the case of the full ingredient list, criteria for exemption from constraints on the order of listing based on content, requirements for ingredient names, font size, and mandatory exceptional labeling for specific ingredient names are specified; therefore, it is necessary to verify whether all these guidelines are satisfied. Furthermore, since other mandatory listing items vary depending on the country of sale, personnel who understand the labeling guidelines for each country must exercise considerable caution to check for typographical errors. Consequently, inspecting mandatory listings inevitably requires a significant amount of time from specialized personnel.

[0005] Since it is difficult for a single individual to fully grasp the diverse labeling guidelines regarding mandatory information for numerous countries, personnel in charge often verify compliance by checking the relevant guidelines during inspections, particularly for countries where sales or exports are not the primary focus. In such cases, inspecting compliance with the exporting country's guidelines can take significantly more time. Furthermore, when exporting to a new country for the first time, there is a possibility that personnel may misjudge mandatory information as compliant due to a lack of understanding of the relevant guidelines. If such a situation occurs, it entails follow-up measures such as repurchasing packages and recalling products, resulting in substantial financial losses. The problem to be solved

[0006] One objective of the present invention is to provide a method for presenting online the results of an inspection into whether the descriptions required to be displayed on a product package comply with the labeling guidelines of a designated country, and an apparatus for such a method.

[0007] Another objective of the present invention is to provide a method for providing an online inspection of essential information regarding product package artwork, which can additionally guide compliance with phrases expressing the function or efficacy of a product to be displayed on the product package, and an apparatus for such a method.

[0008] Another objective of the present invention is to provide an online inspection of mandatory information regarding product package artwork, which can be modified to suit the sales situation of the product seller, such as by notifying that the information regarding the required information on the product package does not comply with the display guidelines.

[0009] Another objective of the present invention is to provide a method for providing an online inspection of mandatory information on product package artwork, and an apparatus for the method, which can automatically determine the type of product package for the artwork provided for inspection of conformity to the mandatory information display guidelines.

[0010] The objectives of the present invention are not limited to those explicitly described above, but naturally include achieving effects that can be derived from the specific and exemplary description of the invention below. means of solving the problem

[0011] According to one aspect of the present invention, a method for inspecting an image of a package regarding mandatory labeling on a product and providing the inspection results online comprises: a first step of receiving an image of a product package from any terminal device via a communication network; a second step of processing the received image to extract a plurality of blocked information from the image; a third step of identifying which item among previously designated mandatory labeling items corresponds to each of the extracted plurality of blocked information; and a fourth step of inspecting whether the set of items identified as the corresponding mandatory labeling items in the third step conforms to the labeling guidelines for mandatory labeling established by one or more designated countries or organizations based on the package type confirmed for the image, and creating one or more pages containing information on the inspection results and transmitting them to the any terminal device. The package type is a first type corresponding to a package for directly accommodating the contents of the product, or a second type corresponding to a package for accommodating the package of the first type.

[0012] In one embodiment according to the present invention, the inspection in step 4 includes checking whether there are any items missing from the set of identified items regarding the listing items that are mandatory for the identified package type in the labeling guidelines.

[0013] In one embodiment according to the present invention, the fourth step checks whether there is a condition satisfied among specified conditions based on the extracted plurality of blocked information, and if there is a satisfied condition, additionally checks the display state of the content displayed on the image according to the inspection content specified for that condition. The specific conditions include one or more conditions selected individually or combined from among conditions including a condition in which a specific required entry item is included in the set of identified items, a condition in which a specific country or organization is included in one or more countries / organizations, a condition specified for the type of product, a condition specified for the ingredients contained in the contents of the product, and a condition in which a predetermined specific phrase is detected. The additional inspection includes checking whether the text is displayed in a predetermined format, and the predetermined format may include at least one of an underlined format, a format that is bolder than other characters, a format that is relatively italicized compared to other characters, and a size greater than or equal to the size specified for the characters. Furthermore, in this embodiment, the additional inspection of the display state includes checking whether the target information specified in the additional inspection is detected in the content displayed on the image. This target information may be a small image corresponding to a logo or text corresponding to a specific phrase.

[0014] In one embodiment according to the present invention, the third step further identifies a special phrase indicating the function or efficacy of the product, and the inspection in the fourth step includes inspecting whether the labeling guidelines restrict the use of the identified special phrase on the product.

[0015] In one embodiment according to the present invention, the third step identifies whether a specific item among the designated essential items is written based on the characteristics of the text portion displayed in the area from which the blocked information was extracted. At this time, the characteristics include at least one of the size of the portion corresponding to the character and the thickness of the stroke of the character.

[0016] In one embodiment according to the present invention, the third step includes a step of identifying which required entry the blocked information corresponds to by confirming the existence of a matching word with reference words within a classification word group, each of which is designated for at least one of the previously designated required entry items for each of the at least a portion of the blocked information, and the step may include, in the confirmation of the existence of the matching word, a process of calculating a total score for the blocked information by assigning different scores to words that match entirely and words that match partially based on each classification word group, and then comparing each of the calculated total scores.

[0017] In one embodiment according to the present invention, the third step may further include a step of identifying which required item the blocked information corresponds to by calculating the degree of image similarity with reference logos within a classification logo group, each of which is designated for one or more of the previously designated required items for each of at least some of the blocked information.

[0018] In one embodiment according to the present invention, at least a portion of the three steps is carried out by an artificial intelligence module trained with a plurality of learning models consisting of a set of texts that can be displayed for each item of the required information and a set of required information items corresponding to each text.

[0019] In one embodiment according to the present invention, the fourth step involves creating one or more pages by including a testing reference country zone presented to allow the selection of testing progress in at least a series of countries (which may include non-state entities such as public or commercial entities). In this embodiment, the method further comprises the step of, when the selection for any country or entity in the testing reference country zone is changed, recreating the one or more pages as a result of checking whether they comply with the display guidelines set for mandatory information in the testing reference country after the change, based on the package type confirmed for the image, and transmitting the result to the arbitrary terminal device.

[0020] In a specific embodiment according to the present invention, the one or more pages are configured to include a first information area in which at least the received image is displayed together with a control object capable of representing the identified package type, and a second information area in which an inspection result is displayed in which at least some of the items from the previously designated required entries are presented as inspection items.

[0021] In the specific embodiment above, the fourth step may constitute the inspection items as items belonging to the union of the entries designated as mandatory entries in each of the one or more countries or organizations. Alternatively, the fourth step may constitute the inspection items as the previously designated mandatory entries. In this case, regarding the previously designated mandatory entries, for items that are not designated as mandatory entries in all of the one or more countries or organizations, information indicating that they do not apply to the one or more countries or organizations is configured to be presented in the corresponding inspection status column.

[0022] In the specific embodiment above, the fourth step creates the second information zone so that when one or more countries or organizations are multiple and any one of the inspection items not identified in the second step is a mandatory item required to be listed in only some of the multiple countries or organizations, a phrase with a different content from when it is a mandatory item required to be listed in all of the multiple countries or organizations is presented in the corresponding inspection status column.

[0023] In the specific embodiment above, the fourth step creates the one or more pages by including the number of items that do not comply with the display guidelines in the inspection items in the second information area, along with a guide message indicating the reason for non-compliance.

[0024] In the specific embodiment above, the fourth step is to add a status phrase to the inspection status column within the second information area for each of the inspection items, wherein for items among the inspection items that do not conform to the display guidelines, a specific status phrase with content different from that of the conforming items is added.

[0025] In the specific embodiment above, the third step may additionally identify special phrases indicating the function or efficacy of the product, and the fourth step may create the one or more pages by including, among the identified special phrases, at least those phrases for which use in the product is restricted by the display guidelines, as inspection items in the second information area along with a specific status phrase indicating that there are precautions. When implemented in this manner, the method may further comprise: a fifth step of transmitting from the arbitrary terminal device an input page that allows a request for the listing or deletion of special phrases indicating the function or efficacy of the product when a specific request from a user is received through the one or more pages from the arbitrary terminal device; a sixth step of editing an existing set of special phrases according to the request for listing or deletion through the input page; and a seventh step of confirming the identification of only the phrases belonging to the edited set of special phrases in the identification of special phrases indicating the function or efficacy of the product for a first image received from a first terminal device logged in with the same account as the subscriber account when the arbitrary terminal device logs in. In addition, the above method may further include the step of, when a user’s selection regarding a first item in which a specific status phrase is presented is received, rewriting the content regarding one or more pages in a form that includes guidance on matters the user should take action on or be aware of regarding the first item in an information field secured at the bottom of the first item, and transmitting it again to the arbitrary terminal device.

[0026] In the specific embodiment above, the method further comprises the step of updating and displaying at least the second information zone as the content examined regarding whether the set of items identified from other received images corresponding to the other type conforms to the display guidelines when there is a user's selection of a type different from the confirmed package type through the control object.

[0027] In one embodiment according to the present invention, the method may further comprise: a step 5 of transmitting to the arbitrary terminal device an input page that enables a request for a change in feedback information to be presented regarding an item identified as not conforming to the display guidelines of a designated inspection standard country or organization when a specific request from a user through one or more pages from the arbitrary terminal device is received; and a step 6 of changing and recording the feedback information regarding the arbitrary item to be used for a subsequent inspection request from a subscriber of a logged-in account to the new text when a request for a change in feedback information regarding the arbitrary item is received through the input page along with a new text. In this case, the change request may further include at least one of a country or organization and a package type as information specifying the target of the change in feedback information, and the step 6 may change and record the feedback information specified for the information specifying the target of the change in the feedback information regarding the arbitrary item to the new text.

[0028] In one embodiment according to the present invention, information about the package type may be received together when the image is received in step 1.

[0029] In another embodiment according to the present invention, the package type may be automatically determined through analysis of the received image. In this automatic type determination, the first type may be determined when a specific item is not included in the set of identified items. The third type may be determined when the specific item is included and the set of essential items identified for another image received from any terminal device other than the image includes a second specific item such as a specific logo. An information display attached to the package of the second type, separate from the package of the second type, corresponds to the third type. The package type may be determined as the first type or the second type through analysis of the characteristics of the edge detected in the image, and may also be determined as the third type based on a comparison of the actual size with another image received from any terminal device other than the image.

[0030] In one embodiment according to the present invention, the first step of receiving an image of a product package may receive multiple different images corresponding to the same package type for a specific package type, particularly a first type.

[0031] According to another aspect of the present invention, an apparatus for inspecting an image of a package regarding mandatory labeling requirements for a product and providing the inspection results online comprises: a database containing labeling guideline information that the respective country has designated as mandatory labeling requirements for the product for each of at least a plurality of countries; and an inspection unit configured to process an image received from a terminal device connected via the communication network to extract a plurality of blocked information from the image, identify which item among the previously designated mandatory labeling items corresponds to each of the extracted plurality of blocked information, inspect whether the set of items identified as the mandatory labeling items conforms to the labeling guidelines for mandatory labeling requirements confirmed by querying the labeling guideline information contained in the database for one or more countries or organizations designated by the terminal device based on the package type confirmed for the image, and create one or more pages containing information on the inspection results and transmit them to the terminal device.

[0032] In the method, apparatus, and embodiments described above according to the present invention, the blocked information is text information extracted from a portion partitioned based on an area where text is displayed in the image, or image information of an area containing a symbol or picture having a change in brightness, enclosed by a margin of a certain width in the image. Effects of the invention

[0033] A method for providing an online inspection of mandatory information on product package artwork according to the present invention described above or at least one embodiment of the present invention described in detail below with the attached drawings enables users to immediately verify whether the markings on the completed artwork comply with the labeling guidelines of the country where the product is to be sold, through the provision of information in a very simple online state. Accordingly, businesses selling products intended for human use can save significant time and costs that were previously unavoidable for inspections performed by human personnel.

[0034] Furthermore, since the release of products with packages that do not comply with the labeling guidelines for mandatory information in the selling country—which may occur due to inspection errors during manual inspections—can be prevented in advance through the automatic rapid online inspection according to the present invention, companies are no longer required to take post-incident measures that incur significant additional costs, such as redesigning artwork containing non-compliant mandatory information items, repurchasing packages, and recalling products. These advantages can also be obtained in an embodiment of the present invention in which precautions are provided regarding the inclusion of phrases indicating the product's function or efficacy on the package. This is because the guidance on precautions confirms whether the use of phrases indicating the product's function or efficacy on the package would jeopardize future sales.

[0035] Furthermore, since the compliance check for mandatory labeling information on the artwork provided online according to the present invention can be conducted based on the latest labeling guidelines for many countries, tasks such as requiring internal personnel to monitor the latest labeling guidelines of various countries serving as sales markets become unnecessary. By eliminating these tasks, corporate costs can be reduced, and more efficient personnel management becomes possible. Brief explanation of the drawing

[0036] FIG. 1 is an example of artwork completed for the packaging of a product, with some of the required information indicated. FIG. 2 is a schematic diagram briefly illustrating the configuration of an overall system to which a method is applied to inspect whether essential information on a package is described in compliance with the labeling guidelines of a designated country and to provide the result, according to one embodiment of the present invention. FIG. 3 is a block diagram showing an example of the configuration of the mandatory item inspection service server of FIG. 2, and FIGS. 4 and 5 respectively illustrate examples of pages presented to a user's terminal device to request data and information necessary for an application for a conformity check of essential descriptions according to an embodiment of the present invention. Figure 6 illustrates a method of registering inspection data provided along with a request to proceed with a conformity check of mandatory entries into a database in the form of a table by linking it to the relevant subscriber. FIG. 7a shows an example of a method for identifying which essential item a block corresponds to, for a block from which text has been extracted, through comparison with classifiers within a pre-prepared set of essential item classifier groups according to an embodiment of the present invention. FIG. 7b illustrates a set of classified logo groups prepared by distinguishing them by required items for use in identifying whether specific required items are included through comparison with a special shape logo displayed on the artwork, according to one embodiment of the present invention. FIG. 7c shows an example in which, according to one embodiment of the present invention, for a specific mandatory item, optional inspection information specifying an inspection to be performed when the item is identified is configured to be linked to the item. FIG. 7d illustrates an option inspection table configured to concentrate and list option inspections that are selectively performed according to conditions, according to an embodiment of the present invention, so as to be applied to a conformity inspection of mandatory entries. 7e is an example of a special classifier group prepared to check whether a phrase indicating the function or efficacy of a product is written in the artwork according to one embodiment of the present invention, and FIG. 8 exemplarily illustrates a learning model for an artificial intelligence module to be used to identify whether essential items are listed in an artwork according to an embodiment of the present invention, and FIG. 9 is an example of a configuration for a table storing the results of a conformity check of essential descriptions for a provided artwork according to an embodiment of the present invention, and FIG. 10 illustrates a layout of display information for a page created to present the results of a conformity check of essential information to a user's terminal device, according to an embodiment of the present invention. FIG. 11a shows an example of the configuration of an inspection country display area included in the layout of FIG. 10 to enable a user to select an inspection standard country according to an embodiment of the present invention. FIG. 11b shows an example of the configuration of a result information area included in the layout of FIG. 10 to clearly present whether each item of the essential description is described on the artwork according to one embodiment of the present invention. FIG. 11c illustrates a method in which a list to be filled in the inspection item column of the result information area of ​​FIG. 11b is determined when multiple countries are selected for inspection according to an embodiment of the present invention. FIG. 11d shows an example of an information surface created to provide guidance on display guidelines for a required item when a user selects a required item that does not conform to the display guidelines, according to an embodiment of the present invention. FIG. 12 is an example of a configuration in which a list of country-specific mandatory items is databased for a conformity check of mandatory items according to an embodiment of the present invention, and FIGS. 13a, 13b, and 13c respectively illustrate configurations of guide information tables prepared to provide necessary information by distinguishing by country when, according to embodiments of the present invention, there are matters lacking in the display guidelines for essential information in the provided artwork, or when there are phrases indicating the function or efficacy of the product. FIGS. 14a and 14b respectively illustrate examples of a portion of the result information section of FIG. 11b, which is created when there are requirements from inspection standard countries regarding phrases indicating the function or efficacy of a product identified from artwork according to embodiments of the present invention, before and after user selection. FIG. 15 is an example of a page that allows feedback information to be freely changed in a user-customized manner when there are deficiencies in the display guidelines for essential information according to an embodiment of the present invention. FIG. 16 illustrates an example of the configuration of an information area included on the page of FIG. 15 so that text indicating the function or efficacy of a product can be customized and edited by the user, according to an embodiment of the present invention. FIG. 17 is a flowchart illustrating a method for automatically identifying what type of package package artwork provided by a user is for based on identified essential entries, according to an embodiment of the present invention. FIG. 18 schematically illustrates a method for automatically identifying what type of package an artwork provided by a user corresponds to based on image characteristics obtained through image analysis of the artwork, according to one embodiment of the present invention. Specific details for implementing the invention

[0037] Hereinafter, various embodiments according to the present invention will be described in detail with reference to the attached drawings.

[0038] In the following description of embodiments according to the present invention and the accompanying drawings, identical numbers refer to the same components unless there are special circumstances. Of course, for the convenience of explanation and to aid understanding, identical components may be assigned different numbers as necessary.

[0039] FIG. 2 is a simplified configuration diagram illustrating the overall system to which a method for providing an online inspection of mandatory information regarding artwork of a product package according to an embodiment of the present invention is applied. The system comprises a mandatory information inspection service server (100) (hereinafter abbreviated as 'inspection server') configured to have structured labeling guidelines for mandatory information of various countries, and to automatically inspect whether the labeling of mandatory information conforms to the user's designated country by extracting text data therefrom when the user provides artwork, and to present the inspection results online so that the user can immediately verify them, and terminal devices (202) each installed in companies, etc. that sell or export products (hereinafter collectively referred to as 'human body products') containing contents that are consumed, drunk, or taken by a person, or applied to the skin or hair, etc. i It is configured to include a terminal device (201) installed in a company operating the inspection server (100) and a public communication network (10) (hereinafter abbreviated as 'communication network') that provides a data path between devices connected by a communication path.

[0040] The above inspection server (100) and the above terminal devices (201, 202 i ) is connected to the communication network (10) and, upon a user's request, can form a connection with the inspection server (100) to perform client-server type data communication with each other.

[0041] FIG. 3 is a block diagram showing an example of the configuration of the inspection server (100), comprising: a communication unit (101) capable of exchanging information with a terminal side based on various communication methods by performing operations according to a hierarchical communication protocol for client-server communication; a database (112) in which display guidelines for mandatory information of many countries and feedback information for providing guidance in cases where the guidelines are not met are structured and stored in respective tables along with information that can be indexed by item, and queries are recorded that specify the fields of each table to be connected and combined according to various specified conditions; an engine (111) (hereinafter referred to as the 'DB engine') that processes requests for inquiry, registration, or update regarding the database, executes the called query by applying authorized parameters, and responds with the result; and a database processing unit (110) (hereinafter abbreviated as 'DB processing unit') configured for a user connecting using their own terminal device It comprises a logon processing unit (102) configured to manage login and registration information, etc., an inspection request processing unit (103) configured to process the input of artwork for a package of human body products and inspection requests, a marking inspection unit (104) that inspects the suitability of essential information on the artwork based on input information including artwork provided by the user, and a service tool unit (105) configured to process a request to change the service provided to the user to suit the user's usage pattern.

[0042] The inspection request processing unit (103), the display item inspection unit (104), and the service tool unit (105) are equipped with the function of requesting necessary information from a user according to an item or condition selected by the user of the connected terminal device, recording the information received according to the request in a corresponding table of the database (112), and querying the database if necessary.

[0043] FIG. 3 is a block diagram in which the components of the inspection server (100) are classified by function for the purpose of providing a specific explanation of the technical concept and principle of the present invention. The components whose operation is described individually and specifically below may be configured such that two or more components are integrated with each other or the inspection server (100) is configured in a more subdivided form, unlike the configuration exemplified in FIG. 3.

[0044] Additionally, the inspection server (100) of FIG. 3 may be a configuration applicable to some of the various embodiments of the present invention. Therefore, in other embodiments of the present invention, the inspection server may be configured to additionally include other components in addition to these components, for example, components that perform operations such as processing payment of costs required for applying for inspection of mandatory information for a logged-in user, in addition to operations for services provided online by the inspection server (100) to a user as described below, components that perform operations such as obtaining information on display guidelines for mandatory information of each country, or components that perform operations such as processing the listing of an information table structured to enable indexing of display guidelines for mandatory information of a specific country entered by the operator of the inspection server (100), or providing status information on the status of a request for inspection of mandatory information and the provision of results.

[0045] In addition, the inspection server (100) that performs the method of providing an online inspection of essential descriptions for the artwork of a product package according to the present invention is configured to further include physical components not shown in FIG. 3, such as an input unit for an operator to input information, a display unit for displaying the input information, etc. However, since the configuration and operation of these components can be intuitively understood only by mentioning them in the specification or describing their operation, they are omitted from the block diagram of FIG. 3 for the sake of simplification of the drawings.

[0046] And, although the block diagram of FIG. 3 shows that the inspection server is configured as a single server so that each of the aforementioned components (102, 103, 104, 105, 110) are connected to each other via an internal bus and share the communication unit (101) connected to the bus, the inspection server described in the present invention may be configured as one or more independent servers that communicate with each other via a local network using the communication unit (101) provided by each of at least some of the exemplified components (102, 103, 104, 105, 110).

[0047] Meanwhile, the tables and queries recorded in the aforementioned database (112) may be input through the input unit. Alternatively, they may be provided by a service operation manager who accessed the inspection server (100) with operator authority through the logon processing unit (102) by uploading them from their terminal device (201).

[0048] Hereinafter, various embodiments of a method for providing an online inspection of essential information regarding artwork of a product package according to the present invention will be described in detail.

[0049] First, an employee belonging to a business operator who intends to sell human body products (hereinafter referred to as 'user' from the perspective of the inspection server (100) above) has a terminal device such as a PC (202 k By using ), you connect to the inspection server (100) and use the service provided by the server (100).

[0050] User terminal device (202 k A connection request from ) is transmitted to the inspection server (100) via the communication network (10), and this connection request is received by the logon processing unit (102) through the communication unit (101), and the logon processing unit (102) responds to the connection request to the terminal device (202 k A session is opened by forming a logical connection with ). The operation of opening the session and maintaining the continuity of the opened session is performed by the communication unit (101), and the opened session is linked with the logon processing unit (102) through specific correlation information, for example, a socket.

[0051] The above communication unit (101) is a user's terminal device (202 k For a request received from ), based on information included in the request information, such as a URL, port number, host address, or session information, one of the logon processing unit (102), the inspection request processing unit (103), the display item inspection unit (104), and the service tool unit (105) is selected and transmitted.

[0052] Then, the logon processing unit (102) configures an information document (hereinafter referred to as a 'page') written in a specific language (e.g., HTML: HyperText Markup Language) according to a specific communication protocol, e.g., HTTP, and requests the communication unit (101) to the terminal device (202 kIt causes it to be transmitted to ). Through this process, the page first transmitted to the connected terminal device is referred to as the 'home page'. Its own terminal device (202 k A user who checks the received home page through an application such as a browser running on the homepage enters user information that has already been registered into a login block configured on the home page, or selects a control object representing a registration request to make a registration request.

[0053] As used in this specification, the term "control object" encompasses display objects of a specific form and function that, on a page displayed by a browser based on a specific communication protocol, execute a predetermined specific action or request designated information from a remote location upon selection, such as items expressed in the form of hypertext, command buttons, combo boxes, checkboxes, option groups, or list boxes, as well as scripts that execute predetermined commands using the computing resources of a terminal device upon selection of said display object.

[0054] The above logon processing unit (102) is connected to the terminal device (202) of the user kIn addition to the user's login block and control objects related to the application for registration, the above-mentioned home page transmitted to the inspection server (100) may also include, as a service menu, control objects for service items designated by the inspection server (100) by classifying them by service type or product type, services that inspect the conformity of mandatory labeling information on packages of products for human use (the entire set of these services provided by the inspection server (100) is referred to as 'mandatory labeling inspection services'). Furthermore, each service item may additionally include another control object, such as a service detailed item in the form of a list box (hereinafter referred to as a 'sub-item' if necessary).

[0055] When a sign-up application is received according to the user's selection of the transmitted home page, the above logon processing unit (102) inputs the basic information required for sign-up on the terminal device (202 k It is transmitted to ) so that the user can input information regarding the items. After the user has entered all the information required for the subscription to the mandatory item display inspection service (account name, password, business name, business address, person in charge name, person in charge email, etc.) through the input items of one or more input pages and requests the registration of subscription information, the logon processing unit (102) separates the information of each input item entered by field and provides it to the DB engine (111), thereby requesting the new registration of the subscriber. Accordingly, the DB engine (111) separates the transmitted information by input item and registers a record of a new subscriber by recording it in each corresponding field of one or more tables related to the subscriber in the database (112).

[0056] In the following, information regarding various types of input items, which are described exemplarily for the specific explanation of the method of providing an online inspection of essential information for the artwork of the product package of the present invention, is also recorded in the database (112) in the manner described above, and if necessary, related information is linked to each other as link information.

[0057] As described above, when the registration procedure of a company wishing to use the mandatory information display inspection service is completed by requiring the input of information necessary for registration and registering the received input information in the respective tables of the database (112), the logon processing unit (102) displays a registration completion guide page to the terminal device (202 k By transmitting to ), the connected user is notified of the completion of registration.

[0058] The above terminal device (202) that received the notification of completion of registration k A user of ) logs into the inspection server (100) by entering the account name and password specified at the time of registration into the login block. Of course, in the case of a user who has already completed the aforementioned registration process and is registered with the mandatory information display inspection service, the user logs into the inspection server (100) by entering the account name of the registered subscriber without the aforementioned registration process.

[0059] When a user logs in, the logon processing unit (102) includes all information identified regarding the connection with the currently connected terminal device (e.g., login information, IP address, session information, etc.) and, if necessary, user unique identification information based on the account name used for login (hereinafter referred to as 'subscriber identification information'), and records it as client information in a pre-agreed format with other components (103, 104) so ​​that it can be shared with those components.

[0060] When the login state is established, the terminal device (202k The user of ) selects the desired service item from the control objects of the service items included as service menus on the home page.

[0061] The mandatory item display inspection service provided by the inspection server (100) may include various service items and sub-items, and the user's use of the mandatory item display inspection service is made by selecting this service or sub-item presented on the homepage. Naturally, the user's selection is made arbitrarily regarding the various services provided by the inspection server (100). However, for the convenience of providing a specific and exemplary explanation of the basic principles and technical ideas of the present invention, it is assumed that the user's selection regarding the mandatory item display inspection service is made in the order described below.

[0062] According to this assumption, the terminal device (202 k The user of the service selects a service item that allows them to apply for a conformity test of the required information displayed on the artwork for the package designed for the production of the package for human use products. The application resulting from the selection of this service item is transmitted to the inspection server (100) via the communication network (10) and is then transmitted to the inspection request processing unit (103) by the communication unit (101).

[0063] When this inspection application is transmitted from the communication unit (101), the inspection request processing unit (103) creates a page requesting the input of data and information necessary for the application for a conformity inspection of essential information, and the connected user's terminal device (202 k By transmitting to ), it enables the user to input materials and information necessary for the application through that page.

[0064] FIG. 4 shows an example of a page requesting the provision of data and information configured according to an embodiment of the present invention. An example is a page (40) requesting the input of an artwork file of a product package as data and information, and this example page (40) may be a page created and presented by an inspection request processing unit (103) that receives the selection from a communication unit (101) when a specific control object is selected by a user on the previously presented page requesting the provision of data and information.

[0065] The illustrated artwork file request page (40) is configured to include input blocks (41, 42) for requesting artwork for a primary package and a secondary package, and each input block includes an image object (411) that exemplarily shows the package type (primary, secondary, tertiary, etc.) of the artwork to be entered, and a control object (412) that enables the uploading of the corresponding artwork file. In this specification, the primary package refers to a container, etc., for directly accommodating the contents of a human body product, and the secondary package refers to a box, etc., for accommodating the primary package. In each input block, upon selection by the user, a terminal device (202 k A button object (413) is also included that provides a dialog box to enable uploading a file stored in ).

[0066] The page (40) illustrated in the drawing presents only the components essential for describing an embodiment according to the present invention, and it is obvious that in addition to these described components, general components such as buttons or hypertext for processing user input or presenting necessary information through the page displayed on the terminal device may also be included. The same applies to other pages described below.

[0067] When the user drags a package artwork file and places it on the control object (412) presented for the corresponding package type, or selects a button object (413) to select an artwork file of the corresponding package type from the dialog box, a script associated with the object is executed and the artwork file is transmitted to the inspection server (100).

[0068] FIG. 4 presents a page for uploading artwork files for a primary package, such as a container, and a secondary package, such as a box, but may also present a page that includes an input block for a tertiary package that allows additional packages to be uploaded in the same way. A tertiary package refers to a separate information display material, such as a card, tag, box, or insert that can reduce its area through folding, which is included inside the secondary package, attached or bound to the outside, or attached to the secondary package in a way that wraps the secondary package.

[0069] In another embodiment according to the present invention, the inspection request processing unit (103) creates an artwork file request page so that the type of package to be uploaded is not definitively specified by a control object selected on the page, and the user’s terminal device (202) uploads an artwork file. k It may also be presented in ). FIG. 5 illustrates an artwork file request page (50) presented according to the present embodiment.

[0070] The artwork file request page (50) according to the present embodiment is created to include control objects (51, 52) that enable artwork file uploading and an upload display block (53) that displays the uploaded artwork file. The upload display block (53) includes, for each uploaded artwork file, an image area (531) that displays the image and an option control object (532) that enables displaying or specifying what type of package the image belongs to.

[0071] The above inspection request processing unit (103), upon receiving an artwork file provided via an upload method through the selection of an upload control object (51 or 52) of the above artwork file request page (50), extracts text from the image, automatically determines what type of package the image belongs to based on the extracted text and the shape of the image, and reconstructs the artwork request page by reflecting the information about the determined type in the type option control object (532) (532a) to the terminal device (202 k It is provided again to ). The example in FIG. 5 is a page showing the result when a user uploads a single artwork file. Specific methods for determining the type of package from the image of the received artwork by the inspection request processing unit (103) will be described later.

[0072] If the package type automatically determined by the inspection server (100) is incorrect, the user can change the corresponding type by bringing a pointing means, such as a mouse, close to the option control object (532) or by performing a special action, such as a click or double-click (hereinafter referred to as a “selection action”). In this way, when the user specifies a different package type, the information of that type is transmitted to the inspection request processing unit (103), and the package type determined for the previously received artwork image is modified.

[0073] Meanwhile, the aforementioned artwork file request pages (40, 50) may be configured to include text that provides guidance to the user regarding the artwork file to be uploaded, and such guidance text may include restrictions on the image format, size, etc. of the artwork file, and precautions for uploading.

[0074] In addition, the page requesting materials and information presented when applying for a conformity test of mandatory information may include pages requesting other types of information in addition to the artwork file request page (40, 50) described above. Such pages may include a page that allows input of information about the product, for example, the product name or type of product, or a page that allows input of information about each component contained in the contents of the product, i.e., full ingredient information.

[0075] User's terminal device (202 k When the user completes the input of all information required for the conformity check of the required information through the material and information request page including the artwork file upload page (40, 50) presented in the document, the user selects the control object for the inspection execution presented on the page and requests the inspection to proceed.

[0076] The selection of the control object for the above inspection execution is such that all information entered for the corresponding data and information request page is transmitted to the inspection server (100) via the communication network (10) in the form of a frame, and the communication unit (101) of the inspection server (100) transmits all information transported by the frame to the inspection request processing unit (103) by referring to the session and socket information for the received frame. When a user uploads an artwork file, the file to be uploaded is transmitted to the inspection server (100) in advance at the time when the file is placed on the control object (412, 51) or at the time when it is selected in the dialog box after selecting the button object (413, 52), and the inspection request processing unit (103) may temporarily store it by linking it to the client information of the currently connected user.

[0077] terminal device (202 k When all user input information regarding the data and information request page presented in ) is received, the inspection request processing unit (103) creates a receipt confirmation page indicating that an inspection has been requested and the terminal device (202 k While transmitting the received information (in the embodiment according to FIG. 5, package type information that is automatically determined or changed by the user is also included) to the DB engine (111) to request registration in the database (112). At this time, subscriber identification information is verified from client information regarding the current connection and transmitted as a parameter of the registration request.

[0078] When there is a request to register in the database, the database engine (111) registers the information transmitted by the request as a new record (610) in the inspection request table (60) as exemplified in FIG. 6, and connects the record (610) to the profile (600) of the corresponding subscriber stored in the database (112).

[0079] In the example of FIG. 6, the ID (611) of a record registered in the inspection request table (60) may be composed of a main number and a sub number, which are the identification information of the subscriber. In this case, it shows that the record ID is connected (602) to the corresponding subscriber for whom the notation conformity inspection was requested by the main number of the record ID.

[0080] Each record of the inspection request table (60) is configured to include, as illustrated in the drawing, a record ID (611), a date and time of listing, an associated product name, an artwork information field (612) for each package, and an index (613) for the record in the inspection result table on the database (112) in which the inspection result is structured and stored. In addition to these table fields, the inspection request table may be configured to include additional fields for information provided by the user through the data and information request page.

[0081] In the artwork information field (612), according to the user's upload request as described above, the terminal device (202 k Image files for one or more artworks received from ) are stored in a folder determined according to a predetermined method in a designated separate storage device (this device may be an internal device mounted inside the inspection server (100) and communicating via an internal bus, or a separate device connected to the inspection server (100) so as to be able to communicate via a local network), and are configured to include a storage location field for recording a URL that specifies the stored path and access method, and a type field for recording the package type of the artwork image.

[0082] FIGS. 4 to 6 and the related descriptions presented for the example of embodiments according to the present invention are based on the premise that the artwork image uploaded for a single product is a single one for a single package type. However, the concept and technical idea of ​​the present invention can naturally be applied to embodiments where multiple artwork images of a specific package type, particularly a primary package, are uploaded for a single product. That is, in the embodiment illustrated with reference to FIG. 4, the user can upload multiple artwork images of the primary package by using a control object for uploading the primary package multiple times, and in the embodiment of FIG. 5, the user can upload multiple artwork images of the primary package by using a control object for uploading the artwork image multiple times. In this case, multiple sub-records for artwork images of the primary package type are listed in the record for a single product of the inspection request table (60) configured as illustrated in FIG. 6.

[0083] Meanwhile, the inspection request processing unit (103), in response to a request to register inspection request information, when the completion of registration is notified from the DB engine (111) along with the ID of the registered record, the terminal device (202) currently connected to the display item inspection unit (104) along with the ID of the record k Request a transfer of the connection with ). This transfer of the connection may be made when a special control object is selected on the receipt confirmation page presented to the connected terminal device.

[0084] When this transfer request is received, the above-mentioned indicator inspection unit (104) checks the current terminal device (202 kBy referencing client information regarding the connection with ), the connection is reset, thereby maintaining the continuity of client-server communication with the terminal device. At the same time, while transmitting the ID of the record received from the inspection request processing unit (103) to the DB engine (111), a query of the information listed in the record is requested to begin the suitability inspection of the required entries, and the information is received to proceed with the next basic inspection for the suitability inspection.

[0085] The above-mentioned display inspection unit (104) reads the corresponding file from the storage device using the URL value of each artwork storage location field in the received record information, stores it in local memory, and then processes the image of the file to extract a series of text. In the image processing for extracting text from the image, the angle of the image is corrected, character writing blocks are partitioned based on the long margin between the character writing areas on the image, and an optical character recognition algorithm is applied to each partitioned block to extract text for the corresponding character writing block, that is, words of the blocked area. At this time, the size of the image block from which the text was extracted is linked to the text, or the size of the area corresponding to each word is linked to the word and recorded. In this extraction process, each word is separated from the extracted text based on the fact that there is a margin of a certain width between the blocks of the text.

[0086] In one embodiment according to the present invention, during the image processing process, an image of an area expected to correspond to a symbol or picture, etc. (hereinafter referred to as a 'logo') that meets the set requirements (hereinafter referred to as a 'blocked logo') is also extracted. The requirements set for extracting the blocked logo may be a roughly square shape with a square border or surrounded by a margin of a certain width, and having a change in brightness that is not extracted as text.

[0087] When block information, namely block words and block logos, is extracted from an image in this way, the extracted block information is identified as corresponding to each required entry. First, a method for identifying whether the block words (hereinafter referred to as the 'block character set') correspond to required entries is described. FIG. 7a schematically illustrates one method according to an embodiment of the present invention regarding this identification process.

[0088] For the extracted block character sets, one by one, a selected block character set (71 i For , i=1,2,..), the above-mentioned indication inspection unit (104) determines the corresponding required entry item (73) by performing a comparison inspection (70) using a classifier group set (72) that has been read in advance from the above-mentioned database (112) and prepared. The method of performing a comparison inspection using the classifier group set (72) is as follows.

[0089] The above-mentioned indicator inspection unit (104) checks each classifier group (72) in a predetermined order from the classifier group set (72). i While selecting each of the , i=1,2,3,..), the block character set (71) currently identified as the target i In ), search for classification criteria words within the selected classification group. In this search, if one or more classification criteria words are matched, the number of matches is the item information (721) of the corresponding classification group. i It is temporarily recorded along with , i=1,2,3,..), and after comparing and checking all classifier groups in this way, the item information with the largest number of matches is determined as the identified required entry.

[0090] In another embodiment according to the present invention, hit scores may be assigned to classification criteria words designated for each classification word group, and a determination may be made based on the total hit score obtained by adding the hit score assigned to that classification criteria word whenever a matching word is found. Additionally, even if the words do not completely match, the similarity of the words may be reflected in the hit score. For example, if a hit score partially matches the classification criteria word assigned as hW1, a value (=δ·hW1) obtained by multiplying the hit score by the similarity (δ) calculated for the partial match may be assigned as the hit score. Here, the similarity may be determined as the ratio of the number of characters of the classification criteria word to the number of characters of the number of characters that need to be added, deleted, or replaced for the two words being compared to match.

[0091] In one embodiment according to the present invention, for specific mandatory entries, instead of using a comparison with classification standard words, whether a word included in the corresponding block character set corresponds to the entry may be identified based on the size of the word area from which the word is extracted and the characteristics of the character part. For example, when identifying whether a mandatory entry corresponds to a product name entry, the size of the area from which an arbitrary word included in the block character set is extracted is larger than a certain magnification than the size of the area from which a word included in another block character set is extracted, and the thickness of the line corresponding to the stroke of the character, identified by the number of pixels, is greater than a certain multiple than the thickness of the line corresponding to the stroke of the character included in another block character set. If these conditions are satisfied, it may be determined that the mandatory entry for the product name has been identified from the artwork image. The same method may be applied to other mandatory entries, for example, product function entries indicating the identity or use of the product, and for these entries, a method of verifying classification standard words within a classifier group in the corresponding block character set may also be used in combination.

[0092] As explained above, when the area corresponding to the logo, that is, the blocked logo, is extracted from the artwork image, the image characteristics of the block are, for the identification of the required information, some of the required information items (741 as exemplified in FIG. 7b). i , i=1,2,3,..) each group of the pre-prepared classification logo group set (74) classification standard logo (742 ij The corresponding required items are determined by comparing with each characteristic of , i=1,..N, j=1,..). To calculate the degree of image similarity between the logos being compared, any one of the known Mean Squared Error (MSE), Maximum Signal-to-Noise Ratio (PSNR), or Structural Similarity (SSIM) methods, or a combination thereof, may be used.

[0093] In one embodiment according to the present invention, for a character description block from which a block character set identified as a specific essential description item has been extracted, the character characteristics of the block can be further analyzed. In this embodiment, as illustrated in FIG. 7c, an optional inspection information (722) is included in a classifier group prepared for identifying essential description items requiring such additional analysis. This optional inspection information (722) is configured to include an information field (722a) that specifies the conditions under which the inspection is performed and an information field (722b) that specifies the content of the inspection.

[0094] In an embodiment where a classifier group is designated and applied as exemplified in FIG. 7c, when a record item of the responsible person information is identified during the identification process for the essential records described above, the label inspection unit (104) [indicates] the corresponding classifier group (721 kAfter confirming that option inspection information (722) is attached to ), according to the specified condition (722a), when the inspection standard country to be inspected is selected as ‘European Union’, according to the specified inspection content, the text format of the corresponding text block is checked to see if it is underlined and bolded.

[0095] Whether the text format is bold can be verified by comparing it with other required entries, such as the full ingredient item, in the text block where the text is identified. For example, this can be verified by checking whether the number of pixels constituting the width of the part corresponding to the stroke of the character is relatively greater than the stroke of the character in the block being compared. Whether it is underlined can be determined by checking whether there is a series of thin pixels extending several times longer than the width of the character within the text block where the required entry is identified.

[0096] Depending on the specified inspection criteria, it may be possible to check whether the character style is italicized. Whether a character is italicized can be identified by whether the vertical strokes in the character are relatively slanted compared to the strokes in other characters.

[0097] Various values ​​different from those exemplified may be assigned and used in the information fields (722a, 722b) of the option inspection information (722). For example, by not assigning any value to the condition information field (722a), when the required entry item specified in the corresponding classifier group is identified, an inspection to verify the value assigned in the content information field (722b) may be performed unconditionally. The inspection content may be specified as a specific unit, such as a value or range, for the size of the characters or the area of ​​the display surface. In the inspection to verify the content assigned as such a value or range, the display item inspection unit (104) utilizes a numerical value for converting between the preset specific unit and the number of pixels, and the resolution characteristics of the uploaded image that is the target of identification for the required entry item. In the case of the area of ​​the display surface, it may be calculated from the number of pixels included in the area formed by the four vertices on the outermost line obtained by edge detection in the image.

[0098] In one embodiment according to the present invention, the option inspection information is specified regardless of whether specific mandatory entries are identified, thereby allowing an additional inspection of the display status of the content displayed on the artwork to be performed when the specified conditions are satisfied. FIG. 7d shows an example of an option inspection table (730) that lists the option inspection items applied in the inspection of the display of entries on an artwork image of any product package, which can be applied in this embodiment. The option inspection information (722) exemplified in FIG. 7c may be listed as a single record in the table of FIG. 7d. In this case, the detection of mandatory entries for 'person in charge information' is additionally specified in the condition of the record.

[0099] In the option inspection table (730) configured according to the present embodiment, conditions that enable additional inspection based on specified inspection content may be specified by various variables. For example, as illustrated, conditions may be specified for the type of product to which the artwork image is applied (7311), the detected component (7312), the content of the component (7313), and the detected phrase (7314). In the conditions of the present embodiment, the country may not be specified (733). In this case, the satisfaction of other conditions of the record is verified for all inspection standard countries, and the identification of mandatory entries may also be imposed as a condition of the record. In addition to these, when there is an item that can be detected from the content displayed on the artwork image and additional matters that must be bound by the display guidelines for mandatory entries arise dependent on that item, this can be registered as a single record in the option inspection table (730) and applied so that it is selectively executed for the conformity inspection of mandatory entries.

[0100] Whether a product corresponds to a specific type can be identified by checking whether there are specific words or phrases that identify the type of product (e.g., 'lipstick', 'lip liner', 'lip gloss', 'lip balm', etc. in the case of lip products) in the previously extracted block character sets, and whether a specific ingredient is included can be determined by checking whether there is a matching ingredient name within the corresponding block character set when the required item for 'all ingredients' is identified, and as for the content ratio, as explained above, it can be checked through a list of all ingredients in a specific file format provided by the user via a page that requests information other than the artwork file.

[0101] Regarding the content of the option inspection performed when the condition is satisfied, in the example of FIG. 7d, only detection with a specific logo as target information is specified (732), but as shown in FIG. 7c, detection with a specific text of a predetermined specific content as target information, as well as whether to write according to a specific format of the characters, can be specified. As previously explained, whether to detect a specific logo can be determined through a specific comparison with the block-shaped logos extracted from the artwork image.

[0102] The inspection based on the aforementioned option inspection information (722, 730) may be performed in the main inspection conducted after the basic inspection identifying whether the required entry items are entered is completed.

[0103] In another embodiment according to the present invention, a learned artificial intelligence module may be applied to the identification of entries for each block character set. The artificial intelligence module applied therein is a learning model (81) composed of many different text areas that are displayed and used on or are likely to be used on the labels of various products, as exemplified in FIG. 8, and essential entries corresponding to the text areas. i It may be a module that has been pre-trained through , i=1,2,..,L). And, the learning model used for such learning includes not only a text area consisting of text, but also an image area (811) containing a logo that is commonly used for human body products instead of text. L_1 ) may also be used. In addition, for specific required items, such as product name (813), barcode, QR code, etc., the artificial intelligence module (80) may be trained using a learning model of various image forms in which the product name is displayed rather than in text format.

[0104] In another embodiment according to the present invention, identification of essential information using an artificial intelligence module (80) learned as described above and identification based on a pre-prepared classifier group set (72) / classifier logo group set (74) may be combined.

[0105] In one embodiment according to the present invention, in addition to the mandatory information required for human body products, the presence of special phrases indicating the function or efficacy of a product (hereinafter referred to as "marketing phrases") displayed on a package by a seller, etc. to promote product sales is also identified. In this embodiment, for this purpose, marketing phrases that are likely to be used by a seller, etc. for human body products are also included as a single classifier group and are used for comparison with the block character set described above, or are pre-trained in an artificial intelligence module to be used for identifying mandatory information.

[0106] Figure 7e illustrates a portion of the phrases that are pre-recorded or trained to identify whether marketing phrases are included.

[0107] When the identification of each item of the required information from each artwork image (6211, 6212) currently requested for inspection is completed according to the method of the aforementioned embodiment, the above-described indication inspection unit (104) creates an entry to be registered as a result record (911, 912) in the inspection result table (90), configured as exemplified in FIG. 9, based on the result. Each entry to be registered in the table has a record ID (911) that allows for unique identification in the corresponding table. i In addition to , i=1,2), it includes fields of index information (9121, 9122) indicating a specific artwork image entry (6211, 6212) of a test request record of a test request table (60) from which a test result listed in the corresponding entry is obtained, and fields (92) that record whether there is an identification result for the required items (93) belonging to the required entries.

[0108] In the embodiment described above with reference to FIG. 7c, in which an additional inspection is performed on the identified required entry based on option inspection information (722), the inspection result table (90) exemplified in FIG. 9 is configured to naturally include an option field that records the result of the option inspection in a form connected to the associated required item. Therefore, in this embodiment, the option inspection result is also included in the entry being created.

[0109] In addition, according to one embodiment of the present invention described above, when identifying whether a marketing phrase is included, the inspection result table (90) further includes a field (94) for recording one or more identified marketing phrases, and the display item inspection unit (104), when a marketing phrase is identified from an artwork image, includes the identified marketing phrase in the entry currently being written so that the identified marketing phrase is recorded as is in the corresponding field (941), unlike other required entries that record information regarding whether the phrase is included.

[0110] When the entry to be newly registered in the inspection result table (90) is completed, the above-mentioned inspection unit (104) transmits the created entry, which consists of a set of each field and field value, to the above-mentioned database processing unit (110), and additionally records new records (911, 912) consisting of the current inspection result values ​​(hereinafter, any value recorded for each field determined on the table is referred to as a 'field value') in the inspection result table (90), and also requests that the record ID of the new record be recorded in the inspection result index field of each registration entry (6211, 6212) of the inspection request record on the inspection request table (60) where the basic inspection was performed (p61), thereby connecting the mutually related records on different tables (60, 90).

[0111] Along with this, an inspection console page (1000) is created having a layout on the screen as exemplified in FIG. 10, in which key information is displayed in areas (hereinafter referred to as 'zones') so that the user can view the field values ​​of records newly registered in the inspection result table (90), that is, the current inspection result information, through the screen, and a page filled with result information corresponding to each zone (1010, 1020, 1030) separated from each other by the layout is connected to the user's terminal device (202 k Sends to ).

[0112] The sections containing key information include an inspection reference country display section (1030) where the reference country of the marking guidelines used or to be used for inspection is displayed / selected, a package image section (1010) showing an image of the artwork to be inspected, and a result guide section (1020) showing the results of the conformity inspection of the required information regarding the content marked on the artwork. Depending on the embodiment, an information section displaying additional information may be further included in the inspection console page (1000).

[0113] The conformity marking guidelines for mandatory information that form the basis of the inspection according to the present invention may not necessarily be designated by a country. For example, they may be designated by a specific public institution, organization, or commercial organization. Therefore, the inspection standard country marking area (1030) may be presented including a control entity that indicates / selects a specific organization, not just a country. To this end, the marking guidelines for mandatory information set by such non-national organizations for human body products are also pre-recorded in the database (112) and used for inspection, just as they are for any country.

[0114] Furthermore, when the term "state" is used in the following explanation regarding the progress of inspections or changes to information listed in the database, if the content is to be applied mutatis mutandis even when it concerns non-state entities, the term "state" should be understood as being used to encompass the meaning of "entity."

[0115] The above package image area (1010) may be configured to include an image display area (1011) in which an image is displayed, a type display area (1012) in which the displayed image is for a certain type of package and can be selected, and a control object area (1013) in which a request can be made to enlarge or reduce the artwork image presented in the image display area (1011).

[0116] When creating an inspection console page (1000) configured with a structure as exemplified in FIG. 10, the page is created based on the first artwork image in the order listed among the artwork images for which the basic inspection has been completed, and the terminal device (202 k Provided to ). Accordingly, the first artwork image is displayed in the image display area (1011), and the package type corresponding to the first artwork image is displayed in the type display area (1012). If the user selects a different package type through the control object presented in the type display area (1012), the display item inspection unit (104) obtains information including the image and basic inspection result recorded for the selected package type from the database (112), and uses this to rewrite the inspection console page (1000) and the terminal device (202 k It will be provided to ), and for the test described below, the newly acquired baseline test results will be used.

[0117] Next, the user selects a country where they want to conduct a primary inspection of the required information in the inspection standard country display area (1030) of the presented inspection console page (1000). The inspection standard country display area (1030) where the user can select a country may be configured as exemplified in FIG. 11a.

[0118] Each country control entity (1031) of the above inspection standard country display area (1030) k Regarding ), when a user makes a selection through a pointing means, the fact of the selection is transmitted to the above-mentioned display inspection unit (104), and the display inspection unit (104) creates an inspection console page that has been changed (1032) with a control object (1033) indicating that the country has been selected, and the terminal device (202 k By providing it again to ), it allows the user to know that the country where the main inspection is desired has been selected.

[0119] In one embodiment according to the present invention, the connected user's terminal device (202 k When transmitting the above inspection console page (1000) to ), for a previously designated major country, it may be transmitted by including a control object indicating that the country has been selected.

[0120] For one or more countries selected by the user, or for a country presented as selected when the page is first provided, a main inspection is first performed to verify whether the results of the basic inspection conducted earlier comply with the guidelines for the mandatory information of the country, and then the results of the main inspection are also included in the inspection console page (1000) as described below and transmitted.

[0121] In this main inspection, information from the mandatory entry guideline table (1200), which is pre-recorded in the database (112) and written in a structure as exemplified in FIG. 12, is referenced. The marking inspection unit (104) provides the country information of the currently selected state to the DB engine (111), requests the provision of information recorded in the guideline information record of the corresponding country, stores it in local memory, and then the verification field values ​​(92) for each mandatory item recorded for the artwork displayed in the image display area (1011) where the corresponding package type is indicated in the current type display area (1012) on the inspection result table (90) are the guideline information record (1210) of each country stored in local memory. ij It checks whether the guidelines specified in , i=1,2,3,4,.., j=1,2) are satisfied. That is, the guideline information record (1210) of the relevant country k1 ,1210 k2 For all items specified as required for the corresponding package type in ), check whether they are recorded as field values ​​indicating identification of the entry in the basic inspection result records (911, 912) for the corresponding artwork image.

[0122] And, the inspection console page created to match the result guide area (1020) of the inspection console page (1000) exemplified in FIG. 10, with the result of the main inspection thus confirmed, is used on the user's terminal device (202 k The result guidance section (1020) created in this way may have a format as exemplified in FIG. 11b and may be configured to include a notification information section (1021) showing the reason why the entry is insufficient for the required essential requirements for the package type and the number of items, an inspection item section (1022) showing the essential entry items for which the entry status has been verified, and a status notification section (1023) showing the status of the results verified for each essential entry item.

[0123] The above-mentioned labeling inspection unit (104), when creating the inspection item column (1022) for the result guidance area (1020), lists only the items that are designated as mandatory entries for the corresponding package type in the country where the main inspection is currently being conducted, and fills in the status notification column (1023) as the reason why those items are not in accordance with the labeling guidelines.

[0124] The example in FIG. 11b is for a case where the manufacturing number item is not identified from the artwork image, and unlike the case of omission where any required item is not identified, in the case where it is identified as being listed but does not comply with the display guidelines, it is indicated in the status notification section for the item with a different status value (1025a), and the number can also be indicated in the notification information section (1021) for a reason different from the omission (1025b).

[0125] In cases where there are multiple countries for which a primary inspection is requested, an inspection item column (1022) is created as a union (1110) of sets (1101, 1102) of items designated as mandatory entries for the corresponding package type in each of the multiple countries, as exemplified in FIG. 11c. In this case, if any mandatory entry that has not been confirmed is a mandatory entry for the corresponding package type in only some of the multiple countries, a phrase distinct from a phrase (1023a) such as 'unconfirmed' indicating that the entry has not been confirmed in the artwork image, such as an expression (1121) such as 'unconfirmed (partially non-conforming)', is used to indicate that the user can know that the current unconfirmed state does not comply with the indication guidelines in only some countries.

[0126] In another embodiment according to the present invention, the inspection item field (1022) may be filled with all items designated as mandatory entries in most countries, or all items designated as mandatory entries for the package type displayed in the current type display area (1012). In this embodiment, for listed items that are not designated as mandatory entries for all package types or for the currently displayed package type in the country currently conducting the main inspection, a word or phrase indicating that it does not apply to the countries designated for inspection is displayed in the corresponding status notification field.

[0127] In the inspection console page (1000) in which the results of the main inspection are displayed in the result guidance area (1020), if the user confirms that there are items that have not been verified in the notification information section (1021) and selects an object (1024) that displays a phrase indicating a fact that is deficient in the display guidelines, the above-mentioned display item inspection unit (104) rewrites the inspection console page (1000) so that a sub-information section containing information on the guidelines set by the inspection standard country for the corresponding package type for the corresponding mandatory entry item is included in a format unfolded below the item, thereby [replacing] the user's terminal device (202 k FIG. 11d exemplarily shows a part of a result guidance area (1020) in which a sub-information column (1027) containing guidance information is presented in this manner.

[0128] In the sub-information section (1027') for providing information about the guidelines, the name of the country to which the guidance applies may be displayed together.

[0129] When multiple countries are designated for the main inspection, regarding mandatory items that are not included in the display guidelines for the corresponding package type in some countries, such as omission of information in the artwork, the sub-information field presented when the user makes a selection action provides a brief explanation indicating that there is no violation of the guidelines, along with the name of the country, even for countries that are not considered to be lacking, as exemplified in FIG. 11d (1028).

[0130] When the indication of the required entry item is not confirmed from the artwork image, in order to present an explanation of the item according to the user's selection action as described above, the database (112) contains a table of country-specific guide information that can be provided to the user when the required entry item is omitted.

[0131] When there is a selection action for any unidentified required item, the above-mentioned display inspection unit (104) transmits the country information where the main inspection was conducted to the above-mentioned DB engine (111) to request a lookup of necessary guide information. In response to the request, the above-mentioned DB engine (111) reads the field value of the field corresponding to the requested item and the requested country from the country-specific guide information table stored in the database (112) and provides it to the display inspection unit (104). The display inspection unit (104) presents this provided information in the form of a sub-information column expanded below the required item where the user's selection action took place.

[0132] FIG. 13a shows a very small number of fields (1301) for an example of a country-specific guide information table (1300) configured according to an embodiment of the present invention. iFeedback information is provided only for , i=..,k-1,k,k+1,..), and feedback information for other fields not exemplified is also written in the same manner as the feedback information for the exemplified fields, explaining the guidelines required by the country for the relevant mandatory entries and, if necessary, including examples of exemplary notation.

[0133] And, each field (1310 nm ) is composed of one or more subfields of feedback information and a subfield specifying the package type to which the feedback information is applied. In the example of FIG. 13a, regarding the package type to which the feedback information is applied, field values ​​of '1st', '2nd', and 'common' applied to both the 1st and 2nd are exemplified, but a field value of '3rd' that can be applied to package artwork such as inserts, and corresponding feedback information can naturally be recorded as the field value.

[0134] Additionally, in an embodiment where an optional inspection is performed on one or more mandatory entries during the main inspection, as exemplified in FIG. 13b, a country-specific guide information table (1300') contains a field (1302) in which feedback information is recorded when a missing display time is identified during the optional inspection. i It is composed including , i=..,j,j+1,..), and for the required entries and the corresponding fields regarding countries for which the option check must be performed, content guiding the resolution of deficiencies is recorded in advance as a field value (1303 i , i=..,m,n,..).

[0135] In the aforementioned embodiment of the present invention, which identifies whether marketing phrases are included in the basic inspection, a table for providing feedback information on marketing phrases is prepared in advance, either integrally with or separately from the country-specific guide information table. FIG. 13c partially illustrates this country-specific marketing phrase guide information table (1310), and the feedback information recorded as the field value of each field of this table (1310) is used when the phrases of the items (1312) designated in each of the records of the table are identified from the artwork image, unlike the preceding country-specific guide information table (1300).

[0136] Accordingly, as in the above-described embodiment, when a marketing phrase is identified in the basic inspection and is recorded in the marketing phrase field of the record (911 or 912) currently conducting the main inspection on the inspection result table (90) (931), the display item inspection unit (104) reads the marketing phrase recorded in the field and transmits it to the DB processing unit (110) along with the information of the inspection-designated country, and requests a lookup of the corresponding feedback information in the country-specific marketing phrase guide information table (1310). Upon receiving the retrieved result in accordance with this request, a result guidance area is created by reflecting the result. FIG. 14a shows an example of the result guidance area (1020') created at this time.

[0137] Meanwhile, regarding the field values ​​of the tables (1200, 1300, 1300', 1310) whose configurations are exemplified in FIG. 12 and FIG. 13a to 13c, the service operation manager of the business operator providing the mandatory item display inspection service periodically checks the display guidelines for the mandatory items of each country, and when there are changes, updates and records them as feedback information. This operation allows the operation manager to log in as a service operator to the inspection server (100) through their terminal device (201) or the aforementioned input unit, and by changing the value of the field of the corresponding table in the database (112) through the administrator page presented to the operator, a guide suitable for the latest display guidelines for the mandatory items of each country can subsequently be provided to the user.

[0138] The above-mentioned display item inspection unit (104), when there is feedback information in the response information received from the DB processing unit (110), presents the identified marketing phrase by including it in the list of mandatory items (1026), and for the item included in the list in this way, additionally displays it in the notification information column (1021) as information different from when it is a missing item in the mandatory items (1021a). Then, for the corresponding display item (1026), a phrase (1026a) indicating that the user needs to check carefully is displayed, which is different from the phrase indicating the reason for the missing display guideline.

[0139] If, from the response information received from the DB processing unit (110), it is confirmed that there is no feedback information for one or more inspected designated countries (meaning that there are no restrictions on the use of the marketing phrase in those countries), the display item inspection unit (104) does not include the identified marketing phrase in the list of required items. Alternatively, it may be included in the list, but a message indicating that there is no problem with its use, such as 'Allowed', may be displayed in the status notification box (1023) for the marketing phrase.

[0140] When multiple countries are designated for the main inspection, if there is feedback information for some of the countries, the display item of the corresponding marketing phrase is reflected in the notification information field (1021), and if there is a user's selection action regarding the corresponding display item, the inspection console page created by including information that can check which country has precautions regarding the corresponding marketing phrase in the sub-information field (1040), which has a display area secured in an expanded form at the bottom of the item as exemplified in FIG. 14b, is displayed on the user's terminal device (202 k It will be provided to ).

[0141] Meanwhile, if there are some countries that have information that does not comply with the display guidelines for the required items as exemplified in FIG. 11d, or have precautions due to marketing phrases as exemplified in FIG. 14b, the user may think that satisfying the display guidelines for the required items for that country is unnecessary and may request the removal of the inspection selection status for that country in the inspection standard country display area (1030) as exemplified in FIG. 11a.

[0142] When such a request for release is made, the above-mentioned display inspection unit (104) switches the country in the inspection standard country display area (1030) to an unselected state (1034), and in the inspection result table (90), refers to the main inspection result information for the remaining countries excluding the inspection result information for the country in question, rewrites the inspection console page, and presents it to the user's terminal device.

[0143] According to the presentation after the rewriting of the inspection console page as described above, the required items or marketing phrases for which the lack of required information or cautionary notices were previously displayed for some countries are not listed in the inspection item section (1022), or are listed in the inspection item section (1022) with a phrase indicating that they are not required items or that there is no problem with their use in the status notification section (1023), such as 'not applicable' or 'not restricted,' thereby allowing the user to know that the omission of the required items or the inclusion of marketing phrases is not a problem in the currently selected inspection standard country.

[0144] In one embodiment according to the present invention, as illustrated in FIG. 10, a control object (1013) capable of making a request to enlarge or reduce the artwork image displayed in the image display area (1011) of the package image area (1010) may be included. When a user makes a selection regarding this object, the display item inspection unit (104), which receives the request for enlargement or reduction according to the selection, rewrites the image display area (1011) as an image enlarged or reduced according to the request, which was the artwork image presented on the current page (1000), and the user's terminal device (202 kIt is presented in ). Through this function, the user can more closely check whether the deficiencies in the display guidelines for the required information presented in the result guidance area (1020) are due to misrecognition in text extraction from the artwork image or due to errors in the text during design.

[0145] Meanwhile, in one embodiment according to the present invention, a service is provided that allows the user to modify the feedback information recorded in each field of the aforementioned country-specific guide information table (1300) and country-specific marketing phrase guide information table (1310) into content more suitable for the user, that is, the company to which the user belongs, and this service is processed by the service tool unit (105).

[0146] When a user selects a service item related to changing feedback information on the home page provided by accessing the inspection server (100), this selection is transmitted to the service tool unit (105) by the communication unit (101), and in accordance with this selection, the service tool unit (105) creates an input page (1500) for changing feedback information as exemplified in FIG. 15 and the user's terminal device (202 k Sends to ).

[0147] In one embodiment according to the present invention, a service for changing feedback information can be provided to a subscriber who has subscribed to the mandatory item display inspection service when they log in with special authority, such as an administrator, rather than as a general user. To this end, when there is a request to subscribe to the mandatory item display inspection service, the logon processing unit (102) receives input from the terminal device for an administrator account for the management authority of the service, in addition to an account for a general user, and records it in the new subscriber profile. Accordingly, in this embodiment, when a selection for a service item regarding the change of feedback information is transmitted through the communication unit (101), the service tool unit (105) refers to the client information associated with the connection, and if the login account of the connection does not correspond to an account designated as an administrator in the corresponding subscriber profile, the requested service is rejected.

[0148] The feedback information change page (1500) is configured to include an area (1510) that allows selecting an item to change the feedback information, as illustrated in the example, and an area (1520) that allows checking and changing the feedback information for the selected item. The selection area (1510) includes a list of item selection control objects (1512) that allows selecting specific required items to change the feedback information and the target thereof, and a target country control object (1511) that allows selecting which country the item is for. The checking / changing area (1520) includes a current text sub-area (1521) that displays the feedback text currently assigned to the selected item, and a change text sub-area (1522) that allows entering a new feedback text to be assigned to the selected item.

[0149] The feedback information change page (1500) of FIG. 15 is an example where the item 'Precautions for Use' for a primary type of package is selected for 'European Union' (1513), and the service tool unit (105) receives the information selected for the selection area (1510) from the terminal device (202 k When received from ), a request is made to the DB processing unit (110) to look up the feedback information currently stored regarding the corresponding selection information, and a confirmation / change area (1520) is created as a feedback message in response to the request, and the feedback information change page is provided again.

[0150] When the service tool unit (105) requests the database processing unit (110) to look up feedback information regarding selection information, it also transmits the subscriber identification information of the currently connected user, and the database engine (111) reads the feedback text recorded in the item matching the transmitted selection information from the country-specific guide information table built for the transmitted subscriber identification information and provides it to the service tool unit (105).

[0151] Accordingly, in this embodiment, a country-specific guide information table configured as exemplified in FIG. 13a can be built in the database (112) for each subscriber who has subscribed to the mandatory item display inspection service. When a feedback information change page exemplified in FIG. 15 is provided to a user who has accessed the inspection server (100), an initial country-specific guide information table for that user can be built by linking it to the subscriber identification information. When building the initial country-specific guide information table, for each field, the corresponding field values ​​of the country-specific guide information table that is already built in the database (112) are copied and used.

[0152] When a user wishes to change the feedback text (1521) for the current selection item, the user inputs the desired feedback text into the change text sub-area (1522) and then selects a control object (1523) for applying the new text. When this selection is transmitted to the service tool unit (105), the service tool unit (105) transmits the received new text, the subscriber identification information of the connected user, and the currently selected information in the selection area (1510) to the DB engine (111), and requests that it be newly recorded as the value for the corresponding field of the country-specific guide information table built for the subscriber.

[0153] In this way, when an arbitrary field value in the country-specific guide information table for the relevant subscriber is changed, users logged in with that subscriber's account can receive feedback text during the inspection of mandatory information for artwork that is different from that of other subscribers, is more suitable for the company's products and sales locations, etc., and is easier for users logging in with that subscriber's account to understand and facilitates processing accordingly.

[0154] FIG. 15 illustrates that the user can change the feedback information presented when there are deficiencies in the display guidelines, using only the mandatory items as examples. However, the user's change of feedback information is not limited to these, and the same method of changing feedback information can be applied to the marketing phrases mentioned above. To this end, when the service tool unit (105) creates the feedback information change page, it creates the page by including an additional control object (1514) in the selection area (1510) that lists the marketing phrases (1312) recorded in the country-specific marketing phrase guide information table (1310) when there is a user selection action, as exemplified in FIG. 16.

[0155] In addition, in one embodiment according to the present invention, when a user selects this additional control object (1514), a feedback information change page that enables editing of a set of marketing phrases can be created by further including a control object (1515a) that allows a request to delete a selected phrase, an input box (1515c) that allows a request to enter a new marketing phrase, and a control object (1515b) that allows a request to register a phrase in the input box, in an area (1515) of each marketing phrase that is arranged alongside a control object that can be unfolded or selected as a separate page at the bottom.

[0156] When there is a user selection action regarding the delete control object (1515a), the terminal device (202 k A request is made to the database processing unit (110) to delete the currently selected marketing phrase received from the country-specific marketing phrase guide information table built for the subscriber.

[0157] Then, after entering an arbitrary phrase into the input box (1515c) (p161) and entering a feedback phrase that is desired to be presented when the marketing phrase is entered into the change phrase sub-area (1522), when the user selects a new control object (1515b), the service tool unit (105) accordingly, the terminal device (202 k These information transmitted from the database engine (111) is transmitted to request the registration of a new record, and as a result, a record containing new marketing phrases and feedback information thereon is added to the country-specific marketing phrase guide information table built for the subscriber, and is subsequently used in the mandatory item display inspection service.

[0158] In the aforementioned embodiment, which allows users to edit marketing text, the identification of marketing text during the identification process for the previously described package image varies depending on the user who requested the mandatory item display inspection service. In other words, regarding the identification of marketing text, it is verified whether the image is identifiable only for the set of marketing texts listed in the country-specific marketing text guide information table created for the subscriber who logged in to request the inspection service.

[0159] One embodiment according to the present invention analyzes an artwork file uploaded through an artwork file request page (50) configured as illustrated in FIG. 5, as previously mentioned, and automatically identifies what type of package the image corresponds to. Below, various methods for identifying the corresponding package type from an artwork image will be described.

[0160] The basic method is to determine the corresponding package type based on a set of essential items identified from each image, and FIG. 17 illustrates the process of determining the package type according to this method.

[0161] If the identified set of listed items does not include a full ingredient item (S171), the inspection request processing unit (103) determines the type of the current image as a primary package (S182), and if it is included, prior to the image determining the current package type, the currently connected terminal device (202 k It is checked whether the Hand-in-Book logo is identified in the artwork image uploaded from ) (S172). If there is no previously uploaded image, or even if there is one but the Hand-in-Book logo is not identified in that image, it is additionally checked whether the full ingredient item is identified in the previously uploaded image (S173).

[0162] If there is no previously uploaded image or if the full ingredient item is not identified in the previous image, the inspection request processing unit (103) determines the type of the current image as a secondary package. Otherwise, an additional method of analyzing the image itself, as described below, is applied to determine the package type for the current image (S175). Then, when the full ingredient item is identified, if the Hand-in-Book logo is identified in the previous image (S172), the type of the current image is determined as a tertiary package (S181).

[0163] In a method for determining the package type by analyzing the image itself, edges are first detected in the received image. In this edge detection, one of various known methods may be used.

[0164] When determining the package type from the detected edges, the bent vertices on the outermost line can be used. FIG. 18 shows an example in which the package type is determined by this method, and a vertex bent at an angle greater than a certain angle is detected in the outermost closed line, and if the maximum number of detected vertices is greater than or equal to a pre-specified number (S191), the type for the corresponding image (1801) is determined as a secondary package (S192).

[0165] If the number of detected maximum vertices is less than a specified number, check whether the outermost closed loop contains a curve or bent shape with a length greater than a certain length (S193), and if such a shape is included, determine the image (1802) as the primary package type (S194). If such a shape is not included, compare the actual size with the previously uploaded image. If there is no previously uploaded image, defer the decision until the next image is uploaded.

[0166] If there is another image to compare, the actual size is compared with that image (S195). The actual size comparison between the two images is based on the size of the image converted into actual dimensions (mm, inch, etc.) by considering the resolution (DPI: Dots Per Inch) of the image. If the actual size of an image (1803) in which the number of vertices detected in the outermost closed path is less than a predetermined number and does not contain a curve or bent shape of a certain length or longer is larger than the actual size of the other image being compared, the type of that image is determined as a third package (S196), otherwise it is determined as a first package (S197).

[0167] In another embodiment according to the present invention, an artificial intelligence module may be used to automatically determine the package type for an image. The artificial intelligence module of this embodiment is trained using images of various types of packages corresponding to various different package types as a learning model, and then used to automatically determine the package type for package images uploaded in the method according to the present invention.

[0168] Various embodiments of the method and apparatus for providing online inspection of essential descriptions for product package artwork according to the present invention, as specifically described so far, and the configurations and operations described in those embodiments, may be selectively combined in various ways, unless they are mutually incompatible.

[0169] The embodiments of the present invention described above are disclosed for illustrative purposes only, and those skilled in the art may modify, change, substitute, or add various other embodiments within the technical concept and scope of the present invention as disclosed in the appended claims. Explanation of the symbols

[0170] 10: Communication network 100: Inspection Server 101: Communications Department 102: Logon Processor 103: Inspection Request Processing Unit 104: Marking Inspection Section 105: Service Tool Unit 110: DB processing unit 111: DB Engine 112: Database 201,202 i : Terminal devices

Claims

Claim 1 A method of a server that inspects an image of a package regarding mandatory labeling requirements on a product and provides the inspection results online, comprising: a first step of receiving an image of a product package from any terminal device via a communication network; a second step of processing the received image to extract a plurality of blocked information from the image; a third step of identifying which item among previously designated mandatory labeling items corresponds to each of the extracted plurality of blocked information; and a fourth step of inspecting whether the set of items identified as the corresponding mandatory labeling items in the third step conforms to the labeling guidelines for mandatory labeling requirements established by one or more designated countries or organizations based on the package type confirmed for the image, and creating one or more pages containing information on the inspection results and transmitting them to the any terminal device, wherein the package type is a first type corresponding to a package for directly accommodating the contents of a product, or a second type corresponding to a package for accommodating the package of the first type. Claim 2 A method according to claim 1, wherein the inspection in step 4 includes checking whether there are any items missing from the set of identified items regarding the items that are mandatory for the identified package type in the labeling guidelines. Claim 3 In claim 1, the above 4th step is a method of checking whether there is a condition satisfied in specific conditions previously specified based on the extracted plurality of blocked information, and if there is a satisfied condition, additionally checking the display state of the content displayed on the image according to the inspection content specified for that condition. Claim 4 A method in which, in the third paragraph, the specific conditions include one or more conditions selected alone or combined from among conditions including a condition in which a specific mandatory entry is included in the set of identified items, a condition in which a specific country or organization is included in one or more countries or organizations, a condition specified for the type of product, a condition specified for the ingredients contained in the contents of the product, and a condition in which a predetermined specific phrase is detected. Claim 5 A method according to claim 3, wherein the additional inspection of the display state includes checking whether the text is displayed in a specified format, and the specified format includes at least one of an underlined format, a format that is bolder than other characters, a format that is italicized relative to other characters, and a size greater than or equal to a specified size for the characters. Claim 6 A method according to claim 3, wherein the additional inspection of the display state includes verifying whether the target information specified in the additional inspection is detected in the content displayed on the image. Claim 7 In Clause 6, the method wherein the above-mentioned target information is text corresponding to a logo or phrase. Claim 8 A method according to claim 1, wherein the third step further identifies a special phrase indicating the function or efficacy of the product, and the inspection in the fourth step includes inspecting whether the labeling guidelines restrict the use of the identified special phrase for the product. Claim 9 A method according to claim 1, wherein the third step identifies whether a specific item among the designated mandatory items is listed based on the characteristics of the text portion displayed in the area from which the blocked information was extracted, wherein the characteristics include at least one of the size of the portion corresponding to the character and the thickness of the stroke of the character. Claim 10 A method according to claim 1, wherein the third step comprises the step of identifying which required entry the blocked information corresponds to by confirming the existence of a matching word with reference words within a classification word group designated for each of at least a portion of the blocked information, for each of the previously designated required entry items. Claim 11 In claim 10, the above 3rd step is a method of calculating a total score by assigning different scores to words that match entirely and words that match partially, based on each classifier group, for the corresponding blocked information in the verification of the existence of the matching word, and then comparing each of the calculated total scores. Claim 12 A method according to claim 1, wherein the third step comprises the step of identifying which required entry the blocked information corresponds to by calculating the degree of image similarity with reference logos within a classification logo group, each designated for one or more of the previously designated required entries for each of at least a portion of the blocked information. Claim 13 A method according to claim 1, wherein at least part of the above three steps is performed by an artificial intelligence module trained with a plurality of learning models consisting of a set of texts that can be displayed for each item of the required information and a set of required information items corresponding to each text. Claim 14 In claim 1, the above 4 steps are a method of creating one or more pages by including inspection standard country zones presented to allow the selection of inspection progress in at least a series of countries. Claim 15 In paragraph 14, the above-mentioned inspection standard country area further includes a control entity that enables one or more non-state entities to select the inspection process. Claim 16 In claim 14, the method further comprises the step of rewriting the one or more pages and transmitting them to the arbitrary terminal device as a result of checking whether they comply with the display guidelines for mandatory information set forth in the inspection reference country after the change, based on the package type confirmed for the image, when the selection of any country in the inspection reference country area is changed. Claim 17 A method according to claim 1, wherein the one or more pages are prepared to include at least a first information area in which the received image is displayed together with a control object capable of indicating the confirmed package type, and a second information area in which an inspection result is displayed in which at least some of the items from the previously designated required entries are presented as inspection items. Claim 18 In Clause 17, the above-mentioned four steps constitute the inspection items as items belonging to the union of the items designated as mandatory entries in each of the above-mentioned one or more countries or organizations. Claim 19 In Clause 17, the above-mentioned 4th step is configured such that the inspection items are composed of the above-mentioned designated mandatory entries, and regarding the above-mentioned designated mandatory entries, for items that are not designated as mandatory entries in all of the above-mentioned one or more countries or organizations, information indicating that such items do not apply to the above-mentioned one or more countries or organizations is presented in the corresponding inspection status column. Claim 20 In claim 17, the above-mentioned 4th step is a method of creating the above-mentioned 2nd information zone such that when one or more of the above-mentioned countries or organizations are multiple, and any one of the above-mentioned inspection items not identified in the above-mentioned 2nd step is a mandatory item required to be listed only in some of the multiple countries or organizations, a phrase with a different content from when it is a mandatory item required to be listed in all of the multiple countries or organizations is presented in the corresponding inspection status column. Claim 21 In Clause 17, the above 4th step is a method of creating one or more pages by including the number of items that do not comply with the above indication guidelines in the above inspection items in the above second information area along with a guidance phrase indicating the reason for non-compliance. Claim 22 In Clause 17, the above-mentioned 4th step is a method of adding a status phrase to the inspection status column within the above-mentioned 2nd information area for each of the above-mentioned inspection items, wherein for items among the above-mentioned inspection items that do not conform to the above-mentioned display guidelines, a specific status phrase with content different from that of the conforming items is added. Claim 23 A method according to claim 17, wherein the above-mentioned 3rd step additionally identifies special phrases indicating the function or efficacy of the product, and the above-mentioned 4th step creates one or more pages by including, among the identified special phrases, at least a specific status phrase indicating that there are precautions regarding phrases for which use in the product is restricted by the above-mentioned labeling guidelines, together with the above-mentioned second information area as inspection items. Claim 24 In claim 23, the method comprises: a step 5 of transmitting from any terminal device an input page that enables a request for the listing or deletion of a special phrase indicating the function or efficacy of a product when a specific request from a user is received through one or more pages from any terminal device; a step 6 of editing an existing set of special phrases in accordance with the request for listing or deletion through the input page; and a step 7 of confirming the identification of only the phrases belonging to the edited set of special phrases in the identification of the special phrase indicating the function or efficacy of a product, with respect to a first image received from a first terminal device logged in with the same account as the subscriber account when the any terminal device logs in. Claim 25 A method according to claim 22 or 23, wherein the method further comprises the step of, upon receiving a user's selection regarding a first item in which a specific status phrase is presented, rewriting the content regarding one or more pages in a form that includes guidance on matters the user must take action on or be aware of regarding the first item in an information field secured at the bottom of the first item, and transmitting it again to any terminal device. Claim 26 In claim 17, the method further comprises the step of updating and displaying at least the second information zone as the content examined regarding whether a set of items identified from other images previously received corresponding to the other type conforms to the display guidelines when there is a user's selection of a type different from the confirmed package type through the control object. Claim 27 The method according to claim 1 further comprises: step 5, transmitting to the arbitrary terminal device an input page that enables a request for a change in feedback information to be presented regarding an item identified as not conforming to the display guidelines of a designated inspection standard country or organization when a specific request from a user through one or more pages from the arbitrary terminal device is received; and step 6, when a request for a change in feedback information regarding an arbitrary item is received through the input page along with a new text, the arbitrary terminal device changes and records the feedback information regarding the arbitrary item to be used for a subsequent inspection request from a subscriber of a logged-in account to the new text. Claim 28 In paragraph 27, the above change request further includes at least one of a country or organization and a package type as information specifying the subject of change of the feedback information, and the above 6th step is a method of changing and recording the feedback information specified for the information specifying the subject of change in the feedback information for any of the above entries into the above new text. Claim 29 A method according to claim 1, wherein information regarding the package type is received together when the image is received in step 1. Claim 30 In claim 1, the method further comprises a type determination step of automatically determining the package type through analysis of the received image. Claim 31 A method according to claim 30, wherein the type determination step comprises the step of determining the package type as the first type if a specific item is not included in the set of identified items. Claim 32 In claim 30, the type determination step further comprises the step of determining the package type as a third type when a specific item is included in the set of essential items identified for the image and a second specific item is included in the set of essential items identified for another image received from any terminal device other than the image, wherein the third type is a type to which an information display attached to the package of the second type corresponds, separate from the package of the second type. Claim 33 A method according to claim 30, wherein the type determination step further comprises the step of determining the package type as the first type or the second type through the analysis of characteristics of the edge detected in the image. Claim 34 In claim 30, the type determination step further comprises a step of determining the package type as a third type based on a comparison of actual sizes with other images received from any terminal device other than the image, wherein the third type is a type to which an information display attached to the package of the second type corresponds, separate from the package of the second type. Claim 35 In claim 1, the first step is a method in which, when receiving an image of a product package, multiple different images corresponding to the same package type can be received for a specific package type. Claim 36 A method according to claim 1, wherein the blocked information comprises text information extracted from a portion partitioned based on an area where text is displayed in the image. Claim 37 A method according to claim 1, wherein the blocked information comprises image information of an area containing a symbol or picture having a change in brightness, surrounded by a margin of a certain width in the image. Claim 38 A device for inspecting an image of a package regarding mandatory labeling requirements for a product and providing the inspection results online, comprising: a database containing labeling guideline information that a country designates as mandatory labeling requirements for a product for each of at least a plurality of countries; and an inspection unit configured to process an image received from a terminal device connected via the communication network to extract a plurality of blocked information from the image, identify which item among the previously designated mandatory labeling items corresponds to each of the extracted plurality of blocked information, inspect whether a set of items identified as the mandatory labeling items conforms to the labeling guidelines for mandatory labeling requirements confirmed by querying the labeling guideline information contained in the database for one or more countries or organizations designated by the terminal device based on the package type confirmed for the image, and create one or more pages containing information on the inspection results and transmit them to the terminal device, wherein the package type is a first type corresponding to a package for directly accommodating the contents of a product, or a second type corresponding to a package for accommodating the first type of package.

Images