Program, information processing method, and information processing apparatus

Abstract

To improve convenience of a user.SOLUTION: A process of inputting first information to a model, a process of inputting second information to the model, a process of acquiring output information that is information output by the model based on the first information and the second information, and a process of storing the output information output by the model in a storage unit, the first information being information obtained from first drawing data including title information including a plurality of item information each being a combination of an item and a content of the item; The second information includes at least the title information included in the second drawing data and a request for specifying a content of the item corresponding to the item of the item information in the title information of the second drawing data, and the output information is information in which the item in the title information included in the second drawing data and the content of the item are associated with each other.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a program, an information processing method, and an information processing device. [Background technology]

[0002] A conventional drawing search device has been disclosed that identifies the arrangement of multiple boxes present in a title block based on the type of title block present in target drawing data, performs character recognition processing on each of the character strings present in each location in the title block, and identifies target attribute values ​​that represent attribute values ​​of the target drawing data represented by the character strings in the boxes based on the character recognition results and the arrangement of the multiple boxes, and also identifies target attributes that are attributes previously associated with the boxes (see, for example, Patent Document 1).This drawing search device searches for drawing data having attribute values ​​similar to the attribute values ​​of the target drawing data from a database in which drawing data, attribute values ​​of drawing data, and attributes corresponding to the attribute values ​​are associated, based on the combination of the identified target attribute values ​​and target attributes, and outputs the search results. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 7377565 Summary of the Invention [Problem to be solved by the invention]

[0004] The above techniques do not sufficiently consider user convenience, for example, it is sometimes difficult to easily import drawing information into a database.

[0005] The present invention has been made in consideration of the above circumstances, and an object of the present invention is to provide a program, an information processing method, and an information processing device that can improve user convenience. For example, drawing information can be easily imported into a database, thereby improving user convenience. [Means for solving the problem]

[0006] An embodiment of the present invention is a program that causes a computer to execute the following processes: inputting first information into a model; inputting second information into the model; obtaining output information, which is information output by the model based on the first information and the second information; and storing the output information output by the model in a memory unit; wherein the first information is information obtained from first drawing data that includes title information having a plurality of item information that are combinations of items and the contents of the items, and is information regarding the location of the item information; the second information is information that includes at least the title information included in second drawing data and a request to identify the contents of the items that correspond to the items of the item information in the title information of the second drawing data; and the output information is information that associates the items and the contents of the items in the title information included in the second drawing data. [Effects of the Invention]

[0007] The program, information processing method, and information processing device of the present embodiment can improve user convenience. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing an example of a drawing to be processed. [Figure 2] 1 is a diagram for explaining an overview of processing in an information processing system according to an embodiment of the present invention; [Figure 3] 1 is a diagram illustrating an example of a functional configuration of an information processing device 100. FIG. [Figure 4] FIG. 1 is a conceptual diagram of a database 184. [Figure 5]FIG. 2 is a diagram showing an example of an interface screen IF1 provided by the information processing device 100. [Figure 6] FIG. 10 is a diagram illustrating an example of a property screen. [Figure 7] 10 is a diagram for explaining the processing of the recognition processing unit 120. FIG. [Figure 8] FIG. 10 is a diagram showing an interface screen IF4 presented on the user terminal device 10. [Figure 9] FIG. 10 is a diagram illustrating a process of acquiring second information. [Figure 10] FIG. 10 is a diagram illustrating an example of a prompt. [Figure 11] FIG. 10 is a diagram showing an example of a response obtained from the model 50. [Figure 12] FIG. 10 is a diagram illustrating an example of a confirmation screen. [Figure 13] FIG. 10 is a diagram illustrating an update of a database 184. [Figure 14] 2 is a sequence diagram showing an example of the flow of processing executed by the information processing system 1. FIG. [Figure 15] FIG. 10 is a diagram illustrating an example of a process for reading a parts list. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, embodiments of a program, an information processing method, and an information processing device of the present invention will be described with reference to the drawings.

[0010] [overview] The information processing device of this embodiment is a device that imports title information (title column information) contained in a drawing into a database. FIG. 1 is a diagram showing an example of a drawing to be processed. The drawing is an object managed in a database, such as a product or part. The area AR of the drawing is a title area that includes title information. The title information includes, for example, one or more pieces of item information. The item information is a combination of an item and its contents. An item is, for example, a drawing number or an item name on the drawing. The item name on the drawing is, for example, the material of the product or part on the drawing, the surface treatment, the name of the drawing, the subject, the date, the scale, the company name, the approval seal, etc. The content of the item is the content of each of the above items (for example, the drawing number "12345" or the material "XXX").

[0011] When this information is imported into a database, a person may manually register it in the database. This involves a high load, so it is desirable to perform this operation more easily. This embodiment supports the easy registration of title information in the database. For example, the location where the content of an item is written varies from company to company or organization, making it difficult to automatically obtain a combination of an item and its content. However, by performing the following process, this embodiment can support the easy and accurate acquisition of a combination of an item and its content in title information.

[0012] [Processing Overview] 2 is a diagram for explaining an overview of the processing of the information processing system of this embodiment. The information processing system 1 includes a user terminal device 10, a model 50, and an information processing device 100. Details will be described later.

[0013] An outline of the process will be explained below, and details will be given later. (1) The user terminal device 10 transmits target drawing data to the information processing device 100 based on a user operation. (2) The information processing device 100 generates information (prompt) to be input to the model 50. The information to be input to the model 50 includes title information of the target drawing data, a request for information to be output, etc. (details will be described later). (3) The information processing device 100 transmits the generated information to the model 50. (4) The model 50 generates a response in response to the request based on the transmitted information, and provides the generated response to the information processing device 100. (5) The information processing device 100 generates provided information based on the provided information. The provided information is information for allowing the user to confirm information obtained from the model 50. For example, the provided information is information in which the items of the item information in the title information are associated with the contents of the items. (6) The information processing device 100 provides the provided information to the user terminal device 10. (7) The user terminal device 10 provides the information processing device 100 with the confirmation result of the information to be provided. (8) The information processing device 100 registers the provided information in the database in response to the acquired confirmation result. This allows the user to easily register title information of drawings in the database.

[0014] [User terminal device] The user terminal device 10 is a computer device such as a personal computer, a smartphone, a tablet terminal, etc. A user operates the user terminal device 10 to perform various processes.

[0015] [Model] The model 50 is a model trained using training data to output an answer to an input question or request. When a question is input, the model 50 outputs an answer to the question. The model 50 is, for example, a large-scale language model (LLM) such as GPT-3, GPT-3.5, GPT-4, BERT, PaLM, or Llama. The model 50 accepts input of an image (e.g., screen data), recognizes the meaning of the image or the type of object contained in the image, and outputs the recognition result as an answer, or outputs an appropriate answer based on the image and a question about the image. The model 50 is trained to output an answer to the request based on the input information and the request, taking the input information into consideration, when information (e.g., letters, numbers, symbols, images, etc.) and a request are input. For example, the model 50 may be a trained model trained with training information. The training information is information that associates a prompt with an answer. For example, the trained model is a model trained to output an answer corresponding to a prompt when a prompt is input.

[0016] [Information processing device] 3 is a diagram illustrating an example of the functional configuration of information processing device 100. Information processing device 100 includes, for example, an information acquisition unit 110, a recognition processing unit 120, a prompt generation unit 130, an information processing unit 140, an information management unit 150, and a storage unit 180. The information acquisition unit 110, the recognition processing unit 120, the prompt generation unit 130, the information processing unit 140, and the information management unit 150 are realized by, for example, a hardware processor such as a CPU (Central Processing Unit) executing a program (software) 182 stored in the storage unit 180. Some or all of these components may be realized by hardware (including circuitry) such as an LSI (Large Scale Integration), an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or a GPU (Graphics Processing Unit), or may be realized by a combination of software and hardware. The program may be stored in advance in a storage device (a storage device having a non-transitory storage medium) such as a hard disk drive (HDD) or flash memory, or may be stored in a removable storage medium (a non-transitory storage medium) such as a DVD or CD-ROM, and installed by inserting the storage medium into a drive device. The storage unit 180 is realized by a storage device such as a HDD, flash memory, or RAM (Random Access Memory). The storage unit 180 stores, for example, the above-mentioned program 182 and database 184.

[0017] The information acquisition unit 110 provides information to the user terminal device 10 or the model 50 , and acquires information from the user terminal device 10 or the model 50 .

[0018] The recognition processing unit 120 analyzes the drawing data and recognizes information contained in the drawing data. The recognition processing unit 120 performs optical character recognition processing such as OCR (Optical Character Recognition / Reader) to recognize information such as letters, numbers, and symbols in the drawing data.

[0019] The prompt generator 130 generates a prompt to be output to the model 50 based on information provided to the user terminal device 10 .

[0020] The information processing unit 140 executes various processes. For example, the information processing unit 140 cooperates with the recognition processing unit 120 and the prompt generation unit 130 to provide prompts to the model 50 and acquire information output by the model 50.

[0021] The information management unit 150 registers the information obtained from the model 50 in the database 184 .

[0022] [Database] 4 is a conceptual diagram of database 184. Database 184 is, for example, data with a plurality of BOM (Bill Of Materials) structures. The BOM-structured data includes, for example, data with a design BOM structure that handles information related to the design of the object, data with a manufacturing BOM structure that handles information related to the manufacture of the object, and data with an integration BOM structure that handles information related to procurement for the manufacture of the object.

[0023] The database 184 contains hierarchically structured information. In hierarchically structured information, information is organized into layers, and each piece of information is associated with another. For example, a first lower layer is associated with a higher layer, and a second lower layer is associated with the first lower layer. Information is associated with a set of layers or each layer. The associated information is files and properties related to a set of layers or each layer. A file or property may be associated with one product or part, or with multiple products or parts. Examples of files include drawings, cost calculations, test data, CAD data, specifications, requirements definition documents, and quality standards. Files are managed by version. Properties are associated with projects, assemblies, and parts. Properties are attribute items of items, such as material, weight, cost, etc. Properties may be set by a user, or may be set automatically using information obtained from the model 50, as in this embodiment.

[0024] In addition to the above, database 184 may contain various other information such as change history information, data tables, specifications, product information on the target component, defect information, defect countermeasure information or guidelines, standards (design requirements, standards, in-house standards), and information on related products or components. Database 184 also contains master information, which is information on products, components, etc. The master information is information in which various specifications of products, components, etc. are associated.

[0025] [Interface screen provided by information processing device] (BOM screen) The following describes information provided by the information processing device 100 to the user terminal device 10. Fig. 5 is a diagram showing an example of an interface screen IF1 provided by the information processing device 100. The interface screen IF1 is a screen that is displayed after a specific project is specified on a screen that displays a list of multiple items (assemblies, parts, etc.). The interface screen IF1 is a BOM screen that hierarchically displays the parts that make up a specific item (for example, a product) that is a specific project.

[0026] Interface screen IF1 contains information such as the model number of a specified item, category, phase related to the concept or manufacturing process (drawing release, prototype, mass production, etc.), cost, BOM screen creation date, update date (e.g., last update date), creator, and person in charge (project owner). It also contains information about the parts that make up a specified item. Part information is displayed with each part as a single recorder. For example, information such as the part's item name, model number, ID, phase, category, link to CAD data / drawing, and standard unit price is displayed as a record.

[0027] In this way, the information processing device 100 can improve user convenience by providing the user with a list of information related to projects.

[0028] (Properties screen) Selecting "Properties" on interface screen IF1 displays the properties screen. Property screen IF2 in FIG. 6 shows a portion of the properties screen. The properties screen is used to manage item attributes. Attributes include design, procurement, and manufacturing. Design attribute items include various design-related information, such as the person who inspected the drawing, the person who approved it, the material of the item, the production method, and weight. Procurement attribute items include various procurement-related information, such as quotation-related information, supplier, price, estimated delivery date, budget, manufacturer product number (MPN), and minimum order quantity (MOQ). Manufacturing attribute items include various manufacturing-related information, such as production performance and inventory management classification. Users can assign tags, which are keywords used during searches, to each attribute item. Users can have the information processing device 100 perform searches and narrow down information using property information and tags. Some or all of the property information is information contained in the title information of the drawing data.

[0029] The information displayed on the above property screen can be customized by the user. For example, the user can customize the information by operating the property setting screen. Property setting screen IF3 in FIG. 6 is a diagram showing a part of the property setting screen. On property setting screen IF3, the user can set the information to be displayed on property screen IF2 by setting the property name, data type, unit, description, etc.

[0030] Furthermore, when the user changes information, the information processing device 100 saves the changed content as a change history, which allows the user to perform cost analysis, search for past drawings, etc. by referring to the information before and after the change.

[0031] As described above, the user can set properties. Generally, customizing properties requires development costs, but the information processing device 100 provides an environment in which settings can be made without coding, thereby reducing the burden on the user. Furthermore, various information related to product development management, such as cost price and inventory quantity, as well as physical attributes of parts (weight and material), can be added, improving user convenience.

[0032] For example, when a drawing contains multiple pieces of item information as shown in FIG. 1, it would be convenient for the user if this item information (either the item or its contents or both) could be easily imported as properties. The following process supports automatic importing. First, the information processing device 100 prepares first information and second information, and inputs prompts based on the first information and second information into the model 50. The information processing device 100 acquires information corresponding to the first information and second information from the model 50, and updates the database 184 using the acquired information.

[0033] For example, the information processing device 100 executes a process of inputting first information into the model 50 and a process of inputting second information into the model 50. The first information is information obtained from the first drawing data. The first drawing data has title information including a plurality of item information (items and their contents). The first information is information regarding the position of the item information (for example, information indicating the position of the item contents relative to the position where the items are written). The second information is information including at least the title information included in the second drawing data and a request to identify the contents of the items corresponding to the items of the item information in the title information of the second drawing data. These will be described in detail later.

[0034] The information processing device 100 executes a process of acquiring output information, which is information output by the model 50 based on the first information and the second information, and a process of storing the output information output by the model 50 in the storage unit 180. The output information is information that associates items in the title information with the contents of the items.

[0035] Model 50 is a model that, when second information is input, outputs information indicating the content of each of the multiple items of item information in the second information, based on information indicating the relative positional relationship between the position where the item of the first information is written and the position where the content of the item is written. Model 50 has been trained to, when second information is input, output the item of item information in the second information and the content corresponding to the item, based on the above-mentioned relative positional relationship of the first information.

[0036] [First information] The first information is information related to the position of the item information. The information related to the position of the item information is information indicating the relative positional relationship between the position where the item is written and the position where the content of the item is written. For example, the information related to the position of the item information is information indicating the position where the content of the item is written relative to the position where the item of the item information is written. The recognition processing unit 120 acquires the first information by performing image processing. FIG. 7 is a diagram for explaining the processing of the recognition processing unit 120. The recognition processing unit 120 acquires information indicating the positional relationship of multiple pieces of item information using a preset algorithm. For example, the recognition processing unit 120 identifies a rectangular area from the first drawing data where item information such as characters or symbols is estimated to be written. The recognition processing unit 120 recognizes, for example, character information in the identified area and groups the recognized character information. For example, information indicating a predetermined item (or similar information) is extracted. Furthermore, information that is written near the information indicating the item (or similar information) and is different from the information indicating the item (or similar information) and information indicating the content of the predetermined item (or information similar to the content of the item) are extracted. The recognition processing unit 120 groups the extracted information. In the example of Fig. 7, the information surrounded by the dotted line is grouped and recognized as one item of information. For example, the recognition processing unit 120 performs the above processing based on an algorithm that has been trained to recognize items and their contents as one group, as shown in Fig. 7.

[0037] The recognition processing unit 120 generates information indicating the relative positional relationship of the grouped character information. For example, the recognition processing unit 120 generates information D1 shown in FIG. 7. Information D1 indicates, for example, that the item content (drawing number) "12345" is written to the right of the item "drawing number," the item content (material) "XXX" is written to the right of the item "material," and the item content (date) "2024 / 06 / 08" is written below the item "date." The recognition processing unit 120 grasps the position of the recognized information and generates information D1 based on this information. Alternatively, the relative positional relationship of information D1 may be expressed by row and column numbers, such as "drawing number" in row 1, column 1, "12345" in row 1, column 2, etc., or may be expressed by coordinates, etc. Information D1 may also be information expressed to reflect the positions of items and their contents, such as information D2 in FIG. 9, which will be described later.

[0038] In addition to (or instead of) the relative positional relationship between the above-mentioned items and their contents, information D1 may include information indicating the relative positional relationship between the position where an item of a first item of information included in the plurality of item information is written and the position where an item of a second item of information included in the plurality of item information is written. Information D1 may include, for example, information indicating that "Material XXX" is written below drawing number 12345, "Surface treatment XXX" to the right of "Material XXX", and "Drawing name..." is written below "Material XXX". This information may be expressed as rows and columns or coordinates as described above. Information D1 may also include data on the area of ​​the first drawing data or the title information of the first drawing data.

[0039] The recognition processing unit 120 may perform the above processing using a model that has learned the learning information. The learning information is information that associates the position of the area of ​​item information (or the position of the item and the position of the content of the item) from the drawing data with the drawing data. The model is trained to identify the position of the area of ​​item information (or the position of the item and the position of the content of the item) from the drawing data.

[0040] Alternatively, the recognition processing unit 120 may obtain information about the location of the item information in cooperation with the user. The recognition processing unit 120 may present the combination of the above items and their contents to the user terminal device 10, and use the user's confirmation result to recognize the items and their contents and identify the positional relationship between the items and their contents.

[0041] The information processing device 100 displays predetermined information on the display unit, and executes a process of generating first information in response to acquiring operation information relating a position where an item performed by a user with reference to the predetermined information displayed on the display unit is written and a position where the content of the item is written. The predetermined information includes at least two or more pieces of information obtained from the first drawing data: the item of the item information, the content of the item of the item information, and position information corresponding to the item information.

[0042] FIG. 8 is a diagram illustrating an interface screen IF4 presented on the user terminal device 10. The interface screen IF4 includes a combination of recognized items and their contents. If the combination is correct, the user presses the confirm button. If the combination is incorrect, the user corrects the item contents. By acquiring the results of the confirmation or correction, the recognition processing unit 120 can recognize the positional relationship between multiple items, their contents, and their combinations. For example, the recognition processing unit 120 can recognize the positional relationship between items, such as "Material" below the drawing number and "Surface treatment" to the right of the material, and can further recognize the positional relationship between the contents of items, such as "12345" or "XXX." Because the recognition processing unit 120 recognizes the position or positional relationship of the recognized information, if it can recognize the combination of items and their contents, it can recognize the positional relationship between the combination of items and their contents, such as information D1.

[0043] Instead of the above example, the user may be allowed to define the relationship between the items of the item information and their positions. This allows the information processing device 100 to recognize the positional relationship between the items, such as the second item being located to the right of the first item. Also, instead of the above example, the user may be allowed to define the relationship between the content of the item of the item information and the position of the content of that item. This allows the information processing device 100 to recognize the relationship between the content of the item and the item (e.g., drawing number 12345) as if it had obtained the first information. Therefore, if the positional relationship between the content of multiple items can be recognized, the positional relationship between multiple items can be recognized.

[0044] [Second information] The second information includes at least title information obtained from the second drawing data and a request specifying the contents of an item corresponding to the item of the item information in the title information of the second drawing data. The title information included in at least the second drawing data includes one or both of (1) and (2). (1) is data of the area where the title information of the second drawing data is written. (1) may be the second drawing data, or may be drawing data in which the area of ​​the title information is extracted from the second drawing data. (2) is information indicating the items, content of the items, and positional relationships between the items and the content of the items in the area of ​​the title information of the second drawing data (see D2 in FIG. 10). The recognition processing unit 120 performs optical character recognition processing on the second drawing data, and obtains information including information indicating the items, content of the items, and positional relationships between the items and the content of the items in the area AR1 of the title information obtained from the results of the optical character recognition processing. In the following explanation, as an example, the title information included in the second information will be explained as (2).

[0045] 9 is a diagram illustrating the process of acquiring the second information. For example, the recognition processing unit 120 generates information D2 that recognizes the character information in a state that reflects the positional relationship of the character information included in the area AR1 (the positional relationship between each item and the content of each item). Instead of the above, the recognition processing unit 120 may recognize the positional relationship by expressing it as character information. For example, it may generate information indicating that 12346 is written to the right of the drawing number, the material below the drawing number, △△ below the material, the drawing name below the material, and △△△... to the right of the drawing name. For example, the recognition processing unit 120 may express the positional relationship using rows, columns, coordinates, etc.

[0046] The first information may be information indicating the relative positional relationship between the title information included in at least second drawing data previously input to the model 50, the position where the item information in the title information is written, and the position where the content of the item is written. In other words, the first information may be information regarding the title information item of second drawing data previously processed, the content of the item, and the relative positional relationship between them. For example, the first information may include information indicating that the item content "12346" is written to the right of the item "Drawing Number" in the previous second drawing data, and that "△△" is written to the right of the item "Material." By including information included in the previously input second drawing data in the first information, the model 50 is expected to output answers with greater accuracy.

[0047] Generate Prompt The prompt generator 130 generates a prompt based on the first information and the second information. Fig. 10 is a diagram showing an example of a prompt. The prompt includes, for example, the above-mentioned information D1 and information D2, as well as information D3, which is a request for identifying a combination of items and their contents from information D2 with reference to information D1.

[0048] The information D2 may be second drawing data (the second drawing data itself) including item information.

[0049] The second information may further include information on a desired data format or a desired data type (type of information desired to be extracted). The desired data format or data type is a data format or type (type of property) used in database 184, which manages product information and information on parts used in the product in a hierarchical structure. For example, it may include information on property items (such as material and drawing name) of a predetermined file in database 184. For example, it may include information specifying items of content desired to be extracted (such as information such as "I want material and drawing name to be extracted"). These processes facilitate updating of database 184, which will be described later.

[0050] In addition to the above information, information D1 may also include case information specific to the user. The specific case information may be, for example, past drawing data, the location of items in item information obtained from the past drawing data, the location of content of items corresponding to items, and the relationship between these. In addition to the above information, information D1 may also include information on standardization and information on compliance standards such as JIS.

[0051] [Answer obtained from the model] The information processing unit 140 inputs the above prompt to the model 50 and obtains an answer output by the model 50. FIG. 11 is a diagram showing an example of an answer obtained from the model 50. The answer is obtained in a manner that makes it easy to recognize the combination of items and their contents, as surrounded by a dotted line in FIG. 11. The output information, which is the answer, is, for example, information in which the contents of multiple items and the items corresponding to each of the contents of the multiple items are expressed in a one-to-one relationship. The answer is provided, for example, in a state in which the items and their contents are expressed in one sentence. In addition, the answer may be provided in such a manner that the items and their contents are connected with a predetermined symbol (for example, connected with =) or associated with a predetermined symbol (for example, the items and their contents are enclosed in " "). In addition, the output information may be provided in a file, or in a form such as a tabular format or a table format. The tabular format is a form in which the items and their contents are expressed in a tabular format. If it is desired to obtain output information in a desired form, this may be included in the prompt.

[0052] The information processing unit 140 extracts a combination of items and their contents from the above answers. For example, the information processing unit 140 recognizes items and their contents from one sentence enclosed by a dotted line in FIG. 11. The information processing unit 140, for example, performs natural language processing to recognize words and numbers, etc., excluding predetermined characters such as particles, as items and their contents. The information processing unit 140 recognizes title information items and their corresponding contents from the answers using an algorithm that performs the above natural language processing. For example, the information processing device 100 recognizes predetermined words, words similar to the predetermined words, and words having the same meaning (or a similar meaning) as the meaning of these words, as items or their contents.

[0053] When an answer is obtained, the information processing unit 140 may generate information for the user to confirm the answer result and display the generated information on the display unit of the user terminal device 10 to request the user's confirmation. FIG. 12 is a diagram showing an example of a confirmation screen. The confirmation screen includes second screen data (or item information of the second screen data) and information indicating the relationship between items and the contents of the items based on the answer result. For example, the user may refer to the second screen data to confirm whether items such as drawing number, material, and surface treatment correspond to the contents of the items and make corrections as necessary. When the user operates the confirmation button, the information management unit 150 may register the items and the contents of the items in the database 184.

[0054] [Update Database] The information management unit 150 updates the database 184 by using the processing results of the information processing unit 140. The information management unit 150 executes a process of storing output information in the database 184 that manages, for example, information on products and information on parts used in the products in a hierarchical structure, and registers items of the item information of the output information as properties linked to the products or parts in the database, and registers the contents of the items of the item information of the output information as the contents of the properties in the database 184.

[0055] 13 is a diagram for explaining the update of database 184. Information management unit 150 updates database 184 by associating the items and item contents obtained by the above processing with targets designated in advance by the user.

[0056] The target may be any target, such as a product or part managed in database 184. For example, information management unit 150 updates database 184 by treating the item as a property item of the target in database 184 and the content of the item as the content of the property. As a result, as shown in Fig. 13, for example, the property "drawing number 12346" of part A is associated, and further, the property material △△ and the property surface treatment △△△ are associated, and database 184 is updated.

[0057] As described above, the information processing device 100 can automatically recognize the items and item contents of the item information contained in the drawing data from the drawing data, and can import the recognized information into the database 184 to update the database 184.

[0058] [Sequence diagram] 14 is a sequence diagram showing an example of the flow of processing executed by the information processing system 1. The information processing device 100 acquires first drawing data, which is a case example (step S100), and acquires first information based on the acquired first drawing data (step S102). Next, the information processing device 100 acquires second drawing data of an object for which it is desired to identify an item and its content (step S104), and acquires second information based on the acquired second data (step S106).

[0059] Next, the information processing device 100 uses the first information and the second information to generate a prompt to be input to the model 50 (step S108), and sends the generated prompt to the model 50 (step S110). The model 50 acquires the prompt and generates an answer to the acquired prompt (S112). Next, the model 50 transmits the generated answer to the information processing device 100 (step S114).

[0060] Next, the information processing device 100 uses the answer to update the database 184 (step S116). Specifically, the information processing device 100 registers the items and the details of the items included in the answer as properties and the contents of the properties in the database 184 (step S118).

[0061] In the above process, the information processing device 100 may execute the process of inputting the first information into the model 50 multiple times. For example, the first information may be input into the model 50 before the process of step S110. The first information at this time is, for example, first information obtained from drawing data different from the drawing data of the first information of step S110. In this way, the model 50 learns multiple pieces of case information, and can therefore more accurately identify items and the contents of the items from the second information.

[0062] Through the above processing, the information processing device 100 can assist in automatically registering properties and property contents in the database 184, thereby improving user convenience.

[0063] In the above example, the information processing device 100 has been described as simultaneously executing a process of inputting first information into the model 50 and a process of inputting second information into the model 50 as a single process. Alternatively, the information processing device 100 may execute a process of inputting the first information into the model 50, and then execute a process of inputting the second information into the model 50. In this case, when the second information is input, the first information includes information indicating that an answer will be generated with reference to the first information, or the second information includes information indicating that an answer will be generated with reference to the first information. Note that the first information may be input after the second information is input. In this case, information indicating that an answer will be generated with reference to the first information input later is included.

[0064] The information processing device 100 may have the following functional configuration. The information processing device 100 executes optical character recognition processing on drawing data including a parts list in a predetermined area, and stores the read information of part names (names), items (e.g., materials) and content (details) corresponding to the items in the parts list in a database 184 that manages product information and information on parts used in the products in a hierarchical structure. The information processing device 100 registers the read part names as parts in the database 184, registers the read items as part items in the database 184, and registers the read content as content corresponding to the items in the database 184.

[0065] The information processing device 100 may display a screen on the display unit for allowing the user to confirm the correspondence between the read part name, the items in the parts list, and the content corresponding to the items, and may store the read information in the database 184 in response to acquiring operation information indicating that the user has confirmed the screen. For example, as shown in FIG. 12 above, the parts list and the read information may be displayed so as to be comparable, and when the user confirms them, the read information may be stored in the database 184.

[0066] Alternatively (or in addition) to the above, the read information may be stored in the database 184 as table-format data. FIG. 15 is a diagram showing an example of processing for reading a parts list. The area AR2 of the drawing data D4 contains the parts list. The information processing device 100 reads the area AR2 and generates data for registration including items in the parts list and the contents of the items. The data is, for example, table-format data. This table-format data is, for example, a collection of information in which items corresponding to parts and the contents of the items are associated with each other, similar to a parts list. The information processing device 100 displays the generated table-format data on the display unit of the user terminal device 10, and, if confirmation from the user is obtained, registers the table-format data in the database 184.

[0067] As described above, the information on the parts list is automatically imported into the database 184 and registered, which improves user convenience.

[0068] According to the embodiment described above, the program causes a computer to execute the following processes: inputting the first information and the second information into the model 50; acquiring output information output by the model 50 based on the first information and the second information, which associates the contents of multiple items of the second information with each of the contents of the multiple items; and storing the output information output by the model 50 in a memory unit, thereby improving user convenience.

[0069] The above describes the form for carrying out the present invention using an embodiment, but the present invention is not limited to such an embodiment, and various modifications and substitutions can be made within the scope that does not deviate from the gist of the present invention. [Explanation of symbols]

[0070] 1. Information processing system, 10. User terminal device, 100. Information processing device, 110. Information acquisition unit, 120. Recognition processing unit, 130. Prompt generation unit, 140. Information processing unit, 150. Information management unit, 180. Memory unit, 182. Program, 184. Database

Claims

1. On the computer, inputting first information into a model; inputting second information into the model; a process of acquiring output information that is information output by the model based on the first information and the second information; and storing the output information output by the model in a storage unit. the first information is information obtained from first drawing data including title information having a plurality of item information, each of which is a combination of an item and the content of the item, and is information regarding the position of the item information; the second information is information including at least the title information included in the second drawing data and a request to identify the content of the item corresponding to the item of the item information in the title information of the second drawing data, The output information is information that associates items in title information included in the second drawing data with the contents of the items. program.

2. The information regarding the position of the item information is information indicating a relative positional relationship between a position where the item is written and a position where the content of the item is written. The program according to claim 1.

3. the information relating to the position of the item further includes information indicating a relative positional relationship between a position where an item of a first item information included in the plurality of item information is written and a position where an item of a second item information included in the plurality of item information is written; The program according to claim 2.

4. The title information included in the at least second drawing data includes one or both of (1) and (2). (1) data of an area in which the title information of the second drawing data is written; (2) information indicating the items of the area of ​​the title information of the second drawing data, the contents of the items, and the positional relationship between the items and the contents of the items; The program according to claim 1 or 2.

5. the model is a large-scale language model; The program according to claim 1 or 2.

6. On the computer, executing a process of inputting the first information into the model, and then executing a process of inputting the second information into the model; or a process of inputting the first information into the model and a process of inputting the second information into the model are simultaneously executed as one process; The program according to claim 1 or 2.

7. the model is a model that, when the second information is input, outputs information indicating the contents of the items corresponding to each of the plurality of items of the item information of the second information, based on information indicating a relative positional relationship between a position where the item of the first information is written and a position where the contents of the item are written. The program according to claim 1 or 2.

8. the first information includes the title information included in the at least second drawing data previously input to the model, and information indicating a relative positional relationship between a position where the item in the item information of the title information is described and a position where the content of the item is described; The program according to claim 1 or 2.

9. The output information is information in which each item of title information included in the second drawing data is associated with a description corresponding to the item among the contents of the plurality of items. The program according to claim 1 or 2.

10. On the computer, performing optical character recognition processing on the second drawing data; execute a process of inputting second information into the model, the second information including information indicating items in the area of ​​the title information obtained from the result of the optical character recognition process, contents of the items, and positional relationships between the items and the contents of the items; The program according to claim 1 or 2.

11. On the computer, displaying predetermined information on a display unit, and executing a process of generating the first information in response to acquisition of operation information relating a position where the item is written and a position where content of the item is written, the operation information being performed by a user with reference to the predetermined information displayed on the display unit; the predetermined information includes at least two or more pieces of information among the item of the item information, the content of the item, and position information corresponding to the item information, which are obtained from the first drawing data; The program according to claim 1.

12. On the computer, A process of storing the output information in a database that manages product information and information on parts used in the product in a hierarchical structure, executes a process of registering the item of the item information of the output information as a property linked to the product or part in the database, and registering the content of the item information of the output information as the content of the property (values ​​and names of dimensions, etc.) in the database; The program according to claim 1.

13. The second information further includes information on a desired data format or a desired data type. The program according to claim 1.

14. the desired data format or data type is a data format or type used in a database that manages product information and information on parts used in the product in a hierarchical structure; The program according to claim 13.

15. The computer, executing a process of inputting the first information into the model a plurality of times; The program according to claim 1.

16. On the computer, A process of executing optical character recognition processing on drawing data including a parts list in a predetermined area, reading information on part names, items, and item contents of the parts list, and storing the read information in a database that manages product information and information on parts used in the product in a hierarchical structure, executes a process of registering the read part name as a part in the database, registering the read item as an item of the part in the database, and registering the content of the read item as content corresponding to the item in the database; The program according to claim 1.

17. On the computer, displaying a screen on a display unit for confirming the correspondence between the read part name and the item and the content of the item in the parts list; storing the read information in the database in response to acquisition of operation information indicating that the user has confirmed the screen; The program according to claim 16.

18. The computer inputting first information into a model; inputting second information into the model; a process of acquiring output information that is information output by the model based on the first information and the second information; and storing the output information output by the model in a storage unit. the first information is information obtained from first drawing data including title information having a plurality of item information, each of which is a combination of an item and the content of the item, and is information regarding the position of the item information; the second information is information including at least the title information included in the second drawing data and a request to identify the content of the item corresponding to the item of the item information in the title information of the second drawing data, The output information is information that associates items in title information included in the second drawing data with the contents of the items. Information processing methods.

19. inputting first information into a model; inputting second information into the model; a process of acquiring output information that is information output by the model based on the first information and the second information; and storing the output information output by the model in a storage unit. the first information is information obtained from first drawing data including title information having a plurality of item information, each of which is a combination of an item and the content of the item, and is information regarding the position of the item information; the second information is information including at least the title information included in the second drawing data and a request to identify the content of the item corresponding to the item of the item information in the title information of the second drawing data, The output information is information that associates items in title information included in the second drawing data with the contents of the items. Information processing device.

Images