Information processing device, information processing method, and information processing program

Abstract

The processor of the information processing device stores data of multiple types of files, including at least one of CAD and drawings, allows for location specification and status management on the files, generates comments that can hold related information based on response relationships with respect to the data of the files in a non-destructive manner, displays the comments together with the data of the files on a terminal, performs a keyword search on the comments, and displays the results of the keyword search together with the corresponding comments and the data of the files associated with those comments.

Description

Technical Field

[0001] The present disclosure relates to an information processing apparatus, an information processing method, and an information processing program.

Background Art

[0002] Regarding CAD (Computer-Aided Design), design drawings, and other various electronic documents (hereinafter referred to as files) generated in business, communication is carried out among multiple users, and decisions on subsequent actions are made based on the content of the communication. For example, requests for improvement to design drawings, responses thereto, design modifications, etc., and also, using this as reference information, designing another subsequent product. In communication regarding files, it is desirable that they are created, displayed, and managed integrally with the files. On the other hand, it is not desirable that the communication with the files is divided into separate tools, or that the set of the communication with the files is divided among different software or systems.

[0003] Assuming that such integrated management is realized, it is desirable that files can be searched later starting from communication. However, there are the following three problems in communication regarding files generated in business.

[0004] First, in various software for file creation, there is a problem that it is difficult to communicate in a unified format regardless of the type of file. For example, word processing software and design software each have their own dedicated comment functions, but since those comments are managed independently for each software, information is likely to be dispersed, making it difficult to comprehensively grasp and utilize it for the entire business operation.

[0005] Secondly, general communication software has the challenge of making it difficult to record or search communications in a way that is associated with specific files or parts of their content. For example, while email and chat are effective as unified means of communication within an organization, they have weak associations with files, and communications tend to be separated from the files they are intended for. As a result, there are problems such as not being able to find the corresponding file when searching the communication history, or not being able to refer to related communications when searching a file. In addition, when comments are responded to multiple times, there is no means to search by combining words that are only contained in each comment (such as AND conditions), making it difficult to search for files from the context of the entire thread.

[0006] Thirdly, there is a challenge in that there is no means to manage the progress and response status of file-related communications across all file types. In particular, requests and feedback that prompt specific actions from the recipient need to be managed with statuses such as "not started," "started," and "completed." However, many existing services are specialized for specific purposes, and for example, Miro (registered trademark), which is specialized for design purposes, makes it difficult to uniformly manage the status of communications in a work environment where multiple types of files coexist. [Prior art documents] [Patent Documents]

[0007] [Patent Document 1] Patent No. 6526304 [Patent Document 2] Patent No. 7506201 [Patent Document 3] Patent No. 7193595 [Patent Document 4] Patent No. 7377565 [Patent Document 5] Patent No. 7372697 [Overview of the Initiative] [Problems that the invention aims to solve]

[0008] Patent Document 1 discloses a comment system specialized for a specific file type. Patent Document 2 shows a configuration for associating information with a specific location in a CAD file, which is expected to have some effect on the second problem mentioned above. However, the technology in Patent Document 2 does not have a means for sharing the associated information with other users, and it cannot be applied to drawings other than CAD. On the other hand, Patent Document 3 discloses a function that visually displays the degree of attention given to communication, and has a function that is partly related to status management. However, this technology is mainly intended for project review purposes and cannot add comments to files. Thus, existing technologies lack sufficient means for integrating files and the communication associated with them, and the business problem of the separation of files and communication has not been fully resolved.

[0009] This disclosure is made in light of the circumstances described above, and aims to provide an information processing device, an information processing program, and an information processing method that enable integrated and flexible management and retrieval of communications associated with files. [Means for solving the problem]

[0010] A first aspect of the present disclosure is an information processing device comprising a processor, the processor storing data of a plurality of types of files, including at least one of CAD and drawings, generating comments that can hold related information based on response relationships with respect to the data of the files in a non-destructive manner, displaying the comments together with the data of the files on a terminal, performing a keyword search of the comments, and displaying the results of the keyword search together with the corresponding comments and the data of the files associated with those comments.

[0011] A second aspect of this disclosure is an information processing program performed by a computer that stores data of multiple types of files, including at least one of CAD and drawings; generates comments that can hold related information based on response relationships with respect to the data of the files in a non-destructive manner; displays the comments together with the data of the files on a terminal; performs a keyword search of the comments; and displays the results of the keyword search together with the corresponding comments and the data of the files associated with those comments.

[0012] A third aspect of this disclosure is an information processing method that causes a computer to store data of multiple types of files, including at least one of CAD and drawings; generate comments that can hold related information based on response relationships with respect to the data of the files in a non-destructive manner; display the comments together with the data of the files on a terminal; perform a keyword search on the comments; and display the results of the keyword search together with the corresponding comments and the data of the files associated with those comments. [Effects of the Invention]

[0013] According to this disclosure, the effect is that communications associated with files can be managed and searched in an integrated and flexible manner. [Brief explanation of the drawing]

[0014] [Figure 1] Figure 1 is a diagram showing an example of the schematic configuration of an information processing system 10 according to the embodiment of this disclosure. [Figure 2] Figure 2 is a block diagram showing an example of the hardware configuration of a computer 70 that constitutes the information processing device 16 of the present disclosure. [Figure 3] Figure 3 shows an example of a comment data creation screen displayed by the information processing system 10. [Figure 4] Figure 4 shows an example of a comment data creation screen. [Figure 5]FIG. 5 is a diagram showing an example of a comment data creation screen. [Figure 6] FIG. 6 is a diagram showing an example of a comment data creation screen. [Figure 7] FIG. 7 is a diagram showing an example of a screen display when a thread becomes long. [Figure 8] FIG. 8 is a diagram showing an example of an internal structure image of comment data. [Figure 9] FIG. 9 is a diagram showing an example of an internal structure image of comment data. [Figure 10] FIG. 10 is a diagram showing an example of an internal structure image of comment data. [Figure 11] FIG. 11 is a diagram showing an example of comment search result display. [Figure 12] FIG. 12 is a flowchart for explaining an example of a processing procedure by the information processing system 10. [Figure 13] FIG. 13 is a flowchart for explaining an example of a processing procedure by the information processing system 10. [Figure 14] FIG. 14 is a flowchart for explaining an example of a processing procedure by the information processing system 10. [Embodiments for Carrying Out the Invention]

[0015] Hereinafter, embodiments will be described in detail with reference to the drawings.

[0016] [Configuration of Information Processing System 10] FIG. 1 is a block diagram showing the information processing system 10 according to an embodiment of the present disclosure. As shown in FIG. 1, the information processing system 10 according to an embodiment of the present disclosure includes an information processing apparatus 16 and a plurality of user terminals 18A, 18B, 18C. Hereinafter, unless otherwise indicating a specific terminal, one user terminal will be referred to as user terminal 18. The information processing apparatus 16 and the user terminal 18 are communicably connected by a network 19 such as the Internet. Hereinafter, the information processing system 10 may be simply referred to as a system.

[0017] User terminal 18 is a terminal capable of displaying a predetermined comment along with the file data.

[0018] The information processing device 16 includes various functional units (comment generation unit 71a, display control unit 71b, search unit 71c) for performing specific processing. It also has a storage unit 28 for storing data necessary for processing. Details of these functions will be described later.

[0019] Figure 2 is a block diagram showing an example of the hardware configuration of a computer 70 that constitutes an information processing device 16 according to an embodiment of the present disclosure. This information processing device 16 is composed of, for example, a general-purpose computer 70, and as shown in the figure, a central processing unit (CPU 71), memory 72, storage unit 73, input / output interface 74, read / write unit (R / W unit) 75, and network interface 76, etc., are interconnected via a system bus 77.

[0020] The CPU 71 performs control processing to execute the various processes of this disclosure. Specifically, the CPU 71 is responsible for software implementation of each functional block of the information processing device 16 shown in Figure 1 (comment generation unit 71a, display control unit 71b, search unit 71c, etc.).

[0021] Memory 72 is used as a workspace for the CPU 71 when it performs various processes, and temporarily stores data and programs. Storage unit 73 is used to hold data from multiple types of files, including at least one of CAD and drawings, and may be implemented as storage unit 28 as shown in Figure 1.

[0022] The input / output interface 74 and the read / write unit 75 are connected to a display, keyboard, mouse, external storage device, etc., enabling user interaction and display.

[0023] The network interface 76 is used to communicate with multiple user terminals 18 via the network 19 as shown in Figure 1.

[0024] This system has the following functional configuration as an example. Reception function: This function accepts user requests for file data registration, comment requests, and extraction requests (search or filtering). Memory function (DB: Database): This function stores file data and comments. This memory function corresponds to the memory unit 28 described above. Analysis function: This function analyzes the file data that has been registered and extracts various types of data. Search and Extraction Function: This function allows you to search and extract comments and file data. Display function: This function allows users to view various file formats such as CAD and drawings on their terminals, and also displays comments if any are present.

[0025] This system allows users to add comments to multiple types of file data, such as documents, videos, and audio, including at least one CAD or drawing.

[0026] Therefore, this system has a database that stores multiple types of file data, such as CAD files, drawings, documents, videos, and audio files. The data format of these files may also differ depending on the file type. For example, CAD files may be in formats such as STEP (Standard for the Exchange of Product model data) or DWF (Design Web Format), drawings may be in formats such as PDF (Portable Document Format) or PNG (Portable Network Graphics), videos may be in formats such as MP4 (MPEG-4 Part 14) or MOV (QuickTime Movie Format), and audio files may be in formats such as MP3 (MPEG-1 Audio Layer-3) or WAV (Waveform Audio File Format). One possible method for saving file data is user uploads. However, the method of saving file data is not limited to this.

[0027] The database can store user comment data.

[0028] The comment data has the following characteristics:

[0029] Comments are non-destructive and do not alter the target file data; they are saved as separate data. The comment data is recorded in association with the target file data. This allows users to comment without the psychological resistance of potentially modifying the original file data. Furthermore, users without editing privileges for the original file can still comment.

[0030] Comments can specify the coordinate location of the file data to which they are commented. Therefore, the comment data records whether a coordinate location was specified, and the coordinate location specified by the user with the mouse or other means when creating the comment. This, combined with the coordinate location visual display function described later, makes it easier for the user to understand which part of the file data and which content a comment corresponds to.

[0031] Comments can be directed to specific recipients. This is a feature called "mentions" in chat systems such as Slack® and Teams®. By including a user ID (IDentifier) ​​in the comment body, notifications can be sent only to the specified users. Therefore, the ID of the mentioned user is recorded in the comment data. This allows users to send notifications to their intended recipients simply by typing a comment.

[0032] Comments can have attached files. Therefore, if an attachment is present, the comment data will record the ID of the attached file. This allows for the expression of richer information compared to text-only comments, and enables the creation of simpler comments such as "Please see the attached file for details."

[0033] Comments can be given a status management function. Therefore, if a user specifies a status for a comment, the comment data will record that status. Furthermore, this status is managed on a thread basis, as will be explained in more detail later. This makes it easy to aggregate comments that have been addressed and those that have not, and helps prevent comments from being overlooked.

[0034] The above comments can be made to two or more of the following: 2D-CAD, 3D-CAD, two-dimensional drawing files, and various files such as specifications and defect reports, and must include at least one of the 2D-CAD, 3D-CAD, and two-dimensional drawing files. This allows for integrated management of files and communication, eliminating the separation between files and communication.

[0035] Because of the characteristics described above, comment data is designed to have a structure like that shown in Figure 8 as an example.

[0036] `comment_id` is an ID used to uniquely identify a comment. There are no restrictions on how the ID is issued; one example is using a UUID (Universally Unique Identifier).

[0037] `file_id` is the ID of the file to which the comment is directed.

[0038] The `position` attribute is data created to indicate a specific coordinate location within a file, as specified by the user. The coordinate location can be either a single point or a defined area. Additionally, in comments on video or audio files, the timestamp of the commented file is also specified.

[0039] As mentioned above, comments can include mentions to specify recipients, attachments to other files, and status management, and fields such as mentions, attachments, and status are provided accordingly. Content is the text data entered by the user through the comment input screen described later. Other fields include the comment creator's ID (author_user_id), the comment creation time (created_at), and the last edited date and time (last_edited_at). Thread ID is a value used to ensure the relationship between comments when a response is made to a comment. Of the above comment data, only content needs to be explicitly entered by the user; the rest are automatically generated by the system.

[0040] Furthermore, this system allows users to view and search comments on a thread-by-thread basis.

[0041] A thread refers to a sequential or hierarchical structure in which multiple comments are linked sequentially as responses to each other. Threads make it easier to understand information because responses to multiple comments are displayed in a way that recreates the flow of a conversation. Furthermore, as will be discussed later, comment searches are performed on a thread-by-thread basis, allowing for searches that capture the flow of the conversation without comments being disconnected.

[0042] Because comments possess the characteristics of a thread as described above, comment data is designed to have thread data with a structure similar to that shown in Figure 9, for example, separate from the comment data itself. Specifically, when the first response comment is created for a comment attached to a file, thread data is created simultaneously. In this embodiment, a thread data structure managed on a per-thread basis is maintained separately from individual comment data. This thread data includes the thread ID, the associated file ID, an array of the comment IDs to which it belongs, participating user information, creation date and time, and update date and time. By managing the response relationships and relationships between comments within the thread data, it is possible to maintain individual comment data while flexibly handling thread display and cross-search.

[0043] `thread_id` is an ID used to uniquely identify a thread. Similar to comment data, thread data is associated with a specific `file_id`. `comments` is a list of comments made within the thread. For example, if a comment with ID xxxxxxxx-xxxx-xxxx-Nxxx-xxxxxxxxxxxx is created, and a response comment with ID xxxxxxxx-xxxx-xxxx-Nxxx-xxxxxxxxxxxy is created in response to this comment, data like the example in Figure 9 will be created, and the date and time this data was created will be recorded in the `created` field. The same applies if a response to a comment is made.

[0044] The "participants" field records the ID of the comment creator, corresponding to the order of the comments in the "comments" section. While the example in Figure 9 shows data from different users, the same user could also be involved.

[0045] The thread data described above is generated automatically by the system. Users only need to create response comments to comments on the input screen described later to generate the thread data.

[0046] As shown in Figure 10, it is also possible to design the system so that comment data is updated directly, without separate thread data. In the example in Figure 10, it can be seen that the first comment and the second comment responding to it are nested within [] and updated as a single data item. In this embodiment, by providing a "parent_id" field for the comment data, it is possible to explicitly indicate which comment a single comment data item is a response to. The configuration of having separate thread data from comment data and the method of representing the thread structure within the comment data can be selected as appropriate. For example, in the configuration where thread data is managed separately, as in Figure 9, management on a thread-by-thread basis becomes easier, but because the structure is separated, the load on the coupling process may increase. In contrast, the configuration in Figure 10 has the advantage of being easy to implement because thread relationships can be maintained with only comment data. Which configuration is suitable should be decided according to the number of comments, update frequency, search requirements, etc.

[0047] This section describes the user interface of this system. The system aims to eliminate the disconnect between files and communication through a unified commenting experience that is not limited by the type of file data. Therefore, users can view, create, and search comments through a screen like the one shown in Figure 3.

[0048] This system has the following UI (User Interface) as an example. More specifically, in the screen shown in Figure 3, comments can be viewed in the comment pane, which is the second area R2, along with the file data displayed in the first area R1. As shown in Figure 3, when a user adds a comment to a specific location on the drawing, they can choose between a mode in which the location is specified as a single point and a mode in which it is specified as a rectangular area, depending on the nature of the comment subject and the user's intention. In either mode, a circled number icon (for example, "1") corresponding to the order in which the comment was created is displayed at the location, and a corresponding number icon is also displayed in the comment pane. This makes it possible to visually clarify the relationship between the comment and its reference location even when multiple comments are added to the drawing, and to intuitively grasp the location and range of the comment. A comment can be created by clicking "Create" in the upper right corner of the second area R2 in Figure 3. More specifically, clicking "Create" displays a comment creation sub-screen as shown in Figure 4, where the comment can be created by entering the comment. By clicking "Mark as resolved" in the lower right corner of the comment pane, or second area R2, in Figure 3, you can manage the status, such as changing the status from unresolved to resolved. You can search for comments using the search interface shown in the fourth area R4 of Figure 3.

[0049] Users can register multiple types of file data, such as CAD files, drawings, and various documents.

[0050] The system accepts file data input and begins the file data registration process. The system accepts design drawings in various ways, including, but is not limited to, user-submitted file data uploads. The system assigns a unique ID to each file. This ID is used as the `file_id` in comment data.

[0051] Next, the system analyzes the received file data and obtains at least two of the following data.

[0052] The system obtains data that can be simply read from file data, such as file names and modification dates. It also obtains various machine-readable data, such as CAD models and geometry.

[0053] If the file data is in PDF format, such as a drawing, the system performs character recognition on the file data to obtain string data containing the numbers written in it. Since known methods such as OCR (Optical Character Recognition) can be used for character recognition to obtain string data by detecting and recognizing the string area, a detailed explanation is omitted.

[0054] The system can convert at least a portion of the string data obtained above into structured data. The data obtained as a result of reading the strings written in the drawing remains unstructured data, meaning that the attributes of the recognized characters are not clear, simply by applying character recognition. The system can, for example, appropriately select known techniques from Patent Document 4 to obtain structured data from the results of character recognition. By performing such processing, a normalization process is carried out to standardize technical terms and drawing-specific notations in the drawing, making it possible to improve the accuracy of the analysis.

[0055] Furthermore, the system extracts features from all or part of the file data. Typical examples of data to be extracted include drawing files created in unstructured data formats such as PDF. There are no particular restrictions on which part of the file features are extracted; for example, features from the entire drawing could be extracted, or it could be limited to the drawing area. Also, structured data does not need to be excluded from feature extraction; the system can be configured to extract features from entities within the CAD software. Any known machine learning algorithm, such as CNNs, can be used as appropriate for feature extraction. In addition to features, it is also possible to obtain vector data of the intermediate output.

[0056] In addition, the system can also estimate at least some of the requirements, processing type, processing characteristics, processing steps, processing difficulty, and risk information of the target object indicated by the file data by inputting the data obtained from previous processing into a machine learning model. Specifically, it is conceivable to use a pre-trained machine learning model that outputs requirements and processing characteristics using data obtained from drawings and CAD as input information. The estimation method is not limited to machine learning; it may be rule-based, or other methods or combinations thereof. Examples of requirements specifications obtained this way include determining whether chamfering is necessary on the corners of the target object based on the inference results of safety and assembly, or estimating tolerances from the intended use of the target object. Examples of processing types obtained include "cutting" and "forging." Examples of processing characteristics obtained include "full-circumference welding," which is an inference result from descriptions in the drawing such as "integral weld formation" and "no water leakage." Examples of processing steps obtained include data on setup, material cutting, rough machining of the outer circumference, hole machining, turning, chamfering, radius machining, finishing, and inspection. For example, regarding the difficulty of processing, if "precision finishing" is required for surface treatment, data such as "high-precision product" could be assigned. Furthermore, risk information may include manufacturing considerations such as "a 5-axis machining center is required," and things that are not directly related to the manufacturing process itself, such as "due to the high difficulty of processing, care should be taken when selecting a manufacturing contractor."

[0057] The system creates view data for each file data to be displayed on the user terminal. The type of view to create is appropriately selected depending on the nature of the file data, such as 3D-CAD, 2D-CAD, or drawings.

[0058] The system stores the data obtained through the above processes along with the file data in the database, and the file data registration process is completed.

[0059] Users can create comments by selecting file data or comments. While there are no specific restrictions on how to select file data, methods such as using the file data search function described later to perform a search and then selecting from the search results are available. For user convenience, this system includes at least two of the comment input methods described below.

[0060] Users can create comments by selecting a comment button, as shown in the third area R3 of Figure 3. If there are already comments, the number of comments may be displayed near the comment button. Also, if there are already comments, users can create a reply comment to the comments by selecting the "Reply" button in the lower part of the second area R2 of Figure 3, which is the comment pane. In this case, the comment will be saved as a thread as described above.

[0061] Figure 4 shows an example of the display that appears when the user selects the "Comment" button mentioned above. In the example drawing, it can be seen that a sub-window for comment input is popped up in the first area R1. The user can also create comments by specifying a location on the file data. For example, a configuration could be conceivable in which the comment sub-window pops up when the user double-clicks on any point in the file pane in Figure 3, or when any area on the view is specified with the mouse or other means.

[0062] Returning to Figure 4, the sub-screen for comment input shows a free text input field, and above it, from left to right, are buttons such as "Specify Recipient," "Template," "Attach Photo," and "Write to File," with an image attachment option below. Users can also mention users by typing "@" followed by the user ID of the user they want to notify about the comment's creation. Clicking the "Specify Recipient" button will bring up a sub-screen for selecting users registered in the system, allowing users to specify recipients from there. This functionality makes it possible to specify recipients using a simpler method than directly entering their names.

[0063] Clicking the "Attach Photo" button displays further options: select a file saved on the device or server, or take a photo using the device's camera. Users can choose to attach a saved photo or take a new one and attach it. The photo taken and attached will appear in the comments pane along with a text-based comment.

[0064] Specifically, a thumbnail image of the photo is displayed in the lower left of the second region R2 in Figure 3, and the user can click on it to enlarge the attached photo. In the example in Figure 4, it says "Attached Photo," but there are no restrictions on the type of file that can be attached.

[0065] Furthermore, the above comments can be applied to various file formats and content types, including not only two-dimensional drawings as shown in Figure 3, but also 2D-CAD files, product specifications, defect reports, and other files. Each file has an input screen tailored to its characteristics, and the comment data structure is adjusted accordingly. Specifically, it works as follows:

[0066] For 3D-CAD, it is possible to specify the location to be commented on in the model viewer screen, and the coordinate location within the comment data is also configured to retain three-dimensional data. Furthermore, for files composed of plain text, such as various reports, it is possible to comment not only by specifying the location in the file but also by directly specifying the string; in this case, the comment data will retain the string data with the comment added instead of the coordinate location. As a result, users can comment on multiple different files on the same system, resolving the problem of file and communication fragmentation.

[0067] Comments can be made using free text or by using input templates. Clicking on "Template" in Figure 4 displays the first area R1 in Figure 5. In Figure 5, example sentences and suggested input items are shown in light gray (or semi-transparent) text as Input Example 1: "@nameA During assembly, interference occurred as shown in the attached photo. How will you deal with this?" Also in the same figure, example sentences and suggested input items are shown as Input Example 2: "Date and time of discovery, part / process, details of the problem, expected impact, proposed improvement."

[0068] Displaying example sentences for input reduces the user's input burden and supports effective communication. The ability to include mentions and file attachments, as well as support for multiple file types, will be omitted as it overlaps with previous explanations.

[0069] In addition to the text-based comments described above, it is also possible to write comments directly to the file data. Clicking "Write to File" as shown in Figure 4 displays the pop-up sub-window shown in the first area of ​​Figure 6. On this sub-window, the user can create text and diagrams as if writing directly to the file. In the example in Figure 6, a specific area of ​​the design drawing is circled with a red line, the word "interference" is written, and the location is further indicated with an arrow. By selecting the "Attach to Comment" button in the upper right corner of the sub-window shown in Figure 6, the user can attach the entire file with the comments to the comment. The attached file with the comments will be displayed in the comment pane, just like with photos. For example, a thumbnail image of the file with the comments is displayed in the lower right corner of the second area R2 in Figure 3. As with photos, the user viewing the screen in Figure 3 can click on this to enlarge the file with the comments.

[0070] Thus, even though comments are written to a file, the original file remains non-destructive, just like with other comments. The ability to mention and attach files, and support for multiple file types are also the same.

[0071] The above input can be performed using any method including keyboard, touch panel, or voice. There are no particular restrictions on the input method. The system accepts the user's comment registration request and creates comment data. A comment registration request can be made, for example, by clicking the "Send" button located in the lower right corner of the comment input subscreen shown in Figure 4. The comment data is stored in the system in the data format described above and associated with the commented file data, and is non-destructive to the commented file data.

[0072] If the created comment data includes a mention, the system will notify the specified user. This notification can be sent as a pop-up on the system screen, or through the device's operating system notification function, email, chat, or other communication tools. When the latter method is adopted, it can be implemented by appropriately selecting known methods such as APIs.

[0073] The above explanation focuses on creating a new comment, but users can also respond to comments. Specifically, a possible configuration is to create a response to a comment by clicking the "Reply" button at the bottom of the second area R2 in Figure 3. The processing flow after clicking the "Reply" button can be configured in the same way as when creating a new comment, so the explanation will be omitted. Furthermore, creating a response to a comment generates the aforementioned thread data.

[0074] Additionally, a "Reply" button may be added to each comment resulting from a response, allowing for further replies. As described above, Figure 7 shows the result of repeated comment replies. As shown in Figure 7, a reply has been made to the initial comment, and a visual indication of "Resolved" is displayed above the initial comment. This is displayed as a result of clicking the "Mark as Resolved" button at the bottom of the second area R2 in Figure 3. If it is inappropriate to mark this comment as resolved, the "Resume" display can be removed by clicking the "Resume" button displayed at the bottom of the response comment shown in Figure 7. Furthermore, this display and click operation are configured to be linked to internally stored status data.

[0075] As a result of this threaded display format, users can easily understand the flow of the conversation through the files and comments.

[0076] Users can view comments along with the file data.

[0077] The screen shown in Figure 3 is also used for viewing comments, and it contains two elements: the first area R1, which is the file pane, and the second area R2, which is the comments pane. In the example in Figure 3, a two-dimensional design drawing is displayed in the file pane, but it is also possible to display and play various documents such as 3D-CAD, quality inspection reports, and design change notifications, as well as videos. The comments pane can be displayed on the right or left of the screen, or as an overlay on mobile devices depending on the selection. There are no particular restrictions on the display method depending on the device.

[0078] Figure 7 shows an image of how comments are displayed when responses are repeated multiple times. Note that, for illustrative purposes, the thread in Figure 7 is shown separated into the main comment section and the reply section; however, in the actual screen display, the main comment and its replies are integrated and displayed consecutively on a single pane. Users can scroll the screen vertically to view the entire comment. However, there are no limitations on how comments and threads are displayed; for example, threads in the thread list are collapsed and invisible except for the first comment, and only the thread of a comment selected by the user is expanded to display the associated comments. On the file pane, the comment location is overlaid on the file data using a circled number icon or a rectangular area. While a rectangle is typical for the area, it does not necessarily have to be a closed space. Furthermore, when a user selects a comment in the comment pane, the corresponding area is highlighted on the file pane. Specifically, this can be done by changing the color of the circled number icon or by changing the contrast inside and outside the rectangle. If text is the subject of the comment, the coordinate information obtained during character recognition can be used to highlight that area. Conversely, if the user selects any area displayed on the file pane, the corresponding comment will be highlighted in the comments pane. The specific highlighting method can be selected as appropriate, such as changing the background color of the comments pane.

[0079] This system includes a function to assign statuses to comments and manage their status. When a user creates a comment, the system generates data as shown in Figure 8. At this time, a record indicating "status": "unresolved," that is, the status being unresolved, is automatically written into the data. Users can manage statuses on a thread basis, and when the task related to the comment is completed in actual work, clicking the "Mark as resolved" button in the lower right corner of the comment pane in Figure 3 will update the record internally to something like "status": "resolved." In addition, resolved comments may also have a visual indicator such as "Resolved" in the comment field.

[0080] Up to this point, for the sake of explanation, we have used the example of a system with only two status values: "Unresolved" and "Resolved." However, there are no restrictions on the number of status categories. It is also possible to create other statuses such as "In Progress" or "Delayed." This thread-level status management is expected to eliminate the possibility of overlooking improvement requests or tasks.

[0081] This disclosure is characterized by its ability to perform thread-level searches.

[0082] Users can perform keyword searches on comments.

[0083] The system accepts search keywords from the user through a search interface like the fourth area R4 in Figure 3, and performs a comment search. The specific search is executed using known technologies as appropriate.

[0084] The system displays search results in units of file data associated with comments. Specifically, a configuration like that shown in Figure 11 is possible. The search interface has the keyword "incorrect instructions" set, and four search results corresponding to this keyword are displayed. Each search result has columns from left to right: a thumbnail image of the file data, status, comment content, creator, last modified date, and number of replies, and there is also a "View Comments" button.

[0085] The comments section displays excerpts of comments containing the search keywords, with the keywords highlighted. To view more detailed comments, users can click "View Comments" to return to the regular file and comment viewer and see the entire comment. This allows users to understand the context and status of comments containing their search keywords while referencing the file data.

[0086] For example, manufacturing companies are motivated to create better products when developing new ones by reflecting past similar products and trouble cases with the same customers. Therefore, they may want to search for keywords such as "◇◇ (product name)," "defect," "assembly," and "fit" using an AND condition, and refer to file data, more specifically design drawings, that contain these keywords within comments. However, when there is a thread with individual comments such as "A defect has been found in the product shipped on X / Y," "This is ◇◇ (product name) delivered to △△ (customer name)," and "During assembly at the delivery site, some products experienced fit defects," a general search system will not find any results using an AND condition because there is no single comment containing all of the above search keywords. On the other hand, using individual search keywords or an OR condition results in search results that are too broad, making it difficult to obtain results that match the desired context. Therefore, this system is configured to allow searching comments on a thread-by-thread basis using an AND condition.

[0087] Thread-based searching in this system is implemented through the following processing procedure.

[0088] This system generates a search index on a thread-by-thread basis each time comment data is created or updated. In this indexing process, the thread ID is used as the key, and the content of all comments within that thread is associated with it. This makes it possible to comprehensively search for keywords that are scattered across multiple comments within a thread.

[0089] When a user enters a search keyword through a search interface like the fourth area R4 in Figure 3, the system performs the search in the following steps.

[0090] The system accepts search keywords entered by the user. If multiple keywords are specified, these are recognized as search conditions. In this embodiment, to avoid placing an excessive selection burden on the user, thread-based search is the default, and no interface is provided to select between comment-based search and thread-based search. However, this selection interface is not necessarily excluded, and a configuration that requires the user to make a selection each time is also possible.

[0091] The system evaluates the relevance of each thread to the search keywords. In this process, the system matches all comments within a thread against the search keywords, and evaluates the relevance on a thread-by-thread basis, even if multiple keywords are scattered across different comments within the thread.

[0092] The system scores search results based on the relevance of each thread. Factors considered in evaluating relevance include keyword frequency, position, and the distribution of keywords within the thread.

[0093] The search results are ranked based on the calculated score.

[0094] The system displays search results in units of file data associated with the thread. Specific display methods include those shown in Figure 11. However, the number of search results will be less than or equal to the number of results obtained using a single keyword, resulting in more focused search results. This allows users to understand the context of the entire thread while referencing the file data.

[0095] As mentioned above, this system obtains various data such as string descriptions and feature quantities from file data, so it is also possible to search the file data directly using this data, rather than relying on comments.

[0096] This system allows keyword searches using string data contained within the file data itself. When a user enters a search keyword through the search interface, the system performs a search on the file data and displays the search results. This keyword search appropriately selects a known search system. In this embodiment, to avoid placing an excessive selection burden on the user, keyword searches are performed by default to simultaneously search comments or threads and files; no interface is provided to select between the two. However, this selection interface is not necessarily excluded, and a configuration requiring user selection each time is also possible.

[0097] This system enables similarity searches based on the mathematical distance between feature quantities of file data. When a user makes a search request specifying a particular file data on the search interface, the system performs a search for similar file data and displays the search results. The specific implementation of the similarity search will be appropriately selected from known technologies such as those described in Patent Document 5.

[0098] The search capabilities of this system include filtering information based on specified conditions. As mentioned above, information such as the creator and creation date is automatically generated for comment data and saved as structured data that forms part of the comment data. Also, as mentioned above, file data includes structured data obtained through file reading and structured data obtained through analysis. Users can also extract information by specifying the attributes and attribute values ​​of this data. Specifically, it is possible to extract comments by specifying the creator and creation date, or to extract drawing files by specifying the product name and material name.

[0099] There are no particular constraints on the user interface that enables these functions. For example, clicking on the "Keywords" entry in the search interface of Figure 3 could display the filtering interface, and similarly, clicking the ">>" icon on the left side of the first area R1 could also display the filtering interface.

[0100] This system allows the first search result obtained through the above explanation to be sequentially narrowed down using the second method, and enables searching by combining multiple methods simultaneously.

[0101] First, users can sequentially refine the first search results using a second method. The means used to obtain the first search results and the second method used for refinement can be anything. For example, using a comment or thread-based search as the first search method, it is possible to refine the results using at least one of the following: comment creator, comment date and time, and thread status. As explained above, this system uses structured data for at least a portion of the comment data and string data, including "product name," "material name," and "company name" found in the title block of drawings. Therefore, using a keyword search or similarity search of file data as the first search method, it is possible to refine the results using at least one of the product name, material name, or customer company name contained in the file data. In addition, it is also possible to refine the results by specifying whether the comment data "exists / doesn't exist" or the "creator" of the comment data using a keyword search of file data as the first search method, or to refine the results by keyword search of file data using a similarity search of file data as the first search method.

[0102] Furthermore, the above search methods can be used in combination with multiple methods simultaneously. There are no particular restrictions on the type or number of search method combinations. Therefore, the first method for refining the search described above can be used in combination with other methods. For example, it is possible to combine a search by comment or thread with filtering using at least one of the following: comment creator, comment date and time, and thread status. In addition, it is possible to combine keyword search or similarity search of file data with filtering that specifies whether the comment data "exists / does not exist", the "creator" of the comment data, or the registration date of the file data.

[0103] As a result, it becomes possible to comprehensively search and utilize information spanning multiple comments, which was difficult to achieve with conventional comment searches. This enables the efficient use of business knowledge, such as searching for past problem cases and solutions in product development.

[0104] Users can "designate recipients" and send them electronic notifications called "mentions." This mention function can be implemented using various known communication tools. In addition to mentions within this system, integration with external tools (such as Slack, Teams, and Outlook®) can also be implemented as needed. To make the mention function more effective, it is also possible to generate URLs (Uniform Resource Locators) for comments and threads. Furthermore, comment data and file data can be downloaded.

[0105] Next, the operation of the information processing system 10 according to the embodiment of this disclosure will be described with reference to Figures 12 to 14.

[0106] Figure 12 shows the processing steps for a user to create and register a comment based on a target file or existing comments.

[0107] Step S1: Select the file or comment you want to comment on. Users select a file to comment on from among several files registered in the system. Alternatively, they can select a comment to respond to an existing comment. File selection can be done, for example, from the file list screen or the search results screen.

[0108] Step S2: Instruct the system to transition to the comment creation screen. Based on the selected file or comment, the user interface transitions to a comment creation screen. After the transition, the user gains access to an interface for entering comments. Whether creating a new comment or a response, the process is handled through the same input UI.

[0109] Step S3: Enter a comment (specifying the position, mentioning, and attaching files are optional) Users can enter comments by typing text into a free-text field, using pre-prepared templates, or by writing freehand on the file viewer. The system also includes the following features: (1) Specify a specific location on the file using the mouse or similar. (2) Mention function to send messages to other users (recipient specified by ID) (3) Add attachments (images, drawings, etc.) These are at the user's discretion and will be used as needed.

[0110] Step S4: Comment Registration Instructions Comment data is registered when the user completes the input and clicks the submit or register button. The comment is recorded non-destructively and stored in the database associated with the corresponding file.

[0111] Figure 13 shows the processing procedure for searching and extracting files or comments based on search or filter conditions specified by the user. This process illustrates a flow for users to efficiently search and extract information related to comment information or file data, and is configured to allow for the flexible application of search or filtering means.

[0112] Step S21: Enter your search or filtering request. First, the user enters information for searching or filtering. This information can include a variety of conditions, such as the following: (1) Keywords in the comments (2) Comment creator, creation date and time, status (e.g., not yet addressed / completed) (3) Processing type, processing steps, processing difficulty, etc., estimated from the file data

[0113] Step S22: Perform search or filter Based on the conditions specified by the user, the processor performs a search or filtering process. This process can perform not only single search methods but also complex searches combining multiple methods, or step-by-step processing where one search result is narrowed down by another method. For example, flexible conditions can be applied such as (1) narrowing down similar drawing search results by comment creator or status, or (2) further extracting keyword search results by processing steps or structured attributes of the drawing.

[0114] Step S23: Display the results Based on the search or filtering results, relevant file data and corresponding comments are displayed. This display includes the comment thread structure, a view of the relevant file, location information, and status information, allowing users to visually understand the results and review and utilize the content.

[0115] Figure 14 shows a processing procedure for narrowing down target data by applying multiple search or filter conditions in stages. This process enables multi-stage search processing, such as "narrowing down the results of a file search by comment attributes," and is an extended embodiment compared to the single-method search shown in Figure 13.

[0116] Step S31: Enter search or filtering request First, the user enters the first search or filtering criteria. For example, the following methods are applicable: (1) Keyword search of file data (2) Feature-based similar drawing search (3) Filtering by attribute conditions such as status (incomplete / completed) and creation date

[0117] Step S32: Perform search or filter Processing is performed based on the specified first search or filter criteria, and candidate comments or files are extracted.

[0118] Step S33: Display the results As a result of the processing, the searched / extracted information (comments, files, threads, etc.) is presented to the user.

[0119] Step S34: Enter the second search or filtering request. Based on the results of step S33, the user can enter additional search or filter conditions. This allows for further refinement and additional conditional searches of the initial search results. For example, for a search result of "files with a specific keyword in the thread," it is possible to specify that only comments within that thread whose author contains the letter A should be extracted.

[0120] Step S35: Perform a second search or filtering. The second method is used to perform another search or filtering, and the first result is processed with additional conditions.

[0121] Step S36: Display the results Comments and files that match the final criteria are displayed to the user. This display may include the comment text, status, and a view of the target file related to the search criteria.

[0122] Thus, the process shown in Figure 14 allows users to utilize multiple search and extraction methods in a stepwise or combined manner, rather than relying on a single search method. This improves the accuracy of information searches, allowing for quick and efficient access to business data that matches specific purposes.

[0123] (Example configuration 1) The comment generation unit 71a stores data from multiple types of files, including at least one of CAD and drawings, and generates comments that retain related information based on response relationships, non-destructively to the file data. The display control unit 71b displays the comments on the terminal along with the file data. Furthermore, in addition to the first configuration example, the display control unit 71b performs a keyword search of the comments and displays the results of the keyword search along with the corresponding comments and the data of the files associated with those comments. This allows files and communications (comments) to be treated as a single unit, eliminating the conventional separation and enabling flexible communication management regardless of file type. It also becomes possible to access files from comment searches, allowing business knowledge to be utilized while maintaining the context of the communication.

[0124] (Second configuration example) In addition to the first configuration example, the comment generation unit 71a has the function of adding comments by specifying a particular location on the file. Users can easily understand which part and which content of the file data a comment corresponds to. For example, by directly linking comments to specific parts or areas on a drawing, the target of the comment becomes clear, improving the accuracy of communication. The correspondence between comments and their locations on the file is visually clear through icon display and highlighting, allowing users to intuitively grasp the relationships between information.

[0125] (Example of configuration 3) In addition to the first configuration example, the comment generation unit 71a can also manage the status of comments. The status management function allows for the management of the progress of comments (especially on a thread basis) using statuses such as "not started," "started," and "completed," making it easy to aggregate comments that have been addressed and those that haven't. This is expected to prevent overlooking improvement requests and tasks. Furthermore, users can visually grasp the progress and track necessary actions.

[0126] (Example of configuration 4) In addition to the first configuration example, the search unit 71c performs keyword searches on a thread-by-thread basis, spanning multiple comments. This enables searching not only individual comments but also the entire thread, including the response relationships, making it easier to grasp the context and intent of the discussion.

[0127] (Example of configuration 5) The search unit 71c extracts comments based on at least one of the following conditions, in addition to the first configuration example: the comment creator, the date and time the comment was created, and its status. This allows for understanding who created a comment, when, and for what purpose, improving the efficiency of progress management and feedback handling.

[0128] (Example 6) In addition to the first configuration example, the comment generation unit 71a has two or more of the following means. (1) A means of simply reading data from a file to obtain data. (2) A means of obtaining data by applying character recognition to image elements in the file data. (3) A means of obtaining structured data in which at least a portion of the data obtained by character recognition is given attributes estimated by either a rule-based method or a machine learning method. (4) A means of obtaining feature data or intermediate output data from file data by using a pre-trained machine learning model. (5) A means of obtaining at least one of the following, estimated using at least one of the acquired data: requirements, processing type, processing characteristics, processing steps, processing difficulty, and risk information. This expands the attribute criteria for comment searches and filtering, improving searchability.

[0129] (Example 7) In addition to the fifth configuration example, the search unit 71c performs a search or extraction of the file data using one of the following methods: a similarity search based on the similarity of the feature quantities of the file data; a search of the file data using keyword searches based on the character recognition results of the file data; or data extraction using the attributes and attribute values ​​of structured data obtained from the file data. This increases the flexibility of the search and improves the search accuracy and comprehensiveness of the target. It enables diverse information retrieval according to the user's intent.

[0130] (Example 8) In addition to the fifth or seventh configuration example, the search unit 71c further refines the results obtained from either the search or extraction process using the other method. This allows for efficient extraction of necessary information from a large volume of search results and enables flexible handling of complex business requirements.

[0131] (Example 9) In addition to the seventh configuration example, the search unit 71c combines means for performing a search and means for performing an extraction to perform both search and extraction simultaneously. By combining search conditions in this way, highly accurate filtering becomes possible, and the time required for information retrieval can be reduced.

[0132] (Example 10) In addition to the first configuration example, when a comment specifying the location of data in a file is selected while viewing a file, the display control unit 71b highlights the location in the file data specified by the selected comment, and when the location of the comment in the file data is selected, it highlights the comment associated with the selected location. This allows the correspondence between comments and file locations to be visually grasped, and the relationships between information to be understood intuitively.

[0133] (Example 11) In addition to the first configuration example, the display control unit 71b provides the user with two or more input methods for comments, including free text input, input of responses to input templates presented by the system, and direct freehand writing in the file view. This allows for flexible comment input according to the user's work style and input environment, increasing adaptability for implementation and operation.

[0134] (Example 12) The comments have a threaded data structure that associates a main comment with its response comments. In this disclosure, a comment in a threaded data structure may be interpreted as a comment that can non-destructively store related information based on response relationships with respect to the file data. A comment in a threaded data structure may be interpreted as a comment that logically connects the response relationships between comments. A comment in a threaded data structure may be interpreted as a comment in which multiple comments are associated with each other based on response relationships, and the main comment and its response comments are logically connected as a series of related data. With such a threaded data structure for comments, not only are individual comments recorded independently, but their response relationships can also be logically connected and managed. This makes it possible to clearly understand hierarchical communication structures, such as multiple replies to a main comment, and even further replies to those replies. Furthermore, the systematic management of the comment structure makes it easy to search and extract, manage progress, and track history on a thread-by-thread basis. In addition, by configuring comments to be added non-destructively to the file data, it becomes possible to maintain and refer to the communication history integrally with the file without compromising the integrity of the original drawings or design files.

[0135] (Example 13) The 13th configuration example implements the processing content of the 1st configuration example as a program for a computer to execute. This allows it to be provided as a program that is device-independent and can be integrated into existing information processing systems.

[0136] (Example 14) The 14th configuration example provides a method for having a computer execute the processing content of the 1st configuration example. This makes it possible to apply the solution on a wide range of platforms, including cloud environments and business applications.

[0137] This embodiment eliminates the disconnect between files and communication. It is expected that this embodiment will enable a unified communication experience regardless of file type, allowing for the accumulation and utilization of business knowledge without loss.

[0138] The control unit and method described herein may be implemented by a dedicated computer comprising a processor programmed to perform one or more functions embodied by a computer program. Alternatively, the apparatus and method described herein may be implemented by a dedicated computer comprising a processor composed of dedicated hardware logic circuits. Alternatively, the apparatus and method described herein may be implemented by one or more dedicated computers comprising a combination of a processor that executes a computer program and one or more hardware logic circuits. Furthermore, the computer program may be stored as instructions executed by the computer on a computer-readable non-transitional tangible recording medium.

[0139] The above process can also be implemented using dedicated hardware circuits. In this case, it may be executed on a single piece of hardware or on multiple pieces of hardware.

[0140] In each of the above embodiments, the term "processor" refers to a processor in a broad sense, and includes general-purpose processors (e.g., CPU: Central Processing Unit, etc.) and dedicated processors (e.g., GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, programmable logic device, etc.).

[0141] Furthermore, the processor operations in each of the above embodiments may not be performed by a single processor, but may be performed by multiple processors located in physically separate locations working together. Also, the order of the processor operations is not limited to the order described in each of the above embodiments, but may be changed as appropriate.

[0142] Furthermore, the above program may be provided on a computer-readable non-temporary recording medium such as a USB (Universal Serial Bus) memory, flexible disk, or CD-ROM (Compact Disc Read Only Memory), or it may be provided online via a network such as the Internet. In this case, the program recorded on the computer-readable non-temporary recording medium is usually transferred to and stored in memory or storage. This program may also be provided, for example, as a standalone application software, or it may be incorporated into the software of each device as a function of that device.

[0143] The program of this application can be provided as a program product. A program product includes all forms of products for providing a program. For example, a program product includes a program provided via a network such as the Internet, and non-temporary computer-readable recording media such as CD-ROMs and DVDs (Digital Video Discs) on which the program is stored.

[0144] (Note) The following is an addendum regarding the nature of this disclosure.

[0145] (Note 1) Equipped with a processor, The aforementioned processor, It stores data from multiple types of files, including at least one of CAD and drawings, allows for location specification and status management on the files, and generates comments that can retain related information based on response relationships to the data in the files in a non-destructive manner. An information processing device that displays the comments on a terminal along with the data of the aforementioned file, performs a keyword search on the comments, and displays the results of the keyword search along with the corresponding comments and the data of the aforementioned file associated with those comments. (Note 2) The processor is an information processing device as described in Appendix 1, which allows specifying a location on the file. (Note 3) The processor is an information processing device as described in Appendix 1 or 2, capable of status management. (Note 4) The processor is an information processing device as described in Appendix 1, which performs a thread-based keyword search across multiple comments. (Note 5) The processor is an information processing device according to any one of the appendices 1 to 4, which extracts comments based on at least one of the following conditions: the creator of the comment, the date and time the comment was created, and its status. (Note 6) The aforementioned processor, A means of simply reading the data from the aforementioned file to obtain the data, A means for obtaining data by applying character recognition to image elements in the data of the aforementioned file, A means for obtaining structured data in which at least a portion of the data obtained by the aforementioned character recognition is given attributes estimated by either a rule-based method or a machine learning method, A means for obtaining feature data or intermediate output data from the data of the aforementioned file by using a pre-trained machine learning model, A means of obtaining at least one of the following, estimated using at least one of the acquired data: requirements specification, processing type, processing characteristics, processing steps, processing difficulty, and risk information. An information processing device described in any one of the appendices 1 to 5, having two or more of the above. (Note 7) The aforementioned processor, Searching based on the similarity of feature quantities in the aforementioned file, Searching the data in the aforementioned file by keyword search using the character recognition results of the data in the aforementioned file, Data extraction using the attributes and attribute values ​​of the structured data obtained from the aforementioned file, An information processing device according to any one of the appendices 1 to 6, which performs a search or extraction of data in the aforementioned file using any of the following. (Note 8) The aforementioned processor, An information processing device according to any one of the appendices 1 to 7, wherein the results obtained from either the search or the extraction are narrowed down by the other. (Note 9) The aforementioned processor, An information processing apparatus according to any one of the appendices 1 to 8, which combines means for performing the search and means for performing the extraction to perform the search and the extraction simultaneously. (Note 10) The aforementioned processor, When a comment specifying the location of data in the file is selected while viewing the file, the selected comment will highlight the location of the data in the file specified by that comment, An information processing device according to any one of the appendices 1 to 9, wherein the position of the comment in the data of the aforementioned file is selected, and the comment associated with the selected position is highlighted. (Note 11) The aforementioned processor, An information processing device according to any one of the appendices 1 to 10, which provides the user with the ability to select two or more input methods for the aforementioned comments, from inputting free text, inputting a response to an input template presented by the system, and directly writing to a file view freehand. (Note 12) The aforementioned comments are information processing devices as described in any one of appendices 1 to 11, having a thread-type data structure that associates a main comment with its response comments. (Note 13) It stores data from multiple file types, including at least one of CAD and drawings. Non-destructively, comments are generated for the data in the aforementioned file, which can retain related information based on the response relationship. The terminal displays the comments along with the data of the aforementioned file, performs a keyword search on the comments, and displays the results of the keyword search along with the corresponding comments and the data of the aforementioned file associated with those comments. An information processing program that a computer executes. (Note 14) It stores data from multiple file types, including at least one of CAD and drawings. A non-destructive thread-type data structure comment is generated for the data in the aforementioned file. The terminal displays the comments along with the data of the aforementioned file, performs a keyword search on the comments, and displays the results of the keyword search along with the corresponding comments and the data of the aforementioned file associated with those comments. An information processing method that causes a computer to perform a task. (Note 15) It stores data from multiple file types, including at least one of CAD and drawings. Non-destructively, comments are generated for the data in the aforementioned file, which can retain related information based on the response relationship. The terminal displays the comments along with the data of the aforementioned file, performs a keyword search on the comments, and displays the results of the keyword search along with the corresponding comments and the data of the aforementioned file associated with those comments. A computer program product that includes a program that causes a computer to perform a task. (Note 16) It stores data from multiple file types, including at least one of CAD and drawings. Non-destructively, comments are generated for the data in the aforementioned file, which can retain related information based on the response relationship. The terminal displays the comments along with the data of the aforementioned file, performs a keyword search on the comments, and displays the results of the keyword search along with the corresponding comments and the data of the aforementioned file associated with those comments. A computer-readable recording medium on which instructions for a computer to perform an action are recorded.

[0146] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference. [Explanation of Symbols]

[0147] 10. Information Processing Systems 16 Information Processing Devices 18, 18A, 18B, 18C User Terminals 19 Network 28 Memory section 70 Computers 71 CPU 71a Comment generation section 71b Display Control Unit 71c Search section 72 memory 73 Memory section 74 Input / Output Interfaces 75 Reading and Writing Section 76 Network Interfaces 77 System bus R1 1st area R2 2nd area R3 3rd area R4 4th area

Claims

1. Equipped with a processor, The aforementioned processor, The system stores data from multiple types of files, including at least one of CAD and drawings, and generates comments that can retain related information based on response relationships for the data in the files in a non-destructive manner. An information processing device that displays the comments on a terminal along with the data of the aforementioned file, performs a keyword search on the comments, and displays the results of the keyword search along with the corresponding comments and the data of the aforementioned file associated with those comments.

2. The information processing apparatus according to claim 1, wherein the processor is capable of specifying a location on the file.

3. The information processing apparatus according to claim 1, wherein the processor is capable of status management.

4. The information processing apparatus according to claim 1, wherein the processor performs a thread-based keyword search across a plurality of comments.

5. The information processing apparatus according to claim 1, wherein the processor extracts the comment based on at least one of the creator of the comment, the date and time the comment was created, and its status.

6. The aforementioned processor, A means of simply reading the data from the aforementioned file to obtain the data, A means for obtaining data by applying character recognition to image elements in the data of the aforementioned file, A means for obtaining structured data in which at least a portion of the data obtained by the aforementioned character recognition is given attributes estimated by either a rule-based method or a machine learning method, A means for obtaining feature data or intermediate output data from the data of the aforementioned file by using a pre-trained machine learning model, A means of obtaining at least one of the following, estimated using at least one of the acquired data: requirements specification, processing type, processing characteristics, processing steps, processing difficulty, and risk information. The information processing apparatus according to claim 1, comprising any two or more of the above.

7. The aforementioned processor, Searching based on the similarity of feature quantities in the aforementioned file, Searching the data in the aforementioned file by keyword search using the character recognition results of the data in the aforementioned file, Data extraction using the attributes and attribute values ​​of the structured data obtained from the aforementioned file, The information processing apparatus according to claim 5, which performs a search or extraction of data in the file using any of the following.

8. The aforementioned processor, The information processing apparatus according to claim 7, wherein the results obtained by performing a search or extraction of data in the aforementioned file and the results obtained by performing a keyword search of the comments or extracting the comments are narrowed down by the other of these results.

9. The aforementioned processor, The information processing apparatus according to claim 7, comprising combining means for performing the search and means for performing the extraction to simultaneously perform the search and the extraction.

10. The aforementioned processor, When a comment specifying the location of data in the file is selected while viewing the file, the selected comment will highlight the location of the data in the file specified by that comment, The information processing apparatus according to claim 1, wherein the position of the comment in the data of the file is selected, and the comment associated with the selected position is highlighted.

11. The aforementioned processor, The information processing apparatus according to claim 1, wherein the user can select from two or more input methods as means for inputting the comment, including inputting free text, inputting a response to an input template presented by the system, and directly writing in a file view freehand.

12. The information processing apparatus according to claim 1, wherein the comments have a thread-type data structure that associates a main comment with a response comment.

13. It stores data from multiple file types, including at least one of CAD and drawings. Non-destructively, comments are generated for the data in the aforementioned file, which can retain relevant information based on the response relationship. The terminal displays the comments along with the data of the aforementioned file, performs a keyword search on the comments, and displays the results of the keyword search along with the corresponding comments and the data of the aforementioned file associated with those comments. An information processing program that a computer executes.

14. It stores data from multiple file types, including at least one of CAD and drawings. A non-destructive thread-type data structure comment is generated for the data in the aforementioned file. The terminal displays the comments along with the data of the aforementioned file, performs a keyword search on the comments, and displays the results of the keyword search along with the corresponding comments and the data of the aforementioned file associated with those comments. A method of information processing performed by a computer.

Images