Information processing program, information processing method, and information processing device
Patent Information
- Application Number
- JP2025133279
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2025-08-08
- Publication Date
- 2026-01-05
- Estimated Expiration
- 2045-08-08
Smart Images

Figure 0007793847000001_ABST
Abstract
Description
[Technical Field]
[0001] An embodiment of the present invention relates to an information processing program, an information processing method, and an information processing device. [Background technology]
[0002] In software development, in order to maintain and improve quality, a common method is to issue and manage reports called tickets (bug tickets) for defects and other issues discovered during development.
[0003] These bug tickets are often created manually by quality control teams, developers, etc. using ticket management systems. However, the number of bug tickets created is increasing depending on the scale of development, and creating tickets manually requires a great deal of effort and time.
[0004] In recent years, various management systems have been used for managing bugs.
[0005] Patent document 1 describes a quality control device that automatically creates a quality report based on quality information including development progress and bug occurrence status obtained from a terminal device, and if there are any items left unfilled in the quality report, it complements the missing information from a development results database.
[0006] Patent Document 2 describes a bug management system that receives bug information sent from a terminal and generates and updates bug management information for each version. [Prior art documents] [Patent documents]
[0007] [Patent Document 1] Patent No. 5464672 [Patent Document 2] Japanese Patent Application Laid-Open No. 2012-38252 Summary of the Invention [Problem to be solved by the invention]
[0008] In the invention disclosed in Patent Document 1, in order to create a quality report, quality information including the progress of development and the occurrence of bugs is required, and it is not possible to efficiently create bug tickets that indicate the occurrence of bugs.
[0009] In the invention disclosed in Patent Document 2, bug information is required to generate and update bug management information, and it is not possible to efficiently create bug tickets that indicate the occurrence status of bugs.
[0010] The present invention has been made in view of the above circumstances, and aims to provide an information processing program, an information processing method, and an information processing device that can improve the efficiency of creating reports on events. [Means for solving the problem]
[0011] In one embodiment, the information processing program is a program that can cause a computer to perform the following functions: receive audio data related to events that occur in software development; obtain analysis results by analyzing information related to the events based on the audio data; and create an event report based on the analysis results. [Effects of the Invention]
[0012] According to the embodiment, it is possible to make the creation of reports on events more efficient. [Brief explanation of the drawings]
[0013] [Figure 1] FIG. 1 is a block diagram illustrating an information processing system according to an embodiment. [Figure 2] FIG. 2 is a block diagram illustrating an example of a functional configuration of the management server according to the embodiment. [Figure 3] FIG. 3 is a block diagram illustrating an example of a functional configuration of a user terminal according to the embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of the configuration of a database server according to the embodiment. [Figure 5] FIG. 5 is a diagram illustrating an example of a login image displayed on a display device of a user terminal according to the embodiment. [Figure 6] FIG. 6 is a diagram illustrating an example of a created image displayed on a display device of a user terminal according to the embodiment. [Figure 7] FIG. 7 is a diagram illustrating an example of a report image displayed on a display device of a user terminal according to the embodiment. [Figure 8] FIG. 8 is a sequence diagram illustrating an example of an information processing procedure related to report creation by the information processing system according to the embodiment. [Figure 9] FIG. 9 is a sequence diagram illustrating an example of an information processing procedure for creating an assumed list by the information processing system according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0014] (Embodiment) Hereinafter, the embodiments will be described with reference to the drawings. In the drawings, the same components are denoted by the same reference numerals whenever possible, and duplicated explanations will be omitted.
[0015] (Configuration example) FIG. 1 is a block diagram illustrating an information processing system S according to the embodiment. The information processing system S is a system for quality control, for example, in software development, where after development work by developers (engineers), a quality control team (verifiers) performs verification, including bug detection, to perform quality control. A bug refers to a defect, flaw, or malfunction discovered through verification work. In the following description, a bug is also referred to as an event. An event refers to a problem discovered through verification work. An event refers to an issue that requires reporting or response. A quality control team may include multiple verifiers. The multiple verifiers may, for example, be verifiers belonging to a single organization such as a company, or may be verifiers belonging to multiple different organizations. A verifier is responsible for quality control work for a project. A verifier performs verification work for each project. A verifier may also perform verification work for each task. If a verifier discovers the occurrence of an event during verification work, they create an event report.
[0016] An event report is also simply called a report. An event report refers to a record table that records information about an event. An event report is a report for managing an event. An event report may refer to a unit for managing an event. An event report is also called a ticket. An event report includes, for example, at least one report item and information for each report item. A report item refers, for example, to at least one item included in a report. A report item includes items necessary for creating a report. A report item includes, for example, at least one of the following: event, target screen, occurrence procedure, reproduction environment, and expected value. An event is an item that indicates an overview of the malfunction. An event may also be an item that indicates a description of the malfunction. A target screen is an item that indicates the screen or function name on which the malfunction occurred. An occurrence procedure is an item that indicates the operating procedure when the malfunction occurred or the operating procedure for reproducing the malfunction. A reproduction environment is an item that indicates the operating environment of the system or software in which the malfunction occurred. A reproduction environment is an item that indicates, for example, the operating system (OS), browser, terminal, application version, etc. on which the malfunction occurred. The expected value is an item that indicates the correct operation that is originally expected. The report items are not limited to the above items and may include other items.
[0017] The project is primarily a software development project. Projects include, for example, the development of a website that provides web services and the development of an application. The project includes multiple tasks. A task, for example, refers to the work required for the development work of the project. A task, for example, refers to individual work that is a breakdown of the work that makes up the project. The verifier may be the person in charge of each project or the person in charge of each task. In the following description, the verifier is also referred to as the administrator, the person in charge, or the member. The information processing system S performs quality control for each project. The information processing system S may also perform quality control for the work for each task. The information processing system S may be a system that provides quality control services for performing quality control for projects.
[0018] The information processing system S includes a management server 1, a user terminal 2, a generation AI (Artificial Intelligence) system 3, and a database (DB) server 4. The management server 1, the user terminal 2, the generation AI system 3, and the database server 4 are communicatively connected to each other via a network. For example, the network NW is the Internet. The network may include a wireless network or a wired network. Note that the information processing system S may also refer to a system including at least two devices among the management server 1, the user terminal 2, the generation AI system 3, and the database server 4. The information processing system S may also include a developer terminal used by a developer. The developer terminal is, for example, a PC (Personal Computer), a smartphone, or a tablet terminal.
[0019] The management server 1 is a device that collects data and processes the collected data. The device includes a computer. The management server 1 provides, for example, quality control services. The management server 1 is communicatively connected to a user terminal 2, a generation AI system 3, and a database server 4 via a network. The management server 1 receives various data from the user terminal 2, the generation AI system 3, and the database server 4, and outputs various data to the user terminal 2, the generation AI system 3, and the database server 4. The management server 1 may be an API server that provides an API (Application Programming Interface). The management server 1 is an example of an information processing device. An example configuration of the management server 1 will be described later.
[0020] The user terminal 2 is a device capable of communicating with other devices. The user terminal 2 is a PC, a smartphone, a tablet terminal, or the like. The user terminal 2 is communicatively connected to the management server 1, the generation AI system 3, and the database server 4 via a network. The user terminal 2 is used by a user who uses the quality control service. The user terminal 2 is used, for example, by a verifier. The verifier uses the user terminal 2 to create an event report. The information processing system S may include multiple user terminals 2. In the following description, the term "user" may be interpreted as a verifier, a person in charge, a member, or a person.
[0021] The generative AI system 3 is a device that generates and outputs information according to input information. The generative AI system 3 is communicatively connected to the management server 1, the user terminal 2, and the database server 4 via a network. The generative AI system 3 includes a generative model. The generative model is, for example, a generative AI equipped with a language model. The language model is, for example, a model that outputs natural language in response to natural language input, such as ChatGPT (Generative Pretrained Transformer). The language model includes language models such as Transformers including BERT (Bidirectional Encoder Representations from Transformers) and BART (Bidirectional and Auto-regressive Transformer), and Recurrent Neural Networks (RNN).
[0022] The generative model is, for example, a natural language generation model or a natural language processing model. The generative model includes a general-purpose natural language processing learning model such as a large-scale language model (LLM) that has been trained using a huge amount of data. The generative model may be a language model that has been fine-tuned for quality control. The generative model may also be a language model that can handle various tasks without fine-tuning. The generative model is not limited to the above. The generative model may be a combination of text generation AI, speech synthesis AI, and image processing AI.
[0023] A generative model is an AI that generates natural language answers based on input from a user. A prompt containing instructions is input to the generative model. At least one of inference data, including voice data indicating voice, text data indicating text, and image data indicating an image, is input to the generative model. The generative model can handle any input data format, such as text, table format, PDF, Word, Excel, image, etc. The generative model performs inference on the input data according to the instructions indicated by the prompt and outputs the inference results in data formats such as voice data, text data, and image data. Inference refers to, for example, analysis, classification, prediction, or summary. In the following description, a prompt is also referred to as a command statement, a question statement, or a directive statement.
[0024] The generative model generates responses based on the instructions, and may perform additional learning based on feedback on the generated responses.
[0025] The generative AI system 3 receives, for example, a command statement from the management server 1. The generative AI system 3 receives input data from the management server 1. The input data is, for example, text data based on voice data. The input data may be voice data. The input data is input data related to an event. The generative AI system 3 analyzes information related to the event based on receiving the input data from the management server 1. The analysis includes generating information related to the event. The information related to the event includes information that can identify the event. The information related to the event includes detailed information about the event. The detailed information about the event includes at least one of, for example, a summary of the event, the target screen on which the event occurred, the procedure in which the event occurred, the environment in which the event was reproduced, and an expected value. The generative AI system 3 generates an analysis result. The analysis result is, for example, a response to the command statement. The generative AI system 3 outputs the analysis result to the management server 1.
[0026] In addition, the generation AI system 3 may be communicatively connected to the management server 1, user terminal 2, and database server 4 via a network such as a local area network within the organization where the information processing system S is operated. The generation AI system 3 may function as an API service provided by the management server 1.
[0027] The database server 4 is a device that centrally manages data. The device includes a computer. The database server 4 provides services with data management functions. The database server 4 is communicatively connected to the management server 1, the user terminal 2, and the generation AI system 3 via a network. The database server 4 receives various data from the management server 1, the user terminal 2, and the generation AI system 3, and outputs various data to the management server 1, the user terminal 2, and the generation AI system 3. An example configuration of the database server 4 will be described later.
[0028] An example of the configuration of the management server 1 will be described. The management server 1 is a device including a processor 11, a main memory 12, an auxiliary storage device 13, and a communication interface (I / F) 14. The components that make up the management server 1 are connected to each other so that signals can be input and output. In FIG. 1, the interface is written as "I / F."
[0029] The processor 11 corresponds to the central part of the management server 1. The processor 11 is an element that constitutes the computer of the management server 1. The processor 11 includes one or more processors. For example, the processor is a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit), but is not limited to these. The processor may be composed of various circuits. The processor 11 loads a program that is pre-stored in the main memory 12 or the auxiliary storage device 13 into the main memory 12. The program is a program that can cause the processor 11 of the management server 1 to execute processing by each unit described below. The processor 11 performs various operations by executing the program loaded into the main memory 12. The processor 11 is an example of a processing circuit.
[0030] The main memory 12 corresponds to the main storage portion of the management server 1. The main memory 12 includes a nonvolatile memory area and a volatile memory area. The main memory 12 stores an operating system or programs in the nonvolatile memory area. The main memory 12 uses the volatile memory area as a work area where data is rewritten as appropriate by the processor 11. For example, the main memory 12 includes a ROM (Read Only Memory) as a nonvolatile memory area. For example, the main memory 12 includes a RAM (Random Access Memory) as a volatile memory area. The main memory 12 stores programs.
[0031] The auxiliary storage device 13 corresponds to the auxiliary storage portion of the management server 1. The auxiliary storage device 13 is an EEPROM (registered trademark) (Electric Erasable Programmable Read-Only Memory), an HDD (Hard Disc Drive), an SSD (Solid State Drive), or the like. The auxiliary storage device 13 stores the above-mentioned programs, data used by the processor 11 when performing various processes, and data generated by the processes in the processor 11. The auxiliary storage device 13 stores the above-mentioned programs.
[0032] The communication interface 14 includes various interfaces that connect the management server 1 to other devices via a network in accordance with a predetermined communication protocol so that the management server 1 can communicate with other devices.
[0033] The hardware configuration of the management server 1 is not limited to the above configuration, and the management server 1 allows the omission or modification of the above components and the addition of new components as appropriate.
[0034] An example of the configuration of the user terminal 2 will be described. The user terminal 2 is a device including a processor 21, a main memory 22, an auxiliary storage device 23, a communication interface (I / F) 24, and an input / output interface (I / F) 25. The components constituting the user terminal 2 are connected to each other so that signals can be input and output. In FIG. 1, the interface is indicated as "I / F."
[0035] The processor 21 corresponds to the central part of the user terminal 2. The processor 21 is an element that constitutes the computer of the user terminal 2. Like the processor 11, the processor 21 includes one or more processors. The processor 21 loads a program that is pre-stored in the main memory 22 or the auxiliary storage device 23 into the main memory 22. The program is a program that can cause the processor 21 of the user terminal 2 to execute processing by each unit described below. The processor 21 performs various operations by executing the program loaded into the main memory 22. The processor 21 is an example of a processing circuit.
[0036] The main memory 22 corresponds to the main storage portion of the user terminal 2. The main memory 22 includes a non-volatile memory area and a volatile memory area. The main memory 22 may be configured in the same manner as the main memory 12.
[0037] The auxiliary storage device 23 corresponds to the auxiliary storage portion of the user terminal 2. The auxiliary storage device 23 may be configured in the same manner as the auxiliary storage device 13. The auxiliary storage device 23 stores the above-mentioned programs.
[0038] The communication interface 24 includes various interfaces that connect the user terminal 2 to other devices via a network in accordance with a predetermined communication protocol so that the user terminal 2 can communicate with other devices.
[0039] The input / output interface 25 is an interface for connecting the user terminal 2 to an external device. The input / output interface 25 receives input data from an external device and outputs output data to the external device.
[0040] The hardware configuration of the user terminal 2 is not limited to the above configuration. The user terminal 2 allows the above components to be omitted or changed, and new components to be added, as appropriate.
[0041] FIG. 2 is a block diagram showing an example of the functional configuration of the management server 1 according to the embodiment. The management server 1 includes a control unit 110. The control unit 110 is a function that is realized by the management server 1 when the processor 11 executes the above-mentioned program. When the processor 11 executes the above-mentioned program, the control unit 110 functions as a communication processing unit 1101, a generation processing unit 1102, a creation processing unit 1103, and an analysis processing unit 1104.
[0042] The communication processing unit 1101 processes communications between the management server 1 and other devices. The communication processing unit 1101 acquires data from the user terminal 2 via the communication interface 14. The communication processing unit 1101 outputs data to the user terminal 2 via the communication interface 14. In the following explanation, "acquire" can be read as "receive". "Output" can be read as "send" or "return".
[0043] For example, the communication processing unit 1101 receives login information from the user terminal 2. The login information is, for example, information required to log in to or access the quality control service. The login information includes, for example, authentication information such as an API key. The communication processing unit 1101 transmits person in charge information regarding the person in charge of the project to the user terminal 2. The person in charge information is information indicating the person in charge. The person in charge information is, for example, the person in charge name, the person in charge number, or the person in charge ID. The person in charge information is not limited to the above and may be information that can identify the person in charge. The person in charge information includes information indicating at least one person in charge. The person in charge information may also be information indicating a preset person in charge.
[0044] The communication processing unit 1101 receives voice data from the user terminal 2. The voice data is, for example, voice data related to events that occur during software development. Events that occur during software development are, for example, events that are discovered during the verification phase of the development program. The communication processing unit 1101 may receive additional voice data from the user terminal 2. The additional voice data is, for example, voice data input by the user based on an error notification related to the verification results described below. The communication processing unit 1101 sends the notification to the user terminal 2. The notification includes an error notification and a completion notification. The error notification includes, for example, a notification related to the verification results based on the voice data. The verification results indicate the results of the verification by the generation AI system 3 described below. The error notification includes a notification related to the format check results of the report. The format check results indicate the results of the format check of the report by the management server 1 described below. The completion notification includes a completion notification related to the registration of the report.
[0045] The communication processing unit 1101 receives case information from the user terminal 2. The case information includes information that can identify the target project or the target task. The case indicates a project or a task. The information that can identify the target project or the target task is, for example, the case name. The case name indicates, for example, the project name of the target project or the task name of the target task. The information that can identify the target project may be the project ID of the target project. The information that can identify the target task may be the task ID of the target task. The target project indicates the project that is the target of processing. The target task indicates the task that is the target of processing. Processing includes processing related to creating an event report. Processing includes processing related to creating an assumption list. The target project or target task is also referred to as the project or task to be verified. The target project or target task is also referred to as the project or task to be analyzed.
[0046] The case information may include, for example, information indicating a list of screens related to the target project or the target task. The screen list is list information of screens created for the target project or the target task. The case information may include, for example, information indicating a list of functions related to the target project or the target task. The function list is list information of functions created for the target project or the target task. The case information is an example of information related to the target case. The target case indicates, for example, a case to be analyzed. The target case is, for example, a new case. A new case may be a case before development. A new case may be a case for which development has been completed and verification has not yet been performed. A new case may be a case for which no event report has been created. The target case may indicate a case for which a list of expected events is to be created. The communication processing unit 1101 transmits the expected event list to the user terminal 2. The expected event list is a list of event reports that are expected to occur for the target case. The expected event list may include a list of events that are expected to occur for the target case. The expected event list indicates a list of expected events generated by the generation AI system 3 based on the case information. The list of expected events is also called the expected list.
[0047] The communication processing unit 1101 acquires data from the database server 4 via the communication interface 14. The communication processing unit 1101 outputs data to the database server 4 via the communication interface 14. For example, the communication processing unit 1101 sends a person in charge information request to the database server 4. The communication processing unit 1101 acquires person in charge information from the database server 4.
[0048] The generation processing unit 1102 performs processing with the generation AI system 3. The generation processing unit 1102 performs processing in cooperation with the generation AI system 3. The generation processing unit 1102 acquires data from the generation AI system 3 via the communication interface 14. The generation processing unit 1102 outputs data to the generation AI system 3 via the communication interface 14.
[0049] The generation processing unit 1102 processes data to be output to the generation AI system 3. For example, the generation processing unit 1102 performs a speech transcription process on the audio data and converts it into text data. The speech transcription process may be performed by any method.
[0050] The generation processing unit 1102 generates a command statement, inputs the command statement to the generation AI system 3, and obtains a response to the command statement from the generation AI system 3. The command statement includes, for example, a verification result generation command statement for generating a verification result based on text data. The generation processing unit 1102 inputs the text data to the generation AI system 3 and obtains the verification result from the generation AI system 3. Verification is also called validation. Verification includes verifying whether the text data contains information corresponding to report items. The verification result is information indicating whether the text data contains information corresponding to each of multiple report items. The verification result is, for example, information indicating "True" or "False" for each report item. "True" indicates that the text data contains information corresponding to the report item. "False" indicates that the text data does not contain information corresponding to the report item. If the text data does not contain information corresponding to the report item, the generation processing unit 1102 determines that the voice data contains missing information. If the text data includes information corresponding to each of the report items, the generation processing unit 1102 determines that there is no missing information in the audio data.
[0051] The command statement includes, for example, an analysis result generation command statement for generating analysis results obtained by analyzing information about an event based on text data. The generation processing unit 1102 inputs the text data into the generation AI system 3 and obtains the analysis results from the generation AI system 3. The analysis indicates analysis of report items. The analysis includes generating information corresponding to the report items. The analysis may include a process of sorting information corresponding to the report items based on the text data. The analysis may include a process of adding information corresponding to the report items based on the text data. The analysis results include information generated for each report item. The analysis results include information about at least one of items such as the event, target screen, occurrence procedure, reproduction environment, and expected value.
[0052] The generation processing unit 1102 acquires an analysis result obtained by analyzing information related to an event based on the audio data. The generation processing unit 1102 may acquire an analysis result obtained by analyzing information related to an event based on additional audio data. The generation processing unit 1102 may acquire an analysis result generated in a preset format from the generation AI system 3. The preset format is, for example, but is not limited to, a JSON format. The format of the analysis result may be set arbitrarily.
[0053] The generation processing unit 1102 may use a preset prompt template and generate a command statement by combining the template with input data.
[0054] The generation processing unit 1102 may input voice data, instead of text data, to the generation AI system 3. In this case, the generation AI system 3 may perform voice recognition processing on the voice data.
[0055] In response to a request from the generation AI system 3, the generation processing unit 1102 may collect information necessary for generating a response from the database server 4 or the like and input it to the generation AI system 3.
[0056] The generation processing unit 1102 inputs the case information and historical information of event reports related to the target case into the generation AI system 3 and obtains a list of anticipated events. The historical information of event reports related to the target case includes, for example, information on past event reports for projects or tasks related to the target case. The historical information of event reports related to the target case is an example of a history of past event reports related to the target case.
[0057] An event report related to the target case is also called an associated report. An associated report refers to an event report created for a case related to the target case. An event related to the target case is, for example, a project related to the target case. An event related to the target case is also called an associated case. A associated case may be a project similar to the project of the target case. A related case may be a task related to the target case. A related case may be a task similar to a task of the target case. A related case may be an image related to the target case. A related case may be an image similar to an image of the target case. A related case may be a function related to the target case. A related case may be a function similar to a function of the target case.
[0058] The related report may be an event report created for a screen similar to a screen included in the screen list included in the case information. The related report may be an event report created for a function similar to a function included in the function list included in the case information. History information of event reports related to the target case is also referred to as related report history information. The related report history information may include information on past event reports created by the management server 1.
[0059] The generation processing unit 1102 may input an assumption list generation command statement for generating an assumed event list to the generation AI system 3.
[0060] The creation processing unit 1103 creates a report based on the analysis results obtained from the generation AI system 3. The creation processing unit 1103 may create a report in a preset format based on the analysis results. The creation processing unit 1103 performs a format check on the confirmed report. The confirmed report indicates, for example, a report confirmed by a user. The confirmed report may be a report edited by a user. The format check includes verifying whether the report format is appropriate. The format check is, for example, a JSON type check. The format check may be a check on any format. The format check includes, for example, a check on the data structure. The format check includes a check on the data format for each report item. The data format check includes, for example, a check on whether data in an unexpected data format is included for each report item. The format check includes a check on required report items. The check on required report items includes, for example, a check on whether data is missing from required report items. The format check is not limited to the above checks and may include other check contents.
[0061] The creation processing unit 1103 registers the report based on the result of the format check. The creation processing unit 1103 may output the report to the database server 4.
[0062] The analysis processing unit 1104 acquires history information of event reports related to the target case based on the case information. The analysis processing unit 1104 transmits a history information request to the database server 4, for example, via the communication interface 14. The history information request is, for example, a request for history information of event reports related to the target case.
[0063] The analysis processing unit 1104 acquires related report history information from the database server 4 via the communication interface 14. The analysis processing unit 1104 acquires a list of expected events for the target case based on the case information and the related report history information from the generation AI system 3. The analysis processing unit 1104 returns the list of expected events to the user terminal 2.
[0064] FIG. 3 is a block diagram showing an example of the functional configuration of the user terminal 2 according to the embodiment.
[0065] The user terminal 2 includes a control unit 210. The control unit 210 is a function that is realized by the user terminal 2 when the processor 21 executes the above-mentioned program. When the processor 21 executes the above-mentioned program, the control unit 210 functions as a communication processing unit 2101, an acquisition unit 2102, and a display processing unit 2103.
[0066] The communication processing unit 2101 processes communications between the user terminal 2 and other devices. The communication processing unit 2101 acquires data from the management server 1 via the communication interface 24. The communication processing unit 1101 outputs data to the management server 1 via the communication interface 24.
[0067] For example, the communication processing unit 2101 transmits login information to the management server 1. The communication processing unit 2101 acquires person in charge information from the management server 1.
[0068] The communication processing unit 2101 transmits the voice data to the management server 1. The communication processing unit 1101 may transmit additional voice data to the management server 1. The communication processing unit 1101 obtains a notification from the management server 1.
[0069] The communication processing unit 2101 transmits the case information to the management server 1. The communication processing unit 2101 acquires the anticipated event list from the management server 1.
[0070] The acquisition unit 2102 acquires input data based on a user operation. For example, the acquisition unit 2102 acquires voice data based on a user operation of inputting voice. For example, the acquisition unit 2102 acquires voice data based on voice input from a voice input device such as a microphone. For example, the acquisition unit 2102 acquires text data based on data input via an input device such as a keyboard.
[0071] The display processing unit 2103 displays various images on the display device. The display processing unit 2103 displays a login image on the display device. The login image is, for example, an image displayed on the display device when a user logs in to the quality control service. The display processing unit 2103 displays a created image on the display device. The created image is, for example, an image displayed when a user creates an event report. The display processing unit 2103 displays a report image on the display device. The report image is an image that displays an event report created by the management server 1. The display processing unit 2103 displays an error notification image on the display device. The error notification image is an image that displays an error notification. The display processing unit 2103 displays a completion notification image on the display device. The completion notification image is an image that displays a completion notification. The display processing unit 2103 displays an expected event list image on the display device. The expected event list image is an image that displays a list of expected events.
[0072] FIG. 4 is a diagram showing an example of the configuration of the database server 4 according to the embodiment. The database server 4 includes a person in charge information storage area 41 and a history information storage area 42.
[0073] The person in charge information storage area 41 stores person in charge information. The person in charge information storage area 41 stores person in charge information for one or more projects or tasks. The data in the person in charge information storage area 41 is updated by adding, updating, deleting, etc. person in charge information. Person in charge information is information that can identify a person in charge of a project or task. Person in charge information includes, for example, project identification information and person in charge identification information. Project identification information is unique identification information assigned to each project to individually identify the project. Project identification information is, for example, a project ID, a project key, or a project name. Project ID indicates a unique ID assigned to each project. Project key indicates a unique key assigned to each project. Project name indicates the name of the project. Person in charge identification information is unique identification information assigned to each person in charge to individually identify the person in charge. Person in charge identification information is, for example, a person in charge name, a person in charge number, or a person in charge ID. Person in charge name indicates the name, title, or user name of the person in charge. Person in charge number indicates a number assigned to the person in charge. Person in charge ID indicates an ID assigned to the person in charge. For example, the database server 4 may store the person in charge identification information in the person in charge information storage area 41 in association with the project identification information.
[0074] The person in charge information may include task identification information. The task identification information is, for example, a task ID, a task key, or a task name. The task ID indicates a unique ID assigned to each task. The task key indicates a unique key assigned to each task. The task name indicates the name of the task.
[0075] The person in charge information may include attribute information of the person in charge. The attribute information may include, for example, information indicating the department to which the person belongs, the team to which the person belongs, the project to which the person belongs, and past projects or tasks for which the person in charge has been responsible. The person in charge information is not limited to the above and may include other information. The person in charge information storage area 41 is an example of a storage unit that stores person in charge information.
[0076] The history information storage area 42 stores history information of event reports. The history information storage area 42 stores history information of event reports for one or more projects or tasks. The data in the history information storage area 42 is updated by adding, updating, or deleting history information. The history information includes history information of event reports created for each project or task. The history information includes project identification information, creation date and time, event report information, etc. The creation date and time indicates the date and time when the event report was created.
[0077] The event report information includes, for example, report identification information, information for each report item, etc. The report identification information is unique identification information assigned to each event report to individually identify the event report. The report identification information is, for example, a report number or a report ID. The report number indicates a unique number assigned to each event report. The report ID indicates a unique ID assigned to each event report. The information for each report item includes, for example, information for each item such as the event, target screen, occurrence procedure, reproduction environment, and expected value.
[0078] The event report information may include information about the function in which the event occurred. The function may also be referred to as, for example, the target function. The event report information is not limited to the above and may include other information. The history information storage area 42 is an example of a storage unit that stores history information. In the following description, "record" may be read as "memorize," "register," or "store."
[0079] (Display example) FIG. 5 is a diagram showing an example of a login image Ima displayed on the display device of the user terminal 2 according to the embodiment. The login image Ima is an image for accepting an operation by a user to start using the quality control service. The operation to start using the quality control service includes logging in to the quality control service. For example, the user inputs login information and the like in the login image Ima.
[0080] The login image Ima includes a login information display area Ara, an email address display area Arb, a project information display area Arc, and a related report information display area Ard.
[0081] The login information display area Ara is an area that displays login information entered by the user. The login information is, for example, an API key. For example, the user enters the login information using a numeric keypad or a keyboard. The email address display area Arb is an area that displays the email address entered by the user. The project information display area Arc is an area that displays project information entered by the user. The project information is, for example, a project key. The related report information display area Ard is an area that displays related report information entered by the user. The related report information is information related to the related report. The information related to the related report is, for example, information that can identify the related report. The information related to the related report is, for example, the report number or report ID of the related report. The related report indicates a report about an event related to the target event. The related report may be a report about a task or project related to the target event. The target event indicates the event for which an event report is to be created.
[0082] The login image Ima includes a setting button Ba. The setting button Ba is an operation element that allows an instruction to confirm login information to be input. The setting button Ba may be an operation element that allows an instruction to start login processing to be input. The setting button Ba may be an operation element that allows an instruction to transition the display image of the display device to a created image to be input. For example, when a user wants to execute login processing, the user operates the setting button Ba.
[0083] The control unit 210 of the user terminal 2 starts the login process based on the user's operation of the setting button Ba.
[0084] The login image Ima may include at least the login information display area Ara and the project information display area Arc.
[0085] FIG. 6 is a diagram showing an example of a created image Imb displayed on the display device of the user terminal 2 according to the embodiment.
[0086] The creation image Imb is an image for creating an event report. For example, the user performs a report creation operation on the creation image Imb. The report creation operation includes an operation for recording audio.
[0087] The created image Imb includes a recording start button Bb, a stop button Bc, and a text display button Bd. The recording start button Bb is an operation element that can be used to input an instruction to start recording audio. An instruction to start recording is also called a recording start instruction. For example, a user operates the recording start button Bb to input audio via a microphone or the like. The stop button Bc is an operation element that can be used to input an instruction to stop recording audio. An instruction to stop recording is also called a recording stop instruction. For example, a user operates the stop button Bc to stop recording audio.
[0088] The text display button Bd is an operation element that can input an instruction to display the text of the audio. Displaying the text includes, for example, transcribing the audio. Displaying the text includes displaying the audio transcription data. Transcription data indicates text data corresponding to the audio. An instruction to display the text is also called a text display instruction. For example, if a user wants to check the text display of the audio, the user operates the text display button Bd to display the audio transcription data.
[0089] The created image Imb includes a recording status display area Are. The recording status display area Are is an area for displaying the recording status. The recording status includes information indicating, for example, the recording time, volume, etc. The created image Imb includes a person in charge display area Arf. The person in charge display area Arf is an area for displaying person in charge information. The person in charge display area Arf displays information that can identify the person in charge of creating the event report. For example, the person in charge display area Arf displays person identification information for the person in charge of the target project or task for which the event report is being created.
[0090] The created image Imb may include an area for displaying a message that prompts the user to input voice. The message may be text such as "Please input voice." The control unit 210 of the user terminal 2 may output the message as voice.
[0091] According to this example, the user of the user terminal 2 can easily create an event report by inputting voice. The control unit 210 of the user terminal 2 can transmit voice data to the management server 1 based on the voice input by the user.
[0092] FIG. 7 is a diagram showing an example of a report image Imc displayed on the display device of the user terminal 2 according to the embodiment.
[0093] The report image Imc is an image for displaying an event report created by the management server 1. For example, the user can check or edit the event report in the report image Imc.
[0094] The report image Imc includes a recording operation area Arg, a person in charge display area Arh, and a report item display area. The recording operation area Arg is an area that displays operation elements related to audio recording. Like the created image Imb, the recording operation area Arg includes a recording start button, a stop button, and a text display button. Like the created image Imb, the recording operation area Arg includes a recording status display area. For example, the user can operate the operation elements in the recording operation area Arg to perform operations such as recording audio and stopping recording.
[0095] The person in charge display area Arh is an area for displaying person in charge information, similar to the person in charge display area Arf of the created image Imb. The person in charge display area Arh displays information that can identify the person in charge of creating the event report.
[0096] The report item display area is an area that displays information for each report item. The report item display area is an area that displays information for the event report created by the management server 1. The report item display area includes a summary display area Ari. The summary display area Ari is an area that displays a summary of the event. The summary of the event is, for example, "The list is loading and the loading display continues."
[0097] The report item display area includes an event item display area Arj. The event item display area Arj is an area that displays a description of the event. For example, the description of the event is, "When the list page is opened, a loading icon continues to be displayed." The report item display area includes a target screen item display area Ark. The target screen item display area Ark is an area that displays the target screen on which the event occurred. For example, the target screen is, "list display screen." The report item display area includes an occurrence procedure item display area Arl. The occurrence procedure item display area Arl is an area that displays the occurrence procedure. For example, the occurrence procedure is, "Open the list page." The report item display area includes an environment item display area Arm. The environment item display area Arm is an area that displays the reproduction environment. For example, the reproduction environment indicates the operating environment in which the event occurred. For example, the reproduction environment is, "Ver. XX." The report item display area includes an expected value item display area Arn. The expected value item display area Arn is an area that displays the expected value. The expected value is, for example, "the list is displayed normally."
[0098] For example, the user can view and edit the information displayed in the report item display area. The user may also edit the information displayed in the report item display area via an input device such as a keyboard.
[0099] The report image Imc includes a file selection button Be. The file selection button Be is an operation element that allows an instruction to select a file to be attached to be input. An instruction to select a file is also called a file selection instruction. For example, a user operates the file selection button Be to select a file to be attached. A file to be attached is also called an attachment. For example, a user may select a screenshot image of the screen when the event occurred as an attachment file.
[0100] The report image Imc includes a create button Bf. The create button Bf is an operation element that allows an instruction to register an event report to be input based on the information displayed in the report image Imc. The instruction to register an event report is also called a registration instruction. For example, a user operates the create button Bf to input an instruction to register an event report. Registering an event report includes sending the event report to the management server 1. The event report sent to the management server 1 is, for example, an event report that has been confirmed or edited by the user. Registering an event report includes creating an event report. Registering an event report includes issuing an event report.
[0101] The control unit 210 of the user terminal 2 starts the process of registering the event report based on the user's operation of the create button Bf. For example, the control unit 210 of the user terminal 2 transmits information about the event report to the management server 1 based on the user's operation of the create button Bf.
[0102] According to this example, the control unit 210 of the user terminal 2 can obtain from the management server 1 an event report based on the analysis results of input data such as voice data, and display the obtained event report on the display device. The user can check the event report created by the management server 1. Because the user can check the information for each report item, the user can easily check whether the report content is excessive or insufficient. The user can easily edit or update the information for each report item. The user can efficiently create an appropriate event report based on the event report created by the management server 1. The management server 1 can obtain the report information checked and edited by the user. As a result, the management server 1 can improve the accuracy of the event report.
[0103] (Processing example) The processing procedure by the information processing system S will be described. In the following explanations focusing on the management server 1, the management server 1 may be read as the processor 11 or the control unit 110. In the explanations focusing on the user terminal 2, the user terminal 2 may be read as the processor 21 or the control unit 210 of the user terminal 2. In the explanations focusing on the generation AI system 3, the generation AI system 3 may be read as the processor or the generation model of the generation AI system 3. In the explanations focusing on the database server 4, the database server 4 may be read as the processor of the database server 4.
[0104] The processing procedures described below are merely examples, and each process may be modified as much as possible. Furthermore, steps may be omitted, replaced, or added as appropriate depending on the embodiment.
[0105] The process of creating an event report by the information processing system S will be described. FIG. 8 is a sequence diagram illustrating an example of the procedure of information processing related to report creation by the information processing system S according to the embodiment.
[0106] In the following process, the person in charge (verifier) will perform verification work on the target project or target task. The target project includes multiple tasks. A project is also called a case. The target task refers to one of the multiple tasks included in the target project. The person in charge will perform verification work using a quality control service.
[0107] The person in charge performs a login operation to log in to the quality control service. In the following description, the person in charge is the user of the user terminal 2. The user of the user terminal 2 inputs login information in accordance with the login image Ima displayed on the display device of the user terminal 2. For example, the user inputs an API key via an input device. Here, the API key is an example of authentication information.
[0108] The control unit 210 of the user terminal 2 acquires login information based on a login operation by the user (step S1). In step S1, for example, the control unit 210 acquires login information entered by the user. The login information includes authentication information. The login information may include project information. The login information may include information related to related reports.
[0109] The control unit 210 of the user terminal 2 transmits the login information to the management server 1 via the communication interface 24. This processing may be performed by the communication processing unit 2101 realized by the control unit 210, for example.
[0110] The control unit 110 of the management server 1 receives the login information from the user terminal 2 via the communication interface 14. This processing may be performed by the communication processing unit 1101 realized by the control unit 110, for example.
[0111] The control unit 110 of the management server 1 performs login processing based on the login information (step S11). In step S11, for example, the control unit 110 performs login authentication processing, etc., based on the login information. If the login authentication is successful, the control unit 110 sends a person in charge information request to the database server 4 via the communication interface 14. The person in charge information request is, for example, a request for person in charge list information. The person in charge list information includes, for example, person in charge information of the person in charge of verification of the target project or the target task. The person in charge information request may also include project information.
[0112] The database server 4 receives the person in charge information request. The database server 4 returns person in charge list information to the management server 1 based on the person in charge information request.
[0113] The control unit 110 of the management server 1 acquires the person in charge list information from the database server 4 via the communication interface 14. This processing may be performed by, for example, the communication processing unit 1101 realized by the control unit 110. The control unit 110 may store the person in charge list information in the auxiliary storage device 13. The control unit 110 of the management server 1 returns the person in charge list information to the user terminal 2 via the communication interface 14.
[0114] The control unit 210 of the user terminal 2 acquires the person in charge list information from the management server 1 via the communication interface 24. The control unit 210 of the user terminal 2 displays the created image on the display device based on the person in charge list information (step S2). The processing of step S2 may be, for example, processing by the display processing unit 2103 realized by the control unit 210. In step S2, for example, the control unit 210 displays the created image Imb including the person in charge list information on the display device. For example, the control unit 210 may display the person in charge information in the created image Imb in a selectable format such as a pull-down menu.
[0115] The user of the user terminal 2 inputs voice regarding an event that occurred in the target project or target task, according to the created image Imb displayed on the display device. For example, the user performs a selection operation to select person in charge information. The control unit 210 of the user terminal 2 acquires the person in charge information based on the selection operation. The user operates the start recording button Bb on the created image Imb to start recording voice. The control unit 210 of the user terminal 2 acquires a start recording instruction based on the operation of the start recording button Bb. The control unit 210 of the user terminal 2 starts recording voice based on the start recording instruction.
[0116] The control unit 210 of the user terminal 2 acquires voice data based on the voice input by the user (step S3). The processing of step S3 may be, for example, processing by the acquisition unit 2102 realized by the control unit 210. In step S3, for example, the control unit 210 acquires voice data input via an input device such as a microphone. The voice data is, for example, microphone-recorded data. The control unit 210 may store the voice data in the auxiliary storage device 13. The control unit 210 transmits the voice data to the management server 1 via the communication interface 24.
[0117] The control unit 110 of the management server 1 acquires voice data from the user terminal 2 via the communication interface 14. The control unit 110 performs transcription processing based on the voice data (step S12). The processing of step S12 may be, for example, processing by the generation processing unit 1102 realized by the control unit 110. The transcription processing refers to processing of converting voice data into text data by voice recognition processing or the like. The transcription processing can be performed by any method. In step S12, for example, transcription processing is performed on the voice data to acquire text data. The control unit 110 inputs the text data to the generation AI system 3 via the communication interface 14.
[0118] The control unit 110 creates, for example, a command statement related to verification. The command statement related to verification is, for example, a verification result generation command statement. The verification result generation command statement includes, for example, a command statement instructing to perform verification on input data. The verification result generation command statement may include, for example, a verification rule. The verification rule includes, for example, verifying whether text data contains information corresponding to report items. The verification rule includes verifying whether text data contains information corresponding to pre-set required report items. The verification rule may include verifying, for each report item, whether text data contains corresponding information. The verification result generation command statement may include information specifying an output format. The output format is, for example, JSON format. The control unit 110 inputs the verification result generation command statement to the generation AI system 3 via the communication interface 14.
[0119] The generation AI system 3 receives text data from the management server 1. The generation AI system 3 receives a verification result generation command from the management server 1. The generation AI system 3 performs data verification based on the text data (step S21). In step S21, for example, the generation AI system 3 performs data verification in accordance with the verification result generation command and generates a response indicating the verification result. The verification result is, for example, "True" or "False." The generation AI system 3 outputs the verification result to the management server 1 in the output format specified by the verification result generation command. The generation AI system 3 may also receive voice data from the management server 1. In this case, the generation AI system 3 may convert the voice data into text data using a voice recognition model or the like. The generation AI system 3 may also perform data verification based on the converted text data.
[0120] The control unit 110 of the management server 1 acquires the verification result from the generation AI system 3 via the communication interface 14. The control unit 110 determines whether there is a problem with the input information based on the verification result. Determining whether there is a problem with the input information includes determining whether there is a problem with the text data. Determining whether there is a problem with the input information includes determining whether there is a problem with the voice data. If the verification result indicates "True", the control unit 110 determines that there is no problem with the input information. If the verification result indicates "False", the control unit 110 determines that there is a problem with the input information.
[0121] If there is a problem with the input information, the process proceeds to step S13. If there is no problem with the input information, the process proceeds to step S14.
[0122] The control unit 110 of the management server 1 returns an error notification to the user terminal 2 based on the fact that there is a problem with the input information (step S13). The processing of step S13 may be, for example, processing by the communication processing unit 1101 realized by the control unit 110. In step S13, for example, the control unit 110 transmits an error notification based on the verification result to the user terminal 2 via the communication interface 14. The error notification based on the verification result may include, for example, a message indicating that there is a problem with the input information. The error notification based on the verification result may also include a message urging the user to redo the voice input. The error notification based on the verification result may also include a message that can identify the missing information. The message that can identify the missing information may, for example, be a message indicating the report item for which information is missing.
[0123] The control unit 210 of the user terminal 2 receives the error notification via the communication interface 24. This processing may be performed by, for example, the communication processing unit 2101 realized by the control unit 210. The control unit 210 displays an error notification image indicating the error notification on the display device (step S4). The processing of step S4 may be performed by, for example, the display processing unit 2103 realized by the control unit 210.
[0124] The user of the user terminal 2 inputs additional audio in response to the error notification. For example, the user operates a recording start button to start recording the additional audio. The control unit 210 of the user terminal 2 acquires a recording start instruction based on the operation of the recording start button. The control unit 210 of the user terminal 2 starts recording the additional audio based on the recording start instruction.
[0125] The information processing system S repeats the processes of steps S3, S12, and S21.
[0126] The control unit 110 of the management server 1 inputs the text data to the generation AI system 3 based on the fact that there is no problem with the input information (step S14). The processing of step S14 may be, for example, processing by the generation processing unit 1102 realized by the control unit 110. In step S14, for example, the control unit 110 inputs the text data to the generation AI system 3 via the communication interface 14. Here, if the control unit 110 acquires additional voice data from the user terminal 2, it inputs text data based on the additional voice data to the generation AI system 3. In this case, the control unit 110 may input both the text data based on the initially acquired voice data and the additional text data based on the additional voice data to the generation AI system 3.
[0127] The control unit 110 creates, for example, a command statement related to analysis. The command statement related to analysis is, for example, an analysis result generation command statement. The analysis result generation command statement includes, for example, a command statement instructing to perform analysis on input data. The analysis result generation command statement may include, for example, a command statement instructing to generate information corresponding to report items. The analysis result generation command statement may include information specifying an output format. The output format is, for example, JSON format. The control unit 110 inputs the analysis result generation command statement to the generation AI system 3 via the communication interface 14.
[0128] The generation AI system 3 receives text data from the management server 1. The generation AI system 3 receives an analysis result generation command statement from the management server 1. The generation AI system 3 analyzes information about the event based on the text data (step S22). Analyzing the information about the event includes generating information corresponding to report items for the target event. In step S22, for example, the generation AI system 3 performs analysis processing in accordance with the analysis result generation command statement and generates a response indicating the analysis results. The analysis results include, for example, information generated for each report item. The generation AI system 3 outputs the analysis results to the management server 1 in the output format specified by the analysis result generation command statement.
[0129] The control unit 110 of the management server 1 acquires the analysis results from the generation AI system 3 via the communication interface 14. The control unit 110 creates a report based on the analysis results (step S15). The processing of step S15 may be, for example, processing by the creation processing unit 1103 realized by the control unit 110. In step S15, for example, the control unit 110 creates an event report including information for each report item based on the analysis results. For example, the control unit 110 may create event report data in a format that can be displayed on the user terminal 2 based on the analysis results. The control unit 110 may perform processing to structure the generated data acquired from the generation AI system 3. Note that the control unit 110 may convert the format of the analysis results acquired from the generation AI system 3 into a predetermined format.
[0130] The control unit 110 transmits the report to the user terminal 2 via the communication interface 14. For example, the control unit 110 transmits the report to the user terminal 2 as data in a predetermined format. The predetermined format is, for example, but is not limited to, the JSON format.
[0131] The control unit 210 of the user terminal 2 receives the report from the management server 1 via the communication interface 24. This processing may be performed by, for example, the communication processing unit 2101 realized by the control unit 210. The control unit 210 receives, for example, report data in a predetermined format from the management server 1. The control unit 210 displays a report image showing the report on the display device (step S5). The processing of step S5 may be performed by, for example, the display processing unit 2103 realized by the control unit 210.
[0132] The user of the user terminal 2 checks or edits the report based on the report image displayed on the display device. The editing operation includes, for example, text input via an input device. The control unit 210 of the user terminal 2 performs editing processing of the report in accordance with the user's operation. After the user of the user terminal 2 has finished checking or editing the report, the user inputs an instruction to register the event report. For example, the user operates the create button Bf included in the report image Imc. The control unit 210 of the user terminal 2 acquires the registration instruction based on the user's operation.
[0133] The user of the user terminal 2 may perform an operation to select an attached file. For example, the user operates a file selection button Be included in the report image Imc. The user selects an attached file such as a screenshot image. The control unit 210 of the user terminal 2 acquires a file selection instruction based on the user's operation. The control unit 210 may register the attached file based on the file selection instruction.
[0134] Upon receiving the registration instruction, the control unit 210 of the user terminal 2 transmits a report to the management server 1. The report is, for example, a confirmed report that has been confirmed or edited by the user. The control unit 210 transmits the confirmed report to the management server 1 as data in a predetermined format, for example, via the communication interface 24.
[0135] The control unit 110 of the management server 1 acquires the confirmed report from the user terminal 2 via the communication interface 14. The control unit 110 performs a format check based on the confirmed report (step S16). The processing of step S16 may be, for example, processing by the creation processing unit 1103 realized by the control unit 110. In step S16, for example, the control unit 110 checks whether the format of the confirmed report is appropriate. For example, the control unit 110 may check the data structure of the confirmed report. The control unit 110 may check the format of the information for each report item in the confirmed report. For example, the control unit 110 may check whether the information for each report item in the confirmed report is in an appropriate format, whether information is included in required items, etc.
[0136] Based on the format check result, the control unit 110 determines whether there is a problem with the format. If there is a problem with the format, the process proceeds from step S16 to step S17. If there is no problem with the format, the process proceeds from step S16 to step S18.
[0137] The control unit 110 of the management server 1 returns an error notification to the user terminal 2 based on the fact that there is a problem with the input information (step S17). The processing of step S17 may be, for example, processing by the communication processing unit 1101 realized by the control unit 110. In step S17, for example, the control unit 110 transmits an error notification based on the format check result to the user terminal 2 via the communication interface 14. The error notification based on the format check result may include, for example, a message indicating that there is a problem with the format. The error notification based on the format check result may include a message urging the user to redo the voice input. The error notification based on the format check result may include a message that can identify the report item that has a format problem. The message that can identify the report item that has a format problem may be, for example, a message indicating the report item that has a format problem.
[0138] The control unit 210 of the user terminal 2 receives the error notification via the communication interface 24. This processing may be performed by, for example, the communication processing unit 2101 realized by the control unit 210. The control unit 210 displays an error notification image indicating the error notification on the display device (step S6). The processing of step S6 may be performed by, for example, the display processing unit 2103 realized by the control unit 210.
[0139] The user of the user terminal 2 may input additional audio in response to the error notification. For example, the user may operate a recording start button to start recording the additional audio. The control unit 210 of the user terminal 2 acquires a recording start instruction based on the operation of the recording start button. The control unit 210 of the user terminal 2 starts recording the additional audio based on the recording start instruction. The process returns to step S3.
[0140] The control unit 110 of the management server 1 registers the report based on the fact that there is no problem with the format (step S18). The processing of step S18 may be, for example, processing by the creation processing unit 1103 realized by the control unit 110. In step S18, for example, the control unit 110 transmits the report to the database server 4 via the communication interface 14. The control unit 110 may transmit a report registration request to the database server 4. The report registration request may include, for example, information that can identify the target project or the target task. The report registration request may include, for example, information that can identify the person in charge.
[0141] The control unit of the database server 4 receives the report from the management server 1. The control unit of the database server 4 may receive a report registration request from the management server 1. The control unit of the database server 4 saves the report (step S31). In step S31, for example, the control unit of the database server 4 may save the report in the history information storage area 42. The control unit of the database server 4 may return a completion notification to the management server 1 indicating that the registration of the report has been completed.
[0142] The control unit 110 of the management server 1 may register the report in an external report management server. For example, the control unit 110 may send a report registration request and the report to the report management server. The external report management server may store the report based on the report registration request. The external report management server may return a completion notification to the management server 1 indicating that the registration of the report has been completed.
[0143] The control unit 110 of the management server 1 transmits a completion notification to the user terminal 2 based on the completion of the registration of the report (step S19). The processing of step S19 may be, for example, processing by the communication processing unit 1101 realized by the control unit 110. For example, the control unit 110 may determine that the registration of the report is complete based on receiving a completion notification from the database server 4. Note that the control unit 110 may also determine that the registration of the report is complete based on receiving a completion notification from an external report management server. In step S19, for example, the control unit 110 transmits a completion notification to the user terminal 2 via the communication interface 14 based on the determination that the registration of the report is complete. The completion notification is, for example, a message indicating that the registration of the report is complete.
[0144] The control unit 210 of the user terminal 2 receives the completion notification via the communication interface 24. This processing may be performed by, for example, the communication processing unit 2101 realized by the control unit 210. The control unit 210 may display a completion notification image indicating the completion notification on a display device. This processing may be performed by, for example, the display processing unit 2103 realized by the control unit 210.
[0145] The management server 1 may perform the above-mentioned processing using an external tool. In this case, the management server 1 may obtain the person in charge list information from the database server 4 via the external tool. The management server 1 may save the report in the database server 4 via the external tool. The database server 4 may be a data server managed by the external tool.
[0146] According to this example, the management server 1 can create an event report based on voice data acquired from the user terminal 2. For example, the management server 1 inputs text data based on the voice data acquired from the user terminal 2 into the generation AI system 3, and acquires the analysis results of analyzing the text data from the generation AI system 3. The management server 1 creates an event report based on the analysis results. Therefore, the management server 1 can create an event report in real time based on the voice data input by the user. Furthermore, the management server 1 can create an event report intuitively, eliminating the need for the user to perform input operations using a keyboard or mouse. This allows the management server 1 to reduce the operational burden on the user when creating an event report. In this way, the management server 1 can improve the efficiency of creating reports related to events.
[0147] The process of creating the expected list by the information processing system S will be described. FIG. 9 is a sequence diagram illustrating an example of the procedure of information processing related to the creation of an assumption list by the information processing system S according to the embodiment.
[0148] In the following process, the user of the user terminal 2 is, for example, a verifier. The user of the user terminal 2 can check in advance events that are expected to occur in the target project or target task through the following process. The user of the user terminal 2 uses the quality control service to check events that are expected to occur in the target case. The user of the user terminal 2 is not limited to a verifier, but may also be a developer, an administrator, etc.
[0149] The user of the user terminal 2 logs in to the quality control service. The user of the user terminal 2 inputs case information according to the case information input image displayed on the display device of the user terminal 2. The case information input image is, for example, an image displayed on the display device when the user uses the expected list creation function. The case information input image is, for example, an image displayed when accepting input of case information. For example, the user inputs information such as the case name, screen list, and function list via the input device. The user may input the case information by text or by voice.
[0150] The control unit 210 of the user terminal 2 acquires case information based on an input operation by the user (step S101). In step S101, for example, the control unit 210 acquires the case information input by the user.
[0151] The control unit 210 of the user terminal 2 transmits the case information to the management server 1 via the communication interface 24. This processing may be performed by the communication processing unit 2101 realized by the control unit 210, for example.
[0152] The control unit 110 of the management server 1 receives the case information from the user terminal 2 via the communication interface 14. This processing may be performed by the communication processing unit 1101 realized by the control unit 110, for example.
[0153] The control unit 110 of the management server 1 requests history information based on the case information (step S201). The processing of step S201 may be, for example, processing by the analysis processing unit 1104 realized by the control unit 110. In step S201, for example, the control unit 110 generates a history information request based on the case information. The history information request includes the case information. The control unit 110 transmits the history information request to the database server 4 via the communication interface 14.
[0154] The database server 4 receives the history information request. Based on the history information request, the database server 4 returns related report history information to the management server 1. The database server 4 may identify related cases, for example, based on the case name. The database server 4 may identify related cases, for example, based on images included in the screen list. The database server 4 may identify related cases, for example, based on functions included in the function list. The database server 4 returns related report history information for the identified related cases to the management server 1.
[0155] The control unit 110 of the management server 1 acquires the related report history information from the database server 4 via the communication interface 14. This processing may be performed by the analysis processing unit 1104 realized by the control unit 110. The control unit 110 may store the related report history information in the auxiliary storage device 13.
[0156] The control unit 110 of the management server 1 inputs the related report history information to the generation AI system 3 (step S202). The processing of step S202 may be, for example, processing by the generation processing unit 1102 realized by the control unit 110. In step S202, for example, the control unit 110 inputs the related report history information to the generation AI system 3 via the communication interface 14. The control unit 110 inputs the case information to the generation AI system 3.
[0157] The control unit 110, for example, creates a command statement related to analysis. The analysis includes generating an assumption list based on related report history information. The command statement related to analysis is, for example, an assumption list generation command statement. The assumption list generation command statement includes, for example, a command statement instructing to analyze input data and generate an assumption list. The assumption list generation command statement may include, for example, a command statement instructing to generate information on an expected event report for the target case. The expected event report is also called a similar report. The assumption list generation command statement may include information specifying an output format. The control unit 110 inputs the assumption list generation command statement to the generation AI system 3 via the communication interface 14.
[0158] The generation AI system 3 receives related report history information from the management server 1. The generation AI system 3 receives case information from the management server 1. The generation AI system 3 receives an assumption list generation command from the management server 1. The generation AI system 3 generates an assumption list based on the case information and related report history information (step S301). Generating the assumption list includes generating information indicating a list of event reports about events that are expected to occur for the target case based on the case information and related report history information. The assumption list includes, for example, information about expected events. The expected events indicate events that are expected to occur for the target case. The information about expected events includes, for example, the event name, an overview of the event, etc. The assumption list includes event reports about the expected events. In step S301, for example, the generation AI system 3 analyzes the case information and related report history information in accordance with the assumption list generation command and generates a response indicating the assumption list. The generation AI system 3 outputs the assumption list to the management server 1 in the output format specified by the assumption list generation command.
[0159] The control unit 110 of the management server 1 acquires the assumption list from the generation AI system 3 via the communication interface 14. The control unit 110 returns the assumption list to the user terminal 2 (step S203). The processing of step S203 may be, for example, processing by the analysis processing unit 1104 realized by the control unit 110. In step S203, for example, the control unit 110 may create data of the assumption list in a format that can be displayed on the user terminal 2 based on the assumption list acquired from the generation AI system 3. The control unit 110 may perform processing to structure the generated data acquired from the generation AI system 3. Note that the control unit 110 may convert the format of the assumption list acquired from the generation AI system 3 into a predetermined format.
[0160] The control unit 110 transmits the expected list to the user terminal 2 via the communication interface 14. For example, the control unit 110 transmits the expected list to the user terminal 2 as data in a predetermined format.
[0161] The control unit 210 of the user terminal 2 receives the expected list from the management server 1 via the communication interface 24. This processing may be performed by, for example, the communication processing unit 2101 realized by the control unit 210. The control unit 210 receives, for example, data of the expected list in a predetermined format from the management server 1. The control unit 210 displays an expected list image showing the expected list on the display device (step S102). The processing of step S102 may be performed by, for example, the display processing unit 2103 realized by the control unit 210.
[0162] The user of the user terminal 2 can check the anticipated events for the target case based on the anticipated list image displayed on the display device.
[0163] According to this example, the management server 1 can provide the user with an assumption list generated by referencing past report history information based on the case information acquired from the user terminal 2. For example, the management server 1 acquires case information about a new case from the user terminal 2 and acquires information about past event reports of related cases based on the case information. The management server 1 inputs the case information and information about past event reports of related cases into the generation AI system 3 and acquires an assumption list from the generation AI system 3 as an analysis result of the case information and past event reports of related cases. The management server 1 returns the assumption list to the user terminal 2. Therefore, the management server 1 can provide the user with information about expected events for the target case based on the case information input by the user. The user can obtain information about expected events before performing verification. Therefore, the user can expand the test cases for verification.
[0164] (effect) An information processing program according to an embodiment can cause a computer to receive voice data related to an event occurring during software development, acquire analysis results obtained by analyzing information related to the event based on the voice data, and create an event report based on the analysis results. For example, the management server 1 can acquire voice data related to an event occurring in a target program and acquire text data from the voice data. The management server 1 can input text data based on the voice data into the generation AI system 3 and acquire analysis results obtained by analyzing the input data from the generation AI system 3. The management server 1 can create an event report based on the analysis results acquired from the generation AI system 3. Therefore, the management server 1 can create an event report in real time based on voice data input by a user. Furthermore, the management server 1 can intuitively create an event report without requiring the user to perform input operations using a keyboard or mouse. This allows the management server 1 to reduce the operational burden on the user when creating an event report. In this way, the management server 1 can efficiently create event reports.
[0165] The information processing program of the embodiment can cause a computer to acquire analysis results including at least one of the following items: event, target screen, occurrence procedure, reproduction environment, and expected value. For example, the management server 1 can acquire, from the generation AI system 3, analysis results obtained by analyzing at least one of the following items based on voice data regarding an event that occurred in the target program: event, target screen, occurrence procedure, reproduction environment, and expected value. Therefore, the management server 1 can create an event report based on the voice data, including information about items required for the event report. This allows the management server 1 to appropriately and efficiently create a report regarding the event based on the voice data.
[0166] The information processing program of the embodiment can cause a computer to execute the following operations: if the voice data contains insufficient information, send an error notification; receive additional voice data related to the event; obtain analysis results obtained by analyzing information related to the event based on the additional voice data; and create an event report based on the analysis results. For example, the management server 1 can input text data based on the voice data acquired from the user terminal 2 to the generation AI system 3 and cause the generation AI system 3 to perform verification such as a validation check. If the voice data contains insufficient information based on the verification results, the management server 1 can output an error notification to the user terminal 2. This allows the user of the user terminal 2 to easily recognize that the voice data is insufficient. The user of the user terminal 2 can re-enter the voice data based on the error notification. The management server 1 can acquire the additional voice data entered by the user and input text data based on the voice data to the generation AI system 3. The management server 1 can acquire analysis results from the generation AI system 3 based on the additional voice data. This allows the management server 1 to appropriately acquire information necessary to create an event report from the user. This allows the management server 1 to create an event report based on the analysis results obtained from the generation AI system 3. This allows the management server 1 to improve the accuracy of the event report. In this way, the management server 1 can appropriately and efficiently create a report on an event based on voice data.
[0167] The information processing program of the embodiment can cause a computer to execute acquiring analysis results generated in a preset format. For example, the management server 1 can specify an output format for the generation AI system 3. The management server 1 can acquire analysis results generated in the specified output format. Therefore, the management server 1 can easily perform the process of creating an event report from the analysis results acquired from the generation AI system 3. Furthermore, the management server 1 can easily check the format of the analysis results acquired from the generation AI system 3. This allows the management server 1 to efficiently create reports.
[0168] The information processing program of the embodiment can cause a computer to receive information about a target case, acquire a history of past event reports related to the target case, acquire information about the target case and a list of anticipated events for the target case based on the history of past event reports, and transmit the list of anticipated events. For example, the management server 1 can acquire related past report history information based on case information acquired from the user terminal 2. The past report history information includes, for example, history information of event reports created by the management server 1. The management server 1 inputs the acquired report history information and case information into the generation AI system 3 and acquires a list of anticipated events from the generation AI system 3 as an analysis result of the case information and past event reports of related cases. The management server 1 can return the list of anticipated events to the user terminal 2. Therefore, the management server 1 can provide the user with information about anticipated events for the target case based on the case information input by the user. The user can obtain information about anticipated events before performing verification. Therefore, the user can expand test cases for verification.
[0169] (Other embodiments) The above-described embodiment has been described using quality control in system development work as an example, but is not limited to this. The above-described embodiment can be applied to work that creates reports on various events. The management server 1 may arbitrarily set report items depending on the type of report.
[0170] In the above embodiment, the information processing system S includes a management server 1, a user terminal 2, a generation AI system 3, and a database server 4, but is not limited to this. The information processing system S may also be one in which the functions of two or more devices included in the information processing system S are realized by a single device.
[0171] The information processing device may be realized by one device such as the management server 1, or may be realized by a plurality of devices with distributed functions.
[0172] The above-described embodiments may be applied not only to an apparatus but also to a method executed by the apparatus. The above-described embodiments may be applied to a program that can cause a computer of the apparatus to execute each function. The above-described embodiments may be applied to a recording medium that stores a program. The above-described embodiments may be applied not only to a system but also to a method executed by multiple elements included in the system.
[0173] The processing circuitry includes one or more circuits that perform multiple processes with multiple functions, such as, but not limited to, a processor, an ASIC (Application Specific Integrated Circuit), or an FPGA (Field-Programmable Gate Array).
[0174] Each of the one or more circuits constituting the processing circuit performs one or more of the multiple processes. When the processing circuit is composed of a single circuit, the single circuit performs all of the multiple processes. When the processing circuit is composed of multiple circuits, each of the multiple circuits performs a part of the multiple processes. The part of the multiple processes may be one of the multiple processes, or two or more of the multiple processes. When the processing circuit is composed of multiple circuits, the multiple circuits may be included in a single device or may be distributed across multiple devices.
[0175] The program may be transferred in a state where it is stored in a device, or in a state where it is not stored in a device. In the latter case, the program may be transferred via a network, or in a state where it is recorded on a recording medium. The recording medium is a non-transitory tangible medium. The recording medium is a computer-readable medium. The form of the recording medium is not important as long as it is a medium that can store the program and is computer-readable, such as a CD-ROM or a memory card.
[0176] Although the embodiments of the present invention have been described in detail above, the above description is merely an example of the present invention in every respect. It goes without saying that various improvements and modifications can be made without departing from the scope of the present invention. In other words, when implementing the present invention, specific configurations according to the embodiments may be appropriately adopted.
[0177] In short, this invention is not limited to the above-described embodiments, and in the implementation stage, the components can be modified and embodied without departing from the spirit of the invention. Furthermore, various inventions can be formed by appropriately combining multiple components disclosed in the above-described embodiments. For example, some components may be omitted from all the components shown in the embodiments. Furthermore, components from different embodiments may be appropriately combined.
[0178] (Addendum) The above embodiment may be expressed as follows: (1) To the computer, A function for receiving voice data relating to events occurring in software development; a function of acquiring an analysis result obtained by analyzing information related to the event based on the voice data; creating an event report based on the analysis results; An information processing program capable of executing the above. (2) The analysis results include at least one of the following items: the event, the target screen, the occurrence procedure, the reproduction environment, and the expected value; (1) An information processing program according to the present invention. (3) To the computer, a function of sending an error notification if the voice data contains insufficient information; receiving additional audio data relating to the event; a function of acquiring an analysis result obtained by analyzing information related to the event based on the additional voice data; creating an event report based on the analysis results; The information processing program according to (1) above, which is capable of executing the above. (4) To the computer: A function for acquiring the analysis results generated in a preset format. The information processing program according to (1) above, which is capable of executing the above. (5) To the computer: The ability to receive information about the subject matter; A function for obtaining a history of past incident reports related to the target case; a function of acquiring information about the target case and a list of anticipated events for the target case based on the past event report history; a function of transmitting the list of anticipated events; The information processing program according to (1) above, which is capable of executing the above. (6) receiving audio data relating to events occurring in software development; and acquiring an analysis result obtained by analyzing information related to the event based on the voice data; generating an event report based on the analysis results; An information processing method comprising: (7) a receiving unit for receiving voice data relating to events occurring during system development; an acquisition unit that acquires an analysis result obtained by analyzing information related to the event based on the voice data; a creation unit that creates an event report based on the analysis results; An information processing device comprising: [Explanation of symbols]
[0179] 1...management server, 2...user terminal, 3...generative AI system, 4...database server, 11...processor, 12...main memory, 13...auxiliary storage device, 14...communication interface, 21...processor, 22...main memory, 23...auxiliary storage device, 24...communication interface, 25...input / output interface, 41...person in charge information storage area, 42...history information storage area, 110...control unit, 210...control unit, 1101...communication processing unit, 1102...generation processing unit, 1103...creation processing unit, 1104...analysis processing unit, 2101...communication processing unit, 2102...acquisition unit, 2103...display processing unit, Ara...login information display area, Arb...email address Display area, Arc...Project information display area, Ard...Related report information display area, Are...Recording status display area, Arf...Person in charge display area, Arg...Recording operation area, Arh...Person in charge display area, Ari...Summary display area, Arj...Event item display area, Ark...Target screen item display area, Arl...Occurrence procedure item display area, Arm...Environment item display area, Arn...Expected value item display area, Ba...Setting button, Bb...Recording start button, Bc...Stop button, Bd...Text display button, Be...File selection button, Bf...Create button, Ima...Login image, Imb...Created image, Imc...Report image, NW...Network, S...Information processing system.
Claims
1. On the computer, A function for receiving voice data relating to events occurring in software development; a function of analyzing information related to the event based on the voice data and acquiring an analysis result including information generated for each report item including at least one of the following items: event, target screen, occurrence procedure, reproduction environment, and expected value; creating an event report based on the analysis results; An information processing program capable of executing the above.
2. On the computer, a function of sending an error notification if the voice data contains insufficient information; receiving additional audio data relating to the event; a function of analyzing information related to the event based on the additional voice data and acquiring an analysis result including information generated for each report item including at least one of the following items: event, target screen, occurrence procedure, reproduction environment, and expected value; creating an event report based on the analysis results; 2. The information processing program according to claim 1, which is capable of causing a user to execute the following.
3. On the computer, A function for acquiring the analysis results generated in a preset format.
2. The information processing program according to claim 1, which is capable of causing a user to execute the following.
4. On the computer, The ability to receive information about the subject matter; A function for obtaining a history of past incident reports related to the target case; a function of acquiring information about the target case and a list of anticipated events for the target case based on the past event report history; a function of transmitting the list of anticipated events; 2. The information processing program according to claim 1, which is capable of causing a user to execute the following.
5. A method executed by an information processing device, comprising: receiving audio data relating to events occurring in software development; Analyzing information related to the event based on the voice data, and acquiring an analysis result including information generated for each report item including at least one of the following items: event, target screen, occurrence procedure, reproduction environment, and expected value; generating an event report based on the analysis results; An information processing method comprising:
6. a receiving unit for receiving voice data relating to events occurring in system development; an acquisition unit that analyzes information related to the event based on the voice data and acquires an analysis result including information generated for each report item including at least one of the following items: event, target screen, occurrence procedure, reproduction environment, and expected value; a creation unit that creates an event report based on the analysis results; An information processing device comprising:
Citation Information
Patent Citations
Software development management system
JP1995200285A
Job performance analysis system, job performance analysis method and program
JP2015141601A
Automatic report creation system
JP2021002391A
Processing device, processing program, and processing method
JP2024154475A
Production of raw beanjam not containing cyanic compound from beans containing cyanic compound
JP1979064672A