Information processing apparatus, data registration system, program, and data registration method

Abstract

To support operations related to registration of data used for an application by using generative AI.SOLUTION: An information processing apparatus has: a data registration unit that operates upon execution of a predefined function, and registers data used by an application to the application, and that registers data in a request in the application; and a chat control unit that transmits a chat message received from a terminal device to a generative AI system. When receiving a request that is transmitted by the generative AI system on the basis of the chat message transmitted to the generative AI system, information on the application, and information for invoking the function, and that includes data generated by the generative AI system on the basis of the chat message and the application, the data registration unit registers the data included in the request in a target application.SELECTED DRAWING: Figure 18

Description

[Technical Field]

[0001] The present invention relates to an information processing device, a data registration system, a program, and a data registration method. [Background technology]

[0002] Currently, a generation AI is known that generates a response requested by a user in a chat message (see, for example, Non-Patent Document 1). As an example of how a generation AI is used, a user may request the generation AI to generate data. Summary of the Invention [Problem to be solved by the invention]

[0003] However, when using the generation AI functions to generate data used by an application, such as configuration data for configuring the application or sample data to be entered into the application, the user must register all of the generated data in the application themselves, which is inconvenient.

[0004] In view of the above-mentioned problems, the present invention provides a technology that uses a generation AI to assist in the work of registering data used in applications. [Means for solving the problem]

[0005] In view of the above-mentioned problems, the present invention provides an information processing device capable of communicating with a terminal device and a generative AI (Artificial Intelligence) system via a network, the information processing device having: a data registration unit that functions by executing a predefined function and registers data used by an application in the application, the data registration unit registering the data included in a request in the application; and a chat control unit that, when a chat message sent from the terminal device is received, transmits the received chat message to the generative AI system; The chat control unit sends to the generation AI system at least once information regarding the application to which the data is to be registered and information for the generation AI system to call the function, and when the chat control unit receives the request sent by the generation AI system based on the chat message, information regarding the application, and information for calling the function sent to the generation AI system, the request including the data generated by the generation AI system based on the chat message and information about the application, the data registration unit registers the data included in the received request in the application to which the data is to be registered. [Effects of the Invention]

[0006] Generative AI can be used to assist with tasks related to registering data used in applications. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 2 illustrates an example of a user interface of an application. [Figure 2] 10A and 10B are diagrams illustrating examples of various graphs generated by a daily report application by processing dummy data. [Figure 3] This diagram explains the process from when the generation AI system requests the information processing system to execute a function in response to a chat message entered by a user, to when the information processing system generates dummy data. [Figure 4] FIG. 1 is a diagram illustrating a system configuration of an example of a data registration system. [Figure 5] FIG. 2 is a diagram illustrating an example of a hardware configuration of an information processing system, a user terminal, and a developer terminal. [Figure 6] FIG. 2 is a diagram illustrating an example functional configuration of an information processing system, a user terminal, and a developer terminal. [Figure 7] FIG. 10 is a diagram illustrating an example of a daily report application screen displayed on the user terminal. [Figure 8]FIG. 10 is a diagram showing an example of a function selection screen displayed when a user presses an AI collaboration function button. [Figure 9] FIG. 10 is a diagram showing an example of a chat screen displayed when a user presses an automatic record generation button. [Figure 10] FIG. 10 is a diagram showing an example of a chat screen on which generated dummy data is displayed. [Figure 11] 10A and 10B are diagrams illustrating an example of a daily report application screen and a chat screen that are displayed when a user presses an OK button. [Figure 12] FIG. 10 is a diagram illustrating an example of a response message that the information processing system acquires from the application service. [Figure 13] A figure showing an example of a request message for calling the first API published by the generation AI system. [Figure 14] This is an example of a response message that the generation AI system sends to the information processing system in response to the request message in Figure 13. [Figure 15] This is an example of a response message that the generation AI system sends to the information processing system in response to the request message in Figure 13. [Figure 16] 16 is a diagram showing an example of a request message that a data registration unit transmits to an application service based on the function call request of FIG. 15. FIG. [Figure 17] A figure showing an example of a request message for calling the first API published by the generation AI system. [Figure 18] 10 is an example of a sequence diagram illustrating a process in which the information processing system assists in registering dummy data. [Figure 19] This is an example of a sequence diagram (part 1) in which an information processing system registers dummy data in an application service by utilizing the collaboration between two web browsers in a user terminal. [Figure 20]This is an example of a sequence diagram (part 2) in which an information processing system registers dummy data in an application service by utilizing the collaboration between two web browsers in a user terminal. DETAILED DESCRIPTION OF THE INVENTION

[0008] An information processing system and an application data registration method performed by the information processing system will be described below with reference to the drawings as an example of an embodiment of the present invention. In this embodiment, a user can generate and register dummy data using a generation AI system with low code or no code.

[0009] <Support for registering dummy data using a generative AI system> Generative AI systems such as ChatGPT (registered trademark) are known. Generative AI systems can perform various natural language processing tasks, such as text generation, question answering, text classification, sentiment analysis, information extraction, and text summarization. Generative AI systems such as Copilot (registered trademark) are also known, which suggest the next line of code to write while a program is being coded. Generative AI systems can also generate applications with low code or no code.

[0010] In this embodiment, a technology will be described in which a user generates dummy data to be used in an application through a conversation (also called a chat) with a generating AI system, and then registers the dummy data in the application. Note that the generating AI system or its function may be simply referred to as AI (Artificial Intelligence).

[0011] <The need for dummy data> Figure 1 shows an example of the user interface of an application. This application may be created manually by a user or generated by a generation AI system. Figure 1 shows the user interface of a daily report application for a construction site as an example. The daily report application is a database-style application, and values can be registered for each item. This daily report application has the following items: record number 601, date 602, construction site 603, weather 604, work content 605, and materials used 606. Five records 607 have already been entered.

[0012] The user uses such records (data) to check whether the generated application is appropriate. For example, as shown in Figure 2, data is required to check whether the graph function of a daily report application can be executed properly. In this embodiment, such data is called dummy data.

[0013] Figure 2 shows various graphs generated by the daily report app by processing dummy data. Figure 2(a) shows the weather by date, Figure 2(b) shows the progress by date, and Figure 2(c) shows the percentage of each weather condition. Therefore, without suitable dummy data for the daily report app, users could not confirm whether the application worked properly. In other words, even if a user or a generation AI system generated an application, the user could not confirm whether the application was suitable for release.

[0014] In addition to such graph functions, various dummy data may be required to check whether the print results of records printed by an application, the results of conversion to PDF files, etc. are appropriate.

[0015] <Support for dummy data generation using a generative AI system> Therefore, in this embodiment, the user generates dummy data appropriate for the application through interaction with the AI generation system 50. Note that the generated test data is not limited to applications generated by the AI generation system 50, and can also be used for testing applications manually generated by the user.

[0016] 3 is a diagram illustrating the process from when the generation AI system 50 requests the information processing system 20 to execute a function in response to a chat message entered by a user to when the information processing system 20 generates dummy data. The information processing system 20, which will be described later, provides a user interface for users to use when developing applications using the generation AI system 50. The information processing system 20 also converts chat messages sent from the user terminal 10 into request messages that call APIs (Application Programming Interfaces) published by the generation AI system 50 and application service 40, and sends the request messages to the generation AI system 50 and application service 40.

[0017] (1) The user terminal 10 transmits a chat message input by the user to the information processing system 20. The chat message in this embodiment is considered to include content such as "I would like you to generate dummy data." In addition, the user terminal 10 transmits identification information (hereinafter referred to as an application ID) that identifies the application to the information processing system 20.

[0018] (2) The information processing system 20 receives a request from the user terminal 10 to generate dummy data by specifying an application ID. The dummy data must correspond to the items that the application has. Therefore, in this embodiment, the information processing system 20 calls the API of the application service 40 to obtain application information, such as items that the application identified by the application ID has, from the application service 40.

[0019] (3) The information processing system 20 includes application items in a request message and sends it to the generation AI system 50 via an API for receiving request messages provided by the generation AI system 50. Here, the information processing system 20 also sends the request message together with function specification settings. A function is a program interface that performs a specific process based on specified arguments and returns a return value as a result. This function enables the generation AI system 50 to request the information processing system 20 to generate dummy data to be used in the application service 40. By including this function specification setting in a request message and sending it to the generation AI system 50, the information processing system 20 can generate or update dummy data with low code or no code in response to a request from the generation AI system 50. Note that the generation AI system 50's request to the information processing system 20 to call this function is referred to as a function call. In addition, as supplemental information, the information processing system 20 can include system settings in the request message that notify the generation AI system 50 of the type of dummy data. Details of system settings and function specification settings will be described later, but while system settings are general policies regarding the application you want to generate, function specification settings are information that the information processing system 20 specifies to the generation AI system 50 as the specifications of the function calls that the generation AI system 50 will call.

[0020] Note that the information processing system 20 does not have to include the system settings and function specification settings in the same request message as the application items. For example, the information processing system 20 may include the system settings and function specification settings in a request message separate from the request message including the application items and send it to the generation AI system 50. The information processing system 20 may also include the system settings and function specification settings in separate request messages and send them to the generation AI system 50.

[0021] Furthermore, the information processing system 20 may transmit the system settings and function specification settings each time an application item is included in a request message and transmitted, or may transmit them only once at the beginning.

[0022] (4) The generating AI system 50 sends a response message including a function call request (function call) to the information processing system 20 based on the application items, function specification settings, and system settings included in the sent request message. Note that the generating AI system 50 only requests the information processing system 20 to call the function, and it is the information processing system 20 that actually executes the function. However, the generating AI system 50 includes the application items sent from the information processing system 20 in the request message.

[0023] Note that the generation AI system 50 does not necessarily send a response message including a function call request to the information processing system 20 based on the conversation history, function specification settings, and system settings. For example, the generation AI system 50 may send a response message including a question or a response message indicating that it could not understand the content of an application item to the information processing system 20.

[0024] (5) In response to a function call request included in the response message sent from the generation AI system 50, the information processing system 20 requests the application service 40 to register dummy data. More specifically, the information processing system 20 generates a request message for calling the API of the application service 40 from the contents of the function call request, and sends the generated request message to the application service 40. In this embodiment, the process of generating such a request message may be expressed as "executing a function" or "running a function." In this embodiment, the information processing system 20 generates dummy data to be used by the application service 40 in response to the function call request.

[0025] In this way, the user simply inputs on the user terminal 10 that they would like dummy data to be generated, and the information processing system 20 can register the dummy data to be used in the application, generated using the generation AI system 50, in the application service 40.

[0026] Existing generation AI systems can also create dummy data, but the user must specify the item names and other information to the generation AI system. Also, if the generation AI system returns dummy data for each item, the user must register the dummy data one by one in the application service 40. In contrast, in this embodiment, the user can register the dummy data used by the application in the application by simply inputting a request to register dummy data in the application.

[0027] <Terminology> An application is an abbreviation for an application program, and is a program generated by a computer for any task. While an OS (Operating System) is general-purpose software that provides basic functions and systems (file system, communication, display control, etc.) for computer operation, an application provides specific functions on the OS. Applications include web apps and native apps. In this embodiment, either may be developed.

[0028] An API is an interface for applications (software), and is therefore a point of contact for connecting systems and sharing functions and mechanisms. APIs define the specifications for the interface used by applications to exchange information with each other. An API between computers is a specification in which one website communicates with another website via HTTP (HTTPS) communication. This communication allows one website to use the functions of the other website. An API between computers is sometimes called a Web-API.

[0029] When an API sends a specific request (for example, retrieving, updating, deleting, or processing data), it returns the corresponding results (for example, data, update results, deletion results, or processing results). The request is sometimes called a request message, and the results are sometimes called a response message. Calling an API means sending a request according to the API specifications and obtaining the results. Calling an API can also be referred to as executing, operating, hitting, or using.

[0030] The information for calling a function is information that enables a function provided by the information processing system 20 to be called from outside the information processing system, for example, from the generation AI system 50. The information for calling a function includes information about the Web-API for calling the function.

[0031] The information regarding the Web-API for calling a function is information that enables the generation AI system 50 to call (use) the Web-API. In this embodiment, this is explained using the term function specification setting (hereinafter referred to as function specification setting). The function specification setting is information that the information processing system 20 specifies to the generation AI system 50 the specifications of the function call that the generation AI system 50 will call. The generation AI system 50 calls the function to the information processing system 20 based on the function specification setting, so the information processing system 20 can analyze the function.

[0032] A function is a program interface that performs a specific process based on specified arguments and returns a return value as a result. While the specifications and functions of a function can be designed by the developer, APIs are pre-prepared for functions that are publicly available for use by the generative AI system 50 and application service 40. A function is one of the API specifications, and can be set by calling the API if the API defines how to specify the function. Furthermore, a function call or a function call request refers to a request to execute a function.

[0033] A chat service is a service that allows multiple users to send and receive messages in real time. A generative AI system is a service that allows users to send and receive messages with AI in real time.

[0034] The setting information is the general policy for generating an application, and may be, for example, a description of the application, hints, or information that the user should not be asked. The setting information is information that, when communicated to the generation AI system 50, makes it easier to generate the desired application.

[0035] System settings are information in which all or part of this setting information has been converted into a request message that calls an API. In other words, system settings are information in which all or part of the setting information has been converted into API format.

[0036] A user is an end user who uses an application provided by the application service 40. A user can also develop an application. A developer is a person who makes the settings required for application development using no-code or low-code programming in the information processing system 20. The developer sets the setting information described below in the information processing system 20.

[0037] The data used by an application is data that the application uses to perform its function. For example, if the application is a tabular database, the data used by the application are the values in the table, in other words, the values registered in the database. If the application creates a graph, the data used by the application are the values visualized by the graph. In addition, the data used by the application may be, for example, setting data for configuring the application or data input to the application. In this embodiment, the data used by the application is described using the term "dummy data." Dummy data may also be called test data, sample data, or the like.

[0038] The information about the application is information about the application that is necessary for registering dummy data in the application, and in this embodiment, is, for example, one or more of the item name, data format, and button name.

[0039] <System configuration example> The system configuration of the data registration system 100 according to this embodiment will be described with reference to FIG. 4. FIG. 4 is a diagram showing the system configuration of an example of the data registration system 100. The data registration system 100 shown in FIG. 4 includes an information processing system 20, a user terminal 10, and a developer terminal 60. The information processing system 20 and the user terminal 10, and the information processing system 20 and the developer terminal 60 are communicatively connected via networks N1 and N2. The information processing system 20 can also communicate with a generation AI system 50 and an external system, an application service 40, via the network N1. The user terminal 10 and the developer terminal 60 can also communicate with the generation AI system 50 and an external system, an application service 40, via the networks N1 and N2.

[0040] The user terminal 10 and the developer terminal 60 are located in facilities such as a company or a home, and are connected to a network N2. The network N2 may be a LAN, Wi-Fi (registered trademark), Wide Area Ethernet (registered trademark), a mobile phone network such as 4G, 5G, or 6G, etc. The network N1 is a wide-area network such as the Internet or a WAN. The user terminal 10 and the developer terminal 60 do not need to be connected to the network N2 at all times; they only need to be connected when using the information processing system 20, the generation AI system 50, or the application service 40.

[0041] The generative AI system 50 provides a service in which users can converse with artificial intelligence (AI). A known example of such a generative AI system 50 is a system that uses large-scale language models (LLMs). Large-scale language models are natural language processing models trained using large amounts of text data. The generative AI system 50 first imports a huge amount of text and learns knowledge from it using deep learning, reinforcement learning, and other methods. Using this knowledge, the generative AI system 50 provides a response message to data based on a chat message. An interface through which a user inputs a chat message to the generative AI system 50 is called a prompt. The prompt may contain not only chat messages (natural language) such as instructions or questions, but also files. Chat messages may be conversational sentences or words written in natural language spoken by humans. Images may also be used as chat messages. A generative AI system 50 that generates text in response to a chat message may also be called a generative AI. In this embodiment, the information processing system 20 generates an application that runs on the application service 40 using the response message provided by the generative AI system 50 in response to a chat message entered by a user.

[0042] The generative AI system 50 has the following features: 1. The generative AI system 50 advances the conversation in a natural flow. 2. The generative AI system 50 can expand on and propose ideas even in areas where the user has no knowledge. 3. The generative AI system 50 can output accurate program code. Therefore, the information processing system 20 can naturally advance conversations with the user via the generative AI system 50. Furthermore, the user can receive ideas necessary for an app simply by specifying the app they want to create. Furthermore, because the functions called by the generative AI system 50 are accurate (highly reproducible), the information processing system 20 can easily generate the application and dummy data the user desires.

[0043] Systems using LLMs such as GPT-3, GPT-4, Transformer, and BERT (all registered trademarks) are known as the generative AI system 50. As an example, ChatGPT using GPT-3 or GPT-4 can be used in the data registration system 100 of this embodiment, but systems using other LLMs may also be used.

[0044] The application service 40 is one or more information processing devices that provide applications executed by users. The applications provided by the application service 40 are, for example, database-type web applications that manage data in a tabular format. Users can arbitrarily set fields in the application and customize it so that they can save, read, or process data related to their own business. Setting fields and other settings desired by the user in a pre-prepared database in this way is application development. Registering data desired by the user in the database is registering dummy data.

[0045] In this embodiment, the information processing system 20 includes a chat message from a user in a request message and sends the request message to the generation AI system 50. The information processing system 20 uses the response message from the generation AI system 50 to register dummy data for the application service 40. In other words, the user can register dummy data to be used by the application service 40 without any coding.

[0046] If the domains of the application service 40 and the information processing system 20 are different (for example, if the service origins are different), the accounts of the application service 40 and the information processing system 20 are different even for the same user.

[0047] On the other hand, the application service 40 and the information processing system 20 may be integrated. That is, the application service 40 may include the functions of the information processing system 20, or the information processing system 20 may include the functions of the application service 40. The application service 40 and the generation AI system 50 may also be integrated. The generation AI system 50 and the information processing system 20 may also be integrated. The information processing system 20, the application service 40, and the information processing system 20 may also be integrated.

[0048] Examples of application services 40 include cloud services, ASPs (Application Service Providers), SaaS, etc., and may include various services provided over a network. For example, examples of services include providing databases and storage services. Application services 40 may exist on the Internet or on-premise.

[0049] In the following description, when multiple application services 40 are to be distinguished from one another, they will be referred to as "application services 40A, 40B" as shown in the figure.

[0050] The information processing system 20 transmits chat messages sent from the user terminal 10 to the generation AI system 50. The information processing system 20 is configured as one or more information processing devices. From the perspective of the user terminal 10, the information processing system 20 acts as a server that accepts requests. A server is a computer or software that performs the function of providing information and processing results in response to requests from clients. The information processing system 20 provides a user interface to the user terminal 10, generates a request message from the received chat message, and sends the generated request message to the generation AI system 50. When the information processing system 20 receives a dummy data registration request (function_call) from the generation AI system 50, it requests the application service 40 to register the dummy data. The user does not have to go through the trouble of switching between connecting the user terminal 10 to the generation AI system 50 and connecting it to the application service 40.

[0051] As will be described later, a user may use the application service 40 as a portal to register dummy data. The information processing system 20 receives a connection request to the generation AI system 50 from a user terminal 10 connected to the application service 40, and communicates with the generation AI system 50. Details of such communication are explained in Figures 19 and 20.

[0052] The information processing system 20 also accepts setting of configuration information from the developer terminal 60. Setting of configuration information means setting the knowledge (configuration information) necessary for generating an application of the application service 40 and generating dummy data in the information processing system 20. Therefore, the configuration information is information that the generation AI system 50 uses to generate dummy data for the application. The configuration information may include, for example, what kind of dummy data is required for the application. By having the developer set the configuration information in the information processing system 20, user support becomes easier. The information processing system 20 can create appropriate system settings for the application based on the configuration information and notify the generation AI system 50 of the created system settings. The system settings are generated from the configuration information, and the system settings are part or all of the configuration information.

[0053] The setting information is set in the information processing system 20 before the user starts developing an application or registering dummy data. However, the information processing system 20 can also customize the setting information for each customer. For example, if the setting information is "You will now be talking to a customer in the $$ industry" depending on the customer's industry, the information processing system 20 changes the industry name of $$ depending on the customer's industry and notifies the generation AI system 50.

[0054] The information processing system 20 uses this setting information to create a request message to be sent to the generation AI system 50. However, in this embodiment, setting information is not necessary because the information processing system 20 can obtain the application items from the application service 40. In the request message, the setting information is reflected in the system settings, which will be described in detail later.

[0055] The information processing system 20 may be realized by cloud computing or by a single information processing device. Cloud computing refers to a form in which resources on a network are used without being aware of specific hardware resources. The information processing system 20 may exist on the Internet or on-premise.

[0056] Furthermore, the functions of the information processing system 20 may be distributed across multiple information processing devices, or there may be multiple information processing systems 20 with the same functions, and the number of information processing systems that deliver videos may be increased or decreased depending on the processing load.

[0057] The user terminal 10 or the developer terminal 60 is, for example, a terminal device such as a PC (Personal Computer), smartphone, or tablet terminal used by a user or developer. A web browser or native application runs on the user terminal 10 or the developer terminal 60. The developer operates the developer terminal 60 to create setting information for the application. The user operates the user terminal 10 to input chat messages. The administrator or user operates the developer terminal 60 and the user terminal 10 to use various services provided by the information processing system 20, the generation AI system 50, or the application service 40.

[0058] The user terminal 10 or the developer terminal 60 may be any information processing device. Examples of such information processing devices include output devices such as electronic whiteboards and digital signage, HUD (Head Up Display) devices, industrial machinery, imaging devices, sound collection devices, medical equipment, network appliances, mobile phones, smartphones, tablet terminals, car navigation systems, game consoles, PDAs (Personal Digital Assistants), digital cameras, and wearable PCs.

[0059] <Hardware configuration example> 5, the hardware configurations of the information processing system 20, user terminal 10, and developer terminal 60 included in the data registration system 100 will be described. The generation AI system 50 and application service 40 are assumed to have the same hardware configuration as that shown in FIG. 5 or to have the hardware configuration of an information processing device compatible with cloud computing.

[0060] <<Information processing system, user terminal, and developer terminal>> Fig. 5 is a diagram showing an example of the hardware configuration of the information processing system 20, user terminal 10, and developer terminal 60 according to this embodiment. As shown in Fig. 5, the information processing system 20, user terminal 10, and developer terminal 60 are constructed by a computer 500, and include a CPU 501, a ROM 502, a RAM 503, a HD (Hard Disk) 504, an HDD (Hard Disk Drive) controller 505, a display 506, an external device connection I / F (Interface) 508, a network I / F 509, a bus line 510, a keyboard 511, a pointing device 512, a DVD-RW (Digital Versatile Disk Rewritable) drive 514, and a media I / F 516.

[0061] Of these, the CPU 501 controls the overall operation of the computer 500. The ROM 502 stores programs, such as an IPL, used to drive the CPU 501. The RAM 503 is used as a work area for the CPU 501. The HD 504 stores various data, such as programs. The HDD controller 505 controls the reading and writing of various data from and to the HD 504 under the control of the CPU 501. The display 506 displays various information, such as a cursor, menus, windows, characters, or images. The external device connection I / F 508 is an interface for connecting various external devices. In this case, external devices include, for example, USB (Universal Serial Bus) memories and printers. The network I / F 509 is an interface for data communication using the network N2. The bus line 510 is an address bus, a data bus, or the like, for electrically connecting the components, such as the CPU 501, shown in FIG. 5.

[0062] The keyboard 511 is a type of input means having multiple keys used to input characters, numbers, various instructions, etc. The pointing device 512 is a type of input means for selecting and executing various instructions, selecting a processing target, moving a cursor, etc. The DVD-RW drive 514 controls reading and writing of various data from a DVD-RW 513, which is an example of a removable recording medium. The DVD-RW drive 514 is not limited to a DVD-RW, and may be a DVD-R or the like. The media I / F 516 controls reading and writing (storing) of data from a recording medium 515, such as a flash memory.

[0063] <About the function> Next, the functional configuration of the data registration system 100 will be described with reference to Fig. 6. Fig. 6 is a diagram showing an example of the functional configuration of the information processing system 20, the user terminal 10, and the developer terminal 60.

[0064] <<User device>> The user terminal 10 has a communication unit 11, a display control unit 12, an operation reception unit 13, and an inter-browser cooperation unit 14. Each of these functional units is a function or means realized by the CPU 501 shown in FIG. 5 executing instructions contained in one or more programs installed in the user terminal 10. For example, the communication unit 11, the display control unit 12, the operation reception unit 13, and the inter-browser cooperation unit 14 may be realized by at least one of a web browser and JavaScript (registered trademark, omitted below). When the developer terminal 60 executes a native app, these may be realized by the native app.

[0065] The communication unit 11 transmits and receives various types of information to and from the information processing system 20. In this embodiment, the communication unit 11 receives screen information of a daily report app screen from the application service 40, and receives screen information of a chat screen on which chat messages are entered from the information processing system 20. The communication unit 11 transmits chat messages, operation information for the user terminal 10, and the like to the information processing system 20. Note that the communication unit 11 can also communicate directly with the generation AI system 50.

[0066] The display control unit 12 interprets screen information of various screens and displays it on the display 506. The operation accepting unit 13 accepts various operations on the various screens displayed on the display 506 by the user.

[0067] The inter-browser cooperation unit 14 transmits and receives information between web browsers. One user terminal 10 can simultaneously run multiple web browsers. The inter-browser cooperation unit 14 can notify information from one of the multiple web browsers to another web browser (and vice versa). If only one web browser holds authentication information for a specific website (e.g., application service 40), the other web browser can cooperate with the first web browser to communicate with the specific website. Assume that one web browser communicates with the application service 40, and the other web browser communicates with the generation AI system 50 via the information processing system 20. The other web browser can send a response message from the generation AI system 50 to the first web browser. The function of the inter-browser cooperation unit 14 is executed by the web browser (user terminal 10), but JavaScript that realizes the inter-browser cooperation unit 14 is written in the screen information sent from the application service 40 and the information processing system 20.

[0068] <<Developer device>> The developer terminal 60 has a communication unit 61, a display control unit 62, and an operation reception unit 63. Each of these functional units is a function or means realized by the CPU 501 shown in FIG. 5 executing instructions contained in one or more programs installed on the developer terminal 60. For example, the communication unit 61, the display control unit 62, and the operation reception unit 63 may be realized by at least one of a web browser and JavaScript. When the developer terminal 60 executes a native app, these may be realized by the native app.

[0069] The communication unit 61 transmits and receives various information to and from the information processing system 20. In this embodiment, the communication unit 61 receives screen information related to input of setting information from the information processing system 20. The communication unit 61 transmits setting information, operation information for the developer terminal 60, etc. to the information processing system 20. The communication unit 21 can also communicate with the generation AI system 50 and the application service 40.

[0070] The display control unit 62 interprets screen information of various screens and displays it on the display 506. The operation receiving unit 63 receives various operations on the various screens displayed on the display 506 by the user.

[0071] <<Information Processing System>> The information processing system 20 has a communication unit 21, a screen generation unit 22, a chat control unit 23, a setting information storage unit 24, a data registration unit 25, and a processing control unit 28. Each functional unit of the information processing system 20 is a function or means realized by the CPU 501 shown in FIG. 5 executing instructions included in one or more programs installed in the information processing system 20. The setting information storage unit 24 is constructed in the HD 504, RAM 503, or the like shown in FIG. 5. The setting information storage unit 24 does not have to be included in the information processing system 20, and may be located on a network accessible by the information processing system 20.

[0072] The communication unit 21 transmits and receives various types of information to and from the user terminal 10. The communication unit 21 transmits screen information of the daily report app and chat screen to the user terminal 10. The communication unit 21 receives chat messages entered by the user from the user terminal 10. The communication unit 21 also transmits and receives various types of information to and from the developer terminal 60. The communication unit 11 transmits screen information of the setting information input screen to the developer terminal 60. The communication unit 11 receives setting information entered by the developer from the developer terminal 60 and stores it in the setting information storage unit 24.

[0073] The screen generation unit 22 generates screen information for screens (web pages) displayed by the user terminal 10 and the developer terminal 60. Web pages are provided as part of a web application. The screen information is a program written in HTML, JSON, XML, a scripting language, CSS (Cascading Style Sheet), etc. The structure of the web page is mainly specified by HTML, the behavior of the web page is defined by the scripting language, and the style of the web page is specified by CSS. The user terminal 10 may also execute a native application. A native application is an application that cannot be executed unless it is installed on the user terminal 10. In the case of a native application, the screen information is held by the user terminal 10, and the information to be displayed is transmitted in JSON, XML, etc.

[0074] The chat control unit 23 sends a request message to the generation AI system 50 by calling the first API 26. The request message includes the application item name, function specification settings, etc. When the chat control unit 23 receives a chat message sent from the user terminal 10, it includes the received chat message in a request message and sends it to the generation AI system 50. The chat control unit 23 can also send a request message to the generation AI system 50 that includes a history of past conversations before and after sending the chat message or together with the chat message. The first API 26 is one or more APIs published by the generation AI system 50. As a result of calling the first API 26, the chat control unit 23 receives a response message to the request message from the generation AI system 50. The response message includes a reply message to the chat message, a function call request to the information processing system 20, dummy data, etc.

[0075] The data registration unit 25 calls the second API 27 to send a request message to the application service 40. The data registration unit 25 functions by executing a predefined function. The request message includes parameters related to the application (application item name, data format, etc.). The request message to the application service 40 requests the registration of dummy data.

[0076] The second API 27 is one or more APIs published by the application service 40. As a result of calling the second API 27, the data registration unit 25 receives a response message to the request message from the application service 40. The response message includes the result (success or failure) of the request to register the dummy data. If successful, it indicates that the dummy data has been registered in the application.

[0077] The data registration unit 25 may generate dummy data within the information processing system 20 without making a request to the application service 40. The data registration unit 25 may, for example, register dummy data managed by spreadsheet software in the spreadsheet software, or may register dummy data in database software.

[0078] Here, "generating or registering dummy data" does not only mean that the data registration unit 25 actually generates or registers dummy data, but also includes the data registration unit 25 requesting the application service 40, etc. to register dummy data, and the application service 40, etc. actually registering the dummy data.

[0079] The process control unit 28 determines the next process to be performed based on the chat message sent from the user terminal 10 and the button pressed by the user (operation content). By determining the process, the process control unit 28 requests the chat control unit 23 or the data registration unit 25 to perform the process.

[0080] <Additional information on the operation of the generative AI system> In this embodiment, the information processing system 20 uses the generating AI system 50 by calling the first API 26 made public by the generating AI system 50. When the information processing system 20 calls the first API 26, it becomes possible to converse with the AI, which is one of the functions of the generating AI system 50. The generating AI system 50 has distinctive operations or processes, which will be described in more detail below.

[0081] The information processing system 20 communicates with the generation AI system 50 by sending a request message for calling an API to the generation AI system 50. The request message enables the information processing system 20 to obtain a response message from the generation AI system 50.

[0082] The generation AI system 50 returns a response message to the request message to the information processing system 20. The response message included in the response message of the generation AI system 50 often differs each time, even for the same chat message. However, if the information processing system 20 sets a parameter called temperature to 0, the generation AI system 50 will return the same response message for the same chat message.

[0083] If the information processing system 20 wants to continue a conversation with the generative AI system 50, it must include all past conversation history in the request message. This is because conversations with the generative AI system 50 are stateless. This is a specification of one generative AI system 50, and another generative AI system 50 may not require the inclusion of past conversation history.

[0084] In this way, the first API 26 does not have a state related to past communications (it is stateless). For this reason, the user of the first API 26 (in this embodiment, the information processing system 20) must hold the history of past conversations and specify it each time the first API 26 is called. The history of past conversations may also be held by the user terminal 10. Furthermore, since the first API 26 returns an error if the conversation history becomes too long, it is preferable that the information processing system 20 take appropriate measures, such as including only the most recent exchanges in a request message if the conversation has continued for a long time.

[0085] <<Function call returned by the generation AI system>> The functions provided by the generative AI system 50 include a function called a function call. A function call is when the generative AI system 50 requests the information processing system 20 to call a function. Therefore, if the information processing system 20 allows the generative AI system 50 to use this function, the generative AI system 50 can call a "function."

[0086] The request message includes a function specification setting set by the information processing system 20 so that the generating AI system 50 can call a "function." The function specification setting enables the generating AI system 50 to make a function call (function call request). In this way, the function specification setting is information about the first API 26 for calling the data registration unit 25. In other words, the function specification setting notifies the generating AI system 50 that the generating AI system 50 can request the information processing system 20 to call a function.

[0087] In this way, the information processing system 20 causes the generation AI system 50 to use function call, which allows the generation AI system 50 to call a function provided by the information processing system 20 and the information processing system 20 to execute the function. Furthermore, the information processing system 20 can use the execution results of the function to converse with the user.

[0088] However, since the response message of the generation AI system 50 is different each time, the generation AI system 50 does not necessarily request a function call. Even if the information processing system 20 includes a function specification setting in the request message, the generation AI system 50 may return the same response message as when no function specification setting is set.

[0089] The continuity of the conversation between the user and the generation AI system 50 will now be described. However, in this embodiment, there is no phase in which conversation continuity is desirable. If a process is adopted in which the entire history of past conversations is included in the request message, the information processing system 20 must also include the execution result of the function in the request message and transmit it to the generation AI system 50. However, it is not necessary for the information processing system 20 to include the execution result of the function in the request message along with the history of past conversations and transmit it to the generation AI system 50. In other words, the information processing system 20 may transmit the execution result of the function directly to the user terminal 10. However, by transmitting the execution result of the function to the generation AI system 50, the generation AI system 50 can continue the conversation using the history of past conversations, thereby creating continuity in the conversation. For example, consistency in writing style and wording will be achieved, making it less likely for the user to feel uncomfortable. For example, even if the user's native language is English and the conversation is in English, the information processing system 20 does not need to translate the response message into English.

[0090] Furthermore, the information processing system 20 cannot predict whether the generating AI system 50 will request a function call. However, if the information processing system 20 explicitly specifies the "function_call option" in the request message, it can force the generating AI system 50 to make a function call.

[0091] <Automatic generation of dummy data> In this embodiment, a request message transmitted by the information processing system 20 and a response message transmitted by the generation AI system 50 will be described using an example in which a user registers dummy data in a daily report application.

[0092] First, for convenience of explanation, examples of screens displayed by the user terminal 10 when the user generates dummy data will be described with reference to Figures 7 to 11. Request messages and response messages will be described after the examples of the screens.

[0093] 7 shows an example of a daily report application screen 610 displayed on the user terminal 10. The daily report application is a web application executed by the application service 40. This daily report application has the following fields: date 611, goal achievement level 612, work content 613, and impressions and learning 614. Five records 615 have already been entered. The five records 615 may be dummy data or may be data manually entered by the user.

[0094] The generative AI system 50 provides various types of support to users regarding applications using no-code or low-code. The AI collaboration function button 616 is a button for displaying such various support contents. The filtering button 618 is a button for filtering each record according to predetermined conditions, and the calculation button 617 is a button for calculating and graphing statistical information for each record.

[0095] 8 shows a function selection screen 620 that is displayed when the user presses the AI collaboration function button 616. Note that the app ID of the daily report app is identified by pressing the AI collaboration function button 616 on the daily report app screen 610. The function selection screen 620 is displayed as a pop-up superimposed on the daily report app screen 610. The function selection screen 620 may be displayed after a screen transition from the daily report app screen 610. The function selection screen 620 has an automatic record generation button 621, an add field button 622, and a form layout setting button 623.

[0096] The Automatic Record Generation button 621 is a button for automatically generating and registering dummy data. The Add Field button 622 is a button for the user to add an item (field) to the daily report app with the support of the generation AI system 50, and the Set Form Layout button 623 is a button for changing the arrangement of items in the daily report app with the support of the generation AI system 50. The arrangement of items in the daily report app refers to the position of each item on the input screen of the daily report app (a screen different from Figure 7).

[0097] 9 shows a chat screen 630 that is displayed when the user presses the automatic record generation button 621. The chat screen 630 is displayed as a pop-up that overlaps the daily report application screen 610. The chat screen 630 may be displayed after a screen transition from the daily report application screen 610. The chat screen 630 has a message 631 that reads, "Registering dummy data in the application." The user sees this message 631 and enters a chat message 632 that reads, "Please try registering some dummy data."

[0098] When the user terminal 10 sends this chat message 632 to the information processing system 20, the information processing system 20 acquires information about the daily report app (such as item names) from the application service 40. The information processing system 20 also specifies the information about the daily report app and requests the generation AI system 50 to generate dummy data, and acquires the dummy data from the generation AI system 50. At this stage, the information processing system 20 can also register the dummy data in the application service 40. However, if the amount of data already entered in the daily report app suddenly increases, or if the amount of data that the user does not like increases, the user may be confused. For this reason, the information processing system 20 registers the dummy data in the application after obtaining the user's permission. The information processing system 20 sends a message to the user terminal 10 to confirm whether it is okay to register the dummy data.

[0099] FIG. 10 shows a chat screen 630 on which the generated dummy data is displayed. The chat screen 630 in FIG. 10 displays a message 633 saying "The following dummy data will be registered" and two pieces of dummy data 634. The message 633 corresponds to a confirmation request for registering the data in the application service 40. The chat screen 630 also has an OK button 635 and a Cancel button 636. When the user presses the OK button 635, the information processing system 20 registers the dummy data 634 in the daily report app of the application service 40. Pressing the OK button 635 corresponds to accepting an instruction to register the dummy data included in the request (function_call) from the generation AI system 50.

[0100] 11 shows a daily report application screen 610 and a chat screen 630 that are displayed when the user presses an OK button 635. The chat screen 630 in FIG. 11 displays a chat message 637 of "OK" that the user entered when they pressed the OK button 635, and a response message 638 that reads "Registration completed." In addition, two pieces of dummy data 639 are registered in the daily report application. The dummy data 639 is, for example, a date and a character string, and is the same as the dummy data 634 in FIG. 10.

[0101] <Request message and response message> Next, a request message sent from the information processing system 20 to the application service 40 or the generation AI system 50, and a response message received by the information processing system 20 from the application service 40 or the generation AI system 50 will be described.

[0102] 12 is an example of a response message that the information processing system 20 acquires from the application service 40. When a user inputs a chat message 632 saying, "Please register some dummy data" on the chat screen 630, the data registration unit 25 includes a request for the application ID and application information (item name, data format, etc.) in a request message for calling the second API 27 and transmits the request message to the application service 40. As a result, the data registration unit 25 acquires the response message shown in FIG.

[0103] 12, label 641 indicates the item name, and type 642 indicates the data format. The label of "goal achievement level" also includes option 643. Option 643 is the button name displayed on the button when the data format is "RADIO_BUTTON." In this way, data registration unit 25 can acquire application information (item name, data format, etc.) that the application has from application service 40.

[0104] Then, the chat control unit 23 uses the response message of FIG. 12 to generate a request message for requesting the generation AI system 50 to generate dummy data.

[0105] FIG. 13 shows an example of a request message that calls the first API 26 published by the AI generation system 50. The request message includes roles 651 and 653 and content 652 and 654. Roles 651 and 653 indicate the speaker, and include user (user), assistant (AI of the AI generation system 50), and system (instruction for setting up the AI assistant). Contents 652 and 654 represent the content of the conversation and may be written in natural language. The system content 652 is "Please help me create appropriate dummy data for the daily report app." This content 652 was generated by the chat control unit 23 in response to pressing the record auto-generation button 621 in FIG. 8. However, if the user inputs a chat message into the user terminal 10 requesting the generation of dummy data, content 652 may be omitted.

[0106] The content 654 of the user is "Please try registering some dummy data." This content 654 is the chat message 632 that the user entered on the chat screen 630 in FIG.

[0107] 13 includes a function specification setting 655. "function" is the function specification setting 655, and the function specification setting 655 has the following attributes. name656 is the name of the function (generate_samples). Parameters 657 are also part of the function specification and specify the format of the items. samples658 is also part of the function specification, meaning that it contains samples of item names. "type": "array" 659 indicates that the items are in tabular format. "items" 661 and below indicate the item name and data format. "type": "object" 662 indicates the data format of the return value. "Properties" 663 includes item information 664 of the application returned by the application service 40 to the information processing system 20 in a response message. The item information 664 includes the item name, data format, etc. of each item. The item information 664 may also include the button name ("Unachieved" or "Achieved" in FIG. 13) corresponding to option 643 in FIG. 12.

[0108] By this function specification setting 655, the information processing system 20 has instructed the generating AI system 50 that the generating AI system 50 can request the information processing system 20 to call the function defined as shown in FIG.

[0109] Figure 14 is an example of a response message that the generation AI system sends to the information processing system 20 in response to the request message of Figure 13. The response message of Figure 14 does not include a function call request, and is not the response message expected by the chat control unit 23. In such a case, the information processing system 20 sends the response message included in the response message to the user terminal 10. Since the response message 671 is "How many pieces of data do you want to generate?", the user inputs an appropriate number of pieces of data into the user terminal 10 and sends it to the information processing system 20. By the chat control unit 23 sending a request message including the number of pieces of data to the generation AI system 50, the chat control unit 23 can obtain a response message including a function call request.

[0110] FIG. 15 is an example of a response message that the generation AI system 50 sends to the information processing system 20 in response to the request message of FIG. 13. The response message of FIG. 15 includes a function call request 681. In this embodiment, when the function call of FIG. 15 is included in the response message, the chat control unit 23 detects it, and the data registration unit 25 requests the application service 40 to register dummy data. The application service 40 is a low-code or no-code platform. In this embodiment, the second API 27 published by the application service 40 and the first API 26 published by the generation AI system 50 are called, enabling the information processing system 20 to register dummy data in the application of the application service 40 while the user is conversing with the generation AI system 50 in natural language.

[0111] The function call request 681 in the response message corresponds to a request to register dummy data. The function call request 681 includes a name 682 and arguments 683. The name 682 is the name of the function defined in the function specification setting 655. The generation AI system 50 is requesting the information processing system 20 to call a function with this name. The arguments 683 are the return value, which is defined in the function specification setting 665. In Figure 15, dummy data 684 (item value) of "2023-01-09" is generated for the item name "Date", and dummy data 685 (item value) of "Not achieved" is generated for the item name "Goal achievement level". In this way, the generation AI system 50 generates dummy data for each item and transmits it to the information processing system 20.

[0112] By this function call request 681 (function call), the generation AI system 50 can specify the item name of the daily report application and dummy data, and request the information processing system 20 to call a function that registers the generated dummy data.

[0113] The chat control unit 23 of the information processing system 20 analyzes the function call request 681 included in the response message of Fig. 15 and determines to register dummy data in the application service 40 (executes the function). The chat control unit 23 notifies the data registration unit 25 that it has received the function call request 681. The data registration unit 25 calls the second API 27 made public by the application service 40, and requests the application service 40 to register the dummy data using the item name and data format (an example of a parameter) included in the response message.

[0114] Specifically, an example is considered in which the information processing system 20 uses the following API of the application service 40 as follows. -API to register dummy data published by Application Service 40 Fig. 16 shows an example of a request message that the data registration unit 25 transmits to the application service 40 based on the function call request 681 in Fig. 15. The data registration unit 25 transmits the request message in Fig. 16 to the application service 40 by calling the second API 27. The application ID of the daily report application (an example of application identification information for identifying an application) is stored in "XXX" of app691. Records 692 is the content of the record (dummy data) to be registered, and a value 694 is associated with an item name 693 .

[0115] By the above request message and response message, dummy data is registered in the daily report application of the application service 40, with item names and values associated with each other.

[0116] A case will be described in which the user inputs a chat message indicating that he or she would like to register more dummy data. In response to the chat message from the user, the chat control unit 23 calls the first API 26 with a request message as shown in FIG.

[0117] 17 shows an example of a request message for calling the first API 26 made public by the generation AI system 50. This request message includes the contents 652 and 654 shown in FIG. Description 703 is also a history of past conversations, and indicates that the generative AI system 50 has already requested a function call. Description 704 conveys the execution result of the function to the generation AI system 50. That is, when the user inputs a chat message indicating that he / she wants to register more dummy data, the chat control unit 23 includes the execution result of the function (completed, failed) in the response message. Description 705 is a chat message entered by the user. In this example, the user has entered the chat message "Please register more data." Description 706 and subsequent descriptions are omitted, and function specification settings are described in the same manner as in FIG.

[0118] 17, the chat control unit 23 can register dummy data in the application service 40 through interaction with the generation AI system 50 by repeatedly generating a request message including past history, calling the first API 26 of the generation AI system 50, and receiving a response message. A user can register dummy data in any application simply by entering a chat message.

[0119] <Action or Processing> 18 is an example of a sequence diagram illustrating a process of supporting the registration of dummy data by the information processing system 20. As a general flow, steps S9 to S18 are repeatedly executed, and the process branches to step S12 or S13.

[0120] S1: The communication unit 11 of the user terminal 10 connects to the URL of the information processing system 20. This URL may be specified by the user directly entering it on the user terminal 10 or by executing a shortcut that specifies the URL. The communication unit 11 of the user terminal 10 generates an HTTP request that includes the URL of the daily report app and transmits the generated HTTP request to the information processing system 20.

[0121] S2: When the communication unit 21 of the information processing system 20 receives the above HTTP request from the user terminal 10, the screen generation unit 22 creates screen information for the daily report application screen. In response to the above HTTP request, the communication unit 21 transmits an HTTP response including the screen information for the daily report application screen to the user terminal 10 (see FIG. 7).

[0122] S3: The user operates the user terminal 10 to press the AI collaborative function button 616. The operation reception unit 13 receives the press. This identifies the app ID. The communication unit 11 of the user terminal 10 transmits to the information processing system 20 a message that the AI collaborative function button 616 has been pressed, along with the app ID.

[0123] S4: In response to receiving the notification that the AI collaborative function button 616 has been pressed and the application ID, the communication unit 21 of the information processing system 20 causes the screen generation unit 22 to generate a function selection screen. The communication unit 21 transmits screen information of the function selection screen to the user terminal 10.

[0124] S5: When the communication unit 11 of the user terminal 10 receives the screen information of the function selection screen, the display control unit 12 displays the function selection screen 620 (see FIG. 8). The user operates the user terminal 10 to press the automatic record generation button 621. The operation reception unit 13 receives the press. The communication unit 11 of the user terminal 10 transmits to the information processing system 20 a message that the automatic record generation button 621 has been pressed.

[0125] S6: The communication unit 21 of the information processing system 20 receives the notification that the automatic record generation button 621 has been pressed, and the process control unit 28 causes the data registration unit 25 to acquire application information in response to the pressing of the automatic record generation button 621. The data registration unit 25 calls the second API 27. The data registration unit 25 calls the second API 27 using a request message that requests acquisition of the application information together with the application ID.

[0126] S7: The application service 40 returns the application information (item name, data format, etc.) of the application identified by the application ID to the information processing system 20 via the second API 27 (see FIG. 12). The data registration unit 25 acquires the application information (item name, data format, etc.) from the application service 40.

[0127] S8: The screen generation unit 22 of the information processing system 20 has acquired the application information, and therefore transmits screen information of the chat screen to the user terminal 10. The user can instruct the generation of dummy data on the chat screen.

[0128] S9: When the communication unit 11 of the user terminal 10 receives the screen information of the chat screen, the display control unit 12 displays the chat screen (see FIG. 9). The user operates the user terminal 10 to input a chat message. An example of the chat message 632 is "Please register some dummy data." The operation reception unit 13 receives the input. The communication unit 11 of the user terminal 10 generates a request message including the chat message and transmits the generated request message to the information processing system 20. The communication unit 11 of the user terminal 10 transmits the generated request message as, for example, an HTTP request. Note that the communication unit 11 of the user terminal 10 may generate a request message including a history of past conversations. Furthermore, the history of past conversations may be stored in the information processing system 20. If the information processing system 20 stores the history of past conversations, the communication unit 11 of the user terminal 10 does not need to include the history of past conversations in the request message.

[0129] S10: The communication unit 21 of the information processing system 20 receives the request message. The processing control unit 28 of the information processing system 20 determines to register dummy data based on whether the automatic record generation button 621 has been pressed or by analyzing the chat message 632. The generation AI system 50 may be used to analyze the chat message 632. In this case, the chat control unit 23 sends the chat message 632 to the generation AI system 50 and acquires the user's request or intention to register dummy data.

[0130] The processing control unit 28 passes the chat message to the chat control unit 23. The chat control unit 23 generates a request message including the system settings (setting information), the chat message, and the function specification settings, and sends the generated request message to the generation AI system 50 by calling the first API 26 (see FIG. 13).

[0131] S11: The generation AI system 50 returns a response message (normal message) or a response message including a function call request to the information processing system 20 (see Figures 14 and 15). The chat control unit 23 receives the response message from the generation AI system 50. This response message may be a response message (Figure 14) or a function call request (Figure 15). If it is a response message, processing proceeds to step S12, and if it is a function call request, processing proceeds to step S13.

[0132] S12: When the chat control unit 23 receives a normal response message, the communication unit 21 of the information processing system 20 transmits the response message to the user terminal 10. For example, the response message may be "Please tell me more details."

[0133] S13: When the chat control unit 23 receives a function call request, it analyzes the function and determines that a request to register dummy data (application generation request) has been made to the application service 40. Because the function for registering dummy data was specified in the function specification setting in step S10, the chat control unit 23 can easily determine that the request is for registering dummy data based on the function name (name 682) included in the function call request. The chat control unit 23 also obtains arguments 683 (item name, data format, etc.) included in the function call request.

[0134] To receive confirmation from the user, the chat control unit 23 causes the screen generation unit 22 to create a confirmation message (the following dummy data is registered). The communication unit 21 sends the confirmation message to the user terminal 10.

[0135] S14: When the communication unit 11 of the user terminal 10 receives the confirmation message, the display control unit 12 displays a chat screen (FIG. 10). The chat screen 630 displays a message 633 saying "The following dummy data will be registered," two pieces of dummy data 634, an OK button 635, and a cancel button 636. The user operates the user terminal 10 to press the OK button 635 or the cancel button 636. Here, it is assumed that the OK button 635 has been pressed. The operation acceptance unit 13 accepts the press. The communication unit 11 of the user terminal 10 transmits to the information processing system 20 that the OK button 635 has been pressed.

[0136] S15: The communication unit 21 of the information processing system 20 receives a notification that the OK button 635 has been pressed. The processing control unit 28 of the information processing system 20 determines that dummy data should be registered in the data registration unit 25 because the OK button 635 has been pressed. The data registration unit 25 calls the second API 27 to send a request message to register dummy data to the application service 40 (see FIG. 16). That is, the data registration unit 25 realizes the functionality of the function requested to be called by the generation AI system 50 by sending the request message. In this embodiment, the data registration unit 25 registers dummy data. The data registration unit 25 calls one or more of the APIs described above. -API to register dummy data published by Application Service 40 The data registration unit 25 requests the registration of dummy data by including in the request message the application ID and arguments 683 (item name and value), which are parameters included in the response message from the generation AI system 50. The request message may differ depending on the application service 40. In this way, when the chat control unit 23 receives a request (function_call) sent by the generation AI system 50 based on the chat message sent to the generation AI system 50, item names, etc., and function specification settings, and the request includes dummy data generated by the generation AI system 50 based on the chat message and item names, etc., the data registration unit 25 can register the dummy data included in the received request in the target application.

[0137] S16: The data registration unit 25 receives a response message from the application service 40. The response message includes, for example, a result indicating that registration is complete. The response message may also include registered dummy data. Although it is rare for registration of dummy data to fail, if it does fail, a message indicating the failure is sent to the user terminal 10. The process then returns to, for example, step S9.

[0138] S17: If the registration of the dummy data is successful, the communication unit 21 of the information processing system 20 transmits a message such as "Registration completed" to the user terminal 10 (see FIG. 11).

[0139] S18: The communication unit 21 may also request the user terminal 10 to update the daily report application screen 610. By updating, the dummy data registered in step S15 is displayed on the daily report application screen 610 displayed by the user terminal 10 (see FIG. 11). The update can be performed by the information processing system 20 causing the user terminal 10 to execute an update process, or by the user terminal 10 receiving a registration notification from the application service 40 and acquiring the dummy data. The user may also manually display the update results.

[0140] 18 ends, and the user can then return to step S9 as needed to add more dummy data. In this case, the user can enter a chat message to register another piece of dummy data.

[0141] <Additional information regarding authentication for information processing systems to use the second API published by application services> In order for the information processing system 20 to call the second API 27, the information processing system 20 needs to be authenticated by the application service 40. When the information processing system 20 in the sequence diagram of FIG. 18 operates in the same domain as the application service 40, authentication information for the application service 40 is sent to the information processing system 20 from a web browser running on the user terminal 10. The authentication information is pre-stored in a cookie, for example. This allows the information processing system 20 to call the second API 27 published by the application service 40. When the low-code or no-code platform (application service 40) and the information processing system 20 are developed by the same organization, it is considered easy to make them in the same domain, and in this case, there is considered to be no problem.

[0142] However, when the information processing system 20 and the application service 40 operate in different domains, authentication issues may arise. This will be explained with reference to Figure 8. A user can use or develop applications from the daily report application screen 610.

[0143] For example, consider the following configuration of a daily report application screen 610 provided by the application service 40. First, the daily report application screen 610 is opened in a web browser. When the user presses the AI collaboration function button 616 on the daily report application screen 610, a function selection screen 620 for communicating with the information processing system 20 is displayed in a pop-up. Assume that this function selection screen 620 is opened in a separate web browser. In this case, because the application service 40 and the information processing system 20 are in different domains, the user terminal 10 cannot send authentication information for the application service 40 to the information processing system 20. Therefore, the information processing system 20 cannot call the second API 27 published by the application service 40. This is because the pop-up function selection screen 620 is in a different domain from the daily report application screen 610, and therefore the pop-up function selection screen 620 (a separate web page) cannot access the cookies of the application service 40.

[0144] Therefore, a configuration is conceivable in which a request is made from the pop-up displayed function selection screen 620 (another Web page) to the original daily report application screen 610 to call the second API 27 made public by the application service 40.

[0145] 19 and 20 are example sequence diagrams in which the information processing system 20 registers dummy data in the application service 40 by utilizing cooperation between two web browsers in the user terminal 10. Note that the explanation of FIGS. 19 and 20 may mainly focus on the differences from FIG. 18.

[0146] S21: The user specifies the URL of the application service 40 to the user terminal 10. The web browser that connects to the application service 40 is assumed to be the original web browser 240 (an example of a first web browser).

[0147] S22: The communication unit 11 of the user terminal 10 connects to the URL of the application service 40. The user instructs the user terminal 10 on the URL of the daily report application screen 610, and the web browser of the user terminal 10 sends an HTTP request including the URL of the daily report application screen 610 to the application service 40.

[0148] S23: When the application service 40 receives the above HTTP request from the user terminal 10, it transmits screen information (HTML, JavaScript, CSS, etc.) of the daily report application screen 610 to the user terminal 10. This screen information includes a script for launching another web browser 250 (an example of a second web browser), the URL of the function selection screen 620, etc.

[0149] S24: The communication unit 11 of the user terminal 10 receives the screen information of the daily report application screen 610, and the display control unit 12 of the original Web browser 240 displays the daily report application screen 610 (see FIG. 7).

[0150] S25: The user presses the AI collaboration function button 616 on the daily report application screen 610.

[0151] S26: As a result, the inter-browser cooperation unit 14 starts up another Web browser 250. The application ID of the daily report application screen 610 and the URL of the function selection screen 620 are notified to the other Web browser 250. The other Web browser 250 is displayed as a pop-up. More specifically, the start-up of the other Web browser 250 is performed by JavaScript included in the screen information of the daily report application screen 610.

[0152] S27: The other Web browser 250 uses the URL of the function selection screen 620 notified by the original Web browser 240 to request the function selection screen 620 from the information processing system 20.

[0153] S28: In response to this request, the screen generation unit 22 of the information processing system 20 generates screen information (HTML, JavaScript, CSS, etc.) for the function selection screen 620, and the communication unit 21 transmits the screen information for the function selection screen 620 to another web browser 250 (user terminal 10).

[0154] S29: The communication unit 11 of the user terminal 10 receives the screen information of the function selection screen 620. The display control unit 12 displays the function selection screen 620 based on the screen information (see FIG. 8).

[0155] S30: The user operates the user terminal 10 to press the automatic record generation button 621 on the function selection screen 620. The operation reception unit 13 receives the pressing of the automatic record generation button 621.

[0156] S31: When the automatic record generation button 621 is pressed, the inter-browser cooperation unit 14 of the other Web browser 250 specifies the application ID and requests the original Web browser 240 to acquire application information of the application service 40. Such cooperation (message communication) between browsers is as follows: https: / / developer.mozilla.org / ja / docs / web-API / Window / postMessage is known.

[0157] S32: The original Web browser 240 generates a request message that calls the second API 27 of the application service 40. The request message specifies the application ID to the application service 40 and requests acquisition of application information.

[0158] S33: The application service 40 includes the application information (item name, data format, etc.) of the application identified by the application ID in a response message and sends it to the original Web browser 240.

[0159] S34: The inter-browser cooperation unit 14 of the original Web browser 240 transmits the application information to the other Web browser 250.

[0160] S35: When the other Web browser 250 receives the application information, it switches the display from the function selection screen 620 to the chat screen 630. The chat screen 630 has been transmitted from the information processing system 20 in step S28 or the like. The other Web browser 250 displays the chat screen 630 (see FIG. 9).

[0161] S36: Next, the user inputs a chat message 632 such as "Please try registering some dummy data."

[0162] The subsequent processing in steps S37 to S40 is the same as that in steps S9 to S12 in FIG.

[0163] S41: In step S40, when another Web browser 250 receives a response message (in this case, a response message) from the generation AI system 50, the display control unit 12 of the other Web browser 250 displays the response message (e.g., Please tell me more).

[0164] The subsequent processing of steps S42 and S43 may be similar to steps S13 and S14 in Fig. 18. The user terminal 10 displays the chat screen 630 in Fig. 10.

[0165] S44: When the OK button 635 on the chat screen 630 in Fig. 10 is pressed, the inter-browser cooperation unit 14 of the other Web browser 250 requests the original Web browser 240 to register dummy data by specifying the application ID for the application service 40. The inter-browser cooperation method may be the same as in step S31.

[0166] S45: The original Web browser 240 calls the second API 27 to register dummy data in the application service 40 by specifying the application ID.

[0167] S46: The application service 40 sends the result of the dummy data registration to the original Web browser 240. This result may indicate, for example, that registration is complete. The registered dummy data may also be included. Although it is rare for the registration of dummy data to fail, if it does fail, a message indicating this is not successful is sent to the original Web browser 240. The process then returns to, for example, step S36.

[0168] S47: The inter-browser cooperation unit 14 of the original Web browser 240 transmits the result of the registration of the dummy data to the other Web browser 250.

[0169] S48: When the registration is complete, the separate Web browser 250 displays a message such as "Registration is complete" on the chat screen 630 (see FIG. 11).

[0170] Furthermore, another Web browser 250 can request the original Web browser 240 to update the daily report application screen 610, thereby allowing the original Web browser 240 to display the daily report application screen 610 including the registered dummy data. Alternatively, there is a method in which the original Web browser 240 receives a notification of registration from the application service 40 and obtains new dummy data.

[0171] <Major Effects> In the information processing system 20 of this embodiment, the user simply inputs on the user terminal 10 that they would like to register dummy data, and the information processing system 20 uses the generation AI system 50 to generate dummy data to be used in the application and registers the dummy data in the application service 40. Existing generation AI systems can also create dummy data, but the user must specify the item names and other information to the generation AI system. Furthermore, when the generation AI system returns dummy data, the user must enter the dummy data one by one into the application service 40. In contrast, in this embodiment, the user simply inputs a request to register dummy data in the application, and the information processing system 20 can register the dummy data used by the application in the application.

[0172] <Other application examples> The best mode for carrying out the present invention has been described above using examples, but the present invention is not limited to these examples in any way, and various modifications and substitutions can be made within the scope that does not deviate from the gist of the present invention.

[0173] For example, in this embodiment, the dummy data generated by the generation AI system 50 is text data, but it may also be numerical values. The dummy data generated by the generation AI system 50 may also be image data. Various types of image data are possible, and the image data may be anything, such as illustrations for instruction manuals, maps, layout diagrams of desks, illustrations for web pages, etc. The image data may also be video. The dummy data may also be text, or may be in a table format such as form data. Other dummy data may also be radio buttons, check boxes, time, attached files, links (URLs), etc.

[0174] Furthermore, in this embodiment, dummy data for an application is generated, but the dummy data may be dummy data for a file created by the application. For example, if the application is a spreadsheet software, the information processing system 20 causes the generation AI system 50 to generate dummy data to be set in the spreadsheet software items. The information processing system 20 registers the generated dummy data in the spreadsheet software. In a use case, a user sends a spreadsheet software file and a chat message to the information processing system 20. The information processing system 20 sends the spreadsheet software file along with function specification settings and chat messages to the generation AI system 50, and the generation AI system 50 returns the dummy data to the information processing system 20. The information processing system 20 registers the dummy data in the spreadsheet software file.

[0175] Furthermore, the application itself may execute the functions of the information processing system 20 described in this embodiment. In this case, the application receives the application ID from the user terminal 10, so the information processing system 20 does not need to transmit the application ID to the application service 40.

[0176] Furthermore, in this embodiment, an example has been described in which the information processing system 20 receives a request to call a function from the generation AI system 50, but the information processing system 20 may also receive a request to call the Web-API itself from the generation AI system 50. In other words, functions and APIs do not need to be strictly distinguished.

[0177] Additionally, the devices described in the examples are merely illustrative of one of several computing environments for implementing the embodiments disclosed herein. In one embodiment, information processing system 20 includes multiple computing devices, such as a server cluster, configured to communicate with each other via any type of communication link, including a network, shared memory, etc., and to perform the processes disclosed herein.

[0178] Furthermore, the information processing system 20 can be configured to share the processing steps disclosed in this embodiment, such as those shown in FIG. 10, in various combinations. For example, a process executed by a specific unit can be executed by multiple information processing devices included in the information processing system 20. Furthermore, the information processing system 20 may be integrated into a single server device, or may be divided into multiple devices.

[0179] In addition, the configuration examples shown in Fig. 6 and the like are divided according to main functions to facilitate understanding of the processing by the information processing system 20. The method of dividing the processing units and their names do not limit the present invention. The processing of the information processing system 20 can be divided into even more processing units depending on the processing content. Furthermore, it can also be divided so that one processing unit includes even more processes.

[0180] Furthermore, each function of the above-described embodiments can be realized by one or more processing circuits. Here, the term "processing circuit" in this specification includes a processor programmed to perform each function by software, such as a processor implemented by an electronic circuit, as well as devices such as an ASIC (Application Specific Integrated Circuit), a DSP (Digital Signal Processor), an FPGA (Field Programmable Gate Array), and conventional circuit modules designed to perform each of the above-described functions.

[0181] Embodiments of the present invention provide significant improvements in computer power and functionality. These improvements allow users to utilize computers that provide more efficient and robust interaction with tables, which are ways of storing and presenting information in information processing devices. Furthermore, embodiments of the present invention provide a better user experience through the use of more efficient, powerful, and robust user interfaces. Such user interfaces provide better interaction between humans and machines.

[0182] <Additional Notes> [Appendix 1] An information processing device capable of communicating with a terminal device and a generation AI (Artificial Intelligence) system via a network, a data registration unit that functions by executing a predefined function and registers data used by an application with the application, the data registration unit registering the data included in the request with the application; a chat control unit that, when receiving a chat message from the terminal device, transmits the received chat message to the generation AI system; and the chat control unit transmits, at least once, to the generation AI system, information regarding the application to which the data is to be registered and information for the generation AI system to call the function; When the chat control unit receives the request sent by the generation AI system based on the chat message sent to the generation AI system, information about the application, and information for calling the function, the request including the data generated by the generation AI system based on the chat message and information about the application, the data registration unit registers the data included in the received request in the application to which the data is to be registered. Information processing device. [Appendix 2] When the chat control unit receives the request from the generation AI system, the chat control unit transmits to the terminal device a request for confirmation regarding the registration of the data included in the received request in the application; receiving an instruction to register the data included in the confirmation request displayed by the terminal device on the same screen as the chat message when the instruction is received from the terminal device; The information processing device according to claim 1, wherein the data registration unit registers the data included in the request received from the generation AI system in the application to which the data is to be registered in response to receiving the instruction from the terminal device. [Appendix 3] The information processing device described in Appendix 1, wherein the chat control unit, when receiving a response message from the generation AI system in response to the data sent to the generation AI system, sends the response message to the terminal device. [Appendix 4] When application identification information for identifying the application is received from the terminal device, the data registration unit acquires item names of the application identified by application identification information that identifies the application; The chat control unit transmits the acquired item name to the generation AI system as information related to the application to which the data is to be registered; 4. The information processing device according to claim 1, wherein the data registration unit associates the data included in the request with the item name and registers the data in the application to which the data is to be registered. [Appendix 5] the information processing device communicates with an application service that executes the application via a network; 5. The information processing device according to claim 4, wherein the data registration unit acquires, from the application service, the item names of the application identified by application identification information that identifies the application. [Appendix 6] The information for calling the function includes a setting of the specifications of the function to be called by the generation AI system, a function call request for calling the function, which the generation AI system transmits to the information processing device based on the setting of the function specifications, includes a request for registering the data; 6. The information processing device according to any one of appendices 1 to 5, wherein the chat control unit receives a request for registering the data from the generation AI system. [Appendix 7] When the chat control unit receives a request for registering the data from the generation AI system, the data registration unit registers the data included in the request in the application to which the data is to be registered; An information processing device as described in Appendix 4, wherein when the chat control unit receives a response message to the data from the generation AI system rather than a request for registration of the data, the chat control unit sends the response message to the terminal device. [Appendix 8] When the chat control unit receives a request for registering the data from the generation AI system, the data registration unit transmits the data included in the request to the terminal device before registering the data in the application; 8. The information processing device according to claim 7, wherein, when receiving a request to register the data from the terminal device, the data registration unit registers the data included in the request in the application. [Appendix 9] If the application is an application in which the data is registered in a table, 9. The information processing device according to any one of appendices 1 to 8, wherein the data is one or more values registered in the table. [Appendix 10] The information processing device according to claim 9, wherein the value is a date, a character string, or a number. [Appendix 11] 6. The information processing device according to claim 5, wherein the data registration unit associates the data with the item name and requests the application service to register the data. [Appendix 12] a first web browser that communicates with the application service and a second web browser that is started by the first web browser are executed on the terminal device; the information processing device receives the chat message from the second web browser; When the chat control unit receives a request for registering the data transmitted by the generation AI system, the data registration unit transmits the request for registering the data to the second web browser; the second web browser transmits a request for registering the data to the first web browser; 12. The information processing device according to claim 11, wherein the first web browser sends a request for registering the data to the application service. [Appendix 13] the data registration unit acquires, from the application service, the item names and data formats of the application identified by the application identification information; When the chat control unit receives the request sent by the generation AI system based on the chat message sent to the generation AI system, the item name and data format which are information about the application, and information for calling the function, The information processing device according to claim 4, wherein the data registration unit associates the data in the data format included in the received request with the item name and registers the data in the application to which the data is to be registered. The information processing device communicates with an application service that executes the application via a network, 6. The information processing device according to claim 5, wherein the data registration unit acquires, from the application service, the item names included in the application identified by application identification information that identifies the application. [Explanation of symbols]

[0183] 10 User Devices 20 Information Processing Systems 40 Application Services 50 Generative AI System 100 Data Registration System [Prior art documents] [Patent documents]

[0184] [Patent Document 1] https: / / chat.openai.com /

Claims

1. An information processing device capable of communicating with a terminal device and a generation AI (Artificial Intelligence) system via a network, a data registration unit that functions by executing a predefined function and registers data used by an application with the application, the data registration unit registering the data included in the request with the application; a chat control unit that, when receiving a chat message from the terminal device, transmits the received chat message to the generation AI system; and The chat control unit transmits, at least once, information regarding the application to which the data is to be registered and information for the generation AI system to call the function to the generation AI system; When the chat control unit receives the request sent by the generation AI system based on the chat message sent to the generation AI system, information about the application, and information for calling the function, the request including the data generated by the generation AI system based on the chat message and information about the application, the data registration unit registers the data included in the received request in the application to which the data is to be registered. Information processing device.

2. When the chat control unit receives the request from the generation AI system, the chat control unit transmits to the terminal device a request for confirmation regarding the registration of the data included in the received request in the application; receiving an instruction to register the data included in the confirmation request displayed by the terminal device on the same screen as the chat message when the instruction is received from the terminal device; The information processing device according to claim 1 , wherein the data registration unit registers the data included in the request received from the generating AI system in the application to which the data is to be registered in response to receiving the instruction from the terminal device.

3. The information processing device according to claim 1 , wherein the chat control unit transmits a response message to the terminal device when the chat control unit receives a response message from the generation AI system in response to the data transmitted to the generation AI system.

4. When application identification information for identifying the application is received from the terminal device, the data registration unit acquires item names of the application identified by application identification information that identifies the application; The chat control unit transmits the acquired item name to the generation AI system as information regarding the application to which the data is to be registered, 4. The information processing apparatus according to claim 1, wherein the data registration unit associates the data included in the request with the item name and registers the data in the application to which the data is to be registered.

5. the information processing device communicates with an application service that executes the application via a network; The information processing apparatus according to claim 4 , wherein the data registration unit acquires, from the application service, the item names of the application identified by application identification information that identifies the application.

6. The information for calling the function includes a setting of the specifications of the function to be called by the generating AI system, a function call request for calling the function, which is sent by the generating AI system to the information processing device based on the setting of the function specification, includes a request for registering the data; The information processing device according to claim 1 , wherein the chat control unit receives a request for registering the data from the generation AI system.

7. When the chat control unit receives a request for registering the data from the generation AI system, the data registration unit registers the data included in the request in an application to which the data is to be registered; The information processing device according to claim 4, wherein when the chat control unit receives a response message to the data from the generation AI system rather than a request for registration of the data, the chat control unit transmits the response message to the terminal device.

8. When the chat control unit receives a request for registering the data from the generation AI system, the data registration unit transmits the data included in the request to the terminal device before registering the data in the application; The information processing apparatus according to claim 7 , wherein, when receiving a request to register the data from the terminal device, the data registration unit registers the data included in the request in the application.

9. If the application is an application in which the data is registered in a table, The information processing apparatus according to claim 1 , wherein the data is one or more values registered in the table.

10. The information processing device according to claim 9 , wherein the value is a date, a character string, or a numeric value.

11. The information processing apparatus according to claim 5 , wherein the data registration unit associates the data with the item name and requests the application service to register the data.

12. a first web browser that communicates with the application service and a second web browser that is started by the first web browser are executed on the terminal device; the information processing device receives the chat message from the second web browser; When the chat control unit receives a request for registering the data transmitted by the generation AI system, the data registration unit transmits the request for registering the data to the second web browser, the second web browser transmits a request for registering the data to the first web browser; The information processing apparatus according to claim 11 , wherein the first web browser transmits a request for registering the data to the application service.

13. the data registration unit acquires, from the application service, the item names and data formats of the application identified by application identification information that identifies the application; When the chat control unit receives the request sent by the generation AI system based on the chat message sent to the generation AI system, the item name and data format which are information about the application, and information for calling the function, The information processing apparatus according to claim 5 , wherein the data registration unit associates the data in the data format included in the received request with the item name and registers the data in the application to which the data is to be registered.

14. A data registration system in which a terminal device, a generation AI (Artificial Intelligence) system, and an information processing device can communicate with each other via a network, The terminal device sending a chat message to the information processing device to register data to be used by the application; The information processing device includes: a data registration unit that functions by executing a predefined function and registers data used by an application with the application, the data registration unit registering the data included in the request with the application; a chat control unit that, when receiving the chat message transmitted from the terminal device, transmits the received chat message to the generation AI system; and The chat control unit transmits, at least once, information regarding the application to which the data is to be registered and information for the generation AI system to call the function to the generation AI system; When the chat control unit receives the request sent by the generation AI system based on the chat message sent to the generation AI system, information about the application, and information for calling the function, the request including the data generated by the generation AI system based on the chat message and information about the application, the data registration unit registers the data included in the received request in the application to which the data is to be registered. Data registration system.

15. An information processing device capable of communicating with a terminal device and a generating AI (Artificial Intelligence) system via a network, a data registration unit that functions by executing a predefined function and registers data used by an application with the application, the data registration unit registering the data included in the request with the application; When a chat message sent from the terminal device is received, the chat control unit functions to send the received chat message to the generation AI system; The chat control unit transmits, at least once, information regarding the application to which the data is to be registered and information for the generation AI system to call the function to the generation AI system; When the chat control unit receives the request sent by the generation AI system based on the chat message sent to the generation AI system, information about the application, and information for calling the function, the request including the data generated by the generation AI system based on the chat message and information about the application, the data registration unit registers the data included in the received request in the application to which the data is to be registered. program.

16. A data registration method performed by an information processing device that can communicate with a terminal device and a generation AI (Artificial Intelligence) system via a network, The information processing device includes: a data registration unit that functions by executing a predefined function and registers data used by an application with the application, the data registration unit registering the data included in the request with the application; a chat control unit that, when receiving a chat message from the terminal device, transmits the received chat message to the generation AI system; and The chat control unit transmits, at least once, information regarding the application to which the data is to be registered and information for the generation AI system to call the function to the generation AI system; When the chat control unit receives the request sent by the generation AI system based on the chat message sent to the generation AI system, information about the application, and information for calling the function, the request including the data generated by the generation AI system based on the chat message and information about the application, the data registration unit registers the data included in the received request in the application to which the data is to be registered. Data registration method.

Images