Information processing apparatus, application editing system, program, and information processing method

The described system facilitates efficient program editing by integrating a terminal device and generative AI system, allowing users to edit applications through chat interactions, reducing the need for manual coding.

JP2025143133APending Publication Date: 2025-10-01RICOH CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2024042902
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-03-18
Publication Date
2025-10-01

AI Technical Summary

Technical Problem

Existing program editing systems require significant manual input of code, even after automatic generation, which is inefficient and labor-intensive.

Method used

An information processing device that communicates with a terminal device and a generative AI system to receive and transmit messages, allowing users to edit applications through chat interactions without extensive coding, using a networked system to facilitate program editing.

Benefits of technology

Enables users to edit applications with minimal coding or no coding required, leveraging generative AI systems for efficient and user-friendly program editing support.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025143133000001_ABST
    Figure 2025143133000001_ABST
Patent Text Reader

Abstract

To support editing a program using generative AI.MEANS FOR SOLVING THE PROBLEM: An information processing apparatus is configured to: receive a request from a terminal device to acquire screen information of an editing screen for an application including identification information of the application; transmit, to the terminal device, the screen information including a program for editing the application in accordance with a response message from generative AI; on receipt of a chat message from the terminal device, the chat message including modifications input to the editing screen displayed on the terminal device, transmit, to the generative AI, the chat message, information on the application identified by the identification information, and information for calling a function defining the modifications; receive, from the generative AI, a response message including a call of the function defining the modifications; and transmit, to the terminal device, the response message including the call of the function defining the modification received by a chat control unit, to execute editing processing based on the function defining the modifications.SELECTED DRAWING: Figure 5
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an application editing system, an information processing method, and a program. [Background technology]

[0002] In recent years, programming support technologies have become known that reduce or even eliminate the need to input program code. One example of such technologies is the automatic generation of program code using artificial intelligence (AI). Summary of the Invention [Problem to be solved by the invention]

[0003] Even after a program is created, it is edited depending on the usage situation. For this reason, even when editing a program automatically generated using an AI system, it is desirable to provide assistance that reduces or even eliminates the need to input program code.

[0004] The disclosed technology was developed in consideration of the above circumstances, and aims to support program editing by using an external AI system (such as a generative AI system). [Means for solving the problem]

[0005] The disclosed technology is an information processing device that communicates with a terminal device and a generation AI system via a network, and includes a communication unit that receives from the terminal device a request to obtain screen information of an editing screen of the application, including identification information of the application, and transmits the screen information to the terminal device, including a program that edits the application in accordance with a response message from the generation AI system; and a chat control unit that, when the communication unit receives from the terminal device a chat message including editing content entered on the editing screen displayed on the terminal device, transmits the chat message, information about the application identified by the identification information, and information for calling a function that defines the editing content to the generation AI system, and receives a response message from the generation AI system that includes a call to the function that defines the editing content, and the communication unit further transmits a response message including a call to the function that defines the editing content received by the chat control unit to the terminal device, causing the terminal device to execute editing processing based on the function that defines the editing content. [Effects of the Invention]

[0006] External AI systems (such as generative AI systems) can be used to assist in editing programs. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a diagram illustrating an example of a system configuration of an application editing system according to a first embodiment. [Figure 2] FIG. 1 is a diagram illustrating an outline of the operation of the application editing system. [Figure 3] FIG. 2 is a diagram illustrating an example of a hardware configuration of an information processing system, a user terminal, and a developer terminal. [Figure 4] FIG. 2 is a diagram illustrating functions of each device included in the application editing system of the first embodiment. [Figure 5] FIG. 4 is a sequence diagram illustrating an operation of the application editing system according to the first embodiment. [Figure 6]FIG. 10 is a diagram illustrating the functions of each device included in the application editing system of the second embodiment. [Figure 7] FIG. 10 is a sequence diagram illustrating the operation of the application editing system according to the second embodiment. [Figure 8] FIG. 10 is a first diagram showing an example of a display on a user terminal. [Figure 9] FIG. 10 is a second diagram showing an example of a display on a user terminal. [Figure 10] FIG. 10 is a third diagram showing an example of a display on a user terminal. [Figure 11] FIG. 4 is a fourth diagram showing an example of a display on a user terminal. [Figure 12] FIG. 5 is a fifth diagram showing an example of a display on a user terminal. [Figure 13] FIG. 10 is a diagram illustrating an example of information related to an application to be edited. [Figure 14] A figure showing an example of a request message sent from the information processing system to the generation AI system. [Figure 15] This is the first figure showing an example of a response message from the generation AI system. [Figure 16] This is a second figure showing an example of a response message from the generation AI system. [Figure 17] FIG. 6 is a sixth diagram showing an example of a display on a user terminal. [Figure 18] FIG. 10 is a diagram illustrating an example of a request message sent from a web browser to an application service. [Figure 19] FIG. 7 is a seventh diagram showing an example of a display on a user terminal. [Figure 20] A figure showing another example of a request message sent from the information processing system to the generation AI system. DETAILED DESCRIPTION OF THE INVENTION

[0008] (First embodiment) The present embodiment will be described below with reference to the drawings: Fig. 1 is a diagram illustrating an example of the system configuration of an application editing system according to a first embodiment.

[0009] The application editing system 100 of this embodiment includes an information processing system 20, a user terminal 10, and a developer terminal 60.

[0010] In the application editing system 100, the information processing system 20 and the user terminal 10, and the information processing system 20 and the developer terminal 60 are communicatively connected via networks N1 and N2. The information processing system 20 can also communicate with a generation AI system 50 via the network N1. Furthermore, the user terminal 10 and the developer terminal 60 can communicate with the generation AI (Artificial Intelligence) system 50 and an external system, an application service 40, via the networks N1 and N2. The information processing system 20 may also communicate with the application system 40 via the network N1.

[0011] In this embodiment, the network N1 is a wide area network such as the Internet or a WAN, and the network N2 may be a LAN, Wi-Fi (registered trademark), wide area Ethernet (registered trademark), or a mobile phone network such as 4G, 5G, or 6G.

[0012] The user terminal 10 is a terminal device such as a PC (Personal Computer), a smartphone, or a tablet terminal that is mainly used by a user who uses the services provided by the application service 40. The developer terminal 60 is a terminal device that is mainly used by a developer of the information processing system 20.

[0013] The user terminal 10 and the developer terminal 60 are located in facilities such as a company or a home, and are connected to the network N2. Note that the user terminal 10 and the developer terminal 60 do not need to be connected to the network N2 at all times; they only need to be connected when using the information processing system 20, the generation AI system 50, or the application service 40. A web browser or a native application runs on the user terminal 10 or the developer terminal 60. Furthermore, the user terminal 10 or the developer terminal 60 can use various services provided by the information processing system 20, the generation AI system 50, or the application service 40.

[0014] A user inputs a chat message to the user terminal 10 to edit an application provided by the application service 40. A developer operates the developer to create setting information related to editing the application on the developer terminal 60. The setting information is stored in the information processing system 20. Details of the setting information will be described later.

[0015] The application service 40 is one or more information processing devices that provide applications executed by users. The applications provided by the application service 40 are, for example, database-type web applications that manage data in a table format. Users can arbitrarily set application fields and customize them so that they can save, read, or process data related to their own business. Editing an application involves users adding, deleting, renaming, changing the number of characters, etc., of fields, etc., as desired, to a pre-prepared database. In the following description, an application may simply be referred to as an app. In the following description, adding, deleting, renaming, changing the number of characters, etc., of fields, etc. may also be referred to as the content of editing.

[0016] The application service 40 may be, for example, a cloud service, an ASP (Application Service Provider), or SaaS, and may include various services provided via a network. For example, a database or storage service is provided as an example of the service. The application service 40 may exist on the Internet or on-premise.

[0017] The generative AI system 50 provides a service that allows users to converse with artificial intelligence (AI) in a conversational format. A known example of such a generative AI system 50 is a system that uses large language models (LLMs). A large language model is a natural language processing model trained using a large amount of text data.

[0018] The generative AI system 50 takes in a huge amount of text in advance and learns knowledge from it using deep learning, reinforcement learning, etc. The generative AI system 50 uses this knowledge to provide a response message to a chat message.

[0019] The interface through which a user inputs chat messages to the generative AI system 50 is called a prompt. Chat messages such as instructions and questions are input into the prompt. Chat messages may be conversational sentences or words written in natural language spoken by humans. Images may also be used as chat messages. The generative AI system 50 that generates sentences in response to chat messages may be called generative AI.

[0020] Other features of the generative AI system 50 include the ability to conduct conversations in a natural flow, the ability to expand and propose ideas even in areas in which the user has no knowledge, and the ability to output accurate program code.

[0021] In this embodiment, by using the generative AI system 50 having such characteristics, the information processing system 20 can advance a conversation with the user in a natural flow.

[0022] In this embodiment, systems using LLMs such as GPT-3, GPT-4, Transformer, and BERT (all of which are registered trademarks) are known as the generative AI system 50. As an example, ChatCPT using GPT-3 or GPT-4 can be used in the app editing system 100 of this embodiment, but systems using other LLMs may also be used.

[0023] When the information processing system 20 of this embodiment receives an operation to start editing an application from the user terminal 10, it outputs to the user terminal 10 a program for executing editing processing of the application.

[0024] More specifically, when an application to be edited is selected on the user terminal 10, the information processing system 20 outputs a program for executing the editing process of the application to the user terminal 10. In the following description, the program for executing the editing process of the application may be referred to as an editing process program. The application to be edited is one of the applications managed by the application service 40.

[0025] Furthermore, in this embodiment, when the information processing system 20 receives a chat message regarding the editing content from the user terminal 10, the information processing system 20 includes the chat message in a request message and transmits the request message to the generation AI system 50. When the information processing system 20 receives a response message from the generation AI system 50, the information processing system 20 transmits the response message to the user terminal 10.

[0026] When the user terminal 10 receives the response message, the user terminal 10 performs editing processing according to the response message on the application to be edited, using the editing processing program output from the information processing system 20.

[0027] As described above, in this embodiment, the user can edit the application of the application service 40 without coding by selecting the application to be edited on the user terminal 10 and entering a chat message. In other words, in this embodiment, the user can receive suggestions for specific editing content simply by selecting the application to be edited and entering a chat message instructing the desired editing.

[0028] In the example of Figure 1, the application service 40 and the information processing system 20 are provided separately, but this is not limited to this, and the information processing system 20 and the application service 40 may be integrated. That is, the application service 40 may include the functions of the information processing system 20, or the information processing system 20 may include the functions of the application service 40. Furthermore, the application service 40 and the generation AI system 50 may be integrated. Furthermore, the generation AI system 50 and the information processing system 20 may be integrated. Furthermore, the information processing system 20, the application service 40, and the information processing system 20 may be integrated.

[0029] The information processing system 20 may be realized by cloud computing or by a single information processing device. Cloud computing refers to a form in which resources on a network are used without being aware of specific hardware resources. The information processing system 20 may exist on the Internet or on-premise.

[0030] Furthermore, the functions of the information processing system 20 may be distributed among multiple information processing devices, or there may be multiple information processing systems 20 with the same functions, and the number of information processing systems that execute processing may be increased or decreased depending on the processing load.

[0031] The user terminal 10 is, for example, a terminal device such as a PC (Personal Computer), a smartphone, or a tablet terminal that is used by a user to whom a service is provided by the application service 40.

[0032] The user terminal 10 may be any information processing device, such as an electronic whiteboard, an output device such as digital signage, a head-up display (HUD), industrial machinery, an imaging device, a sound collection device, a medical device, a network appliance, a mobile phone, a smartphone, a tablet terminal, a game console, a personal digital assistant (PDA), a digital camera, or a wearable PC.

[0033] An outline of the operation of the application editing system 100 of this embodiment will be described below with reference to Fig. 2. Fig. 2 is a diagram illustrating an outline of the operation of the application editing system.

[0034] In the application editing system 100, the user terminal 10 transmits a chat message input by the user to the information processing system 20 (step S1). In this embodiment, the chat message may be a message indicating the editing content of the application, such as "add a field." Note that the chat message may include not only a message indicating the specific editing content, such as "add a field," but also a message expressing a desire, such as "I want to edit the application."

[0035] When the information processing system 20 receives the chat message input by the user, it includes the received chat message in a request message and transmits it to the generation AI system 50 (step S2). At this time, the information processing system 20 transmits the request message to the generation AI system 50 via an API (Application Programming Interface) for receiving the request message, which is provided by the generation AI system 50. The information processing system 20 also transmits the request message together with a specification of the function.

[0036] A function is a program interface that performs a specific process based on a specified argument and returns a return value as a result. This function enables the generation AI system 50 to request the information processing system 20 to edit an application used by the application service 40. The information processing system 20 includes the specification settings of this function in a request message and sends it to the generation AI system 50.

[0037] The request from the generation AI system 50 to the information processing system 20 to call this function is called a function call. The information processing system 20 can include information about the application to be edited in the request message.

[0038] The information about the application to be edited is information indicating parameters managed by the application requested by the user, such as the field names, number of fields, and number of characters representing the field names managed by the application.

[0039] Note that the information processing system 20 does not have to include information about the application to be edited and the function specification settings in the same request message as the received chat message. For example, the information processing system 20 may include information about the application to be edited and the function specification settings in a request message separate from the request message containing the received chat message and transmit the request message to the generation AI system 50.

[0040] In addition, the information processing system 20 may also include information about the application to be edited and the function specification settings in separate request messages and transmit them to the generation AI system 50.

[0041] Furthermore, the information processing system 20 may transmit information about the application to be edited and function specification settings each time a received chat message is included in a request message and transmitted, or may transmit the information only once at the beginning.

[0042] The generation AI system 50 sends a response message including a function call request to the information processing system 20 based on the conversation history via chat messages included in the sent request message, the function specification settings, and information about the application to be edited (step S3).

[0043] Here, the generation AI system 50 simply requests the information processing system 20 to call a function. In the following description, a response message from the generation AI system 50 may be expressed as a response from the generation AI system 50.

[0044] The information processing system 20 transmits the response message received from the generation AI system 50 to the user terminal 10 (step S4).

[0045] Upon receiving the response message, the user terminal 10 executes the function call indicated in the response message using the editing processing program received from the information processing system 20, and edits the application managed by the application service 40 (step S5).

[0046] In this way, in this embodiment, the user of the user terminal 10 can edit applications with low code or no code.

[0047] Next, the hardware configuration of each device included in the application editing system 100 of this embodiment will be described with reference to FIG.

[0048] Fig. 3 is a diagram showing an example of the hardware configuration of an information processing system, a user terminal, and a developer terminal. As shown in Fig. 3, the information processing system 20, the user terminal 10, and the developer terminal 60 are constructed by a computer 500, and include a CPU 501, a ROM 502, a RAM 503, a HD (Hard Disk) 504, an HDD (Hard Disk Drive) controller 505, a display 506, an external device connection I / F (Interface) 508, a network I / F 509, a bus line 510, a keyboard 511, a pointing device 512, a DVD-RW (Digital Versatile Disk Rewritable) drive 514, and a media I / F 516.

[0049] Of these, the CPU 501 controls the overall operation of the computer 500. The ROM 502 stores programs, such as an IPL, used to drive the CPU 501. The RAM 503 is used as a work area for the CPU 501. The HD 504 stores various data, such as programs. The HDD controller 505 controls the reading and writing of various data from and to the HD 504 under the control of the CPU 501. The display 506 displays various information, such as a cursor, menus, windows, characters, or images. The external device connection I / F 508 is an interface for connecting various external devices. In this case, external devices include, for example, USB (Universal Serial Bus) memories and printers. The network I / F 509 is an interface for data communication using the network N2. The bus line 510 is an address bus, a data bus, or the like, for electrically connecting the components, such as the CPU 501, shown in FIG. 3.

[0050] The keyboard 511 is a type of input means having multiple keys used to input characters, numbers, various instructions, etc. The pointing device 512 is a type of input means for selecting and executing various instructions, selecting a processing target, moving a cursor, etc. The DVD-RW drive 514 controls reading and writing of various data from a DVD-RW 513, which is an example of a removable recording medium. The DVD-RW drive 514 is not limited to a DVD-RW, and may be a DVD-R or the like. The media I / F 516 controls reading and writing (storing) of data from a recording medium 515, such as a flash memory.

[0051] Next, the functions of each device included in the application editing system 100 of this embodiment will be described with reference to Fig. 4. Fig. 4 is a diagram illustrating the functions of each device included in the application editing system of the first embodiment.

[0052] First, we will explain the functions of the information processing system 20. The information processing system 20 of this embodiment has a communication unit 21, a screen generation unit 22, a chat control unit 23, a setting information storage unit 24, and an edit program output unit 25. Each functional unit of the information processing system 20 is a function or means realized by the CPU 501 shown in FIG. 3 executing instructions included in one or more programs installed in the information processing system 20.

[0053] 3. The setting information storage unit 24 does not have to be included in the information processing system 20, but may be located on a network that the information processing system 20 can access.

[0054] The communication unit 21 transmits and receives various types of information to the user terminal 10. The communication unit 21 transmits screen information of an application editing screen to the user terminal 10. The communication unit 21 receives chat messages input by the user for application editing from the user terminal 10. The communication unit 21 also transmits and receives various types of information to the developer terminal 60. The communication unit 21 transmits screen information of a setting information input screen to the developer terminal 60. The communication unit 21 receives setting information input by the developer from the developer terminal 60 and stores it in the setting information storage unit 24. The communication unit 21 also transmits a response message (response) received by the chat control unit 23 from the generation AI system 50 to the user terminal 10.

[0055] The screen generation unit 22 generates screen information for the screen (web page) to be displayed on the user terminal 10 and the developer terminal 60.

[0056] More specifically, the screen generation unit 22 generates screen information for an editing screen of an application to be displayed on the user terminal 10. The screen information for the editing screen includes an editing processing program for realizing an application editing unit 14 (described later) on the user terminal 10.

[0057] Web pages are provided as part of web applications. Screen information is a program written in HTML, JSON, XML, scripting languages, and CSS (Cascading Style Sheets), etc. HTML primarily determines the structure of a web page, scripting languages ​​define the behavior of the web page, and CSS determines the style of the web page.

[0058] The chat control unit 23 calls the first API 26 to send a request message to the generation AI system 50. The request message includes chat messages (including the history of past conversations) and information defining functions.

[0059] The first API 26 is one or more APIs made public by the generation AI system 50. As a result of calling the first API 26, the chat control unit 23 receives a response message to the request message from the generation AI system 50. The response message includes a reply message to the chat message, a function call request to the information processing system 20, or the URL of an application that has been created or developed.

[0060] The setting information storage unit 24 stores the setting information. Here, the setting information will be explained.

[0061] The setting information in this embodiment is information indicating knowledge necessary for editing an application of the application service 40. In other words, the setting information is information for the generation AI system 50 to edit an application, and includes a function that defines the editing process.

[0062] Specifically, the function that defines the editing process is a function that enables the generation AI system 50 to request the information processing system 20 to add a field to the application to be edited. Also, the function that defines the editing process is a function that enables the generation AI system 50 to request the information processing system 20 to delete a field from the application to be edited. Also, the function that defines the editing process is a function that enables the generation AI system 50 to request the information processing system 20 to update the application to be edited.

[0063] In the following description, a function that enables the generation AI system 50 to request the information processing system 20 to add a field to an application may be referred to as a field addition function. Also, in the following description, a function that enables the generation AI system 50 to request the information processing system 20 to delete a field from an application may be referred to as a field deletion function. Also, in the following description, a function that enables the generation AI system 50 to request the information processing system 20 to update an application may be referred to as an update function.

[0064] In this embodiment, the developer stores the setting information in the setting information storage unit 24 before the user starts editing the application, so that the user does not need to include application parameters, etc. in the chat message.

[0065] The information processing system 20 uses this setting information to create a request message to be sent to the generation AI system 50. In this way, in this embodiment, by having the developer store the setting information in the information processing system 20, the user can edit the application with simple chat messages even if they do not have specialized knowledge of the application.

[0066] Note that it is not always necessary to set the setting information, and there may be cases where the setting information is not necessary depending on the application.

[0067] When the communication unit 21 receives a request from the user terminal 10 to obtain screen information of the editing screen for the application to be edited, the editing program output unit 25 outputs an editing processing program for editing the application to be edited to the screen generation unit 22. The editing processing program is written in JavaScript (registered trademark, omitted below), and when executed by the user terminal 10, causes the user terminal 10 to perform editing processing in accordance with the response message from the generation AI system 50.

[0068] Next, we will explain the functions of the user terminal 10. The user terminal 10 of this embodiment has a web browser 5, which has a communication unit 11, a display control unit 12, and an operation reception unit 13. Each of these functional units is a function or means realized by the CPU 501 shown in FIG. 3 executing instructions contained in one or more programs installed in the user terminal 10.

[0069] The communication unit 11, the display control unit 12, and the operation reception unit 13 may be realized by JavaScript (registered trademark, omitted below).

[0070] The communication unit 11 transmits and receives various types of information to and from the information processing system 20. In this embodiment, the communication unit 11 receives screen information of a portal screen from the application service 40, and receives screen information of an app editing page where chat messages are entered from the information processing system 20. The communication unit 11 transmits chat messages, operation information for the user terminal 10, and the like to the information processing system 20. Note that the communication unit 11 can also communicate directly with the generation AI system 50.

[0071] The display control unit 12 interprets screen information of various screens and displays it on the display 506. The operation accepting unit 13 accepts various operations on the various screens displayed on the display 506 by the user.

[0072] Furthermore, the user terminal 10 of this embodiment receives screen information of the editing screen including the editing processing program from the information processing system 20.

[0073] The user terminal 10 receives the screen information of the editing screen and executes the editing processing program, thereby realizing the functions of the application editing unit 14. In other words, the web browser 5 of the user terminal 10 executes JavaScript included in the screen information of the editing screen obtained from the information processing system 20, thereby having the application editing unit 14.

[0074] The application editor 14 calls the second API 27 to send a request message to the application service 40. The request message requests editing of the application, and includes parameters related to the application (such as a database field name and data format), the content of the edit, and the like.

[0075] The second API 27 is one or more APIs published by the application service 40. As a result of calling the second API 27, the application editing unit 14 receives a response message to the request message from the application service 40. The response message includes the result (success or failure) of the request to edit the application. If successful, the URL of the application is notified, and if unsuccessful, an error message is notified. The result of the request to edit the application may be displayed by the display control unit 12.

[0076] Here, "editing an application" means that the application editing unit 14 requests the application service 40 or the like to edit the application, and the application service 40 or the like actually edits the application.

[0077] Note that the user terminal 10 may also execute a native application. A native application is an application that cannot be executed unless it is installed in the user terminal 10. In the case of a native application, screen information of the editing screen is held by the user terminal 10, and the information to be displayed is transmitted in JSON, XML, or the like.

[0078] Next, the functions of the developer terminal 60 will be described. The developer terminal 60 has a communication unit 61, a display control unit 62, and an operation reception unit 63. Each of these functional units is a function or means realized by the CPU 501 shown in FIG. 3 executing instructions contained in one or more programs installed on the developer terminal 60. For example, the communication unit 61, the display control unit 62, and the operation reception unit 63 may be realized by at least one of a web browser and JavaScript. When the developer terminal 60 executes a native app, these may be realized by the native app.

[0079] The communication unit 61 transmits and receives various information to and from the information processing system 20. In this embodiment, the communication unit 61 receives screen information related to input of setting information from the information processing system 20. The communication unit 61 transmits setting information, operation information for the developer terminal 60, etc. to the information processing system 20. The communication unit 21 can also communicate with the generation AI system 50 and the application service 40.

[0080] The display control unit 62 interprets screen information of various screens and displays it on the display 506. The operation accepting unit 63 accepts various operations on the various screens displayed on the display 506 by the user.

[0081] Next, the operation of the application editing system 100 of this embodiment will be described with reference to Fig. 5. Fig. 5 is a sequence diagram illustrating the operation of the application editing system of the first embodiment.

[0082] In the following description, a case where a process for adding a field managed by an application is performed will be described as an example of editing an application.

[0083] In the application editing system 100, the web browser 5 of the user terminal 10 displays a list screen of applications managed by the application service 40 (step S501).

[0084] The application list screen in this embodiment may be displayed on the user terminal 10, for example, when an operation to display a list of applications is performed on the portal screen of the application service 40 displayed on the user terminal 10.

[0085] Next, the Web browser 5 accepts an operation to select an application to be edited on the application list screen (step S502).

[0086] Next, the Web browser 5 requests the application service 40 to start the selected application (step S503).

[0087] Specifically, the web browser 5 connects to the URL of the application service 40 via the communication unit 11. Here, since an application to be edited is selected on the user terminal 10, the communication unit 11 generates an HTTP request including the URL of the screen of the application selected to be edited, and transmits the generated HTTP request to the application service 40. In the following description, the application screen may be referred to as an app screen. The app screen may be a home screen of the application that accepts various operations on the application.

[0088] When the application service 40 receives the HTTP request from the user terminal 10, it transmits screen information of the application screen to the user terminal 10 (step S504). Specifically, the application service 40 transmits screen information (HTML, JavaScript, CSS, etc.) of the application screen to the user terminal 10.

[0089] The Web browser 5 receives the screen information of the application screen via the communication unit 11, and causes the display control unit 12 to display the application screen based on the screen information (step S505). Next, the Web browser 5 receives, via the operation reception unit 13, an operation to instruct the launch of an editing screen for this application from the application screen (step S506). In the following description, the editing screen for an application may be referred to as an application editing screen.

[0090] Next, the Web browser 5 transmits a request to acquire screen information of the application editing screen to the information processing system 20 via the communication unit 11 (step S507). Note that the acquisition request transmitted to the information processing system 20 here may include an application ID, which is identification information for identifying the application selected in step S502.

[0091] The information processing system 20 generates screen information (HTML, JavaScript, CSS, etc.) for the application editing screen (step S508).

[0092] Specifically, the generation of screen information for an edit screen by the information processing system 20 will be described. When the information processing system 20 of this embodiment receives a request to acquire an edit screen, the edit program output unit 25 passes an edit processing program for editing the selected application to the screen generation unit 22. Note that the edit program output unit 25 may prepare an edit processing program written in JavaScript for each application managed by the application service 40.

[0093] The screen generator 22 includes an editing program written in JavaScript in the screen information of the application editing screen.

[0094] Next, the information processing system 20 transmits screen information of the application editing screen to the user terminal 10 via the communication unit 21 (step S509).

[0095] The Web browser 5 receives the screen information of the application editing screen via the communication unit 11, and causes the display control unit 12 to display the application editing screen based on the screen information (step S510). Next, the Web browser 5 causes the operation accepting unit 13 to accept an operation to select the content of editing on the application editing screen (step S511). Here, it is assumed that the content of editing selected is to add a field managed by the application.

[0096] When adding a field is selected as the content of editing, the Web browser 5 transmits a request to acquire information about the application to the application service 40 via the communication unit 11 (step S512).

[0097] Specifically, the Web browser 5 calls the second API 27 to send a request message for acquiring information about the application to the application service 40. This acquisition request includes the application ID of the application selected to be edited.

[0098] The information about the application is information written in JSON format and includes fields managed by the application. In other words, the information about the application is information that indicates the items of information managed by the application.

[0099] The application service 40 accepts this acquisition request and transmits information about the application identified by the application ID to the user terminal 10 (step S513). The information about the application transmitted from the application service 40 is written in JSON format.

[0100] Next, the Web browser 5 causes the display control unit 12 to display a field addition screen for adding a field (step S514).

[0101] Next, the Web browser 5 receives an input of a chat message regarding the content of the edit via the operation receiving unit 13 (step S515). Here, the Web browser 5 receives a chat message regarding the addition of a field. The input may be made using a keyboard or by voice input.

[0102] The Web browser 5 generates a request message including a chat message regarding the addition of the field, and transmits the generated request message to the information processing system 20 via the communication unit 11 (step S516).

[0103] Here, the request message sent from the user terminal 10 may include the application ID of the application to be edited, information about the application, and a history of past conversations in addition to the chat message.

[0104] Furthermore, the history of past conversations may be stored in the information processing system 20. In this case, the history of past conversations may be stored, for example, linked to the app ID of the application to be edited, or linked to a conversation session ID that is assigned each time a new conversation is held. When the history of past conversations is stored in the information processing system 20, the communication unit 11 of the user terminal 10 does not need to include the history of past conversations in the request message.

[0105] When the information processing system 20 receives a request message from the user terminal 10, it generates a request message to be sent to the generation AI system 50, and sends the generated request message to the generation AI system 50 by calling the first API 26 (step S517).

[0106] Here, the processing of the information processing system 20 will be described.

[0107] When the information processing system 20 receives a request message from the user terminal 10, it passes the chat message and past conversation history included in the request message, and information related to the application, to the chat control unit 23.

[0108] The chat control unit 23 also references the setting information storage unit 24 to identify a function according to the content of the edit indicated by the chat message. Here, the chat message is a chat message instructing the addition of a field. Therefore, the chat control unit 23 references the setting information storage unit 24 to identify a field addition function that enables the generation AI system 50 to request the information processing system 20 to add a field.

[0109] Then, the chat control unit 23 generates a request message including a chat message instructing the addition of a field, a history of past conversations, information about the application, and a field addition function, and sends it to the generation AI system 50 by calling the first API 26. Note that the request message sent to the generation AI system 50 here does not have to include the history of past conversations.

[0110] Next, the generation AI system 50 transmits a response message to the information processing system 20 in response to the request message transmitted from the information processing system 20 (step S518). This response message may be a reply message to a chat message or may include a function call request.

[0111] Step S519 shown below shows the processing when the response message from the generation AI system 50 is a reply message. Also, steps S520 to S526 shown below show the processing when the response message from the generation AI system 50 is a function call request.

[0112] When the information processing system 20 receives a response message (reply message) via the chat control unit 23, the communication unit 21 sends the response message to the web browser 5 of the user terminal 10, and the display control unit 12 of the web browser 5 displays the response message on the field addition screen (step S519).

[0113] The response message displayed here is the exact string of characters output from the generation AI system 50.

[0114] When the chat control unit 23 of the information processing system 20 receives the response message including the function call request, the communication unit 21 transmits the response message to the Web browser 5 of the user terminal 10 (step S520).

[0115] The web browser 5 of the user terminal 10 receives the response message, and executes an editing processing program that realizes the application editing unit 14, and generates text data from the character string included in the response message to confirm the added content of the field (step S521).

[0116] Next, the Web browser 5 causes the display control unit 12 to display a confirmation screen for the additional content of the field including the text data generated in step S522 (step S522). When the Web browser 5 of the user terminal 10 receives an operation from the user indicating that the additional content has been confirmed (step S523), the application editing unit 14 requests the application service 40 to add a field to the application to be edited (step S524).

[0117] Specifically, the application editor 14 calls the second API 27 to send a request message to the application service 40 requesting that the field included in the response message be added to the application. This request includes the application ID of the application selected to be edited.

[0118] The application service 40 adds a field in response to the request message received from the Web browser 5, and transmits the result to the user terminal 10 (step S525).

[0119] Specifically, if the application service 40 has successfully added the field, it sends a message indicating that to the user terminal 10. If the application service 40 has failed to add the field, it sends a message indicating that to the user terminal 10.

[0120] When the Web browser 5 of the user terminal 10 receives the message indicating the processing result of the field addition from the application service 40, the display control unit 12 displays the received message (step S526).

[0121] In the application editing system 100 of this embodiment, the processes from step S515 to step S526 are repeated until the user's editing operation of the application is completed.

[0122] 5, the process in which the Web browser 5 of the user terminal 10 acquires information about the application to be edited from the application service 40 is performed after the process of adding a field is selected in the Web browser 5, but this is not limiting. The process of acquiring information about the application may be performed immediately after the application to be edited is selected. In other words, the process of acquiring information about the application may be performed at any timing after the application to be edited is selected and before the chat message is sent to the information processing system 20.

[0123] In this embodiment, by doing so, the user of the user terminal 10 can edit a desired application simply by inputting a chat message regarding the editing content. Therefore, according to this embodiment, it is possible to support the editing of applications.

[0124] (Second embodiment) The second embodiment will be described below with reference to the drawings. The second embodiment differs from the first embodiment in that the administrator of the application service 40 is different from the administrator of the information processing system 20, and two web browsers are linked in the user terminal 10. Therefore, in the second embodiment below, differences from the first embodiment will be described, and components having the same functional configuration as those in the first embodiment will be assigned the same reference numerals as those used in the description of the first embodiment, and their description will be omitted.

[0125] FIG. 6 is a diagram illustrating the functions of each device included in the application editing system of the second embodiment.

[0126] The application editing system 100A of this embodiment includes a user terminal 10A, an information processing system 20, an application service 40, a generating AI system 50, and a developer terminal 60.

[0127] The user terminal 10A of this embodiment has a web browser 5A and a web browser 5B. The web browser 5A of this embodiment is provided by a provider of an application service 40. The web browser 5B is provided by a provider of an information processing system 20. The web browser 5A is an example of a first web browser, and the web browser 5B is an example of a second web browser.

[0128] The web browser 5A includes a communication unit 11A, a display control unit 12, an operation reception unit 13, and an inter-browser cooperation unit 15.

[0129] The communication unit 11A transmits and receives information to and from the application service 40. The communication unit 11A receives from the application service 40 screen information of the application list screen, information on the application to be edited, and the like.

[0130] The inter-browser cooperation unit 15 transmits and receives information to and from the web browser 5B. For example, the inter-browser cooperation unit 15 passes information about the application that the communication unit 11A has received from the application service 40 to the web browser 5B.

[0131] The web browser 5B is a web browser that communicates with the generation AI system 50 via the information processing system 20.

[0132] The web browser 5B includes a communication unit 16, a display control unit 17, an operation reception unit 18, an inter-browser cooperation unit 19, and an application editing unit 14.

[0133] The communication unit 16 transmits and receives information to and from the information processing system 20. For example, the communication unit 16 transmits a chat message input in the web browser 5B to the information processing system 20. The communication unit 16 also receives from the information processing system 20 a response message that the information processing system 20 received from the generation AI system 50.

[0134] The inter-browser cooperation unit 19 transmits and receives information to and from the web browser 5 A. For example, the inter-browser cooperation unit 19 passes a response message from the generation AI system 50 that the communication unit 16 receives from the information processing system 20 to the web browser 5 A.

[0135] In this embodiment, multiple web browsers can be simultaneously executed on one user terminal 10. The inter-browser cooperation unit 15 can transmit information from the web browser 5A to the other web browser 5B. The inter-browser cooperation unit 19 can transmit information from the web browser 5B to the other web browser 5A.

[0136] In this embodiment, by linking multiple web browsers in this manner, if only one web browser holds authentication information for a specific website (e.g., application service 40), the other web browser can link with the first web browser and communicate with the specific website.

[0137] In other words, in this embodiment, when the Web browser 5A and the Web browser 5B communicate with each other, the Web browser 5B can communicate with the application service 40 in cooperation with the Web browser 5A that holds the authentication information of the application service 40.

[0138] Next, the operation of the application editing system 100A of this embodiment will be described with reference to Fig. 7. Fig. 7 is a sequence diagram illustrating the operation of the application editing system of the second embodiment.

[0139] The processing from step S701 to step S706 in FIG. 7 is the same as the processing from step S501 to step S506 in FIG. 5, except that the processing is performed by the web browser 5A instead of the web browser 5, and therefore a description thereof will be omitted.

[0140] When the Web browser 5A of the user terminal 10 receives an operation instructing the launch of the edit screen of the application to be edited in step S706, the Web browser 5A causes the inter-browser cooperation unit 15 to launch the Web browser 5B (step S707).

[0141] As a result of this processing by the inter-browser cooperation unit 15, the web browser 5B is popped up and displayed on the user terminal 10. At this time, the inter-browser cooperation unit 15 also notifies the web browser 5B of the application ID of the application selected to be edited in step S706, for example, by a URL. The web browser 5B is launched by JavaScript included in the screen information of the application screen.

[0142] The Web browser 5B of the user terminal 10 uses the application ID notified from the Web browser 5A to send a request to the information processing system 20 to acquire screen information of the application editing screen (step S708). The acquisition request sent to the information processing system 20 here includes the application ID.

[0143] The information processing system 20 generates screen information (HTML, JavaScript, CSS, etc.) for the application editing screen (step S709) and transmits the screen information for the application editing screen to the Web browser 5B of the user terminal 10 (step S710). The Web browser 5B receives the screen information for the application editing screen from the information processing system 20 via the communication unit 16. The screen information for the application editing screen includes an editing processing program written in JavaScript.

[0144] The Web browser 5B of the user terminal 10 causes the display control unit 17 to display an application editing screen (step S711).

[0145] Next, the Web browser 5B accepts an operation to select the content of editing on the application editing screen via the operation accepting unit 18 (step S712). Here, it is assumed that adding a field has been selected as the content of editing.

[0146] Next, the web browser 5B transmits a request to the web browser 5A via the inter-browser cooperation unit 19 to acquire information about the application identified by the application ID (step S713).

[0147] The Web browser 5A receives this acquisition request and transmits an acquisition request for information about the application to the application service 40 via the communication unit 11A (step S714).

[0148] The application service 40 accepts this acquisition request and transmits information about the application identified by the application ID to the Web browser 5A (step S715). The information about the application transmitted from the application service 40 is written in JSON format.

[0149] Next, the web browser 5A notifies the web browser 5B of information related to the application through the inter-browser cooperation unit 15 (step S716).

[0150] Next, the Web browser 5B causes the display control unit 17 to display a field addition screen for adding a field (step S717).

[0151] Next, the Web browser 5B accepts input of a chat message regarding the content of the edit via the operation accepting unit 16 (step S718).

[0152] The processing from step S718 to step S726 in FIG. 7 is the same as the processing from step S515 to step S523 in FIG. 5, except that the processing is performed by the Web browser 5B instead of the Web browser 5, and therefore a description thereof will be omitted.

[0153] When the Web browser 5B receives an operation indicating that the added content has been confirmed in step S726, the application editing unit 14 generates a request message requesting the application service 40 to add a field to the application to be edited, and the inter-browser collaboration unit 19 notifies the Web browser 5A of the request message (step S727).

[0154] The Web browser 5A receives this request message and calls the second API 27 via the communication unit 11A to send a request message to the application service 40 requesting that the field included in the response message be added to the application (step S728).

[0155] The application service 40 adds a field in response to the request message received from the Web browser 5A, and transmits the processing result to the Web browser 5A (step S729).

[0156] When the Web browser 5A receives the additional processing result from the application service 40, the inter-browser cooperation unit 15 notifies the Web browser 5B of the additional processing result (step S730).

[0157] When the Web browser 5B receives the processing result from the Web browser 5A, the display control unit 17 causes the Web browser 5B to display a screen showing the processing result (step S731).

[0158] In this embodiment, the processes from step S718 to step S731 are repeated until the editing operation by the user of the user terminal 10 is completed.

[0159] In this embodiment, the Web browser 5A and the Web browser 5B provided by different providers are linked in one user terminal 10.

[0160] In this way, even if the web browser 5B does not have authentication information for accessing the application service 40, it can communicate with the application service 40 via the web browser 5A that has authentication information for accessing the application service 40.

[0161] Therefore, even if the provider of application service 40 is different from the provider of information processing system 20 and the domains of web browser 5A and web browser 5B are different, the application provided by application service 40 can be linked to the functions provided by information processing system 20.

[0162] The operation of the application editing system 100A of this embodiment will be described in more detail below with reference to FIGS.

[0163] 8 is a first diagram showing an example of a display on a user terminal. A screen 81 shown in Fig. 8 is an example of an application list screen that is displayed on the display by the web browser 5A in step S701 of Fig. 7, for example.

[0164] The screen 81 includes a display area 82, in which a list of applications that are provided by the application service 40 and that are permitted for use by the user of the user terminal 10 is displayed.

[0165] When an application to be edited is selected in the display area 82, the Web browser 5A of this embodiment acquires screen information of the application screen of the selected application from the application service 40, and displays the application screen on the display.

[0166] Fig. 9 is a second diagram showing an example of a display on a user terminal. Screen 91 shown in Fig. 9 is an example of an application screen that is displayed on the display by web browser 5A, for example, in step S705 in Fig. 7. Screen 91 shown in Fig. 9 shows the application screen when "file management application" is selected as the application to be edited on screen 81 shown in Fig. 8.

[0167] The screen 91 includes an operation button 92 and a display area 93. The operation button 92 is an operation button for instructing the start of an editing operation of the application. The display area 93 displays a list of fields managed in the "file management application."

[0168] In this embodiment, when the operation button 92 is operated, the web browser 5A starts the web browser 5B and displays the web browser 5B on the screen 91 as a pop-up, assuming that an editing operation of the application has started.

[0169] Fig. 10 is a third diagram showing an example of a display on a user terminal. Screen 91A shown in Fig. 10 is an example of a screen displayed on user terminal 10, for example, in step S711 of Fig. 7. Specifically, screen 91A shows an example of a screen including an app editing screen popped up by web browser 5B.

[0170] The screen 91A includes a pop-up window 94 displayed by the web browser 5B. The pop-up window 94 includes a display area 95, in which operation buttons 95a and 95b are displayed.

[0171] Operation buttons 95a and 95b are operation buttons for selecting the editing content. Operation button 95a is an operation button for setting the editing content to adding a field, and operation button 95b is an operation button for setting the editing content to deleting a field. Note that the editing content is not limited to adding or deleting a field, and operation buttons for selecting editing content other than adding or deleting a field may be displayed in display area 95. Note that in the following description, it is assumed that adding a field has been selected as the editing content in FIG. 10.

[0172] Also, in the example of FIG. 10, the pop-up window 94 is displayed superimposed on the screen 91A, but the pop-up window 94 may be displayed in an area on the display of the user terminal 10 that is separate from the area in which the screen 91A is displayed.

[0173] Fig. 11 is a fourth diagram showing an example of a display on a user terminal. Screen 91B shown in Fig. 11 is an example of a screen displayed on user terminal 10, for example, in step S717 of Fig. 7. Specifically, screen 91B shows an example of a screen including a field addition screen popped up by web browser 5B.

[0174] Screen 91B includes a pop-up window 94A. Pop-up window 94A is a chat screen for inputting the additional fields as a chat message. In the example of Fig. 11, pop-up window 94A displays a message 96 prompting the user to input a chat message.

[0175] 12 is a fifth diagram showing a display example of a user terminal. Screen 91C shown in Fig. 12 shows an example in which a chat message including edited content has been entered in step S718 of Fig. 7, for example.

[0176] On screen 91C, a pop-up window 94B displays a chat message 97 including the details of the edit. The chat message including the details of the edit may be a chat message instructing the specific details of the edit. In the example of Fig. 12, chat message 97 is a message instructing the addition of an "Address" field to the fields managed by the file management application.

[0177] In this embodiment, when a chat message regarding the content of editing is sent to the information processing system 20, the information processing system 20 sends a request message to the generation AI system 50.

[0178] This request message includes the chat message input in the pop-up window 94B instructing the addition of a field, information about the file management application to be edited, and a field addition function.

[0179] Here, information about the application and the request message will be described.

[0180] 13 is a diagram showing an example of information related to an application to be edited. In this embodiment, the application to be edited is described in JSON format. In this embodiment, this description in JSON format is used as information related to the application.

[0181] 13 expresses a "file management application" in JSON format. This description 131 shows that the fields managed by the file management application are "company name," "department name," "person in charge name," and "email address."

[0182] FIG. 14 is a diagram showing an example of a request message transmitted from the information processing system to the generation AI system.

[0183] A request message 141 shown in FIG. 14 is an example of the request message sent from the information processing system 20 to the generation AI system 50 in step S720 of FIG.

[0184] The request message 141 includes descriptions 141a, 141b, 141c, and 141d. Description 141a indicates a request to the generative AI system 50. In Fig. 14, description 141a requests the addition of a field to the application to be edited. In other words, description 141a indicates that the addition of a field has been selected as the content of the edit.

[0185] Description 141b indicates fields included in the file management application to be edited. In other words, description 141b is information about the application to be edited.

[0186] Description 141c is a chat message regarding the content of the edit input by the user. Description 141c shows that the chat message instructed the addition of an address field.

[0187] Description 141d is a description for calling a function that defines the edit content. In the example of Fig. 14, description 141d is a function that enables the generation AI system 50 to request the information processing system 20 to add a field in the file management application.

[0188] In this embodiment, a request message including a chat message containing the edited content, information about the application identified by the app ID, and information for calling the function that defines the edited content is sent to the generation AI system 50.

[0189] In this embodiment, this allows the generative AI system 50 to propose specific editing content for an existing application.

[0190] Note that the example of Fig. 14 describes a request message for adding a field. For example, if the content of the edit is deletion and the field to be deleted is specified in a chat message related to the content of the edit, the function included in description 141d is a function that enables generation AI system 50 to request information processing system 20 to delete the field in the file management application.

[0191] In this embodiment, the function included in the description 141d may be a function called "edit" and an argument may be added. In this way, by preparing a function called "edit" and deleting or updating an argument, various edits can be performed.

[0192] The information processing system 20 of this embodiment transmits such a request message to the generation AI system 50, and receives a response message from the generation AI system 50 regarding the addition of a field.

[0193] The generation AI system 50 may return a normal message as a response message, or may return a message including a function call.

[0194] The response message from the generation AI system 50 will be described below with reference to FIGS.

[0195] Figure 15 is a first diagram showing an example of a response message from the generating AI system. Description 151 shown in Figure 15 indicates that the response message from the generating AI system 50 is the normal message "Please tell me more details."

[0196] Figure 16 is a second diagram showing an example of a response message from the generation AI system. The response message 161 shown in Figure 16 includes a function call 162. The function call 162 corresponds to a request to edit an application. The function call request 162 includes a name 162a and arguments 162b. Name 162a is the name of the function defined in description 141d of the request message 141.

[0197] The generation AI system 50 requests the invocation of the function with this name in the response message 161. Arguments 162b is the return value, and is defined in the description 141d.

[0198] 16 includes, as return values, "Postal Code," "Hokkaido," "City," "Town," "Area, Address," and "Other." Therefore, response message 161 requests the addition of fields such as "Postal Code," "Hokkaido," "City," "Town," "Area, Address," and "Other."

[0199] In this embodiment, the information processing system 20 notifies the web browser 5B of this response message 161. Upon receiving this notification, the web browser 5B generates text data including the character string (return value) included in the response message 161, and displays the generated text data on the display as a response from the generation AI system 50.

[0200] 17 is a sixth diagram showing an example of a display on a user terminal. A screen 91D shown in Fig. 17 is an example of a confirmation screen for adding content to a field that is displayed by the web browser 5B in step S725 of Fig. 7.

[0201] On screen 91D, a pop-up window 94C displays a chat message 97 instructing the user to add an "Address" field, and text data 97a generated from the response message from generation AI system 50. Operation buttons 98 and 99 are also displayed in pop-up window 94C.

[0202] The text data 97a displays a list of fields to be added by the generation AI system 50. The operation button 98 is an operation button that is operated when the user of the user terminal 10 permits the addition of the field indicated by the text data 97a. The operation button 99 is an operation button that is operated when the user does not permit the addition of the field indicated by the text data 97a.

[0203] In this embodiment, when the operation button 98 is operated, a field indicated by the text data 97a is added to the file management application.

[0204] In this embodiment, the content of the editing suggested by the generation AI system 50 is thus confirmed by the user terminal 10. Therefore, according to this embodiment, it is possible to prevent editing that is not intended by the user from being automatically performed.

[0205] In this embodiment, when the operation button 98 is operated in the pop-up window 94C, the Web browser 5B sends a request message to the application service 40 via the Web browser 5A, requesting that a field be added to the file management application.

[0206] FIG. 18 is a diagram illustrating an example of a request message sent from a web browser to an application service.

[0207] A request message 181 shown in FIG. 18 is sent from the web browser 5B to the application service 40 via the web browser 5A in step S727 in FIG. 7, for example.

[0208] The request message 181 states that a field included in the response message 161 sent from the generation AI system 50 to the information processing system 20 is to be added.

[0209] In this embodiment, when the application service 40 completes adding a field to the file management application, it notifies the web browser 5B of the processing result via the web browser 5A, and the web browser 5B displays the processing result.

[0210] 19 is a seventh diagram showing a display example of the user terminal. A screen 91E shown in Fig. 19 is an example of a screen showing the processing result, which is displayed by the web browser 5B in step S731 of Fig. 7, for example.

[0211] In FIG. 19, a pop-up window 94D displays a chat message 97 and text data 97a, 97b, and 97c.

[0212] Text data 97a indicates the result of the user's confirmation of the content indicated by text data 97a. In this embodiment, when operation button 98 displayed in pop-up window 94C is operated, text data 97b may be automatically displayed in pop-up window 94D.

[0213] The text data 97c is text data indicating the result of the field addition process performed by the application service 40. In the example of Fig. 19, the text data 97c indicates that the field addition process performed by the application service 40 has been completed.

[0214] In this embodiment, the application to be edited can be edited simply by inputting a chat message instructing the content of the edit in the pop-up window 94.

[0215] If the user of the user terminal 10 wants to add another field, he or she can simply input a chat message indicating the field to be added after the text data 97c.

[0216] For example, if a chat message such as "Add phone number" is entered after the text data 97c in the pop-up window 94D, this chat message is transmitted from the web browser 5B to the information processing system 20.

[0217] Then, the information processing system 20 transmits a request message including this chat message to the generation AI system 50.

[0218] FIG. 20 is a diagram showing another example of a request message transmitted from the information processing system to the generation AI system.

[0219] When a chat message such as “Add a phone number” is further entered in the pop-up window 94D shown in FIG. 19, the information processing system 20 generates a request message 201 including this chat message and transmits it to the generation AI system 50.

[0220] In this embodiment, by doing this, it is possible to repeatedly add fields until the user finishes the operation of adding a field.

[0221] Each function of the above-described embodiments can be realized by one or more processing circuits. Here, the term "processing circuit" in this specification includes a processor programmed to execute each function by software, such as a processor implemented by an electronic circuit, as well as devices such as an ASIC (Application Specific Integrated Circuit), a DSP (Digital Signal Processor), an FPGA (Field Programmable Gate Array), and conventional circuit modules designed to execute each of the above-described functions.

[0222] Additionally, the devices described in each embodiment represent only one of multiple computing environments for implementing the embodiments disclosed herein.

[0223] In one embodiment, the information processing apparatus that makes up information processing system 20 may include multiple computing devices, such as a server cluster, configured to communicate with each other over any type of communication link, including a network, shared memory, etc., to perform the processes disclosed herein. Similarly, the information processing apparatus that makes up information processing system 20 may include multiple computing devices configured to communicate with each other.

[0224] Furthermore, the information processing devices that make up the information processing system 20 can be configured to share the disclosed processing steps in various combinations. For example, a process executed by a predetermined unit can be executed by an information processing device that makes up the information processing system 20. Similarly, the function of a predetermined unit can be executed by an information processing device that makes up the information processing system 20. Furthermore, in the information processing devices that make up the information processing system 20, each element possessed by each device may be integrated into a single server device or may be separated into multiple devices.

[0225] The information processing device constituting the information processing system 20 may be any device equipped with a communication function. The information processing device 200 may be, for example, a PJ (Projector), an IWB (Interactive White Board: an electronic white board with a blackboard function that allows mutual communication), an output device such as digital signage, a HUD (Head Up Display) device, industrial machinery, an imaging device, a sound collection device, medical equipment, a network home appliance, an automobile (Connected Car), a notebook PC (Personal Computer), a mobile phone, a smartphone, a tablet terminal, a game console, a PDA (Personal Digital Assistant), a digital camera, a wearable PC, a desktop PC, or the like.

[0226] For example, aspects of the present invention are as follows. <1> An information processing device that communicates with a terminal device and a generation AI system via a network, a communication unit that receives a request for acquiring screen information of an editing screen of the application, including identification information of the application, from the terminal device, and transmits the screen information, including a program for editing the application in response to a response message from the generation AI system, to the terminal device; a chat control unit that, when the communication unit receives from the terminal device a chat message including edited content input on the editing screen displayed on the terminal device, transmits the chat message, information about the application identified by the identification information, and information for calling a function that defines the edited content to the generation AI system, and receives from the generation AI system a response message including a call to the function that defines the edited content, The communication unit further an information processing device that transmits a response message including a call of a function that defines the edited content, which response message is received by the chat control unit, to the terminal device, and causes the terminal device to execute an edit process based on the function that defines the edited content. <2> the terminal device has a first web browser that communicates with an application service that provides the application, and a second web browser that communicates with the first web browser; The communication unit receiving, from the second Web browser, a request to acquire the screen information transmitted from the first Web browser to the second Web browser in response to an operation on the first Web browser, and transmitting the screen information to the second Web browser; The chat control unit Sending the chat message entered on the editing screen displayed by the second web browser to the generation AI system; The communication unit further The response message received by the chat control unit from the generation AI system is sent to the second web browser. <1> The information processing device described. <3> The information about the application is: Information obtained by the first web browser from the application service, The communication unit receiving information about the application via the second web browser; <2> The information processing device. <4> The communication unit receiving information about the application from the second web browser along with the chat message sent from the second web browser; <2> or <3> The information processing device described. <5> The program for editing the application is When the response message from the generation AI system includes a function call request for a function that defines the edited content, The terminal device executes an editing process of the application in response to the function call request; <1> ~ <4> 10. The information processing device according to claim 9, wherein: <6> The chat control unit transmits information indicating past conversation history to the generation AI system. <1> ~ <5> 10. The information processing device according to claim 1, <7> The editing includes adding, deleting, and updating fields managed by the application. <1> ~ <6> 10. The information processing device according to claim 9, wherein: <8> An application editing system in which a terminal device, a generation AI system, and an information processing device communicate with each other via a network, The information processing device includes: a communication unit that receives a request for acquiring screen information of an editing screen of the application, including identification information of the application, from the terminal device, and transmits the screen information, including a program for editing the application in response to a response message from the generation AI system, to the terminal device; a chat control unit that, when the communication unit receives from the terminal device a chat message including edited content input on the editing screen displayed on the terminal device, transmits the chat message, information about the application identified by the identification information, and information for calling a function that defines the edited content to the generation AI system, and receives from the generation AI system a response message including a call to the function that defines the edited content, The communication unit further sending a response message, which is received by the chat control unit and includes a call to a function defining the edited content, to the terminal device; The terminal device Has a web browser, The web browser causes the terminal device to execute a program for editing the application when the response message includes a function call request for a function that defines the editing content. <9> An information processing device that communicates with the terminal device and the generation AI system via a network, receiving a request for screen information of an editing screen of the application, including identification information of the application, from the terminal device, and transmitting the screen information, including a program for editing the application in response to a response message from the generation AI system, to the terminal device; a process of receiving, from the terminal device, a chat message including edited content input on the editing screen displayed on the terminal device, transmitting the chat message, information about the application identified by the identification information, and information for calling a function defining the edited content to the generation AI system, and receiving from the generation AI system a response message including a call to the function defining the edited content; A program that executes a process of sending a response message including a call of a function that defines the editing content received from the generation AI system to the terminal device, and executing an editing process based on the function that defines the editing content. <10> An information processing device that communicates with a terminal device and a generation AI system via a network, receiving, from the terminal device, a request for acquiring screen information of an editing screen of the application, including identification information of the application, and transmitting, to the terminal device, the screen information, including a program for editing the application in response to a response message from the generation AI system; When a chat message including edited content input on the editing screen displayed on the terminal device is received from the terminal device, the chat message, information about the application identified by the identification information, and information for calling a function that defines the edited content are transmitted to the generation AI system, and a response message including a call to the function that defines the edited content is received from the generation AI system. An information processing method that sends a response message including a call to a function that defines the editing content received from the generation AI system to the terminal device, and causes the terminal device to execute editing processing based on the function that defines the editing content.

[0227] Although the present invention has been described above based on the embodiments, the present invention is not limited to the requirements shown in the above embodiments. These requirements can be changed without departing from the spirit of the present invention, and can be appropriately determined depending on the application form. [Explanation of symbols]

[0228] 5, 5A, 5B Web Browser 10 User terminal 14 App Editorial Department 15, 19 Inter-browser communication section 20 Information Processing Systems 22 Screen generation section 23 Chat control section 24 Setting information storage unit 25 Editing program output section 40 Application Services 50 Generative AI System 100 App Editing System [Prior art documents] [Patent documents]

[0229] [Patent Document 1] Japanese Patent Application Publication No. 2023-018851

Claims

1. An information processing device that communicates with a terminal device and a generation AI system via a network, a communication unit that receives from the terminal device a request for acquiring screen information of an editing screen of the application, including identification information of the application, and transmits to the terminal device the screen information, including a program that edits the application in response to a response message from the generation AI system; a chat control unit that, when the communication unit receives from the terminal device a chat message including edited content input on the editing screen displayed on the terminal device, transmits the chat message, information about the application identified by the identification information, and information for calling a function that defines the edited content to the generation AI system, and receives from the generation AI system a response message including a call to the function that defines the edited content, The communication unit further an information processing device that transmits a response message including a call of a function that defines the edited content, which response message is received by the chat control unit, to the terminal device, and causes the terminal device to execute an edit process based on the function that defines the edited content.

2. the terminal device has a first web browser that communicates with an application service that provides the application, and a second web browser that communicates with the first web browser; The communication unit receiving, from the second Web browser, a request to acquire the screen information transmitted from the first Web browser to the second Web browser in response to an operation on the first Web browser, and transmitting the screen information to the second Web browser; The chat control unit Sending the chat message input on the editing screen displayed by the second web browser to the generating AI system; The communication unit further The information processing device according to claim 1 , wherein the response message received by the chat control unit from the generation AI system is transmitted to the second web browser.

3. The information about the application is: Information obtained by the first web browser from the application service, The communication unit The information processing apparatus according to claim 2 , wherein the information relating to the application is received via the second web browser.

4. The communication unit The information processing apparatus according to claim 2 , further comprising: receiving information about the application from the second web browser together with the chat message sent from the second web browser.

5. The program for editing the application is When the response message includes a function call request for a function that defines the edited content, The terminal device The information processing apparatus according to claim 1 , wherein the information processing apparatus executes an editing process of the application in response to the function call request.

6. The information processing device according to claim 1 or 2, wherein the chat control unit transmits information indicating a past conversation history to the generation AI system.

7. The information processing apparatus according to claim 1 , wherein the editing includes adding, deleting, and updating a field managed by the application.

8. An application editing system in which a terminal device, a generation AI system, and an information processing device communicate with each other via a network, The information processing device includes: a communication unit that receives from the terminal device a request for acquiring screen information of an editing screen of the application, including identification information of the application, and transmits to the terminal device the screen information, including a program that edits the application in response to a response message from the generation AI system; a chat control unit that, when the communication unit receives from the terminal device a chat message including edited content input on the editing screen displayed on the terminal device, transmits the chat message, information about the application identified by the identification information, and information for calling a function that defines the edited content to the generation AI system, and receives from the generation AI system a response message including a call to the function that defines the edited content, The communication unit further sending a response message, which is received by the chat control unit and includes a call to a function defining the edited content, to the terminal device; The terminal device A web browser is provided. The web browser causes the terminal device to execute a program for editing the application when the response message includes a function call request for a function that defines the editing content.

9. An information processing device that communicates with a terminal device and a generation AI system via a network, receiving, from the terminal device, a request to acquire screen information of an editing screen of the application, including identification information of the application, and transmitting, to the terminal device, the screen information, including a program for editing the application in response to a response message from the generation AI system; a process of receiving, from the terminal device, a chat message including edited content input on the editing screen displayed on the terminal device, transmitting the chat message, information about the application identified by the identification information, and information for calling a function defining the edited content to the generation AI system, and receiving a response message from the generation AI system including a call to the function defining the edited content; A program that executes a process of sending a response message including a call of a function that defines the editing content received from the generation AI system to the terminal device, and executing an editing process based on the function that defines the editing content.

10. An information processing device that communicates with a terminal device and a generation AI system via a network, Receive a request for screen information of an editing screen of the application, including identification information of the application, from the terminal device, and transmit the screen information, including a program for editing the application in response to a response message from the generation AI system, to the terminal device; When a chat message including edited content input on the editing screen displayed on the terminal device is received from the terminal device, the chat message, information about the application identified by the identification information, and information for calling a function that defines the edited content are transmitted to the generation AI system, and a response message including a call to the function that defines the edited content is received from the generation AI system. An information processing method that sends a response message including a call to a function that defines the editing content received from the generation AI system to the terminal device, and executes editing processing based on the function that defines the editing content.

Citation Information

Patent Citations

  • Automatic program code generation system

    JP2023018851A