Web application method, web application program and web application system
The web application method and system facilitate remote support by generating and displaying input pages on the user's terminal during a video call, addressing the challenge of elderly users operating electronic devices for web applications.
Patent Information
- Application Number
- JP2024029196
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-02-28
- Publication Date
- 2025-09-09
AI Technical Summary
Users, particularly elderly individuals, face difficulties in operating electronic devices to perform web applications during remote support via video calls due to their unfamiliarity with such technology.
A web application method and system that enables remote support by allowing supporters to access application pages, acquire user information from a database, generate input page information, and display it on the user's terminal during a video call, facilitating easy application execution without user operation.
Enables remote web application support by generating and displaying input pages on the user's terminal, allowing easy application execution and recording user interactions for future reference.
Smart Images

Figure 2025131441000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to a web application method, a web application program, and a web application system. [Background technology]
[0002] In recent years, with the widespread use of devices equipped with cameras, such as smartphones and tablet terminals, video calling services have become available that allow users to enjoy calls while seeing the other person's face. Such video calling services are also used as a means of communication in services targeting elderly people, such as elderly care.
[0003] Patent Document 1 discloses a technology relating to a video call service that enables communication using a video call bot.
[0004] Patent Document 2 discloses a technology relating to a monitoring device and a monitoring system that can transmit fixed messages and carry out voice conversations. [Prior art documents] [Patent documents]
[0005] [Patent Document 1] Japanese Patent Publication No. 2021-129296 [Patent Document 2] Japanese Patent Application Publication No. 2017-208657 Summary of the Invention [Problem to be solved by the invention]
[0006] However, when supporters provide support remotely using video calls, etc., there are difficulties in providing remote support, such as elderly users who are not accustomed to using electronic devices such as smartphones being unable to operate them as instructed by the supporter.
[0007] In view of this situation, an object of the present invention is to provide a novel technology that can provide users with remote support for web applications. [Means for solving the problem]
[0008] [1] A web application method executed by a computer device, comprising: the computing device includes at least one processing unit configured to execute computer-readable instructions stored in a memory unit; The web application method further comprises: A reception process for receiving access information from the supporter to access the application page; a page information acquisition step of accessing the application page based on the access information and acquiring application page information including input field data item information for input fields on the application page; a generating step of generating inputted page information for displaying an inputted page, which is an application page in which input fields have been input, based on the acquired user information and the application page information; a display processing step of displaying a code capable of acquiring the input page information on a video call screen in a video call terminal of the user who is making a video call with the supporter; and an application step of applying from the input page on the user terminal of the user who reads the input page information, The user information is user information acquired from a database and / or inputted into a terminal device. How to apply online. [2] The web application method further includes: a search step of searching for and acquiring data of data items corresponding to input field data items of input fields included in the application page from the user information stored in a database based on the application page information and the user information; a display processing step of displaying on a supporter terminal an input reception screen for receiving input of data for data items corresponding to the input field data items not found in the search step; [1] The online application method described in [1]. [3] The receiving step further receives, from the supporter, input of additional input data of data items corresponding to one or more of the input field data items not found in the searching step; The generating step further includes generating the input page information based on the additional input data. [2] Online application method. [4] In the generating step, input page information for displaying the input page is generated based on the extracted user information, which is the user information acquired in the searching step, and the application page information. [2] Online application method. [5] In the receiving step, information about the application page including the received access information is stored in a database in association with the user information. [1] - [4] Online application method. [6] A web application program, a reception unit that receives access information from supporters to access the application page; a page information acquisition unit that accesses the application page based on the access information and acquires application page information including input field data item information for input fields on the application page; a generating unit that generates inputted page information for displaying an inputted page, which is an application page in which input fields have been input, based on the acquired user information and the application page information; a display processing unit that performs a video call with the supporter and displays a code that can acquire the input page information on a video call screen at the user's video call terminal; Make the computer function as The user information is user information acquired from a database and / or inputted into a terminal device. Web application program. [7] A web application system, a reception unit that receives access information from supporters to access the application page; a page information acquisition unit that accesses the application page based on the access information and acquires application page information including input field data item information for input fields on the application page; a generating unit that generates inputted page information for displaying an inputted page, which is an application page in which input fields have been input, based on the acquired user information and the application page information; a display processing unit that performs a video call with the supporter and displays a code that can acquire the input page information on a video call screen at the user's video call terminal; Equipped with The user information is user information acquired from a database and / or inputted into a terminal device. Web application system.
[0009] The invention related to [1] makes it possible to provide support that allows users to easily apply by displaying an application page with user information etc. entered on the user's terminal via video call without the user having to perform any operations.
[0010] According to the invention of [2], input page information for displaying an input page can be easily generated by utilizing user information stored in a database.
[0011] [3] According to the invention of the present invention, if the data obtained from the user information cannot fill in the input fields on the application page, input can be accepted from a supporter who is making a video call with the user, and input page information can be easily generated without any operation by the user.
[0012] According to the invention of [4], input page information for displaying an application page with input fields filled in is generated using data acquired from the database.
[0013] According to the invention of [5], information about the application page can be stored in association with user information, and records can be made regarding services, etc., for which the user has applied. [Effects of the Invention]
[0014] The present invention provides a novel technique that can provide remote web application support to users. [Brief explanation of the drawings]
[0015] [Figure 1] FIG. 1 is a block diagram showing the configuration of a system according to an embodiment. [Figure 2] FIG. 1 is a hardware configuration diagram of a system according to an embodiment. [Figure 3] FIG. 1 is a functional block diagram of a system according to an embodiment. [Figure 4] 10 is a flowchart of a web application process of the system according to one embodiment. [Figure 5] 10 shows an example of a screen display on a supporter terminal in the system of one embodiment. [Figure 6] 10 shows an example of a screen display of a video call terminal in the system of an embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0016] The present invention will now be described in more detail with reference to the accompanying drawings, in which preferred embodiments are shown, but which may be embodied in many different forms and are not limited to the embodiments set forth herein.
[0017] For example, in this embodiment, the configuration, operation, etc. of the web application system will be described, but similar effects can be achieved by the executed method, device, computer program, etc. The program may be provided as a non-transitory computer-readable recording medium, or may be provided so as to be downloadable from an external server.
[0018] In this embodiment, a case will be described in which a supporter remotely provides support to a user, such as an elderly person who is not familiar with operating electronic devices, via a video call to support the user in applying online. The user is not limited to an elderly person, and can be anyone who receives remote support via a video call.
[0019] Furthermore, the embodiment described below is an example of processing in which a supporter or web application system provides support to a user who wishes to purchase a product or apply for a service by entering the necessary information on their behalf.
[0020] <System configuration> Figure 1 is a block diagram showing the system configuration of one embodiment. As shown in Figure 1, the web application system 0 includes a web application device 1, a supporter terminal 2, a video call terminal 3, a user terminal 4, and a database DB, which are configured to be able to communicate with each other via a network 5. Although not shown, in this embodiment, the user terminal 4 is configured to be able to communicate with a server device, such as an e-commerce system, to which a service or other application is made via the network 5.
[0021] The web application device 1 can be one or more server devices, such as a general-purpose server or a personal computer. In this embodiment, the video call between the supporter terminal 2 and the video call terminal 3 is realized, for example, via a session compliant with the WebRTC (Web Real-Time Communication) standard, but it may also be made by establishing a session compliant with standards such as HTTP or WebSocket. Furthermore, the web application device 1 may be appropriately equipped with a web server for screen display, a STUN server, a TURN server, a signaling server, etc. as resources for realizing the video call, but may also realize video call-related functions by communicating with an external communication system, etc. Hereafter, explanation of the video call function will be omitted to the extent that it will not be unclear.
[0022] Terminal devices 9 such as personal computers, smartphones, and tablet terminals can be used as the supporter terminal 2, video call terminal 3, and user terminal 4. The supporter terminal 2, video call terminal 3, and user terminal 4 connect to the web application device 1 by executing a web application device usage program, and perform the processes related to the web application described below. In this embodiment, the web application device usage program is a web browser application that is pre-installed or downloaded in advance to the terminal device 9, but it may also be a client application downloaded from a program provider device (not shown). In this embodiment, the supporter terminal 2 and video call terminal 3 make video calls by using a video call program that is a downloaded client application, but they may also make video calls using a web browser application.
[0023] In this embodiment, the network 5 is an IP (Internet Protocol) network, but there are no restrictions on the type of communication protocol, the type of network, etc.
[0024] <Hardware configuration> FIG. 2 is a diagram showing the hardware configuration of the web application device 1 and the terminal devices 9 (supporter terminal 2, video call terminal 3, and user terminal 4).
[0025] Fig. 2(a) is a hardware configuration diagram of the web application device 1. As shown in Fig. 2(a), the web application device 1 has a processing unit 101, a storage unit 102, and a communication unit 103, which are used to perform the functions of each unit and each process.
[0026] The processing unit 101 has a processor such as a CPU that can execute an instruction set, and executes an OS, a web application program, and the like. The storage unit 102 has a volatile memory such as a RAM capable of storing an instruction set, and a non-volatile recording medium such as an HDD or SSD capable of recording an OS, a web application program, and the like. The communication unit 103 has an interface for physically connecting to a network, and controls communication with the network 5 to input and output information.
[0027] Fig. 2(b) is a hardware configuration diagram of the terminal device 9 (supporter terminal 2, video call terminal 3, user terminal 4). As shown in Fig. 2(b), the terminal device 9 has a processing unit 901, a memory unit 902, a communication unit 903, an input unit 904, and an output unit 905, which are used to perform the functions of each unit and each process.
[0028] The processing unit 901 has a processor such as a CPU that can execute an instruction set, and executes programs such as an OS and a program for using the web application device. The memory unit 902 has a volatile memory such as RAM that can store an instruction set, an OS, an application program that can use multiple services including a web application device usage program (web application device usage program, video call program), and a non-volatile recording medium such as an HDD or SSD that can store the program. The communication unit 903 has an interface for connecting to a network, and controls communication with the network 5 to input and output information. The input unit 904 includes an operation input device capable of input processing such as a touch panel or keyboard, an audio input device capable of audio input such as a microphone, and an image input device capable of image input such as a camera. The output unit 905 includes a display device capable of display processing, such as a display, and an audio output device, such as a speaker.
[0029] In this embodiment, the database DB is a database server that is communicatively connected via the network 5 and is capable of storing various data including user information, but it may also be realized, for example, using the processing unit 101 and memory unit 102 that constitute the web application device 1.
[0030] <Web Application System 0 Functional Configuration> FIG. 3 is a functional block diagram of the web application system 0. As shown in FIG. 3, the web application device 1 comprises a page information acquisition unit 11, a generation unit 12, and a search unit 13. This is a specific implementation of information processing by software (a web application program stored transiently or non-transiently in a storage unit 102) using hardware (such as a processing unit 101). Although not shown in FIG. 3, the web application device 1 may further comprise a video call control unit that mediates the transfer of audio and images (including video, etc.) related to video calls and controls processing related to video calls.
[0031] The supporter terminal 2 is a terminal device 9 operated by a supporter who provides remote support for web applications to users such as elderly people via video calls, and includes a video call processing unit 21, a display processing unit 22, and a reception unit 23. In this embodiment, the supporter who interacts with the user and provides support is a human, but as long as the supporter is capable of interacting with the user and providing support, the supporter may be a rule-based robot such as a generative AI (artificial intelligence) or a chatbot that can interact with the user.
[0032] The video call terminal 3 is a terminal device 9 that a user receiving support uses for a video call, and includes a video call processing unit 31 and a display processing unit 32. The functional configuration of these terminal devices 9 (supporter terminal 2, video call terminal 3) is a specific implementation of information processing by software (such as a web application device utilization program for a user or supporter stored transiently or non-transiently in a storage unit 902, etc.) with hardware (such as the processing unit 901, etc.).
[0033] The user terminal 4 is a terminal device 9 used by a user who talks with a supporter via video call and receives remote support. The user terminal 4 obtains input page information by reading a code displayed on the video call terminal 3, and displays the input page, which is an application page with input fields filled in, using a web browser application or the like. The user terminal 4 executes a web application by sending the information input in the input fields to a server device of a service provider or the like, which is the application destination. The processing related to this application is specifically realized by hardware (processing unit 901) or the like, which processes information using software such as a web browser application stored transiently or non-transiently in a memory unit 902 or the like of the user terminal 4.
[0034] <Video call processing units 21 and 31> The video call processing units 21 and 31 display a video call screen on the terminal device 9 (supporter terminal 2, video call terminal 3) and execute video call processing. As part of the video call processing, the video call processing units 21 and 31 transmit audio and images (including video) acquired via the audio input device and image input device of the terminal device 9 (supporter terminal 2, video call terminal 3) to the video call processing units 21 and 31 of other terminal devices 9 (supporter terminal 2, video call terminal 3) directly or via another server device (web application device 1, etc.). In addition, in this embodiment, in order to provide support to the user via a video call, the video call processing units 21 and 31 function as display processing units 22 and 32, which will be described later, and execute processing related to screen displays on the video call screen, such as displaying a code and a screen for accepting additional input data.
[0035] In addition, the supporter terminal 2 may be equipped with a video call control unit and may be able to handle one or more of the controls input at the video call terminal 3, such as audio on / mute, video on / off, and screen configuration adjustment, from the supporter terminal 2 side.
[0036] <Display processing unit 22> The display processing unit 22 displays a screen for receiving necessary information, such as an access information receiving screen for receiving access information and an additional input data receiving screen for receiving data of data items that were not filled in with the user information stored in the database DB. Alternatively, the video call processing unit 21 may function as a display processing unit, and display the access information receiving screen and the additional input data receiving screen on the video call screen.
[0037] <Reception Department 23> The reception unit 23 accepts various information input by the supporter. In this embodiment, the reception unit 23 accepts access information from the supporter for the user to access an application page for a service or the like to apply, and transmits the access information to the web application device 1. In this embodiment, the reception unit 23 accepts the URL (Uniform Resource Locator) of the application page, which is a web page, as the access information, but any format is acceptable as long as the information allows access to the application page. In this embodiment, the reception unit 23 associates information about the application page, including the accepted access information, with user information about the user making the application and stores it in the database DB. The reception unit 23 also accepts in advance information (user identification information) for identifying the user applying for the service, such as the user name and user ID of the user.
[0038] The reception unit 23 also receives input of additional input data such as the number of items to be purchased on the application page, delivery date and time, etc. When the input fields on the application page cannot be filled in with the user information stored in the database DB, the reception unit 23 receives input of additional input data from the supporter to fill in the input fields, and transmits the received additional input data to the web application device 1.
[0039] Furthermore, if the input fields on the application page cannot be filled in with the user information stored in the database DB (if the search unit 13 cannot obtain data for the corresponding data item from the user information stored in the database DB), the reception unit 23 accepts input of data for the data item corresponding to the input field data item that was not filled in with the user information stored in the database DB. The data (additional input data) accepted by the reception unit 23 from the supporter is used to generate input page information in the generation unit 12, which will be described later.
[0040] <Page information acquisition unit 11> Based on the access information acquired from the supporter terminal 2, the page information acquisition unit 11 accesses the application page, which is a web page, and acquires resource information, such as an HTML file for displaying the application page. Then, from the acquired resource information, it acquires application page information for the accessed application page. In this embodiment, the page information acquisition unit 11 acquires application page information including information about the data items (input field data items) of the input fields included in the application page, such as the names of data items actually displayed on the application page, such as "name" and "address," and variable names of data entered in the input fields, such as "name" and "address." The input field data item information acquired at this time, which is information about the input field data items, includes, in this embodiment, labels and tags assigned to data entered in the input fields, and item names displayed next to the input fields. In this embodiment, the page information acquisition unit 11 acquires information about the input field data items, but it may acquire any information about the application page, such as the address of the application page.
[0041] In this embodiment, the page information acquisition unit 11 acquires application page information (information on input field data items in this embodiment) from resource information on an application page, which is a web page, using a technique related to web scraping.
[0042] <Exploration part 13> The search unit 13 searches the user information stored in the database DB for data items corresponding to the input field data items based on the application page information acquired by the page information acquisition unit 11, including information about the input field data items. For example, if the input field data item is "Name," the search unit 13 searches for and acquires "Taro Tanaka" as the corresponding data item data from the database DB. Based on the application page information acquired by the page information acquisition unit 11, the search unit 13 searches for and acquires data items corresponding to the input field data items in the database DB. In this case, the search unit 13 may search for data items corresponding to the input field data items based on actually stored user information, such as "Taro Tanaka," or may search for data items corresponding to the input field data items based on data item names, such as "Name." When the search unit 13 performs a search and finds data items corresponding to the input field data items in the user information, it performs a process of acquiring data items corresponding to the found input field data items. Furthermore, the search unit 13 performs a search and identifies input field data items for which corresponding data items cannot be found in the user information stored in the database DB. The search unit 13 may also execute a process of identifying the correspondence between the input field data items on the application page and the data items of the user information based on the data items of the user information stored in the database DB, and acquiring data of the data items corresponding to the input field data items from the user information stored in the database DB. In this embodiment, the search unit 13 searches for and acquires the user information of the user making the application from the user information of multiple users stored in the database DB, based on information for identifying the user making the application (user identification information) received in advance by the reception unit 23 from the supporter.
[0043] In this embodiment, the search unit 13 searches for and acquires data corresponding to input field data items using a search model configured based on a rule base, but it may also perform processing related to searching for and acquiring data for data items corresponding to input field data items using a trained model that has been trained based on data items and labels for associating data items, a model for classifying data items, etc.
[0044] In this embodiment, the search unit 13 searches for data of corresponding data items within the user information, and therefore performs processing related to matching data items and converting data item names in advance, based on the data items of the user information handled within the web application system 0, such as matching the data item name "Name" with the data item name "Last Name", or unifying the data item names "Name" and "Last Name" into "Last Name".
[0045] Furthermore, for example, when the input field data item is "name," the search unit 13 may find and acquire data of multiple data items as data of a data item corresponding to the input field data item, such as finding and acquiring data of multiple data items such as "last name" and "first name" as user information related to the name in the database DB. In this way, as long as content data corresponding to the input field data item can be acquired, the number of data items of data searched and acquired by the search unit 13 does not need to correspond to the number of input field data items.
[0046] <Generation part 12> The generation unit 12 generates input page information for displaying an input page in which input fields are filled in based on the application page information, data corresponding to the input field data items acquired by the search unit 13 (extracted user information), and additional data entered by the supporter (additional input data). The application page information acquired by the generation unit 12 may include access information acquired from the supporter (the URL of the application page in this embodiment).
[0047] The input page information is information for displaying an application page for which input has been made, and includes access information such as a URL for accessing the application page, input data to be input into input fields based on the extracted user information and additional input data, and data item information for each data item of the input data associated with the input data. In this embodiment, the generation unit 12 generates the input page information, which is a character string including the URL of the application page, the input data to be input into the input fields, and the data item names (URL parameters) of the input fields. Upon acquiring the input page information, the user terminal 4 displays the application page based on the acquired input page information and inputs the corresponding input data into the input fields.
[0048] Furthermore, in this embodiment, the generation unit 12 generates a code based on the generated input page information, and transmits the generated code to the video call terminal 3. By displaying this code, the video call terminal 3 displays the code that enables acquisition of the input page information on the video call screen.
[0049] In this embodiment, the generated input page information is displayed on the video call terminal 3 as a readable code, and the input page information is provided by reading the displayed code, but it may also be provided by being sent directly to the user's terminal device 9, such as the video call terminal 3 or the user terminal 4.
[0050] <Display processing unit 32> The display processing unit 32 displays on the screen a code that can acquire the input page information, based on the code acquired from the web application device 1. In this embodiment, the display processing unit 32 acquires and displays an image of a two-dimensional code that can be read by a camera (image sensor), such as a QR code (registered trademark), as the code that can acquire the input page information, but it may also acquire and display a character string itself, such as a URL, as a code.
[0051] <How to apply online> FIG. 4 is a flowchart of the process for applying online using a video call.
[0052] <Video call display process> In step S101, the supporter terminal 2 and the user's video call terminal 3 start a video call. At this time, the video call processing units 21 and 31 display images (videos) of the user and supporter on the video call screens of the participants (user, supporter) of the video call. When the supporter is not a person, an avatar or the like may be displayed as the supporter image.
[0053] 5 and 6 are examples of video call screens displayed on the terminal device 9 of a supporter or user. The examples shown in FIGS. 5 and 6 are examples of screen displays when there are two participants, but there is no limit to the number of participants, and the screen configuration of the video call screen, such as images of video call participants such as users and supporters, is not limited to the examples shown. Furthermore, processing related to the screen display of a video call, which will be described later, is realized by video call processing units 21 and 31 and display processing units 22 and 32.
[0054] <Supporter video call screen (when receiving access information)> 5 is a screen display example of a video call screen for supporters displayed on the supporter terminal 2. Below, the screen displayed on the supporter terminal 2 will be described with reference to FIG.
[0055] 5(a) shows an example of a video call screen W1 for supporters displayed on the supporter terminal 2 of a supporter who has confirmed their intention to apply via a video call with a user. The video call screen W1 for supporters includes a supporter image W11, a user image W12, an access information reception screen W13, and an end call button W14. The video call screen W1 for supporters may also include buttons for performing other video call-related operations, such as an audio mute or unmute button and a video on / off button.
[0056] The supporter image W11 and the user image W12 may be arranged in a screen configuration other than the configuration shown in FIG. 5(a) on a screen display that displays images (video) of participants in a video call, including the supporter and the user.
[0057] The access information reception screen W13 is a screen display that is displayed when a supporter who has received a user's intention to apply through a conversation via video call or the like selects to start inputting access information, and includes an access information reception section W131 and a start button W132. In this embodiment, information (user identification information) for identifying the user making the application is received in advance from the supporter terminal 2 before the access information reception screen W13 is displayed, but if the user identification information is not received in advance, the access information reception screen W13 may include an input field for receiving user identification information such as a user name or user ID.
[0058] <Access information reception process, page information acquisition process, search process> If the end call option is not selected (NO in step S102) and the video call is still ongoing, and a display request for an access information input acceptance screen is sent from the supporter terminal 2 to the web application device 1, the display processing unit 22 displays the access information acceptance screen W13 on the supporter video call screen W1. When access information is entered in the access information acceptance section W131 included in the access information acceptance screen W13 and the start button W132 is pressed (YES in step S103), the page information acquisition unit 11 accesses the application page based on the access information and acquires application page information (step S104). Based on the application data information acquired by the page information acquisition unit 11, the search unit 13 searches for and acquires data of data items corresponding to the input field data items from the user information stored in the database DB (step S105). At this time, the search unit 13 searches for and acquires user information of the corresponding user making the application based on information for identifying the user making the application (user identification information) previously acquired by the supporter terminal 2.
[0059] <Supporter video call screen (when accepting additional input data)> Fig. 5(b) shows an example of a video call screen W2 for supporters that is displayed after the processing (step S105) by the search unit 13 is completed. The screen shown in Fig. 5(b) is a screen for accepting additional input data that is displayed when the user information (extracted user information) acquired by the search unit 13 is not sufficient to fill in all of the input fields on the application page (NO in step S106).
[0060] The supporter video call screen W2 shown in Figure 5(b) includes a supporter image W21, a user image W22, and an end call button W24, similar to the example shown in Figure 5(a), but also includes an additional input data acceptance screen W23.
[0061] The additional input data acceptance screen W23 shown in FIG. 5(b) is a screen display that is displayed when the user information (extracted user information) acquired by the search unit 13 is not sufficient to fill in all of the input fields on the application page (NO in step S106), and includes an additional input data input field W231 and a generate button W232. The additional input data input field W231 is an input field for accepting data for the input fields on the application page that were not filled in with the user information; in the example shown in FIG. 5(b), it accepts the product delivery date and purchase quantity. The generate button W232 is a button for starting the generation of the inputted page information; when pressed, a generation start instruction is sent from the supporter terminal 2 to the web application device 1, and the generation unit 12 generates the inputted page information.
[0062] <Additional input data reception process> When the input fields of the application page cannot be filled in with the data acquired by the search unit 13 (NO in step S106), the display processing unit 22 displays an additional input data acceptance screen W23 on the video call screen (step S107). At this time, based on the search results by the search unit 13, the display processing unit 22 displays the additional input data acceptance screen W23 including an additional input data entry field W231 that accepts input of data for input field data items not found by the search unit 13. When data is entered in the additional input data entry field W231 included in the additional input data acceptance screen W23, the acceptance unit 23 accepts the entered data as additional input data.
[0063] <Entered page information generation process> When the generate button W232 is pressed with data entered in the additional input data input field W231, the generation unit 12 generates input page information based on the data entered in the additional input data reception screen W23, the extracted user information, and the application page information (step S108).
[0064] Also, although not shown, when all input fields on the application page can be filled in based on the extracted user information acquired by the search unit 13 (YES in step S106), in this embodiment, the generation unit 12 generates the inputted page information (step S108) without going through a screen display such as that shown in FIG. 5(b), or a screen displaying the generate button W232 may be displayed, and the process for generating the inputted page information may be started by pressing the generate button W232.
[0065] <User video call screen> FIG. 6 shows an example of a screen display of a user video screen displayed on the video call terminal 3, which is the user's terminal device 9.
[0066] The user video call screen W3 includes a supporter image W31, a code display section W32, and an end call button W33. The supporter image W31 is a screen display that displays an image of a supporter. In the example shown in FIG. 6, the user video call screen W3 includes only the supporter image W31 as an image of a participant, but may also include images of other participants such as the user. The code display section W32 is a screen display that displays a code for acquiring the input page information. In the example shown in FIG. 6, a QR code is displayed as the code for acquiring the input page information. In this embodiment, the display processing unit 32 of the user's video call terminal 3 displays the code acquired as image data from the web application device 1 on the video call screen. However, it may also acquire the input page information in the form of a URL or the like from the web application device 1 and, based on the acquired input page information, display the code for acquiring the input page information by, for example, converting the URL to a QR code.
[0067] <Code display process> The display processing unit 32 displays on the video call screen the code acquired from the web application device 1. In this embodiment, the display processing unit 32 displays on the screen the code acquired as image data from the web application device 1, but the code acquired as a character string such as a URL may also be converted into an image such as a QR code.
[0068] When the call end button W14, W24, W33 shown on the video call screen of FIG. 5 and FIG. 6 is pressed (YES in step S102), the video call is ended.
[0069] <Application process> 6(b) with the user terminal 4, the user terminal 4 acquires the input page information and, based on the acquired input page information, displays an input page where the input fields have been filled in. When the user presses the application button displayed on this input page, the input data is sent to the server of the service provider, etc., and the application is executed (step S110).
[0070] <Modification> In this embodiment, the supporter is a person, but for example, an AI or the like may also be used as the supporter to converse with the user. In this case, the supporter converses with the user by generating questions and performing processing to recognize the user's utterances as linguistic information, and supports the user in entering data. If the input fields cannot be filled in with the user information stored in the database DB, the supporter may generate and ask questions to acquire necessary data based on the input field data items, acquire input data for additional input data from the content of the utterance through a dialogue with the user, and the receiving unit 23 may receive the additional input data from the supporter based on the content of the user's utterance.
[0071] In this embodiment, the web application device 1 stores information about the application page including access information in association with user information, but the generated input page information, additional input data, and data items of the additional input data may also be stored in the database DB in association with the user information of the user making the application. In this case, the information about the application page and input pages stored in the database DB may be stored as the user's application history, and may be used to train a proposal model for proposing additional input data suitable for each user, such as proposing product delivery dates and times.
[0072] If the supporter is a human, the additional input data proposed by the proposed model may be automatically entered and displayed in an input field on the additional input data reception screen, or may be displayed in a suggestion display unit displayed near the input field. Furthermore, if the supporter is an AI or the like, the supporter generates a question asking whether the additional input data proposed by the proposed model is acceptable based on the additional input data proposed by the proposed model and the data items of the proposed additional input data. The supporter then asks the question through dialogue and acquires the content of the user's utterance. If it is determined that consent has been obtained based on the acquired user utterance, the acceptance unit 23 may accept the additional input data proposed by the proposed model as additional input data to be used in generating input page information.
[0073] In addition, in this embodiment, the display processing unit 32 displays a code on the screen, making it possible to read the input page information via the code, but the input page information may also be obtained by the user terminal 4 using other methods, such as the video call terminal 3 being equipped with a code output unit that uses short-range wireless communication to output a code that allows the user terminal 4 to obtain the input page information. [Explanation of symbols]
[0074] 0: Web application system 1: Web application device 2: Supporter terminal 3: Video calling device 4: User terminal 9: Terminal device 11: Page information acquisition section 12: Generation part 13: Search Department 21: Video call processing unit 22: Display processing section 23: Reception 31: Video call processing unit 32: Display processing section 101: Processing section 102: Storage section 103: Communications Department 901: Processing section 902: Storage section 903: Communications Department 904: Input section 905: Output section
Claims
1. A web application method executed by a computer device, comprising: the computing device includes at least one processing unit configured to execute computer-readable instructions stored in a memory unit; The web application method further comprises: A reception process for receiving access information from the supporter to access the application page; a page information acquisition step of accessing the application page based on the access information and acquiring application page information including input field data item information for input fields on the application page; a generating step of generating inputted page information for displaying an inputted page, which is an application page in which input fields have been input, based on the acquired user information and the application page information; a display processing step of displaying a code capable of acquiring the input page information on a video call screen in a video call terminal of the user who is making a video call with the supporter; and an application step of applying from the input page on the user terminal of the user who reads the input page information, The user information is user information acquired from a database and / or inputted into a terminal device. How to apply online.
2. The web application method further includes: a search step of searching for and acquiring data of data items corresponding to input field data items of input fields included in the application page from the user information stored in a database based on the application page information and the user information; a display processing step of displaying on a supporter terminal an input reception screen for receiving input of data for data items corresponding to the input field data items not found in the search step; The web application method of claim 1 , comprising:
3. The receiving step further includes receiving, from the supporter, input of additional input data of data items corresponding to one or more of the input field data items not found in the searching step; The generating step further includes generating the input page information based on the additional input data. The web application method according to claim 2.
4. In the generating step, inputted page information for displaying the inputted page is generated based on the extracted user information, which is the user information acquired in the searching step, and the application page information. The web application method according to claim 2.
5. In the receiving step, information regarding the application page including the received access information is stored in a database in association with the user information. The web application method according to any one of claims 1 to 4.
6. A web application program, a reception unit that receives access information from supporters to access the application page; a page information acquisition unit that accesses the application page based on the access information and acquires application page information including input field data item information for input fields on the application page; a generating unit that generates inputted page information for displaying an inputted page, which is an application page in which input fields have been input, based on the acquired user information and the application page information; a display processing unit that displays a code that can acquire the input page information on a video call screen in a video call terminal of the user who is making a video call with the supporter; Make the computer function as The user information is user information acquired from a database and / or inputted into a terminal device. Web application program.
7. A web application system, a reception unit that receives access information from supporters to access the application page; a page information acquisition unit that accesses the application page based on the access information and acquires application page information including input field data item information for input fields on the application page; a generating unit that generates inputted page information for displaying an inputted page, which is an application page in which input fields have been input, based on the acquired user information and the application page information; a display processing unit that displays a code that can acquire the input page information on a video call screen in a video call terminal of the user who is making a video call with the supporter; Equipped with The user information is user information acquired from a database and / or inputted into a terminal device. Web application system.
Citation Information
Patent Citations
Observation apparatus and observation system
JP2017208657A
Method, system, and computer program for providing communication by using video call bot
JP2021129296A