Program, information processing device, and control method for the information processing device.
The control method enhances usability by transitioning to assistant mode upon long-pressing an icon, offering explanatory content to clarify functions, addressing the complexity of numerous mini-apps in applications.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- PAYPAY CO LTD
- Filing Date
- 2024-12-23
- Publication Date
- 2026-07-03
AI Technical Summary
The increasing number of functions and mini-apps within applications makes it difficult for users to understand the functions provided by these mini-apps on the user interface.
A control method that transitions from normal mode to assistant mode upon receiving a long-press operation on an icon, displaying explanatory content such as text and an assistant character to explain the function of the icon.
Improves usability by allowing users to quickly grasp the function of icons, especially when many icons are displayed, by providing concise explanatory content.
Smart Images

Figure 2026111238000001_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to a program, an information processing apparatus, and a control method for an information processing apparatus.
Background Art
[0002] In recent years, with the diversification of services provided, the number of applications installed on information processing apparatuses such as smartphones for receiving services has also increased. In addition, the number of functions that can be provided by a single application has increased.
[0003] Patent Document 1 discloses a method of generating an icon corresponding to the function of an application on a desktop by performing a predetermined operation on an icon of the application on the desktop displayed on the display unit of a smartphone.
Prior Art Documents
Patent Documents
[0004]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0005] There is a need for a method that can improve the usability in the use of applications.
[0006] The present disclosure aims to improve the usability in the use of applications.
Means for Solving the Problems
[0007] [[ID= / / ID=49]] A program according to one aspect of the present disclosure is a program for an application executed by an information processing device, characterized in that the information processing device is configured to function as a control unit that performs control to execute the function of the first icon in response to the reception unit receiving the first operation on the screen in a first mode, and to transition to a second mode in which explanatory content corresponding to the icon displayed on the screen is displayed in response to the reception unit receiving the second operation in a first mode. [Effects of the Invention]
[0008] This disclosure makes it possible to improve the usability of the application. [Brief explanation of the drawing]
[0009] [Figure 1] This figure shows an example of the application's user interface. [Figure 2] This figure shows an example of the application's user interface. [Figure 3] This figure shows an example of the application's user interface. [Figure 4] This figure shows an example of the application's user interface. [Figure 5] This figure shows an example of the hardware configuration of an information processing device. [Figure 6] This figure shows an example of the application's configuration. [Figure 7] This figure shows an example of a management table. [Figure 8] This figure shows an example of text information. [Figure 9] This figure shows an example of the process that an application performs. [Figure 10] This figure shows an example of the application's user interface. [Figure 11]This figure shows an example of an AI assistant screen. [Modes for carrying out the invention]
[0010] Preferred embodiments of the program, information processing apparatus, and control method for the information processing apparatus relating to this disclosure will be described in detail below with reference to the drawings. However, the following embodiments do not limit the program, information processing apparatus, and control method for the information processing apparatus relating to this disclosure. Furthermore, identical components are denoted by the same reference numerals in the following embodiments, and redundant descriptions are omitted.
[0011] In recent years, with the diversification of services offered, the number of services provided within a single application has increased. One method of providing services is through mini-apps, which are applications that run on top of the main application. As the number of services that an application can provide increases, the number of mini-apps displayed on the application's user interface also increases.
[0012] In such cases, it becomes difficult for application users to understand what functions the mini-apps displayed on the application's user interface have and what services they provide.
[0013] Therefore, the following describes methods that can improve the usability of the application. Specifically, it describes how to display the functions of mini-apps as icons on the application's operation screen.
[0014] <First Embodiment> [1. Examples of application usage in this embodiment] Figures 1 to 4 show examples of application operation screens 100 in this embodiment, which are displayed on the display unit of an information processing device such as a smartphone. An example of how to use the application in this embodiment will be explained with reference to Figures 1 to 4.
[0015] The application in this embodiment will be described by taking as an example a settlement application that can provide a settlement service and a money transfer service. The settlement service is a service that transfers electronic money corresponding to the payment amount from the account of the user who makes the settlement to the store account of the store in order to pay the consideration for the purchase of goods and the provision of services at the store. The money transfer service is a service for transferring electronic money between a first user and a second user registered in the application. Specifically, the money transfer service is a service that transfers electronic money from a first account of a first user who is the remitter to a second account of a second user who is the recipient. Note that in the money transfer service, it is also possible to transfer electronic money from the second account to the first account.
[0016] In addition, the application in this embodiment is not limited to the settlement service and the money transfer service, and can provide a trading service for financial assets through financial institutions such as securities companies or banks. Furthermore, the application in this embodiment can provide coupons, point reduction information, store information where the settlement service can be used, salary information, insurance-related information, and tax-related information.
[0017] Alternatively, the application in this embodiment is not limited to the settlement service and the money transfer service, and may provide services related to medical care, transportation, sales, education, real estate, and other fields.
[0018] FIG. 1(a) and FIG. 1(b) are diagrams showing an operation screen 100 of an application displayed on the display unit of an information processing device after the application in this embodiment is launched. As shown in FIG. 1(a), the operation screen 100 has a code display area 101, a settlement / money transfer function display area 102, an icon display area 103, and a balance display area 105.
[0019] The code display area 101 displays a one-dimensional code and a two-dimensional code. The payment / money transfer function display area 102 displays the "Scan" button, the "Send" button, and the "Charge" button. The codes displayed in the code display area 101 and the buttons displayed in the payment / money transfer function display area 102 are used when using payment or money transfer services.
[0020] Before explaining the details of application usage examples, we will now describe examples of using payment and remittance services using the code displayed in the code display area 101 and the buttons displayed in the payment / remittance function display area 102.
[0021] (Examples of using payment and money transfer services) For example, when using a payment service, the user presents the code displayed in the code display area 101 to the store clerk. The store clerk then scans the code displayed in the code display area 101, and the payment is processed based on the scanned information.
[0022] When using the money transfer service, the sending user reads the code displayed in the code display area 101 using the scanning function described later. The code displayed in the code display area 101 has embedded the identification information of the first user, which is linked to the account corresponding to the operation screen 100. In other words, the sending user, the second user, reads the identification information of the recipient user, the first user, embedded in the code displayed in the code display area 101, and by entering the transfer amount, can send the corresponding electronic money to the first user.
[0023] In the following explanation, a user associated with the account corresponding to the operation screen 100 and possessing the information processing device displaying the operation screen 100 will be referred to as the first user. A user different from the first user will be referred to as the second user. For example, in the use of a money transfer service, if the user sending the money is considered the first user, the user receiving the money may be referred to as the second user. Conversely, in the use of a money transfer service, if the user receiving the money is considered the first user, the user sending the money may be referred to as the second user.
[0024] The "Scan" button displayed in the payment / remittance function display area 102 provides a scanning function for reading codes. Specifically, when the "Scan" button is pressed, the application displays a scanning screen for code scanning and activates the camera unit provided in the information processing device.
[0025] For example, when using a payment service, a user can make a payment by reading a code placed in the store, which contains identification information for identifying the store, via an application.
[0026] When using the money transfer service, the first user, who is the sender, uses the scanning function provided by the "Scan" button to read a code embedded with identification information to identify the second user, who is the recipient. Then, the first user can send the corresponding amount of electronic money to the second user by entering the transfer amount.
[0027] The "Send" button displayed in the payment / remittance function display area 102 provides the function to send electronic money to the recipient user in the remittance service. Specifically, when the "Send" button is pressed, the application displays a selection screen in which the recipient user (the first user) can be selected. The sending user (the first user) can send electronic money corresponding to the amount by selecting the second user from the selection screen and entering the amount to be sent. The balance display area 105 displays the balance of points and electronic money available in the remittance service and payment service.
[0028] (Example of application usage) The icon display area 103 displays icons corresponding to the services (sometimes called functions) that the application can provide. For the purposes of this explanation, the icons will be described using, as an example, icons for mini-applications that run on the application in this embodiment.
[0029] When the application detects that the "Coupon" icon displayed in the icon display area 103 has been pressed, it transitions from the operation screen shown in Figure 1(a) to a screen (not shown) for obtaining coupons that can be applied at the time of payment. Also, when the application detects that the "Bank Loan" icon displayed in the icon display area 103 has been pressed, it transitions from the operation screen shown in Figure 1(a) to a screen (not shown) related to card loans provided by the bank.
[0030] The icon display area 103 shown in the operation screen of Figure 1(a) displays some of the icons corresponding to the services that the application can provide. If a user wants to view icons for all the services that the application provides, they press the "All" icon 104 displayed in the service list, as shown in Figure 1(b). When the application detects that the "All" icon 104 has been pressed, it transitions from the operation screen of Figure 1(a) to the operation screen of Figure 1(c).
[0031] Figure 1(c) shows the application's operation screen that appears after the "All" icon 104 is pressed. The operation screens shown in Figures 1(d) and 2(b), which will be described later, are the same as the operation screen shown in Figure 1(c).
[0032] The operation screen in Figure 1(c) displays icons for each of the services that the application can provide, categorized accordingly. Specifically, the operation screen in Figure 1(c) displays all icons categorized as "Finance" 110, "Send / Receive" 120, "Insurance" 130, and "Sales" 140. The operation screen in Figure 1(c) also includes a "Back" button 150 that accepts instructions to return to the previous screen.
[0033] If it is not possible to display icons for all services on one side of the operation screen in Figure 1(c), the application may display the icons that can be displayed on that screen and then display the remaining icons in response to user actions on that screen. For example, the application may display the remaining icons in response to user scrolling on the operation screen in Figure 1(c).
[0034] Here, as shown in Figure 1(d), the user presses (for example, taps) the "Send / Receive" icon 121. When the application detects a tap on the "Send / Receive" icon 121, it executes the function corresponding to the "Send / Receive" icon 121. In other words, the application transitions from the operation screen in Figure 1(d) to the operation screen in Figure 2(a).
[0035] In the following, pressing operations on icons will be explained separately as tap operations and long-press operations. Unless otherwise specified, tap operations and long-press operations will be collectively referred to as pressing operations. Furthermore, tap operations include click operations.
[0036] Figure 2(a) shows the application operation screen 200 that appears after the "Send / Receive" icon 121 is tapped. The operation screen 200 in Figure 2(a) is the screen for using the money transfer service, which is the service corresponding to the "Send / Receive" icon 121.
[0037] The operation screen 200 in Figure 2(a) displays the second user, who is the recipient of the remittance, as registered by the first user in the application. Users A201 through C203 are displayed as the second user. The first user can specify the second user displayed on the operation screen 200 in Figure 2(a) as the recipient of the electronic money and, after performing the prescribed operations, can send the electronic money to the specified second user.
[0038] Furthermore, the operation screen 200 in Figure 2(a) is provided with a back button 150. When the application detects that the back button 150 has been pressed, it transitions from the operation screen 200 in Figure 2(a) to the operation screen 100 in Figure 1(c).
[0039] Here, the operation screens in Figures 1(a) to 2(a), and the operation screen in Figure 2(b), which will be described later, are screens when the application is in normal mode. Normal mode refers to a mode in which the application executes the function corresponding to the tapped icon in response to a tap on the icon displayed on the application's operation screen. In this embodiment, the explanation will be based on the example that the application is in normal mode immediately after startup.
[0040] Figure 2(b) illustrates how a user performs a long-press operation on the "Payroll" icon 111 on the operation screen shown in Figure 1(c). When the application detects a long-press operation on the "Payroll" icon 111, it changes the screen display from the state shown in Figure 2(b) to the state shown in Figure 2(c), which will be described later. In other words, when an application in normal mode detects a long-press operation on any icon displayed on the operation screen, it switches to assistant mode without executing the function corresponding to the operated icon.
[0041] Assistant mode is a mode that displays explanatory content corresponding to the function of the manipulated icon. This explanatory content includes text, shapes, or images that explain the function of the manipulated icon. It also includes data for an assistant character that can move around the operation screen. The assistant character data includes data for an object representing the assistant character. This object can consist of a still image or a video.
[0042] The timing of when explanatory content begins to be displayed will be explained using the example of when an application in normal mode detects a long press operation on an icon, or when an application in assistant mode detects a tap operation on an icon.
[0043] Figure 2(c) shows the application's operation screen displayed after the application in normal mode detects a long press operation on the "Payroll" icon 111. Note that the operation screens from Figure 2(c) to Figure 4(b), which will be described later, are screens when the application is in assistant mode.
[0044] In Assistant Mode, the application displays explanatory content, including text describing the function of the operated icon and an assistant character. Specifically, as shown in Figure 2(c), the application displays text describing the function of the "Paycheck" icon 111 that has been long-pressed in the text display area 220, and displays the assistant character 210.
[0045] In other words, the application accepts a long press on the "Payroll" icon 111, which triggers the transition to assistant mode, and displays explanatory content without accepting any subsequent taps on the same icon. The assistant character 210 is displayed in a predetermined position on the operation screen immediately after the application transitions to assistant mode.
[0046] The text display area 220 shown in Figure 2(c) is provided with a "Learn More" button 221 (sometimes referred to as an item). The "Learn More" button 221 has a link to access information that explains the content of the text in more detail. For example, when the application detects that the "Learn More" button 221 has been pressed, it controls the launch of a web browser. The launched web browser then displays a page explaining the function of the "Payroll" icon 111.
[0047] Alternatively, when the application detects that the "Learn More" button 221 has been pressed, it may expand the text display area 220 shown in Figure 2(c) and display additional text in the expanded area that provides a more detailed explanation of the function of the "Pay Your Salary" icon 111. For example, the application may display a text display area 230 as shown in Figure 2(d).
[0048] Figure 2(d) shows the application's operation screen with the text display area 220 shown in Figure 2(b) expanded. In Figure 2(d), the text display area 230 is displayed as a result of the expansion of the text display area 220. In addition to the text shown in Figure 2(c), the text display area 230 also displays text that explains the function of the "Payroll" icon 111 in more detail.
[0049] Additionally, the text display area 230 is provided with a "close" button 231. The "close" button 231 is a button that receives an instruction to return the text display area 230 to the state of the text display area 220. When the application detects that the "close" button 231 has been pressed, it returns the text display area 230 to the state of the text display area 220.
[0050] Figure 3(a) is a diagram illustrating how a user performs a tap operation on the "Asset Management" icon 113 in the operation screen shown in Figure 2(c). Specifically, Figure 3(a) is a diagram illustrating how a user performs a tap operation on the "Asset Management" icon 113 in assistant mode. When the application detects a tap operation on the "Asset Management" icon 113 shown in Figure 3(a), it displays the assistant character 210 in the vicinity of the tapped "Asset Management" icon 113, as shown in Figure 3(b). In this embodiment, the vicinity of the icon means a position within a predetermined range from the icon. Specifically, the position within the predetermined range can be set to a position within a predetermined number of pixels (px) from the center of the icon's graphic. Furthermore, the predetermined pixel can be a pixel corresponding to a distance longer than the longest distance from the center of the icon's graphic to the outer frame of the graphic.
[0051] In other words, the application displays the assistant character in a position that does not overlap with the manipulated icon (the first icon), but is as close to the first icon as possible. The application can also display the assistant character in a position that does not overlap with the manipulated first icon, nor with a second icon that is different from the first icon.
[0052] Figure 3(c) shows the application's operation screen in which the assistant character 210 is displayed near the "Asset Management" icon 113 that was tapped in the operation screen of Figure 3(a). As shown in Figure 3(c), the application displays text explaining the function of the tapped "Asset Management" icon 113 in the text display area 300.
[0053] Note that the method of displaying the assistant character is not limited to the method described above. For example, as shown in Figure 3(d), the application can move the assistant character 210 in a different direction than that shown in Figure 3(b). In such cases as well, the application displays the assistant character 210 in a position that does not overlap with the manipulated "Asset Management" icon 113, but is as close to the "Asset Management" icon 113 as possible. Figure 4(a) shows the result of moving the assistant character 210 in the direction shown in Figure 3(d).
[0054] Figure 4(a) shows the application's operation screen with the assistant character moved in the direction shown in Figure 3(d). In Figure 4(a), the assistant character 400 is displayed in a position that does not overlap with the operated "Asset Management" icon 113, but overlaps with the "Bank Loan" icon 112, which is different from the "Asset Management" icon 113.
[0055] Figure 4(b) illustrates how a user performs a long-press operation on the "Asset Management" icon 113 on the operation screen shown in Figure 3(c). When the application detects a long-press operation on the "Asset Management" icon 113, it changes the screen display from the state of the operation screen in Figure 4(b) to the state of the operation screen in Figure 1(c). In other words, when an application in assistant mode detects a long-press operation on any icon displayed on the operation screen, it switches to normal mode without displaying explanatory content explaining the function of the operated icon.
[0056] As described above, in this embodiment, when the application detects a long press operation on any icon in the normal mode state, it switches to assistant mode and displays explanatory content to explain the function of the operated icon. Alternatively, in this embodiment, when the application detects a long press operation on any icon in the assistant mode state, it switches to normal mode. Or, in the assistant mode state, when the application detects a press of the back button 150, it may forcibly exit assistant mode and switch to normal mode. In this case, after the press of the back button 150 is detected, the application transitions to the operation screen shown in Figure 1(a).
[0057] [2. Hardware configuration of the information processing device in this embodiment] Figure 5 shows an example of the hardware configuration of the information processing device 500 in this embodiment. In this embodiment, the information processing device 500 will be described using a smartphone as an example. However, the information processing device 500 in this embodiment is not limited to a smartphone, but may also be a desktop PC, notebook PC, PDA (Personal Digital Assistant), or tablet terminal.
[0058] The information processing device 500 includes a CPU 501, ROM 502, RAM 503, storage device 504, input / output interface (I / F) 505, and network I / F 506. These are connected to each other via a system bus. The information processing device 500 also includes a display unit 510 and an input unit 520. The display unit 510 and the input unit 520 are connected to the input / output I / F 505.
[0059] The CPU 501 controls the entire information processing unit 500. The CPU 501 may be an MPU (Micro Processing Unit) or an ASIC (application-specific integrated circuit). The CPU 501 may also be an FPGA (Field Programmable Gate Array), etc.
[0060] The CPU 501 reads various programs stored in the ROM 502 and the storage device 504 into the RAM 503, and executes the read programs to realize the various functions of the information processing device 500.
[0061] ROM 502 stores the startup program and control program for the information processing device 500. RAM 503 is the main memory of the CPU 501 and is used as working memory to temporarily store programs and other data.
[0062] The storage device 504 stores applications, various programs, and various data. The storage device 504 is, for example, an HDD (Hard Disk Drive), an SSD (Solid State Drive), flash memory, or storage. In this embodiment, the storage device 504 is located inside the information processing device 500, but it may be an external storage device or may be located in an external device connected to the information processing device 500 via a network N.
[0063] The display unit 510 receives control signals and image data output from the information processing device 500 via the input / output interface 505, and can display a screen or the like based on the instructions indicated by the control signals. For example, the display unit 510 is a display composed of liquid crystal or LEDs.
[0064] The input unit 520 can input control signals and various data to the information processing device 500 via the input / output interface 505. For example, the input unit 520 may be a button or an operation key. Alternatively, the input unit 520 may be a keyboard or a mouse.
[0065] In this embodiment, the display unit 510 and the input unit 520 are described as being provided in the information processing device 500, but they may be provided outside the information processing device 500. The input / output interface 505 may be configured as an input interface and an output interface.
[0066] In this embodiment, the display unit 510 and the input unit 520 are described as being integrated, such as in a display with a touch panel function, but the display unit 510 and the input unit 520 are not limited to this configuration. For example, the display unit 510 and the input unit 520 may be separate devices.
[0067] The network interface 506 connects the information processing device 500 to a WAN network N, such as a LAN or the Internet, via wired or wireless connection. The information processing device 500 can connect to the network N via wireless communication networks such as LTE (Long Term Evolution), 4G mobile communication systems, and 5G mobile communication systems, and communicate with other devices such as servers. The information processing device 500 can also connect to the network N via short-range wireless communication such as Bluetooth® and Wi-Fi, and communicate with other devices. The server is, for example, a server that performs payment processing and remittance processing in a payment application.
[0068] Furthermore, the information processing device 500 is not limited to the configuration described above. For example, the information processing device 500 may be equipped with a camera unit for acquiring images representing codes, or an audio unit capable of inputting and outputting sound.
[0069] The information processing device 500 may also be equipped with a media interface (not shown). The media interface reads programs and data stored in a storage device (not shown) connected by wire or wireless, and provides them to the CPU 501 via RAM 503. The CPU 501 can read the provided program from the storage device onto RAM 503 via the media interface and execute the read program. The storage device is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or PD (Phase Change Rewritable Disk), or a magneto-optical recording medium such as an MO (Magneto-Optical disk). Alternatively, the storage device may be a tape medium, a magnetic recording medium, or a semiconductor memory.
[0070] [3. Application Configuration of the Information Processing Device in This Embodiment] Figure 6 shows an example of the configuration of the application 600 in this embodiment, which is executed by the information processing device 500. The application 600 in this embodiment includes a display control unit 601, an operation unit 602, and a control unit 603.
[0071] (Regarding the display control unit) The display control unit 601 displays the operation screen of the application 600, and displays the application status or messages in a dialog box. The display control unit 601 can also acquire explanatory content corresponding to icons operated by the user and display the acquired explanatory content.
[0072] (Regarding the control panel) The operation unit 602 detects user operations on the operation screen of application 600 and identifies icons displayed on the operation screen of application 600 that have been operated by the user. The operation unit 602 functions as a reception unit that receives user operations on the operation screen of application 600.
[0073] (Regarding the control unit) The control unit 603 executes the functions of icons displayed on the operation screen of application 600 and controls the switching between the normal mode and assistant mode of application 600.
[0074] The information processing device 500 may include software and programs other than the application 600 described above. For example, the information processing device 500 may have a general-purpose web browser.
[0075] Application 600 may include a transmission unit for transmitting user identification information and electronic money amount information necessary for providing payment and money transfer services to a server that provides such services. Application 600 may also include a reception unit for receiving information necessary for providing the aforementioned services from the aforementioned server.
[0076] [4. An example of explanatory content displayed in the application] Figure 7 shows an example of a management table for managing explanatory content corresponding to icons displayed on the operation screen of application 600. In the management table shown in Figure 7, an icon ID 700, which uniquely identifies the icon displayed on the operation screen of application 600, is linked to the explanatory content 710 corresponding to that icon.
[0077] The explanatory content 710 includes text information that describes the function of the icon corresponding to icon ID 700. When the display control unit 601 displays the explanatory content on the operation screen of the application 600, it acquires text information as shown in Figure 8. A specific example of the text information shown in Figure 7 is shown in Figure 8.
[0078] Figure 8 shows an example of text information included in explanatory content 710 associated with A001(701). For illustrative purposes, the icon associated with A001(701) is the "salary receipt" icon.
[0079] The text content of Text Information 1 corresponds to the text displayed in the text display area 220 shown in Figure 2(c). The text content of Text Information 1 is set to explain the function of the "Payroll Receipt" icon in the simplest way possible. For example, the text content of Text Information 1 is set to text that represents the function of the "Payroll Receipt" icon within a predetermined number of characters.
[0080] Text information 2 contains text that explains the function of the "Payroll" icon, which is different from the text content of text information 1. Text information 3 contains text that encourages the user to use it in conjunction with other services provided by application 600.
[0081] In other words, the display control unit 601 acquires text information contained in the explanatory content corresponding to the icon operated when transitioning to assistant mode or while in that mode. The display control unit 601 then displays the acquired text information in the text display area.
[0082] Immediately after the operation unit 602 detects a user operation on an icon, the display control unit 601 may display all of the acquired text information in the text display area, or it may display only a portion of the acquired text information in the text display area.
[0083] For example, as shown in Figure 2(c), immediately after the operation unit 602 detects a user operation on the "Payroll" icon 111, the display control unit 601 displays the text content of text information 1 and the "Learn More" button 221. The operation unit 602 then detects a user operation on the "Learn More" button 221. In response to the detection of the user operation by the operation unit 602, the display control unit 601 displays the text content of text information 2 and text information 3 in addition to the text content of text information 1 that is currently displayed, as shown in Figure 2(d).
[0084] In this way, by displaying explanatory content immediately after a user interacts with an icon, concise text summarizing the icon's function is shown, allowing for an appropriate understanding of the function to be conveyed to the user. Furthermore, since no secondary information about the function of the interacted-with icon is displayed at this point, the function of the icon can be effectively communicated to the user.
[0085] The management table shown in Figure 7, the text content shown in Figure 8, and the assistant character data are explained using the example that they are saved in the storage device 504 of the information processing device 500 during the installation of application 600. However, the method of saving the management table, text content, and assistant character data is not limited to this. For example, the management table, text content, and assistant character data may be saved and managed on the server that provides application 600. In this case, the server can send this data to the information processing device 500 upon request from the information processing device 500.
[0086] [5. An example of the processing performed by the application in this embodiment] Figure 9 is a flowchart illustrating an example of the processing performed by application 600. The flowchart shown in Figure 9 is realized when the CPU 501 of the information processing device 500 loads the application 600 program stored in ROM 502 and storage device 504 into RAM 503 and executes the loaded program. This flowchart starts after application 600 is launched. As mentioned above, application 600 is in normal mode immediately after launch.
[0087] In S901, the display control unit 601 displays the operation screen of the application 600 and proceeds to S902. In this embodiment, the explanation will be given using as an example the case in which the display control unit 601 displays the operation screen shown in Figure 1(c) after a predetermined operation by the user.
[0088] In S902, if the application 600 is in normal mode, the operation unit 602 determines whether or not it detected a tap operation on an icon on the operation screen displayed by the display control unit 601 in S901. If the operation unit 602 determines in S902 that it detected a tap operation on an icon on the displayed operation screen (Yes), it proceeds to S905. If the operation unit 602 determines in S902 that it did not detect a tap operation on an icon on the displayed operation screen (No), it proceeds to S903.
[0089] In S903, if the application 600 is in normal mode, the operation unit 602 determines whether or not it detected a long press operation on an icon on the operation screen displayed by the display control unit 601 in S901. If the operation unit 602 determines in S903 that it detected a long press operation on an icon on the displayed operation screen (Yes), it proceeds to S907. If the operation unit 602 determines in S903 that it did not detect a long press operation on an icon on the displayed operation screen (No), it proceeds to S904.
[0090] In S904, if application 600 is in normal mode, the operation unit 602 determines whether an operation to terminate application 600 has been performed. If the operation unit 602 determines in S904 that an operation to terminate application 600 has been performed (Yes), it notifies the control unit 603 that the operation has been performed. The control unit 603 then executes the process to terminate application 600 and ends this flow.
[0091] If the operation unit 602 determines in S904 that no operation has been performed to terminate application 600 (No), it returns to S902. Here, the operation to terminate application 600 refers to, for example, the operation to close the operation screen of application 600.
[0092] In S905, when application 600 is in normal mode, the operation unit 602 identifies the icon that was targeted by the tap operation in S902 and proceeds to S906. Then, the operation unit 602 notifies the control unit 603 of the identified icon.
[0093] In S906, when application 600 is in normal mode, the control unit 603 executes the function of the icon notified in S905 and returns to S901. For example, the operation unit 602 detects a tap operation on the "Receive Salary" icon 111 displayed on the operation screen shown in Figure 1(c). In response to the detection of the tap operation by the operation unit 602, in S906 the control unit 603 instructs the display control unit 601 to display a viewing screen in which the monthly salary amount paid by the employer can be viewed. The display control unit 601 then displays the viewing screen in response to the instruction from the control unit 603. Furthermore, if the operation unit 602 detects an operation to close the viewing screen, the display control unit 601 controls the display to close the displayed viewing screen and display the operation screen shown in Figure 1(c).
[0094] In other words, in S906, the control unit 603 instructs each part included in the application 600 to perform processing corresponding to the function of the icon, or performs the processing itself.
[0095] In S907, the control unit 603 switches the application 600 from normal mode to assistant mode and proceeds to S908. In S908, with the application 600 in assistant mode, the operation unit 602 identifies the icon that was the target of the long-press operation in S903 and proceeds to S909. The operation unit 602 then notifies the display control unit 601 of the identified icon.
[0096] In S909, when application 600 is in assistant mode, the display control unit 601 acquires explanatory content corresponding to the "Asset Management" icon 113 and displays the acquired explanatory content. Then, the display control unit 601 proceeds to S910. Here, we will explain using the example that the icon targeted by the long-press operation is the "Asset Management" icon 113.
[0097] In this case, at S909, the display control unit 601 retrieves text information from the management table shown in Figure 7, which corresponds to the icon ID 700 associated with the "asset management" icon 113 identified by the operation unit 602, and contains the explanatory content 710. Also at S909, the display control unit 601 retrieves data for the assistant character.
[0098] Then, in S909, the display control unit 601 displays the text content of the acquired text information in the text display area 300, as shown in Figure 3(c), and displays the acquired assistant character 210 on the operation screen. At this time, if the initial display position of the assistant character 210 is not near the "Asset Management" icon 113, the display control unit 601 moves the assistant character to the vicinity of the icon while displaying it.
[0099] In S910, when application 600 is in assistant mode, the operation unit 602 determines whether or not it has detected a tap operation on an icon on the operation screen displayed by the display control unit 601. If in S910 the operation unit 602 determines that it has detected a tap operation on an icon on the displayed operation screen (Yes), the process proceeds to S908.
[0100] For example, as shown in Figure 3(a), with text and an assistant character explaining the function of the "Salary Receipt" icon 111 displayed, at S910 the operation unit 602 detects a tap operation on the "Asset Management" icon 113 and proceeds to S908 again. Then, at S908 the operation unit 602 identifies the tapped "Asset Management" icon 113 and proceeds to S909 again. After this, as shown in Figure 3(c), at S909 the display control unit 601 displays text and an assistant character explaining the function of the "Asset Management" icon 113 and proceeds to S910 again.
[0101] If the control unit 602 determines in S910 that it has not detected a tap operation on an icon on the displayed operation screen (No), the process proceeds to S911.
[0102] In S911, if application 600 is in assistant mode, the operation unit 602 determines whether or not it has detected a long press operation on an icon on the operation screen displayed by the display control unit 601. If in S911 the operation unit 602 determines that it has detected a long press operation on an icon on the displayed operation screen (Yes), the process proceeds to S913. If in S911 the operation unit 602 determines that it has not detected a long press operation on an icon on the displayed operation screen (No), the process proceeds to S912.
[0103] In S912, if application 600 is in assistant mode, the operation unit 602 determines whether an operation to terminate application 600 has been performed. If the operation unit 602 determines in S912 that an operation to terminate application 600 has been performed (Yes), it notifies the control unit 603 that the operation has been performed. The control unit 603 then executes the process to terminate application 600 and ends this flow.
[0104] If the operation unit 602 determines in S912 that no operation has been performed to terminate application 600 (No), it returns to S910. In S913, the control unit 603 switches application 600 from assistant mode to normal mode and returns to S901.
[0105] According to this embodiment, in response to a long press operation on an icon, the application switches to assistant mode and displays explanatory content corresponding to the function of the long-pressed icon. This allows the user to quickly grasp the function of the icon displayed on the application's operation screen, thereby improving usability.
[0106] For example, if an application's user interface displays many icons and the icons are difficult to see, displaying text explaining the function of each icon allows the user to understand that function.
[0107] In this embodiment, the mode of application 600 was described as being switched in response to a long press operation on an icon, but the switching method is not limited to this. For example, the method for switching the mode of application 600 may be a tap operation on the icon, or a double tap operation on the icon. Alternatively, the method for switching the mode of application 600 may be a flick operation in which the cursor is moved in a predetermined direction after pressing the icon. In other words, the method for switching the mode of application 600 may be a second operation different from the first operation for executing the icon's function in normal mode or displaying explanatory content for the icon's function in assistant mode.
[0108] <Second Embodiment> In the first embodiment, the mode of application 600 was described as being switched in response to a long press operation on an icon. However, a user may accidentally perform a long press operation when intending to perform a tap operation. In this case, the mode of application 600 may be switched, which may result in an unexpected outcome for the user. Therefore, in this embodiment, a button for switching the mode of application 600 is provided on the operation screen, and a method for switching the mode in response to the pressing of this button will be described. Note that the basic configuration of the information processing device 500 and application 600 in this embodiment is the same as the configuration described in the first embodiment, so a detailed explanation will be omitted. The differences from the first embodiment will be described below.
[0109] Figure 10 shows an example of the operation screen of application 600 in this embodiment. Figure 10(a) shows the operation screen of application 600 in normal mode in this embodiment. Figure 10(b) shows the operation screen of application 600 in assistant mode in this embodiment.
[0110] The operation screen in Figure 10(a) is provided with an assistant mode button 1000 that accepts an instruction to switch to assistant mode, compared to the operation screen in Figure 1(c) in the first embodiment. When the operation unit 602 detects that the user has pressed the assistant mode button 1000, the display control unit 601 displays the operation screen in Figure 10(b).
[0111] The operation screen in Figure 10(b) is provided with a normal mode button 1010 that accepts an instruction to switch to normal mode, compared to the operation screen in Figure 2(c) in the first embodiment. Also, the operation screen in Figure 10(b) does not display the text display area 220, compared to the operation screen in Figure 2(c) in the first embodiment. Thus, if the operation unit 602 has not detected an operation on the icon before the mode transition, the display control unit 601 displays the assistant character in its initial position.
[0112] Then, when the operation unit 602 detects that the user has pressed the normal mode button 1010 in the state shown in Figure 10(b), the display control unit 601 displays the operation screen shown in Figure 10(a). That is, when the operation of the mode switching button provided on the operation screen of the application 600 is detected, the control unit 603 switches the mode of the application 600.
[0113] In this embodiment, we will explain using the example that the function of the operated icon is executed regardless of whether a tap operation or a long press operation is detected on the operation screen of Figure 10(a). Specifically, when the operation unit 602 detects a tap operation or a long press operation on the "Send / Receive" icon 121 on the operation screen of Figure 10(a), the display control unit 601 displays the operation screen of Figure 2(a).
[0114] Furthermore, we will explain using the example that when either a tap or long press operation is detected on an icon on the operation screen in Figure 10(b), text describing the function of the operated icon is displayed. Specifically, when the operation unit 602 detects a tap or long press operation on the "Payroll" icon 111 on the operation screen in Figure 10(b), the display control unit 601 displays text as shown in Figure 2(c) in addition to the currently displayed assistant character.
[0115] According to this embodiment, by providing a mode switching button on the application's operation screen, it is possible to suppress unexpected results caused by user errors while achieving the same effects as in the first embodiment. This improves usability.
[0116] In this embodiment, the mode of the application 600 is switched in response to the press of a button on the operation screen shown in Figure 10. Furthermore, the process corresponding to each mode is executed regardless of whether a tap or long press operation is detected on an icon on the operation screen shown in Figure 10. However, the method of switching modes is not limited to this.
[0117] For example, the mode switching method of the first embodiment may also be applied in this embodiment. Specifically, when a press operation on the assistant mode button 1000 provided on the operation screen of Figure 10(a) or a long press operation on an icon on the operation screen of Figure 10(a) is detected, the application 600 switches from normal mode to assistant mode. Also, when a press operation on the normal mode button 1010 provided on the operation screen of Figure 10(b) or a long press operation on an icon on the operation screen of Figure 10(b) is detected, the application 600 switches from assistant mode to normal mode.
[0118] For example, if the application 600 detects a press on the assistant mode button 1000 on the operation screen shown in Figure 10(a), it switches from normal mode to assistant mode. Subsequently, if it detects a long press on an icon on the operation screen shown in Figure 10(b), the application 600 switches from assistant mode to normal mode. Conversely, if it detects a long press on an icon on the operation screen shown in Figure 10(a), the application 600 switches from normal mode to assistant mode. Subsequently, if it detects a press on the normal mode button 1010 on the operation screen shown in Figure 10(b), the application 600 switches from assistant mode to normal mode.
[0119] In other words, the operation for switching from the first mode to the second mode may be different from the operation for switching from the second mode to the first mode. By providing multiple methods for switching application modes in this way, the degree of freedom that users have in operating the application can be increased.
[0120] <Third Embodiment> In the first embodiment, an example was given of displaying text in the text display area that explains the function of the operated icon. However, users may want a more detailed explanation than the text explanation, or an explanation different from the text explanation. Therefore, in this embodiment, a method for displaying text that explains the services provided by the application using AI will be described. Note that the basic configuration of the information processing device 500 and the application 600 in this embodiment is the same as the configuration described in the first and second embodiments, so a detailed explanation will be omitted. The differences from the first and second embodiments will be described below.
[0121] Figure 11 shows an example of a screen for displaying text explaining the services provided by application 600 using an AI assistant. The screen in Figure 11 shows an input area 1100 for entering questions to be asked of the AI assistant. For example, the AI program that explains the services provided by application 600 is stored in the storage device 504 when application 600 is installed. Alternatively, the AI program may be held by a server (not shown), and application 600 of the information processing device 500 may obtain the processing results of the AI program from the server.
[0122] The user can input information about a service provided by the application 600 that they wish to receive an explanation of from the AI into the input area 1100. For example, the user might input the string "What is salary payment?" into the input area 1100. The control unit 603 then executes the AI program to analyze the meaning of the string entered in the input area 1100 and generates text explaining the "salary payment" service as a result of the analysis. Furthermore, the control unit 603 passes the text generated by the AI program to the display control unit 601. The display control unit 601 displays the text received from the control unit 603 on the screen shown in Figure 11.
[0123] Furthermore, when the control unit 603 executes the AI program to generate text, it may generate text that differs from the text content of the text information included in the explanatory content of the management table shown in Figure 7. Also, when the control unit 603 executes the AI program to generate text, it may generate text that differs from the text content of the text information in the management table, in addition to the text corresponding to the text information of said text table.
[0124] According to this embodiment, the AI assistant generates and displays text that describes the services provided by the application that the user requests an explanation for. This makes it possible to provide users with explanations about services that cannot be expressed in the explanation content managed in the management table.
[0125] <Other Embodiments> In the above-described embodiment, application 600 was described as controlling the switching between normal mode and assistant mode by long-pressing an icon or pressing a mode switching button. However, the method of switching modes is not limited to this. For example, application 600 may control the switching of modes using a timer.
[0126] Specifically, in assistant mode, when the operation unit 602 detects a user operation on the operation screen of application 600, the control unit 603 starts a timer. If the operation unit 602 does not detect a user operation on the operation screen, and a predetermined time (for example, about 3 minutes) has elapsed since the timer was started, the control unit 603 controls the application 600 to switch from assistant mode to normal mode. In other words, if no user operation is performed on the operation screen within the predetermined time, the control unit 603 controls the application 600 to switch from assistant mode to normal mode.
[0127] If the user does not interact with the application 600's interface within a specified time, it is assumed that the user has already fully understood the services provided by the application. In such a situation, the user's operational burden can be reduced by automatically switching to normal mode based on the condition that there is no interaction with the interface within a specified time.
[0128] In the embodiment described above, the display of explanatory content was explained as an example on the operation screen of application 600 that appears after the "All" icon 104 is pressed (for example, Figure 1(c)). However, the screen on which explanatory content can be displayed is not limited to the operation screen of application 600 that appears after the "All" icon 104 is pressed.
[0129] For example, explanatory content may be displayed on the operation screen after the application 600 has been launched, as shown in Figure 1(a) or Figure 1(b). As an example, if the operation unit 602 detects a long press operation on any of the icons displayed in the icon display area 103, the display control unit 601 displays explanatory content consisting of text and an assistant character. Then, after transitioning to assistant mode, if the operation unit 602 detects a long press operation on any of the icons displayed in the icon display area 103, similar to the embodiment described above, the control unit 603 performs control to transition to normal mode.
[0130] Furthermore, the explanation may include not only the icons displayed on the operation screen after the application 600 is launched, as shown in Figure 1(a) or Figure 1(b), but also the code display area 101, the payment / remittance function display area 102, and the balance display area 105.
[0131] For example, in Assistant Mode, when the 2D code in the code display area 101 shown in Figure 1 is tapped, text explaining how to use the 2D code may be displayed. Also, in Assistant Mode, when the "Scan" button in the payment / remittance function display area 102 shown in Figure 1 is tapped, text explaining the function of the "Scan" button may be displayed.
[0132] In the above-described embodiment, the application 600 was described as displaying text in the text display area in assistant mode. However, the method of outputting text is not limited to this. For example, as a method of outputting text, the application 600 may display text and output the content of the text as audio. Alternatively, the application 600 may output the content of the text as audio without displaying the text. For example, the control unit 603 controls the output of the text content as audio via the audio unit.
[0133] Furthermore, in the third embodiment, an example was given in which the user inputs information about a service provided by the application 600 that the AI would like to explain into the input area 1100, but the input method is not limited to this. For example, the control unit 603 may receive questions about the services provided by the application 600 via voice through the audio unit.
[0134] Furthermore, the configuration of the aforementioned information processing device 500 can be flexibly changed, for example, by calling external platforms via APIs or network computing depending on the function.
[0135] Furthermore, the embodiments described above can be combined as appropriate, as long as the processing content is not contradictory. [Explanation of Symbols]
[0136] 500 Information Processing Devices 600 applications
Claims
1. A program for an application executed by an information processing device, The aforementioned information processing device A receiving unit capable of receiving a first operation on the screen of the application that displays the icon, and a second operation different from the first operation, In the first mode, upon receiving the first operation for the first icon displayed on the screen at the reception unit, the function of the first icon is executed. In the first mode, the control unit performs control to transition to a second mode in which explanatory content corresponding to the icon displayed on the screen is displayed, in response to the reception unit receiving the second operation. A program characterized by its ability to function in a certain way.
2. The program according to claim 1, characterized in that the control unit, in response to the reception unit receiving the second operation for the first icon in the first mode, transitions to the second mode and performs control to display explanatory content corresponding to the first icon.
3. The program according to claim 1, characterized in that the control unit performs control to switch to the first mode in response to the reception unit receiving the second operation in the second mode.
4. The program according to claim 2, characterized in that the control unit performs control to display explanatory content corresponding to the second icon in response to the reception unit receiving the first operation for the second icon displayed on the screen in the second mode.
5. The program according to claim 2, characterized in that the descriptive content includes first text describing the function of the icon.
6. The program according to claim 5, characterized in that the first text is set to describe the function of the icon within a predetermined number of characters.
7. The aforementioned explanatory content includes items for displaying a more detailed explanation of the function of the aforementioned icon, The program according to claim 6, characterized in that, in response to the reception unit receiving an operation on the item, the control unit performs control to display a second text, which is a detailed explanation text, in addition to the first text.
8. The program according to claim 7, wherein the explanatory content further includes an object representing an assistant character for explaining the function of the icon.
9. The program according to claim 8, characterized in that the control unit displays the object at a predetermined position on the screen immediately after transitioning to the second mode.
10. The program according to claim 8, wherein the control unit further performs control to move the object to the vicinity of the second icon in response to the reception unit receiving the first operation on the second icon on the screen in the second mode.
11. The first operation is a tap operation, The program according to claim 8, characterized in that the second operation is a long press operation.
12. The program according to claim 11, characterized in that the control unit performs control to transition from the second mode to the first mode in response to a third operation different from the first and second operations.
13. The program according to claim 12, characterized in that the third operation is an operation in which no operation is performed on the screen for a predetermined period of time.
14. The screen in the first mode is provided with a first button for switching to the second mode. The program according to claim 11, characterized in that the second operation is the first operation on the first button.
15. The screen in the second mode is provided with a second button for switching back to the first mode. The program according to claim 14, characterized in that the control unit performs control to transition from the second mode to the first mode in response to the reception unit receiving the first operation for the second button.
16. The program according to claim 14, characterized in that the control unit performs control to display the explanatory content corresponding to the first icon when the reception unit has received the first operation for the first button and the reception unit has received the first operation for the first icon as the second operation.
17. The control unit, As the second operation, when the reception unit receives the first operation for the first button, the object is displayed as the explanatory content. The program according to claim 14, characterized in that, after displaying the object, if the reception unit receives the first operation for the first icon, it performs control to display the first text describing the function of the first icon.
18. The control unit, Upon receiving the first operation for the first button at the reception unit, control is performed to transition from the first mode to the second mode. The program according to claim 15, characterized in that, in response to the reception unit receiving the first operation for the second button, it performs control to transition from the second mode to the first mode.
19. The program according to claim 1, characterized in that the aforementioned icon is a mini-application that runs on the aforementioned application.
20. The program according to claim 1, characterized in that the application is an application that provides a payment service for transferring electronic money from a first account held by a first user to the store's store account in order to pay for the purchase of goods or provision of services at the store, and a remittance service for transferring the electronic money from the first account to a second account held by a second user.
21. An information processing device for executing an application, A receiving unit capable of receiving a first operation on the screen of the application that displays the icon, and a second operation different from the first operation, In the first mode, upon receiving the first operation for the first icon displayed on the screen at the reception unit, the function of the first icon is executed. In the first mode, the control unit performs control to transition to a second mode in which explanatory content corresponding to the icon displayed on the screen is displayed, in response to the reception unit receiving the second operation. An information processing device characterized by comprising:
22. A method for controlling an information processing device that executes an application, A reception step capable of receiving a first operation on the screen of the application that displays the icon, and a second operation different from the first operation, In the first mode, in response to receiving the first operation on the first icon displayed on the screen during the reception process, the function of the first icon is executed. A control step is performed to perform control to transition to a second mode in which explanatory content corresponding to the icon displayed on the screen is displayed, in response to the acceptance of the second operation in the first mode in the acceptance step. A control method for an information processing device, characterized by having the following features.