Proposal device, proposal method, and proposal program
The proposal device calculates user urgency through voice and operational analysis to provide tailored responses, addressing the limitations of conventional systems by offering appropriate coping methods, enhancing user interaction and system responsiveness.
Patent Information
- Application Number
- PCT/JP2024/016625
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-30
- Filing Date
- 2024-04-30
- Publication Date
- 2024-12-05
AI Technical Summary
Conventional information processing systems struggle to dynamically respond to user situations, particularly in emergency contexts, as they rely solely on voice input to assess urgency, which may not be appropriate for diverse user interactions and complex systems.
A proposal device and method that calculates the user's degree of urgency based on usage status, selecting and presenting appropriate coping methods from a variety of options, including voice, gesture, and social interactions, to provide tailored responses.
Enables flexible and dynamic system responses that meet user expectations by determining the urgency level through voice analysis and operational data, offering immediate solutions or comprehensive help content based on the user's situation, thereby improving user experience.
Smart Images

Figure JP2024016625_05122024_PF_FP_ABST
Abstract
Description
Proposal device, proposal method, and proposal program
[0001] The present disclosure relates to a suggestion device, a suggestion method, and a suggestion program that can appropriately present a response that is suited to a user's situation.
[0002] With the development of information processing technology, opportunities for users to utilize information devices equipped with information processing systems are increasing. With the development of technology, when users input commands or information to information processing systems, they can use various input means such as voice input and gesture input in addition to input devices such as keyboards and mice. Furthermore, the systems themselves can not only display information on a display but also communicate with users through voice output and other means, enabling a variety of expressions.
[0003] In this regard, a technique is known in which the urgency level of a user is estimated based on the user's voice, and the content of a response to the user is changed accordingly.
[0004] Japanese Patent Application Laid-Open No. 2020-86943
[0005] According to conventional technology, the level of urgency is estimated based on the user's voice, so the user can interact with the system according to the situation without having to input to the system that they are in an emergency.
[0006] However, users' situations vary, and it may not always be appropriate to estimate the urgency based on voice information alone. For example, as the number of users using a system increases and the system becomes more complex, the system may have input means other than voice, or the available input means may differ depending on the application within the system.
[0007] In other words, it is desirable for an information processing system to be able to respond flexibly and dynamically according to the user's situation.Furthermore, it is desirable for the system to provide responses in the content and format desired by the user according to the user's situation.
[0008] Therefore, the present disclosure proposes a suggestion device, a suggestion method, and a suggestion program that can appropriately present a response that is suited to the user's situation.
[0009] In order to solve the above problem, a proposal device according to one embodiment of the present disclosure includes a reception unit that receives a request input by a user to an information processing system, and a proposal unit that, when the request is received, calculates the urgency of the user based on the user's usage status in the information processing system, and selects and proposes a solution to be presented to the user from among multiple solutions related to the request according to the calculated urgency.
[0010] FIG. 1 is a diagram illustrating an overview of a proposal process according to an embodiment. FIG. 2 is a diagram for explaining the proposal process according to an embodiment. FIG. 3 is a diagram illustrating an example of a configuration of a proposal device according to an embodiment. FIG. 4 is a diagram illustrating an example of a user information storage unit according to an embodiment. FIG. 5 is a flowchart (1) illustrating an example of a procedure of a proposal process according to an embodiment. FIG. 6 is a flowchart (2) illustrating an example of a procedure of a proposal process according to an embodiment. FIG. 7 is a diagram illustrating a variation of a calculation process according to an embodiment. FIG. 8 is a diagram illustrating a variation of a display control process according to an embodiment. FIG. 9 is a diagram illustrating a variation of a display control process according to an embodiment. FIG. 10 is a diagram illustrating a variation of a display control process according to an embodiment. FIG. 11 is a diagram illustrating a variation of a display control process according to an embodiment. FIG. 12 is a diagram illustrating a variation of a display control process according to an embodiment. FIG. 13 is a diagram illustrating a variation of a display control process according to an embodiment. FIG. 14 is a diagram illustrating a variation of a display control process according to an embodiment.
[0011] Hereinafter, embodiments will be described in detail with reference to the drawings. In the following embodiments, the same components are designated by the same reference numerals, and redundant description will be omitted.
[0012] The present disclosure will be described in the following order: 1. Embodiment 1-1. Overview of proposal processing according to embodiment 1-2. Configuration of proposal device according to embodiment 1-3. Procedure of proposal processing according to embodiment 1-4. Variations of proposal processing 1-5. Modified example 1-5-1. Device configuration 1-5-2. Input to the system 1-5-3. System aspects 1-5-4. Aspects of proposal of countermeasures (help content) 2. Other embodiments 3. Effects of proposal device according to the present disclosure 4. Hardware configuration
[0013] (1. Embodiment) (1-1. Overview of Proposal Process According to Embodiment) Fig. 1 is a diagram showing an overview of proposal process according to an embodiment. The proposal process according to the embodiment is realized by a proposal device 100 shown in Fig. 1.
[0014] The proposal device 100 is an example of an information processing device that executes the proposal process according to the embodiment. For example, the proposal device 100 may be a video game console such as a game machine, a cloud server or personal computer (PC) connected to a network, a smartphone, or a tablet terminal. The proposal device 100 may also be a smart home appliance such as a television or a wearable device such as a smart watch, as long as it has the functions described below. In the example of FIG. 1 , the proposal device 100 is an information processing device equipped with a voice agent capable of voice dialogue with the user 10 and capable of displaying various information on a connected display.
[0015] The user 10 is a user who uses an information processing system (hereinafter simply referred to as the "system") provided by the proposal device 100. The system provided by the proposal device 100 functions as a so-called OS (Operating System), for example, running installed game apps, video viewing apps, etc., and controlling message sending to other users and chat functions. The user 10 can input various instructions (referred to as "commands," etc.) to the system using a controller 20, which is an example of an input device. For example, the user 10 can operate the controller 20 to search for friends (friend users) connected to the network or search for videos they want to watch. In the following description, the user who inputs commands to the proposal device 100 will be referred to as the "user 10" to distinguish him or her from other users (friends) connected to the user 10 via the network.
[0016] In recent years, with the development of technologies such as voice dialogue and image recognition, the user 10 can now give commands to a system using voice commands or gesture commands without using a physical input device such as the controller 20. For example, the user 10 can use the voice recognition function of the proposal device 100 to utter commands such as "search for a video," "open a game app," or "send a message to another user," thereby launching an app or interacting with other users.
[0017] For example, the user 10 can input various requests to the proposal device 100 using voice, even while playing game content (hereinafter simply referred to as a "game"). As an example, the user 10 can input a request for some kind of solution when he or she becomes unsure of how to operate the game while playing, when he or she is stuck in the game, or when he or she finds it difficult to beat the game. Such solutions are, for example, called help information, and are realized by a help file officially provided by the game provider. For example, the user 10 can activate and display help information by vocalizing a preset command (such as a word like "Help").
[0018] However, solutions to problems in games and the like are not limited to official help information, and various other means are possible, such as walkthrough videos and websites provided as web content, or asking one's friends for help (hereinafter, such means and solutions may be collectively referred to as "help content"). User 10 can refer to official help information when he or she has time to play, but during the course of playing a game that requires immediacy, there may be times when user 10 wants to know a solution as quickly as possible or a means to quickly improve the current playing situation.
[0019] Currently, the user 10 has to think of ways to deal with these issues on his or her own and input requests accordingly into the system. As a result, in situations where immediacy is required (for example, while playing a game), the user 10 may find himself or herself in a situation where he or she is unable to utilize requests for help content or is unable to receive the desired solution.
[0020] In other words, when a request for help content is made to the system, it is desirable that the proposed content be highly useful to the user 10 and be executed in a manner that does not interfere with playing a game or the like.
[0021] Therefore, the proposal device 100 according to the present disclosure solves the above problem by the following process. That is, the proposal device 100 accepts a request input by the user 10 to the system, and when accepting the request, calculates the urgency of the user 10 based on the user's usage status in the system. Then, the proposal device 100 selects and proposes a solution to be presented to the user 10 from among multiple solutions related to the request, according to the calculated urgency.
[0022] For example, if the urgency is lower than a predetermined value, i.e., if the user 10 playing the game seems to have time to spare, the suggestion device 100 suggests viewing official help content in response to a request for help content from the user 10. On the other hand, if the urgency is higher than a predetermined value, i.e., if the user 10 wants to resolve the current situation as soon as possible, the suggestion device 100 suggests a more immediate solution, such as inviting the user 10's friend to play the game together to solve the problem.
[0023] In this way, the proposal device 100 dynamically changes and proposes a solution to be presented to the user 10 from among a plurality of solutions, depending on the situation when the user 10 makes a voice input. As a result, even if the user 10 makes the same request, such as "I want to obtain help content," the proposal device 100 can propose a solution that is suited to the situation at hand and meets the expectations of the user 10.
[0024] An overview of the proposal process according to the embodiment will be described below using the example shown in Fig. 1. The example in Fig. 1 shows a situation in which a user 10 is using a controller 20 to play a game being executed on a proposal device 100.
[0025] When the user 10 needs some help while playing a game, the user 10 performs a voice input to the proposing device 100 to search for a solution. For example, the user 10 issues a preset voice command 30 such as "Help My Game."
[0026] When the proposing device 100 receives the input of the voice command 30, it determines the situation of the user 10 who is playing the game (step S10).
[0027] As an example, the proposal device 100 calculates the urgency of the user 10, which is a value indicating how quickly the user 10 wants to take action, as the situation of the user 10. Specifically, the proposal device 100 calculates the urgency of the user 10 based on voice information of the voice command 30 issued by the user 10.
[0028] Thereafter, the proposal device 100 determines the situation of the user 10 based on the calculated urgency level, and then provides the user 10 with help content according to the situation (step S11).
[0029] For example, if the user 10 wants to deal with the gameplay as soon as possible, the proposing device 100 may suggest to the user 10 an immediate solution, such as inviting the user's 10 online friends to play the game. On the other hand, if the proposing device 100 determines that the urgency is low and the user 10 has time to take time to look up solutions, the proposing device 100 may suggest to the user 10 static and comprehensive help content, such as official help content.
[0030] The process shown in Fig. 1 will be described in more detail with reference to Fig. 2. Fig. 2 is a diagram for explaining the proposal process according to the embodiment.
[0031] In FIG. 2, the user 10 inputs a voice command 30 to the proposing device 100 by issuing the voice command 30, as in FIG.
[0032] The proposal device 100 analyzes acoustic parameters of the voice included in the voice command 30 and acquires the analyzed information (step S20). Specifically, the proposal device 100 acquires the speaking rate, volume, pitch, etc. of the voice uttered by the user 10.
[0033] In addition, the proposed device 100 acquires acoustic parameters of the user 10's normal speech from the database 40, such as voice data when the user 10 previously registered the voice command 30 and data of the user 10's normal speech.
[0034] The proposal device 100 then compares the input voice command 30 with the acoustic parameters of the user 10 in normal situations and obtains the difference therebetween (step S21). Subsequently, the proposal device 100 calculates the urgency of the user 10 based on the obtained difference (step S22).
[0035] For example, the proposing device 100 calculates the urgency level using the following formula (1): S_emrg = a * speed_diff + b * vol_diff + c * pitch_diff (1)
[0036] In the above formula (1), "S_emrg" indicates the urgency of the user 10. Furthermore, "speed_diff" indicates the difference in speaking speed between when the voice command 30 is input and when normal. "vol_diff" indicates the difference in volume between when the voice command 30 is input and when normal. "pitch_diff" indicates the difference in pitch between when the voice command 30 is input and when normal. "a", "b", and "c" indicate coefficients for weighting. Note that the above formula (1) is an example of calculating the urgency, and the proposed device 100 may use acoustic parameters other than those exemplified in the calculation process. Furthermore, the method for calculating the difference between each acoustic parameter may use known technology as appropriate.
[0037] Then, the proposing device 100 selects help content that suits the situation of the user 10 based on the calculated urgency (step S23).
[0038] At this time, the suggestion device 100 acquires related information 50 linked to the user 10 and the game. The related information 50 includes friend information 51 indicating online friends of the user 10, help content 52 linked to the game, and the like.
[0039] The proposing device 100 refers to the related information 50 and selects the most appropriate solution (help content) that can be proposed to the user 10. The data table 60 shows candidates for help content that the proposing device 100 presents to the user 10.
[0040] Examples of help content shown in the data table 60 include registered solutions such as "invite a friend to the game" and "start a voice chat with a friend" when the urgency level is higher than a predetermined value. That is, if the user 10 desires a quick solution in the game, the suggestion device 100 suggests to the user 10 a solution such as inviting an online friend of the user 10 to the game and having them solve the problem together. Alternatively, the suggestion device 100 suggests to the user 10 a solution such as starting a voice chat with the online user 10 and asking the friend for a solution. When suggesting such a solution, the suggestion device 100 confirms that the friend is online and available to participate in the game (is not busy). If the friend is busy, the suggestion device 100 selects another solution as the solution to suggest to the user 10.
[0041] As another example of help content shown in the data table 60, when the level of urgency is medium, measures such as "send a text message to a friend" and "post a message on a social networking service (SNS) used by the user 10" are registered. That is, when the level of urgency of the user 10 is medium, the proposal device 100 suggests to the user 10 a measure such as sending a message to a friend of the user 10 who is online and having the friend reply with a solution. Alternatively, the proposal device 100 suggests to the user 10 a measure such as posting a message on the SNS and waiting for a solution to be provided on the SNS. For example, when the user 10 has an online friend, the proposal device 100 may suggest to the user 10 a measure such as "send a text message to a friend," and when the user 10 has no online friend, the proposal device 100 may suggest to the user 10 a measure such as "post a message on the SNS."
[0042] As another example of help content shown in the data table 60, when the level of urgency is low, measures such as "display official help content provided by the company that sold the game" and "search the web for game walkthrough information, etc." are registered. That is, when the level of urgency for the user 10 is lower than a predetermined value and no urgency is required, the proposal device 100 displays official help content and suggests to the user 10 a measure such as the user 10 searching for a solution from the help content. Alternatively, the proposal device 100 suggests to the user 10 a measure such as searching for information on a website, etc., related to the game. For example, when official help content is registered, the proposal device 100 may suggest to the user 10 a measure such as "display official help content" to the user 10, and when official help content is not registered, the proposal device 100 may suggest to the user 10 a measure such as "search the web for game walkthrough information, etc."
[0043] As described above, the proposal device 100 selects, according to the urgency level, a solution to be presented to the user 10 from among a plurality of solutions registered as help content. Then, the proposal device 100 proposes the selected one or more solutions to the user 10 (step S24).
[0044] In this way, when the suggestion device 100 receives a request from the user 10 to provide a solution, the suggestion device 100 does not simply provide information about the game to the user 10, but suggests help content from among multiple solutions that is suited to the situation of the user 10. In this way, the suggestion device 100 can accurately provide the information desired by the user 10.
[0045] (1-2. Configuration of Proposal Device According to Embodiment) Next, a description will be given of the configuration of the proposal device 100. Fig. 3 is a diagram showing an example of the configuration of the proposal device 100 according to the embodiment.
[0046] 3, the proposal device 100 includes a communication unit 110, a storage unit 120, and a control unit 130. The proposal device 100 may also include an input unit (e.g., a microphone, a keyboard, a touch display, etc.) that accepts various operations from an administrator who manages the proposal device 100, a user 10, etc., and a display unit (e.g., a liquid crystal display, etc.) that displays various information.
[0047] The communication unit 110 is realized by, for example, a network interface card (NIC) or a network interface controller. The communication unit 110 is connected to a network N by wire or wirelessly, and transmits and receives information to and from the controller 20, external devices, etc. via the network N. The network N is realized by a wireless communication standard or method such as Bluetooth (registered trademark), the Internet, Wi-Fi (registered trademark), UWB (Ultra Wide Band), or LPWA (Low Power Wide Area).
[0048] The storage unit 120 is realized by, for example, a semiconductor memory element such as a random access memory (RAM) or a flash memory, or a storage device such as a hard disk or an optical disk.
[0049] The storage unit 120 stores various information for performing the proposal processing according to the embodiment. The storage unit 120 also stores programs such as apps that function in the system and various data used in the processing. In the embodiment, the storage unit 120 includes an utterance information storage unit 121, a user information storage unit 122, and a proposal information storage unit 123.
[0050] The utterance information storage unit 121 stores utterance information uttered by a user who uses the system. For example, the utterance information storage unit 121 stores utterance information of the user 10 when registering the user who uses the system. The utterance information includes, for example, acoustic parameters of the user 10's normal utterance. For example, when calculating the urgency level of the user 10, the proposal device 100 refers to the information of the user 10's normal utterance stored in the utterance information storage unit 121.
[0051] The user information storage unit 122 stores information about users who use the system. Fig. 4 shows an example of information stored in the user information storage unit 122. Fig. 4 is a diagram showing an example of the user information storage unit 122 according to an embodiment. As shown in Fig. 4, the user information storage unit 122 has items such as "user ID," "friend list," "current SNS," and "owned game list."
[0052] "User ID" indicates identification information that identifies a user who uses the system or a specific game. "Friend List" indicates other users who are registered as friends of user 10. "SNS in Use" indicates the SNS used by user 10, and indicates the name and link destination of the SNS linked to the system. "Owned Game List" indicates games owned by user 10, and indicates information on games that run on the system.
[0053] The proposed information storage unit 123 stores information related to proposed information proposed by the proposal device 100 when the user 10 requests help content. For example, the proposed information storage unit 123 stores the content of the help content proposed to the user 10, conditions for selecting the help content, etc. The proposed information storage unit 123 corresponds to, for example, the data table 60 shown in FIG. 2 .
[0054] 3, the explanation will be continued. The control unit 130 is realized by, for example, a central processing unit (CPU), a micro processing unit (MPU), a GPU, or the like executing a program stored inside the proposed device 100 (for example, the proposed program according to the present disclosure) using a RAM or the like as a work area. The control unit 130 is a controller, and may be realized by, for example, an integrated circuit such as an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA).
[0055] 3 , the control unit 130 includes a receiving unit 131 and a proposing unit 132. The proposing unit 132 includes an acquiring unit 133, a calculating unit 134, a determining unit 135, and an output control unit 136.
[0056] The reception unit 131 receives a request input to the system by the user 10. Specifically, the reception unit 131 recognizes voice information uttered by the user 10 and receives a request for help content from the user 10 to the system. More specifically, the reception unit 131 receives a request for help content for a game running on the system.
[0057] When a request from user 10 is accepted, the suggestion unit 132 determines the urgency of user 10 based on the user's usage status in the system, and selects and suggests a solution to be presented to user 10 from among multiple solutions related to the request according to the determined urgency.
[0058] The suggestion unit 132 has an acquisition unit 133, a calculation unit 134, a determination unit 135, and an output control unit 136, and executes the suggestion process according to the embodiment by controlling each processing unit. The acquisition unit 133, for example, acquires the usage status of the user 10 in the system. The calculation unit 134 calculates the urgency of the user 10 based on the usage status. The determination unit 135 determines the solution to be presented to the user 10 (e.g., which help content to present) based on the calculated urgency. The output control unit 136 controls the output of the solution to be presented to the user 10. For example, the output control unit 136 controls the system to display the help content on a screen and to produce audio related to the help content.
[0059] For example, the suggestion unit 132 calculates the level of urgency based on a comparison between the voice of the user 10 when inputting a request and the voice of the user 10 under normal circumstances. Furthermore, depending on the level of urgency, the suggestion unit 132 suggests to the user 10, among other measures, contacting the user 10's friends in the game, posting the content of the request on a network (SNS, etc.), displaying official help content linked to the game, etc.
[0060] The suggestion unit 132 may perform suggestion processing according to the status of a friend of the user 10. For example, when a friend of the user 10 is online, that is, when the friend is likely to be able to join the game of the user 10 soon, the suggestion unit 132 may suggest to the user 10 that the friend invite the friend to a game. Alternatively, when a friend of the user 10 is offline or busy (for example, playing another game), the suggestion unit 132 may suggest to the user 10 that the friend send a message.
[0061] Furthermore, when proposing a solution, if the user 10 has already viewed official help content associated with the game within a certain period of time, the suggestion unit 132 may suggest a solution other than the official help content to the user 10. This allows the suggestion unit 132 to avoid proposing duplicate solutions to the user 10 and to suggest more useful information.
[0062] (1-3. Procedure of Proposal Processing According to the Embodiment) The flow of the proposal processing according to the embodiment will be described with reference to Fig. 5 and Fig. 6. Fig. 5 is a flowchart (1) showing an example of the procedure of the proposal processing according to the embodiment.
[0063] First, the proposing device 100 receives a voice input such as "Help" uttered by the user 10 (step S101). The proposing device 100 can also calculate the urgency level based on the received voice input, and this process will be described later with reference to FIG.
[0064] The proposal device 100 determines whether or not official help content exists associated with the game being played by the user 10 (step S102). If official help content exists (step S102; Yes), the proposal device 100 determines whether or not the official help content has already been referenced by the user 10 (step S103). If the user 10 has not referenced the official help content in the past (step S103; No), or if a considerable amount of time has passed since the user 10 referenced the official help content in the past, the proposal device 100 suggests to the user 10 that they reference the official help content (step S104).
[0065] On the other hand, if the user 10 has already referred to the official help content (step S103; Yes), or if there is no official help content (step S102; No), the proposing device 100 searches for another solution. Specifically, the proposing device 100 determines whether the user 10 has any online friends (step S111).
[0066] If the user 10 has an online friend (step S111; Yes), the proposing device 100 determines whether the online friend is available to respond (step S112).
[0067] If the online friend is available to respond (step S112; Yes), the suggestion device 100 further determines whether the game being played by the user 10 is a game (multiplayer game) in which the friend can participate (step S113).
[0068] If the game being played by the user 10 is a multiplayer game (step S113; Yes), the proposing device 100 determines that it is possible to invite the friend into the game, and suggests to the user 10 that the friend be invited to the game (step S114). On the other hand, if the game being played by the user 10 is not a multiplayer game (step S113; No), the proposing device 100 suggests to the user 10 that the friend be able to talk (voice chat) with the friend and ask for a solution, since the friend cannot directly participate in the game (step S115).
[0069] In addition, if the friend is not available to respond in step S112 (step S112; No), the suggestion device 100 determines that it is difficult to contact the friend directly and suggests to the user 10 that they send a message to the friend (step S116).
[0070] Also, in step S111, if there are no friends on the network or the like that the user 10 can contact (step S111; No), the proposed device 100 determines whether there is an SNS to which the user 10 is linked (registered as available) (step S121).
[0071] If a linked SNS exists (step S121; Yes), the proposing device 100 suggests to the user 10 that he post a message or the like on the SNS (step S122).
[0072] On the other hand, if there is no linked SNS (step S121; No), the suggestion device 100 suggests an alternative to the user 10, such as searching for a website that contains information about the game (step S123).
[0073] Next, a procedure of a proposal process when the proposal device 100 calculates an urgency level based on an input voice will be described with reference to Fig. 6. Fig. 6 is a flowchart (2) illustrating an example of the procedure of the proposal process according to the embodiment.
[0074] 5, the proposing device 100 receives a voice input from the user 10 (step S201). At this time, the proposing device 100 calculates the urgency of the user 10 based on the voice (step S202).
[0075] The proposing device 100 determines the calculated level of urgency based on a predetermined reference value (step S203). In the example of Fig. 6, the proposing device 100 determines the level of urgency as one of three levels: "high," "medium," and "low."
[0076] If the level of urgency is low, the proposing device 100 transitions the process to step S102 shown in FIG. 5 (step S204) to suggest a solution such as referring to official help content, since it is assumed that the user 10 expects reliable and comprehensive information rather than a quick solution.
[0077] If the urgency is medium, the proposing device 100 transitions the process to step S121 shown in FIG. 5 to propose a solution such as posting to an SNS or searching a website (step S205).
[0078] If the urgency is low, the proposing device 100 transitions the processing to step S111 shown in FIG. 5 (step S206) to suggest a solution such as contacting a friend directly, since it is assumed that the user 10 expects a quick resolution.
[0079] In this way, the proposing device 100 can adopt a procedure to skip some of the processes in the processing flow shown in Fig. 5 depending on the urgency, thereby enabling the proposing device 100 to appropriately propose a solution according to the situation of the user 10.
[0080] (1-4. Variations of the proposed process) In the above example, the proposed device 100 calculates the urgency level based on the voice parameters of the user 10, but the proposed device 100 may also calculate the urgency level based on various information that infers the usage status of the user 10.
[0081] For example, the proposal device 100 may calculate the urgency level based on operation information in a game being played when the user 10 inputs a request. Furthermore, the proposal device 100 may determine the urgency level in a game being played by the user 10 based on setting information that is set in advance for each scene in the game.
[0082] This point will be described with reference to Fig. 7. Fig. 7 is a diagram showing a variation of the calculation process according to the embodiment.
[0083] In the example of FIG. 7, the user 10 issues a preset voice command 30: "Help My Game."
[0084] 2 , the proposal device 100 analyzes acoustic parameters of the voice included in the voice command 30 and acquires the analyzed information (step S301). The proposal device 100 also acquires acoustic parameters of the user 10's normal speech from the database 40, such as voice data when the user 10 previously registered the voice command 30 and data of the user 10's normal speech. The proposal device 100 then compares the input voice command 30 with the user 10's normal acoustic parameters and acquires the difference therebetween (step S302).
[0085] In parallel with the above process, the proposing device 100 may acquire and analyze operation data of the game play by the user 10 from the controller 20 or the like (step S311). Then, the proposing device 100 calculates an operation busyness level indicating the degree of urgency of the user 10 based on the operation data (step S312). The proposing device 100 determines the urgency of the user 10 based on the operation busyness level.
[0086] For example, the proposed device 100 calculates the operation busy level using the following formula (2): S_busy = d * key_num_min + e * hold_strength + f * sweat_val (2)
[0087] In the above formula (2), "S_busy" indicates the level of operation busyness of the user 10. Furthermore, "key_num_min" indicates the frequency of key operations by the user 10 in a predetermined period of time. "hold_strength" indicates the degree of force with which the user 10 grips the controller 20. "sweat_val" indicates the amount of sweat produced when the user 10 is holding the controller 20. "d," "e," and "f" indicate weighting coefficients. Note that the above formula (2) is an example of urgency calculation, and the proposed device 100 may use operation data other than the example shown in the calculation process. Furthermore, the calculation method for each operation data may use known technology as appropriate.
[0088] Furthermore, in parallel with the above process, the proposing device 100 may acquire and analyze game information from the game being played by the user 10 (step S321). Then, based on the game information, the proposing device 100 calculates a scene urgency indicating how urgent the game development is for the user 10 (step S322). The proposing device 100 determines the urgency of the user 10 based on the scene urgency.
[0089] For example, the proposing device 100 calculates the scene urgency using the following formula (3): S_emrg_scn=n*(preset urgency for each title / scene) (3)
[0090] In the above formula (3), "S_emrg_scn" indicates the scene urgency based on the game information. The "pre-set urgency for each title / scene" is, for example, a value of urgency that is preset as game information and is set for each game title and each game scene. For example, if the game title is a genre such as a first-person action game, the urgency is set higher than in games of other genres because the user 10 is required to respond more immediately. Furthermore, even within a scene in the game, if the scene requires a high level of difficulty in the user 10's operation, the urgency is set higher than in other scenes.
[0091] The urgency of each scene may be set as appropriate by the proposing device 100. For example, the proposing device 100 may set the urgency of a scene in real time based on the amount of light or volume controlled for display in the scene during play, the intensity of the actions of the game characters, and the like.
[0092] The proposing device 100 calculates the urgency of the user 10 based on the values calculated in steps S302, S312, and S322 (step S331). In this way, the proposing device 100 calculates the urgency based on various elements that indicate the user's situation, not limited to acoustic parameters, and can therefore appropriately determine the response speed and granularity at which the user 10 is requesting help content.
[0093] Furthermore, when outputting help content, the proposing device 100 may also perform processing according to the situation of the user 10. That is, the proposing device 100 may adjust, according to the level of urgency, the number of pieces of help content to be presented to the user 10 that are superimposed on the game play screen or the display area in which the proposed help content is displayed. This point will be described with reference to Figs. 8 to 11. Fig. 8 is a diagram (1) showing a variation of the display control processing according to the embodiment.
[0094] 8 shows a display area 200 that displays a game being played by the user 10. For example, the display area 200 corresponds to a screen provided on a display or a window that displays a game.
[0095] When the suggestion device 100 receives a voice command 30 from the user 10, it calculates the degree of urgency and then displays help content according to the degree of urgency on the screen, thereby suggesting help content to the user 10. In the example of Fig. 8 , the suggestion device 100 displays a display area 210 for suggesting help content so as to be superimposed on the left portion of the game screen.
[0096] 8 , the proposal device 100 displays the display area 210 in a display mode in which the degree of urgency is not high and multiple pieces of help content are presented to the user 10, and the user 10 is prompted to select one of the pieces of help content. For example, the proposal device 100 presents four pieces of help content to the user 10, and then suggests to the user 10 that the user 10 view official help content, which is the highest-level help content. At this time, the proposal device 100 may output a message 215 suggesting to the user 10 that the user 10 view the official help content, or a voice guide 220, together with the display area 210.
[0097] The suggestion device 100 may highlight the help content to prompt the user 10 to select the help content. This point will be described with reference to FIG. 9 . FIG. 9 is a diagram (2) showing a variation of the display control process according to the embodiment. In the example of FIG. 9 , the suggestion device 100 applies a highlight 221, such as a highlight, to the official help content, which is the top-level help content, instead of a message 215. This allows the user 10 to understand the suggested help content at a glance.
[0098] Furthermore, the suggestion device 100 may reduce the number of pieces of help content to suggest when it is estimated that the user 10 is busy playing a game and would find it troublesome to select one of the multiple pieces of help content. That is, when the urgency level is higher than a predetermined value, the suggestion device 100 may reduce the number of pieces of help content to be superimposed on the game play screen. Alternatively, when the urgency level is higher than a predetermined value, the suggestion device 100 may reduce the size of the display region to be superimposed on the game play screen. This point will be described with reference to FIG. 10 . FIG. 10 is a diagram (3) illustrating a variation of the display control process according to the embodiment.
[0099] 10, the proposal device 100 displays a display area 240 that is smaller in area and proposes fewer help contents compared to those in FIGS. 8 and 9. In this case, the user 10 can view a wider area of the game screen, and can continue playing the game without the view being obstructed by the display area 240, even in busy scenes in the game. Note that the proposal device 100 can display only the most suitable help content for the user 10 by changing the order in which the help contents to be displayed by superimposing them on the game play screen among the plurality of help contents according to the level of urgency.
[0100] Furthermore, the suggestion device 100 may suggest help content to the user 10 using a different expression method. For example, the suggestion device 100 may suggest the content of the help content to the user 10 by voice depending on the urgency. This point will be described with reference to Fig. 11. Fig. 11 is a diagram (4) showing a variation of the display control process according to the embodiment.
[0101] 11 , the proposing device 100 does not display specific information about the help content, but instead displays only a notification 250 indicating that help content has been proposed, superimposed on the game screen. The proposing device 100 then outputs a voice message 255 to communicate the details of the proposed help content to the user 10. In this case, the user 10 inputs to the system, for example, by voice, that they accept the proposed help content. This allows the user 10 to check the details of the help content and have the system execute the details of the help content, even while playing a tense scene.
[0102] (1-5. Modifications) (1-5-1. Device Configuration) The proposal device 100 according to the embodiment merely conceptually illustrates the functions, and various aspects may be adopted depending on the embodiment. For example, the proposal device 100 may be configured with two or more devices that differ for each of the above-described functions. As an example, the proposal device 100 may be configured with a cloud server and an edge terminal (such as a smart speaker or a smartphone) connected via a network. In this case, when the edge terminal acquires a voice command from the user 10, the edge terminal transmits the acquired information to the cloud server. Then, the cloud server performs processing such as that shown in FIG. 1 and controls the edge terminal to display the contents of the help content, etc., to be proposed to the user 10.
[0103] (1-5-2. Input to the System) In the above embodiment, an example has been shown in which the proposal device 100 receives some kind of voice input from the user 10. Here, the input from the user 10 is not necessarily limited to voice, but may be any kind of information input to the system, such as a key operation or a gesture. Furthermore, the input target is not limited to a command requesting help content, but may be any command.
[0104] (1-5-3. System Aspects) In the above embodiment, an example was shown in which the system that suggests voice commands, etc. is an operating system. However, the system is not limited to an operating system. For example, the system may be various apps, etc. In other words, if an app has a function as an information processing system that performs search processing within the app or processing such as launching a game, etc. stored within the app, the suggestion process according to the embodiment may be applied to the system of such an app, etc. Furthermore, the screen on which suggestions are displayed in the system is not limited to a game screen, etc., and may be any kind of user interface.
[0105] (1-5-4. Aspects of Proposing a Solution (Help Content)) In the above embodiment, an example has been shown in which the proposing device 100 proposes help content requested by the user 10 while he or she is playing a game. Here, the content for which help content is proposed is not necessarily limited to the genre of games, and does not have to be limited to games as long as it is content that can generate some kind of interactive exchange with the user, for example.
[0106] For example, if the user 10 is driving a car and the system is located inside the car, the proposal device 100 may perform processing to suggest a destination according to the urgency of the user 10. Specifically, when the proposal device 100 receives a request from the user 10 to "find a convenience store," the proposal device 100 calculates the urgency of the user 10 from acoustic parameters of the user's utterance, etc. If the urgency of the user 10 is relatively high, the proposal device 100 suggests going to the convenience store that is the shortest distance away, even though it is off the original route. On the other hand, if the urgency of the user 10 is relatively low, the proposal device 100 selects the nearest convenience store from the original route and suggests going to the selected convenience store.
[0107] Furthermore, when the user 10 uses a device with a voice assistant function to receive transfer guidance for public transportation, the proposal device 100, which is the device, may perform processing to suggest a transfer method according to the level of urgency of the user 10. Specifically, when the proposal device 100 receives a request from the user 10 such as "Tell me how to get to XXX," the proposal device 100 calculates the level of urgency of the user 10 from acoustic parameters of the user's utterance, etc. Then, when the level of urgency of the user 10 is relatively high, the proposal device 100 suggests a transfer method that will allow the user 10 to reach the destination most quickly. On the other hand, when the level of urgency of the user 10 is relatively low, the proposal device 100 listens to other requests from the user 10, such as the cost and arrival time, and suggests a transfer method that meets the user's request.
[0108] Furthermore, when the user 10 is using a device with a voice assistant function to look up a cooking recipe, the proposal device 100, which is the device, may perform processing to suggest a recipe according to the level of urgency of the user 10. Specifically, when the proposal device 100 receives a request from the user 10 such as "Do you have any breakfast recipes?", the proposal device 100 calculates the level of urgency of the user 10 from acoustic parameters of the user 10's speech, etc. Then, when the level of urgency of the user 10 is relatively high, the proposal device 100 suggests a recipe that requires the shortest cooking time. On the other hand, when the level of urgency of the user 10 is relatively low, the proposal device 100 may hold a dialogue, such as listening to the user 10's desired menu, and then suggest a recipe that prioritizes conditions other than the required time.
[0109] (2. Other Embodiments) The processing according to each of the above-described embodiments may be implemented in various different forms other than the above-described embodiments.
[0110] Furthermore, among the processes described in the above embodiments, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically using known methods. Furthermore, the information, including the processing procedures, specific names, various data, and parameters shown in the above documents and drawings, can be changed as desired unless otherwise specified. For example, the various information shown in each drawing is not limited to the information shown in the drawings.
[0111] Furthermore, the components of each device shown in the figure are conceptual functional units and do not necessarily have to be physically configured as shown. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit depending on various loads, usage conditions, etc. For example, the calculation unit 134 and the determination unit 135 may be integrated.
[0112] Furthermore, the above-described embodiments and modifications can be combined as appropriate within the scope of not causing any contradiction in the processing content.
[0113] Furthermore, the effects described in this specification are merely examples and are not limiting, and other effects may also be present.
[0114] (3. Effects of the Proposal Device According to the Present Disclosure) As described above, the proposal device according to the present disclosure (proposal device 100 in the embodiment) includes a reception unit (reception unit 131 in the embodiment) and a proposal unit (proposal unit 132 in the embodiment). The reception unit receives a request input by a user to the information processing system. When a request is received, the proposal unit calculates the urgency of the user based on the user's usage status of the information processing system, and selects and proposes a solution to be presented to the user from among multiple solutions related to the request in accordance with the calculated urgency.
[0115] In this way, the proposing device according to the present disclosure selects a countermeasure according to the user's usage situation and then makes a suggestion to the user, thereby making it possible to appropriately present a response that is suited to the user's situation.
[0116] The suggestion unit also calculates the degree of urgency based on a comparison between the voice of the user when inputting a request and the voice of the user in normal times.
[0117] In this way, the proposed device calculates the urgency level according to the parameters of the user's voice input, and therefore can determine the user's urgency level without requiring the user to take the trouble of making any particular conscious input.
[0118] The receiving unit receives requests for game content running on the information processing system, and the suggesting unit suggests to the user, as a solution, a means for resolving the game content.
[0119] In this way, the proposing device can promptly and appropriately present a solution to the user when using game content or the like that requires an immediate solution.
[0120] The suggestion unit may also suggest to the user, depending on the level of urgency, one of the following solutions: contacting the user's friends in the game content, posting the request to a network, or help content linked to the game content. For example, the suggestion unit may suggest to the user either inviting a friend to the game content or sending a message to a friend depending on the status of the user's friends. When suggesting a solution, if the user has already viewed help content linked to the game content within a certain period of time, the suggestion unit may suggest to the user a solution other than the help content.
[0121] In this way, the suggestion device determines whether a quick solution or comprehensive information is required depending on the user's usage situation, and then presents a solution to the user, so it can suggest a solution to the user that is more suited to the situation.
[0122] The suggestion unit may calculate the urgency level based on operation information in the game content that the user is playing when the user inputs the request. The suggestion unit may also calculate the urgency level based on setting information that is preset for each scene in the game content that the user is playing when the user inputs the request.
[0123] In this way, the proposed device calculates the urgency based not only on the user's voice but also on the game play situation and information set in the game, so it can determine the user's situation from a wider variety of perspectives.
[0124] The suggestion unit may also adjust, according to the level of urgency, the number of solutions to be displayed superimposed on the play screen of the game content and the display area in which the suggested solutions are displayed. For example, when the level of urgency is higher than a predetermined value, the suggestion unit may reduce the number of solutions to be displayed superimposed on the play screen of the game content. Alternatively, when the level of urgency is higher than a predetermined value, the suggestion unit may reduce the area of the display area to be displayed superimposed on the play screen of the game content. The suggestion unit may also change the order of solutions to be displayed superimposed on the play screen of the game content, according to the level of urgency. The suggestion unit may also suggest the content of the solutions to be suggested to the user by voice, according to the level of urgency.
[0125] In this way, even when presenting solutions such as help content, the suggestion device outputs information according to the user's gameplay situation, etc., so it can suggest solutions to the user in a manner that does not interfere with gameplay.
[0126] (4. Hardware Configuration) Information devices such as the proposed device 100 according to each of the above-described embodiments are realized by a computer 1000 having a configuration as shown in FIG. 12, for example. The proposed device 100 will be described below as an example. FIG. 12 is a hardware configuration diagram showing an example of a computer 1000 that realizes the functions of the proposed device 100. The computer 1000 has a CPU 1100, a RAM 1200, a ROM (Read Only Memory) 1300, a HDD (Hard Disk Drive) 1400, a communication interface 1500, and an input / output interface 1600. The components of the computer 1000 are connected by a bus 1050.
[0127] The CPU 1100 operates and controls each component based on programs stored in the ROM 1300 or the HDD 1400. For example, the CPU 1100 loads the programs stored in the ROM 1300 or the HDD 1400 into the RAM 1200 and executes processing corresponding to the various programs.
[0128] The ROM 1300 stores boot programs such as a Basic Input Output System (BIOS) that is executed by the CPU 1100 when the computer 1000 is started, and programs that depend on the hardware of the computer 1000 .
[0129] HDD 1400 is a computer-readable recording medium that non-temporarily records programs executed by CPU 1100 and data used by such programs. Specifically, HDD 1400 is a recording medium that records the proposed program according to the present disclosure, which is an example of program data 1450.
[0130] The communication interface 1500 is an interface for connecting the computer 1000 to an external network 1550 (e.g., the Internet). For example, the CPU 1100 receives data from other devices and transmits data generated by the CPU 1100 to other devices via the communication interface 1500.
[0131] The input / output interface 1600 is an interface for connecting the input / output device 1650 and the computer 1000. For example, the CPU 1100 receives data from input devices such as a keyboard or a mouse via the input / output interface 1600. The CPU 1100 also transmits data to output devices such as a display, a speaker, or a printer via the input / output interface 1600. The input / output interface 1600 may also function as a media interface for reading programs and the like recorded on a predetermined recording medium. Examples of media include optical recording media such as DVDs (Digital Versatile Discs) and PDs (Phase Change Rewritable Disks), magneto-optical recording media such as MOs (Magneto-Optical Disks), tape media, magnetic recording media, and semiconductor memories.
[0132] For example, when the computer 1000 functions as the proposal device 100 according to the embodiment, the CPU 1100 of the computer 1000 executes the proposal program loaded onto the RAM 1200, thereby realizing the functions of the control unit 130 and the like. The proposal program according to the present disclosure and data in the storage unit 120 are stored in the HDD 1400. The CPU 1100 reads and executes the program data 1450 from the HDD 1400, but as another example, the CPU 1100 may obtain these programs from another device via an external network 1550.
[0133] The present technology can also be configured as follows. (1) A proposal device comprising: a reception unit that receives a request input by a user to an information processing system; and a proposal unit that, when the request is received, calculates a level of urgency for the user based on the user's usage status of the information processing system, and selects and proposes a solution to be presented to the user from among multiple solutions for the request in accordance with the calculated level of urgency. (2) The proposal device described in (1), wherein the proposal unit calculates the level of urgency based on a comparison of a voice spoken by the user when inputting the request with a voice spoken by the user under normal circumstances. (3) The proposal device described in (2), wherein the reception unit receives the request for game content running on the information processing system, and the proposal unit proposes to the user, as the solution, a means for resolving the game content. (4) The suggestion device according to (3), wherein the suggestion unit suggests to the user, among the countermeasures, one of contacting the user's friend in the game content, posting details related to the request to a network, and help content linked to the game content, depending on the level of urgency. (5) The suggestion device according to (4), wherein the suggestion unit suggests to the user either inviting the friend to the game content or sending a message to the friend, depending on the status of the user's friends. (6) The suggestion device according to (4) or (5), wherein, when suggesting the countermeasure, if the user has already viewed help content linked to the game content within a certain period of time, the suggestion unit suggests to the user a countermeasure other than the help content. (7) The suggestion device according to any one of (3) to (6), wherein the suggestion unit calculates the level of urgency based on operation information in the game content that the user is playing when the user inputs the request.(8) The proposal device according to any one of (3) to (7), wherein the proposal unit calculates the urgency level based on setting information preset for each scene in the game content that the user is playing when the user inputs a request. (9) The proposal device according to (7) or (8), wherein the proposal unit adjusts, according to the urgency level, the number of solutions from the plurality of solutions to be displayed superimposed on the play screen of the game content and the display area in which the proposed solutions are displayed. (10) The proposal device according to (9), wherein, when the urgency level is higher than a predetermined value, the proposal unit reduces the number of solutions from the plurality of solutions to be displayed superimposed on the play screen of the game content. (11) The proposal device according to (9) or (10), wherein, when the urgency level is higher than a predetermined value, the proposal unit reduces the area of the display area superimposed on the play screen of the game content. (12) The proposal device according to any one of (9) to (11), wherein the proposal unit changes an order of the plurality of solutions to be displayed by superimposing it on the play screen of the game content according to the level of urgency. (13) The proposal device according to any one of (9) to (12), wherein the proposal unit proposes by voice the content of the solution to be proposed to the user according to the level of urgency. (14) A proposal method including: a computer receiving a request input by a user to an information processing system, and when the request is accepted, calculating a level of urgency of the user based on the user's usage status of the information processing system, and selecting and proposing a solution to be presented to the user from among a plurality of solutions related to the request according to the calculated level of urgency. (15) A proposal program that causes a computer to function as a proposal device that includes: a reception unit that receives a request input by a user to an information processing system; and a proposal unit that, when the request is received, calculates the urgency of the user based on the user's usage status in the information processing system, and selects and proposes a solution to be presented to the user from among multiple solutions related to the request in accordance with the calculated urgency.
[0134] REFERENCE SIGNS LIST 10 User 20 Controller 100 Proposal device 110 Communication unit 120 Storage unit 121 Utterance information storage unit 122 User information storage unit 123 Proposal information storage unit 130 Control unit 131 Reception unit 132 Proposal unit 133 Acquisition unit 134 Calculation unit 135 Determination unit 136 Output control unit
Claims
1. A proposal device comprising: a reception unit that receives a request input by a user to an information processing system; and a proposal unit that, when the request is received, calculates a level of urgency for the user based on the user's usage status of the information processing system, and selects and proposes a countermeasure to be presented to the user from among a plurality of countermeasures for the request in accordance with the calculated level of urgency.
2. The proposal device according to claim 1, wherein the proposal unit calculates the urgency level based on a comparison between the voice of the user when inputting a request and the voice of the user under normal circumstances.
3. The proposal device described in claim 2, wherein the reception unit receives the request for game content running on the information processing system, and the proposal unit proposes to the user a means for resolving the game content as the solution.
4. The suggestion device of claim 3, wherein the suggestion unit suggests to the user, depending on the level of urgency, one of the following countermeasures: contacting the user's friends in the game content, posting content related to the request on a network, or help content linked to the game content.
5. The suggestion device according to claim 4, wherein the suggestion unit suggests to the user either to invite the friend to the game content or to send a message to the friend depending on the status of the user's friends.
6. The suggestion device of claim 4, wherein when suggesting the solution, if the user has already viewed help content linked to the game content within a certain period of time, the suggestion unit suggests to the user a solution other than the help content.
7. The proposal device according to claim 3, wherein the proposal unit calculates the urgency based on operation information in the game content that the user is playing when the user inputs a request.
8. The proposal device according to claim 3, wherein the proposal unit calculates the urgency based on setting information preset for each scene in the game content that the user is playing when the user inputs the request.
9. The proposal device described in claim 7, wherein the proposal unit adjusts, according to the level of urgency, the number of the plurality of solutions to be superimposed on the play screen of the game content, and the display area in which the proposed solutions are displayed.
10. The suggestion device according to claim 9, wherein the suggestion unit reduces the number of solutions to be displayed superimposed on the play screen of the game content from among the plurality of solutions when the urgency is higher than a predetermined value.
11. The proposal device according to claim 9, wherein the proposal unit reduces the area of the display region superimposed on the play screen of the game content when the urgency is higher than a predetermined value.
12. The suggestion device according to claim 9, wherein the suggestion unit changes the order in which the multiple solutions are displayed superimposed on the play screen of the game content depending on the level of urgency.
13. The suggestion device according to claim 9, wherein the suggestion unit proposes by voice the content of the countermeasure to be proposed to the user according to the degree of urgency.
14. A proposal method including: a computer receiving a request input by a user to an information processing system; when the request is received, calculating a level of urgency for the user based on the user's usage of the information processing system; and selecting and proposing a countermeasure to be presented to the user from among a plurality of countermeasures related to the request in accordance with the calculated level of urgency.
15. A proposal program that causes a computer to function as a proposal device having: a reception unit that receives a request input by a user to an information processing system; and a proposal unit that, when the request is received, calculates the urgency of the user based on the user's usage status of the information processing system, and selects and proposes a countermeasure to be presented to the user from among multiple countermeasures related to the request in accordance with the calculated urgency.
Citation Information
Patent Citations
Information processing device, information processing method, and program
JP2020086943A
Information providing device, information providing method and program
JP2014115769A
Information processor and program
JP2019098064A
Voice help system using artificial intelligence
JP2021518197A
Emergency call answering device, emergency call answering method, and computer program
JP2022112560A
