Information processing device, information processing method, program, and information processing system
The information processing device addresses the limitations of existing technologies by generating context-based imaginary events to help users maintain personal distance in social situations, ensuring effective and natural avoidance of unwanted interactions.
Patent Information
- Application Number
- JP2022537915
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2020-07-21
- Filing Date
- 2021-07-07
- Publication Date
- 2025-04-02
- Estimated Expiration
- 2041-07-07
AI Technical Summary
Existing technologies for maintaining personal distance in social situations are limited, as users can't repeatedly use apps that generate false incoming calls without suspicion, and agent systems may reduce their effectiveness if the other person becomes aware of the tactic.
An information processing device that generates and presents imaginary events to change the distance between the user and encountered individuals, based on context, using a behavioral support system that includes a server and client terminals to facilitate natural avoidance of unwanted interactions.
Enables users to maintain appropriate personal distance in various social contexts without arousing suspicion, allowing for a peaceful life by naturally avoiding unwanted interactions while maintaining a positive relationship with others.
Smart Images

Figure 0007655322000001 
Figure 0007655322000002 
Figure 0007655322000003
Abstract
Description
[Technical field]
[0001] In particular, the present technology relates to an information processing device, an information processing method, a program, and an information processing system that enable an appropriate distance to be maintained between a user and other people. [Background technology]
[0002] Many people wish to live a peaceful life.
[0003] Nevertheless, for example, if you get into trouble on the train, you may be subjected to unfounded slander from strangers. Also, you may suddenly bump into your boss at work, just when you don't want to meet him, such as after making a mistake at work.
[0004] Whether the other person is a stranger or an acquaintance, maintaining distance from them is important in order to live a peaceful life without feeling bothered.
[0005] There are smartphone applications that generate fake incoming calls. When a user is receiving criticism from his / her boss for a mistake he / she made at work, he / she can operate the application to generate a fake incoming call and pretend to answer the call to get out of the situation.
[0006] Patent Document 1 discloses an agent system that evaluates the atmosphere of a driving situation based on the emotions of two passengers, and improves the atmosphere by having a character speak when the atmosphere is bad. [Prior art documents] [Patent documents]
[0007] [Patent Document 1] JP 2019-158975 A Summary of the Invention [Problem to be solved by the invention]
[0008] Since the same incoming call will be suspicious every time, the user cannot repeatedly use the above-mentioned application to get around the situation. Also, the user needs to perform an operation to start the incoming call.
[0009] On the other hand, in the agent system disclosed in Patent Document 1, if the passengers realize that the character's words are intended to smooth over the situation, their reaction to the character's words may become calm, reducing the effectiveness of the system.
[0010] The present technology has been developed in light of these circumstances, and makes it possible to maintain an appropriate distance from other people. [Means for solving the problem]
[0011] An information processing device according to one aspect of the present technology includes an information processing unit that generates a fictitious event that changes a distance between a user and a person encountered by the user in accordance with a context of the user, and presents the event to the user.
[0012] In one aspect of the present technology, a fictitious event that changes the distance between the user and a person the user encounters is generated and presented to the user, depending on the user's context. [Brief description of the drawings]
[0013] [Figure 1] FIG. 1 is a diagram illustrating an example of support provided by a behavior support system. [Diagram 2] FIG. 13 is a diagram showing a state of avoidance by a user. [Diagram 3] FIG. 13 is another diagram showing the manner in which the user avoids the obstacle. [Figure 4] FIG. 13 is a diagram illustrating an example of sharing a workaround method. [Diagram 5] FIG. 13 is a diagram showing an example of a shared screen for a workaround method. [Figure 6] FIG. 13 is a diagram illustrating an example of determining a workaround method. [Figure 7] FIG. 13 is a diagram showing an example of avoidance desire levels. [Figure 8] 13 is a flowchart illustrating an action support process of the action support server. [Figure 9] FIG. 2 illustrates an example of a situation a user may encounter. [Figure 10] FIG. 13 is a diagram showing an example of avoidance using voice navigation. [Figure 11] FIG. 13 is a diagram showing an example of avoidance using audio AR. [Figure 12] FIG. 13 is a diagram illustrating an example of avoidance using an AR object. [Figure 13] FIG. 13 is a diagram illustrating an example of avoidance using a store. [Figure 14] FIG. 2 illustrates an example of a situation a user may encounter. [Figure 15] FIG. 13 is a diagram showing an exchange between a user and a counterpart. [Figure 16] FIG. 13 is a diagram showing an exchange between a user and a counterpart. [Figure 17] FIG. 13 is a diagram illustrating an example of an event presentation. [Figure 18] FIG. 13 is a diagram showing an example of avoidance using a voice call by a helper. [Figure 19] FIG. 13 is a diagram showing how a helper calls out to a participant. [Figure 20] FIG. 13 is a diagram illustrating an example of a notification. [Figure 21] FIG. 13 is a diagram showing a state of avoidance by a user. [Figure 22] FIG. 13 illustrates an example of knower avoidance. [Figure 23] FIG. 13 illustrates an example of knower avoidance. [Figure 24] FIG. 13 is a diagram illustrating an example of a notification output. [Diagram 25] FIG. 13 is a diagram showing an example of a registration screen for people you do not want to meet. [Figure 26] FIG. 13 is a diagram showing an example of a questionnaire screen. [Figure 27]FIG. 13 is a diagram showing examples of value types. [Figure 28] FIG. 11 is a diagram showing examples of avoidance methods for each value type. [Figure 29] 2 is a block diagram showing an example of the hardware configuration of an action support server. FIG. [Diagram 30] 2 is a block diagram showing an example of a functional configuration of an action support server. FIG. [Diagram 31] FIG. 2 is a block diagram showing an example of the configuration of a client terminal; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0014] Hereinafter, an embodiment of the present technology will be described in the following order. 1. Behavioral Support System 2. Operation of the Action Support Server 3. When the other person is a stranger 4. When the other person is someone you know 5. Deciding on a workaround that takes into account the user's values 6. Configuration of each device 7. Variations
[0015] <<Behavioral Support System>> <Support using behavior support systems> FIG. 1 is a diagram showing an example of support by a behavior support system according to an embodiment of the present technology.
[0016] The action support system according to an embodiment of the present technology is realized by an action support server 1, which is a server on the Internet.
[0017] When the user U1 feels annoyed by a person he / she encounters, the action support server 1 supports the user U1 in selecting an action that will make the distance between the user U1 and that person appropriate. The people the user U1 encounters include not only people the user U1 has already come into contact with, but also people the user may come into contact with in the future. For example, the state of talking and communicating with a person, as shown on the left side of Figure 1, is a state of contact.
[0018] Support for the selection of an action that will keep the distance between the user U1 and the other person appropriate is achieved by the action support server 1 generating an event according to the context, as indicated by the tip of arrow A1 in FIG.
[0019] In the example of Fig. 1, in response to the occurrence of an event according to the context, the user U1 selects his / her own action, and as a result, succeeds in moving away from the other person as indicated by the tip of the arrow A2. The event generated by the action support server 1 is an event that has the potential to change the distance between the other person and the user.
[0020] In this way, the action support system is a system that creates a situation in which the other party can be avoided by generating an event. The user can avoid the other party, i.e., the nuisance, by acting in response to the occurrence of the event.
[0021] Each user of the action support system has a device such as a smartphone, in-ear headphones (earphones), a glasses-type HMD (Head Mounted Display), or a wristwatch-type wearable device (smart watch) as a client terminal.
[0022] Each client terminal is connected to the Internet directly or via another device and is capable of communicating with the action support server 1. The action support server 1 detects the context of each user based on information transmitted from the client terminal and generates an event according to the detected context.
[0023] FIG. 2 is a diagram showing the state of avoidance by the user.
[0024] As shown on the left side of Fig. 2, it is assumed that the situation in which user U1 is being spoken to by his / her boss, the section chief, is detected as the context of user U1 by the action support server 1. The section chief is lecturing user U1 about a mistake he / she made at work. User U1 has to continue to listen to the lecture because the person speaking to him / her is his / her boss.
[0025] In such a situation, if the user U1 requests to avoid the other party, a fictitious event is caused by the action support server 1, as indicated by the tip of the arrow A11.
[0026] In the example of Figure 2, as shown in speech bubble #1, an event occurs when a phone call is received by the smartphone held by user U1. The incoming call is said to be from the president. A ringtone is output from the speaker of the smartphone held by user U1, and a notification that the call is from the president is displayed on the display.
[0027] In reality, the president does not call user U1, so the incoming call from the president is a fictitious event. The event of an incoming call from the president is presented to user U1 and the section manager by a ringtone and a display on the screen.
[0028] User U1 takes out the smartphone, looks at the display, and tells the section manager that the president called. By choosing to answer the phone call from the president, user U1 can avoid the section manager's scolding, as shown by the tip of arrow A12.
[0029] In this way, instead of forcibly avoiding a person who causes annoyance, a situation in which the user U1 can avoid the person in a natural way is created by the action support server 1. In addition, as an event for creating such a situation, an appropriate event according to the context is selected and presented by the action support server 1.
[0030] In the example of Fig. 2, the section manager considers the incoming call from the president to be his superior, and is able to understand why user U1 prioritizes answering the call from the president over listening to his lecture.
[0031] If an event that the section manager cannot accept is generated and the user is forced to escape from the current situation, the section manager will be left feeling dissatisfied. By generating an event that the section manager finds acceptable and presenting the content of the event to user U1 and the section manager, it is possible to prevent such dissatisfaction from remaining in the section manager. User U1 can also select an action to escape without feeling guilty.
[0032] In particular, when the person is an acquaintance, such as your boss, you will need to consider the future of your relationship, so it is important to allow the user to avoid the call in a way that is satisfactory to the other person.
[0033] FIG. 3 is another diagram showing the manner in which the user avoids the obstacle.
[0034] As shown on the left side of Fig. 3, when a user U2 is walking down a street, a situation in which a suspicious person is approaching from the front is detected as the context of the user U2 by the action support server 1. If the user U2 continues walking straight down the street, there is a possibility that the suspicious person will harass the user U2.
[0035] In such a situation, if the user U2 requests to avoid the other party, a fictitious event is caused by the action support server 1, as indicated by the tip of the arrow A21.
[0036] In the example of Fig. 3, as shown in speech bubble #2, an event occurs when a friend calls user U2 when turning right at a corner (T-junction) ahead, and user U2 is notified of this. The notification that a friend is calling is made by a voice from the speaker of the smartphone that user U2 carries.
[0037] Since there is no friend actually around the corner to the right, the fact that a friend is calling is an imaginary event.
[0038] The user U2 hears the notification from the action support server 1 and selects the action of turning right while pretending to look for a friend, thereby being able to avoid the suspicious person, as indicated by the tip of the arrow A22.
[0039] If user U2 suddenly turns right at a corner, the suspicious person may get the impression that the user U2 is avoiding him, which may anger the suspicious person. The action support server 1 informs user U2 that he has a friend and allows user U2 to show to at least the people around him, including the friend, that he is looking for his friend, thereby making it possible to guide user U2 in a way that does not seem strange to the people around him, including the suspicious person.
[0040] As described above, the behavioral support system allows the user to naturally select actions to avoid causes of annoyance and maintain an appropriate distance from others, allowing the user to live peacefully.
[0041] Since the other party will not become dissatisfied with the user who has avoided the user, the behavior support system can be said to be a system that allows the other party who the user encounters to live a peaceful life.
[0042] <Sharing workarounds> FIG. 4 is a diagram illustrating an example of sharing a workaround.
[0043] Each user of the action support system uploads avoidance information, which is information on avoidance methods, to the action support server 1 and shares it with other users.
[0044] The avoidance information is information that links the situation that each user experienced with the avoidance method used in that situation. The avoidance information also includes information indicating whether the user succeeded or failed in avoiding the opponent.
[0045] For example, each user can operate his / her own client terminal to access the action support server 1 and find out what kind of avoidance methods other users are using in what situations, as shown in A of Fig. 5. In the example of A of Fig. 5, information on the avoidance methods of other users is displayed on the display of a certain user's smartphone.
[0046] It may be possible to search for avoidance methods for each situation using the search screen shown in B of Fig. 5. In the search screen of B of Fig. 5, by tapping each section, it is possible to select a situation, such as when the other person is a man or when the location is an office.
[0047] By selecting a specific situation, information on the avoidance methods corresponding to the selected situation is displayed, allowing the user to know the avoidance methods corresponding to each situation.
[0048] The avoidance information provided by each user is also used to learn the avoidance method. In the action support server 1, machine learning is performed using the avoidance information provided by each user, and an avoidance method determination model is generated. The avoidance method determination model will be described later.
[0049] Each user may be allowed to evaluate the avoidance methods used by other users. By calculating a score for each user's avoidance method according to the evaluation, it is possible to add a game-like element to the avoidance of annoying opponents.
[0050] <Determining a workaround> FIG. 6 is a diagram illustrating an example of determining a workaround method.
[0051] 6, an avoidance method determination unit 11 having an avoidance method determination model M is provided in the action support server 1. The avoidance method determination model M is an inference model composed of a neural network or the like, generated by machine learning using avoidance information.
[0052] Information representing the user's context, information representing whether the other party is a known person or a stranger, and information representing the avoidance desire level are supplied to the avoidance method determination unit 11. By inputting these pieces of information to the avoidance method determination model M, information representing the avoidance method is output.
[0053] The context includes external circumstances, such as events occurring around the user. The external circumstances include the user's environment, including the user's actions and the actions of people around the user, and people the user is in contact with or may be in contact with. Whether the other person is a known person or a stranger may be included in the context.
[0054] The context also includes internal situations, which are internal situations such as the user's emotions, the user's biological reactions, etc. The internal situations also include emotions of people the user is in contact with and people the user may come into contact with.
[0055] In this way, the avoidance method determined in the action support server 1 differs depending on whether the other party is a known person or a stranger.
[0056] If the other party is an acquaintance, as described above, a method of avoidance is determined that takes into consideration the future relationship with the other party. On the other hand, if the other party is an unknown person, a method of avoidance is determined that does not take into consideration the future relationship with the other party.
[0057] The avoidance method determined by the action support server 1 varies depending on the avoidance desire level. The avoidance desire level indicates the degree of the user's desire to avoid the other person by changing the distance from the other person.
[0058] FIG. 7 is a diagram showing an example of avoidance desire levels.
[0059] There are three avoidance preference levels: avoidance preference level 1, avoidance preference level 2, and avoidance preference level 3.
[0060] The avoidance desire level 1 is a level used before contact with the other party. The situation of the user U2 described with reference to Fig. 3 is the situation before contact with the other party, that is, the suspicious person.
[0061] An avoidance preference level of 1 indicates a preference for immediate evacuation (immediate avoidance).
[0062] On the other hand, avoidance desire levels 2 and 3 are levels used after contact with the other party. The situation of user U1 described with reference to Fig. 2 is the situation after contact with the other party, the section manager.
[0063] Level 2 avoidance desire indicates a desire to somehow escape from the person in contact (a strong desire to avoid). For example, when someone speaks to you and you are in an awkward situation while responding, and you want to avoid them, you will use the method of avoidance desire level 2.
[0064] Avoidance desire level 3 indicates that you wish to move away from the person you are in contact with if possible (a weak desire to avoid). For example, you would use the avoidance desire level 3 method when you want to avoid casually, but not blatantly.
[0065] Such a desired level of avoidance is designated by, for example, a user. Alternatively, the desired level of avoidance may be automatically determined by the action support server 1 according to the context or the like.
[0066] In this way, in the action support server 1, different avoidance methods are determined according to the avoidance desire level that indicates the strength of the user's desire to avoid the other party.
[0067] <<Behavior Support Server Operation>> Here, the basic operation of the action support server 1 that supports the selection of actions to avoid other people will be described with reference to the flowchart in Fig. 8. It is assumed that a user carries or wears a client terminal in their daily life.
[0068] In step S1, the action support server 1 acquires sensor data transmitted from a client terminal.
[0069] From the client terminal owned by the user, sensor data detected by a sensor provided in the client terminal is repeatedly transmitted. For example, various sensor data are acquired, such as images of the user's surroundings captured by a camera, voice data obtained by detecting the user's voice with a microphone, and biodata obtained by detecting the user's bioreactions with a biosensor.
[0070] Instead of sensor data detected by a sensor provided in the client terminal, sensor data detected by a sensor located near the user (client terminal) may be transmitted.
[0071] In step S2, the action support server 1 analyzes the sensor data and detects the context. As described above, the context includes the external situation and the internal situation. The external situation is identified, for example, by analyzing an image showing the user's surroundings or by analyzing the sound. The internal situation is identified by analyzing the user's biological reaction or the content of the user's speech or by estimating the user's emotions from the user's facial expression shown in the image.
[0072] In step S3, the action support server 1 determines, based on the context, whether or not an occurrence has occurred that will be an event trigger, which is a trigger for generating an event.
[0073] The occurrence of an event trigger includes an avoidance request made by the user, which is a request to avoid the other party. An avoidance request is made by the user uttering specific words such as "SOS" or "dangerous". An avoidance request can also be made by a specific operation such as pressing a button on the screen of the client terminal.
[0074] It may be determined that an event that serves as an event trigger has occurred in response to detection of a preset context, such as a suspicious person near the user, an abnormal biological reaction of the user, etc. In this case, the event is triggered automatically without a request for avoidance.
[0075] If it is determined in step S3 that an event triggering incident has occurred, in step S4 the action support server 1 confirms the avoidance desire level by inquiring of the user. The avoidance desire level may be automatically determined in response to the occurrence of the event triggering incident, without confirming the avoidance desire level with the user.
[0076] In step S5, the action support server 1 determines an avoidance method according to the context, for example, by using the avoidance method determination model M.
[0077] In step S6, the action support server 1 generates an event according to the determined avoidance method. The action support server 1 and the client terminal cooperate to generate the event. The client terminal presents the event generated by the action support server 1 to the user according to the control of the action support server 1. The client terminal presents the event not only to the user but also to people around the user, including at least the other person, as appropriate.
[0078] Depending on the event, the action support server 1 may be woken up in cooperation with a device installed near the user or a device carried by a person near the user.
[0079] After the event has occurred in step S6, or if it is determined in step S3 that no event that will become an event trigger has occurred, the process returns to step S1, and the above processes are repeated.
[0080] A specific example of the avoidance achieved by the above-mentioned processing will be described.
[0081] <<When the other person is a stranger>> <Evasion Desired Level 1> FIG. 9 shows an example of a situation that a user may encounter.
[0082] As shown in Figure 9, let us assume a situation where a user is walking down a street and a suspicious person is approaching from the front. If the user continues walking straight down the street, there is a possibility that the user will approach the suspicious person and be accused of something false, which may lead to the suspicious person harassing the user. The suspicious person ahead is someone that the user has not yet come into contact with, but is expected to come into contact with. There is a corner ahead of the user, which allows the user to make a detour around the road the user is currently walking on.
[0083] Example of voice navigation FIG. 10 is a diagram showing an example of avoidance using voice navigation.
[0084] As shown in box F1 on the left side of Figure 10, if a user notices a suspicious person and utters a word such as "that's dangerous," which requests avoidance, and the action support server 1 detects an abnormality, the user is asked whether or not to avoid the person at avoidance request level 1.
[0085] For example, it is assumed that the user has a smartphone as a client terminal. Sound based on the control of the action support server 1 is output from the smartphone's speaker, and the user's voice is detected by the smartphone's microphone.
[0086] 10, the word "system" means the action support system. The content of the utterance shown next to the word "system" is the voice output from the smartphone based on the control of the action support server 1.
[0087] The desired avoidance level is designated by uttering a phrase such as "please" in response to an inquiry from the action support server 1.
[0088] In the action support server 1, control is performed to output a navigation voice for detouring the road. In the example in the center of Fig. 10, as shown in a frame F2, guidance is given to turn right at the corner and then turn left at the next corner. After that, as shown in a frame F3 on the right side of Fig. 10, a navigation voice for returning to the original road is output.
[0089] Instead of imaginary events, the opponent may be avoided by simply guiding the path in this way.
[0090] -Example of using voice AR FIG. 11 is a diagram showing an example of avoidance using audio AR (Augmented Reality).
[0091] Audio AR is a technology that allows a user to recognize an event that is not actually happening by generating virtual sounds that are not actually being played and playing them for the user. For example, the user is assumed to be wearing earphones as a client terminal.
[0092] When a user notices a suspicious person and utters words requesting avoidance, if the action support server 1 detects an abnormality, the user is asked whether or not to avoid the suspicious person at avoidance desire level 1, as shown on the left side of Fig. 11. The desired avoidance level is specified by uttering words such as "please" in response to the inquiry from the action support server 1.
[0093] The action support server 1 may detect an abnormality not in response to the user uttering a word that requests avoidance, but when contact with a suspicious person is predicted, the abnormality may be detected and the possibility of contact with a suspicious person may be presented to the user. Contact with a suspicious person is predicted based on the context.
[0094] In the action support server 1, a fictitious event is generated in which a person on a detour calls the user. A third party calls the user by outputting a voice calling the user from earphones while changing the sound source position.
[0095] In the example in the center of Fig. 11, a voice saying "Come here, come here" is output with the sound source position being position P1 after turning right at a corner, followed by another voice saying "Come here, come here" with the sound source position being position P2 after turning left at the next corner. By selecting the action of walking towards the voice calling out to the user, the user can avoid the path taken by the suspicious person and return to the original path, as shown on the right side of Fig. 11.
[0096] When an event occurs, such as someone calling the user, the user can naturally choose to move in the direction of the voice calling the user, and can avoid suspicious people in a natural manner. If the user tries to take a detour while consciously trying to avoid a suspicious person, this may be reflected in the user's behavior, and the user may become overtly evasive, but it is possible to prevent the user from taking a behavior that overtly evades the person.
[0097] The voice calling the user may be output as a voice that only the user can hear, or may be output as a voice that can be heard by people in the vicinity, including suspicious people. Output of a voice that can be heard by people in the vicinity is performed by outputting the voice from speakers installed at various locations in the city, such as positions P1 and P2. In this case, the action support server 1 will generate an event by cooperating with a device other than the client terminal owned by the user.
[0098] Example using AR objects FIG. 12 is a diagram showing an example of avoidance using an AR object.
[0099] The AR object is a virtual object displayed on, for example, a see-through HMD. The user can see an object that does not actually exist superimposed on the scenery in front of him / her. It is assumed that the user wears the HMD as a client terminal. In FIG. 12, the glasses worn by the user are a see-through HMD. The AR object may be displayed using a non-see-through HMD.
[0100] As shown on the left side of Fig. 12, when a user who notices a suspicious person specifies an avoidance desired level, a fictitious event is caused in the action support server 1 to make a black cat appear. The black cat is made to appear by displaying the black cat as an AR object on the HMD. The black cat is displayed moving as if walking along a detour route.
[0101] In the example in the center of Fig. 12, a black cat is displayed at position P1 after turning right at a corner, and then at position P2 after turning left at the next corner. By selecting the action of following the black cat, the user can avoid the path taken by the suspicious person and return to the original path, as shown on the right side of Fig. 12.
[0102] By triggering an event such as a black cat appearing, the user can naturally choose to follow the black cat, and can avoid suspicious people in a natural manner. Of course, it is also possible to display AR objects other than black cats.
[0103] Temporary avoidance example FIG. 13 is a diagram showing an example of avoidance using a store.
[0104] As shown in Fig. 13, it is assumed that there are stores that match the user's preferences along the road where the user is walking. Information such as the user's preferences and values is managed in the action support server 1. It is assumed that the user has a smartphone as a client terminal.
[0105] When a user who notices a suspicious person specifies a desired avoidance level, the action support server 1 generates a fictitious event that a store that the user likes, located ahead of the multiple stores lined up, is having a sale, and notifies the user of this, as shown on the left side of Fig. 13. It is also possible to notify the user of multiple stores that match the user's preferences along with the reason.
[0106] Other fictitious events relating to the store may occur, such as a store that does not match the user's tastes selling a product that the user likes, or a salesperson from a store that matches the user's tastes calling the user.
[0107] The user then enters the store, curious about the sale, as shown in the center of Figure 13. The user can avoid the suspicious person by waiting for them to pass and then exiting the store as shown on the right side of Figure 13.
[0108] When an event occurs, such as a sale at a store that the user likes, the user can naturally choose to enter the store, and by checking the state of the store before entering, the user can avoid suspicious people in a natural manner.
[0109] As described above, when avoidance is requested at avoidance desire level 1, various events are triggered to create a situation in which the person who is predicted to come into contact can be immediately avoided, and are presented to the user, etc.
[0110] <Evasion Desired Level 2> Example of evasion by calling the user FIG. 14 shows an example of a situation that a user may encounter.
[0111] As shown in Fig. 14, assume a situation where a user is walking down the street when a stranger calls out to the user and the user kindly gives directions. The situation shown in Fig. 14 is after contact with the other person. As the user continues to talk, the topic of conversation shifts from directions to something else, and the atmosphere changes, as shown in Fig. 15. As shown in speech bubble #11, the user's emotions change from a state of being kind to a state of wanting to avoid the other person.
[0112] As shown on the left side of FIG. 16, when the action support server 1 detects an abnormality in response to the user uttering words requesting avoidance, an inquiry is made to the user as to whether or not to avoid at avoidance desire level 2.
[0113] In the example on the left side of Fig. 16, the words that constitute the avoidance request are "SOS, SOS, please get me out of here! Please do it immediately!". By saying "I'm in trouble" or by applying vibration to the client terminal, an avoidance request at avoidance desire level 2 may be made.
[0114] In this example, the user wears a smart watch as a client terminal. The voice based on the control of the action support server 1 is output at a low volume from the speaker of the smart watch. The user's voice is detected by the microphone of the smart watch. The housing of the smart watch is also provided with a display.
[0115] When it is detected that the user's emotion has changed to a state in which the user desires to avoid the other person, an abnormality is detected in the action support server 1, and an inquiry as to whether or not to avoid the other person may be made to the user. The fact that the user's emotion has changed to a state in which the user desires to avoid the other person is determined based on the context.
[0116] As shown on the right side of FIG. 16, the desired avoidance level is designated by the user accepting the inquiry from the action support server 1.
[0117] In the action support server 1, a fictitious event is generated in which a third party calls the user, and a message calling the user is sent to the smart watch. That is, in this example, a situation is created in which the user needs to leave the place because someone is calling them.
[0118] FIG. 17 is a diagram showing an example of an event presentation.
[0119] As shown in speech bubble #12 on the left side of Figure 17, a message appears on the smartwatch display instructing the user to hurry back to the office because a meeting is about to begin. By telling the other person that they need to hurry back and walking away, the user can avoid the other person in a natural way, rather than blatantly avoiding them.
[0120] That is, when an event such as being called occurs, the user can naturally choose to leave in response to the call, and can avoid the other person in a natural manner. Also, by casually showing the message to the other person while checking it, the user can give the other person a sense of satisfaction in leaving the situation.
[0121] The message to page the user may be sent by e-mail, SMS (Short Message Service), etc. An incoming call may be placed to the smartwatch to page the user by voice.
[0122] In the example of Figure 17, a message such as "Hurry up!" is sent, which directly indicates that the customer will hurry back. However, a message such as "Are you done shopping?" or "How long should we keep you waiting?", which indirectly indicates that the customer will hurry back, may also be sent.
[0123] Example of how a collaborator can avoid the situation by calling out to the other person FIG. 18 is a diagram showing an example of avoidance.
[0124] Depending on the situation, it may be difficult for the user to check the message. If a friend or the like is registered in advance as a helper of the user and the helper is near the user, the action support server 1 may request the helper to call out to the user who is in trouble after being called out by the other person. The action support server 1 manages the location of each helper as well as who the user's helpers are.
[0125] In the example of FIG. 18, in response to an avoidance request as shown by an arrow A31, a call request is made to the helper as shown by an arrow A32, which is a request to call out to the user. The action support server 1 also notifies the helper of the content of the call, such as "Please tell the helper to pretend to have a meeting and hurry back." For example, the helper is notified to tell the user to hurry back to a fictitious event. The call request is made by email, SMS, telephone, etc.
[0126] Even when a collaborator calls out to the user, a fictitious event is generated in which a third party collaborator calls the user, creating a situation in which the user needs to leave the location because someone is calling them.
[0127] The helper who receives a request from the action support server 1 heads to the scene as shown in Fig. 19 and calls out to the user according to the notification from the action support server 1. The user who is called out to by the helper can avoid the other person in a natural way by leaving together with the helper, rather than blatantly avoiding the other person.
[0128] A plurality of people are registered as helpers who will call out to the user. The helpers may be people known to the user, or may be people unknown to the user. If the helpers are people unknown to the user, the action support server 1 notifies the user who is the target of the call, together with information indicating the user's characteristics, such as a facial photograph.
[0129] Instead of the helper who receives the call request heading directly to the site, the helper may call the user to let them know that he or she will be returning quickly. By answering the call from the helper, the user can let the other person know that he or she has been called.
[0130] As described above, when avoidance is requested at avoidance desire level 2, various events are triggered by the other party after contact to create a situation for avoidance somehow, and are presented to the user.
[0131] <Evasion Desired Level 3> The avoidance desire level 3 is used when the user wishes to avoid the other person after contact if possible. Avoidance at the avoidance desire level 3 is performed, for example, by the action support server 1 notifying the user of an event that can be used as a reason for avoidance. The user's event is generated as a fictitious event according to the context and notified to the user.
[0132] The user will be triggered by the notification from the action support server 1 and will avoid the other person on the grounds that he or she has business to attend to, as notified by the action support server 1.
[0133] FIG. 20 is a diagram showing an example of a notification from the action support server 1. As shown in FIG.
[0134] In the example of Fig. 20, the user is notified that the other party will be avoided because he / she is going to the toilet. After confirming the notification in Fig. 20, the user can inform the other party that he / she wants to go to the toilet, and thus subtly avoid the other party. For example, the toilet event is selected when the user's context indicates that the user has not been to the toilet for a certain period of time.
[0135] The errand notified from the action support server 1 may be an errand other than going to the toilet, such as shopping, work, or studying.
[0136] If the user were to think of a reason for avoiding the other person, it may be difficult for the user to leave naturally because the user's attitude may show that he or she is lying. By having the reason for avoidance determined and presented by the action support server 1 according to the context, the user can inform the other person of the reason for leaving without hesitation and avoid the other person casually.
[0137] As described above, when avoidance is requested at avoidance desire level 3, various events are triggered to create a situation in which the other party after contact can avoid the collision if possible, and these events are presented to the user.
[0138] <<When the other person is someone you know>> If the person is known to the person, the second or subsequent times the person is avoided, a different avoidance method is used than was used previously.
[0139] FIG. 21 is a diagram showing how the user avoids the obstacle.
[0140] The situation shown on the left side of Fig. 21 is a situation in which the user is being approached again by his / her boss, the section manager. The user is being approached by the section manager, for example, the day after the user has avoided the situation the first time as described with reference to Fig. 2. The user wants to avoid the current situation again.
[0141] In such a situation, if user U1 requests to avoid the other party, as shown by the arrow A41, a meeting with a customer is triggered as a fictitious event, and the user is notified to hurry back. As shown in speech bubble #21, a message is displayed on the display of the smart watch worn by the user instructing the user to hurry back because the meeting is about to start.
[0142] In other words, since this is the second time to avoid the section chief, a different avoidance method from the first avoidance method is selected and an event is caused. The first avoidance method described with reference to Figure 2 is an avoidance method in which an incoming call from the president is a fictitious event.
[0143] User U1 looks at the display on the smartwatch and tells his manager that he has a meeting with a client. By choosing to go to the meeting with the client, user U1 can avoid being scolded by the manager, as shown by the tip of arrow A42.
[0144] In this way, if the other person is someone you know, you will use a different avoidance method than you used in the past. If you use the same avoidance method on the same person, the other person may become suspicious and your relationship may be damaged in the future, but this can be prevented.
[0145] The operation of the action support server 1 when the other party is an unknown person is basically the same as when the other party is an unknown person, except that an avoidance method different from the one used in the past is used.
[0146] FIG. 22 is a diagram showing an example of avoiding familiar people.
[0147] When there is a person that the user wants to avoid, that is, when there is a person that the user does not want to meet, the user pre-registers information about that person, such as a facial image, in the action support server 1. Other information that can be used to identify a person, such as the ID or external appearance of the person that the user does not want to meet, may also be registered. In the action support server 1, for example, a person that is the same as a person that has been pre-registered is determined to be someone the user knows, and a person different from the person that has been pre-registered is determined to be someone the user does not know.
[0148] 22, while the user is, for example, in a company, images captured by a camera mounted on the user's client terminal are continuously transmitted to the action support server 1. For example, a wide-angle image captured by a camera C capable of capturing an image of a 360-degree range around the user is transmitted to the action support server 1.
[0149] In the action support server 1, images taken around the user are analyzed, and if there is a person present, the person is identified. If it is detected as a context that the section chief, who is registered as a person the user does not want to meet, is near the user and approaching, an inquiry is made as to whether or not to avoid the person, as shown in the balloon in Fig. 23. If an avoidance request is made in response to the inquiry, and if the user is moving in the opposite direction to the section chief, the user is notified to continue moving forward without turning around.
[0150] FIG. 24 is a diagram showing an example of a notification output.
[0151] If the client terminal held by the user is a smartphone, the user is notified by a message on the display to continue moving forward without turning around, as shown in A of Fig. 24. Also, if the user is wearing earphones, the user is notified by audio to continue moving forward without turning around, as shown in B of Fig. 24.
[0152] If the section manager speaks to the user despite such guidance, the section manager will be avoided at desired avoidance level 2, as described with reference to Fig. 21. Note that even if the user knows the person speaking to him, the desired avoidance level is specified by the user as appropriate.
[0153] Rather than simply being guided, a fictitious event such as that described above may be triggered before contact with the other party, and the user may choose an action accordingly to avoid the section chief.
[0154] FIG. 25 is a diagram showing an example of a registration screen for people you do not want to meet.
[0155] When a user launches a behavior support application installed on a smartphone, which is a client terminal, and performs a predetermined operation, a registration screen such as that shown in Fig. 25 is displayed. The behavior support application is an application program that realizes a function for supporting the selection of behavior as described above in cooperation with the behavior support server 1. The registration screen shown in Fig. 25 is displayed based on information transmitted from the behavior support server 1 after communication is performed between the behavior support application and the behavior support server 1.
[0156] In the example of Figure 25, three acquaintances can be registered as people one does not want to meet. "People who cause stress" in the message of Figure 25 refers to people one does not want to meet.
[0157] The information of the person that the user does not want to meet is registered as a face photo, name, nickname, personality, etc. For each person that the user does not want to meet, the user may be able to register a desired level of avoidance and a method of avoidance.
[0158] <<Deciding workarounds based on user values>> Even when encountering the same situation, the preferred avoidance method varies from person to person. In other words, the preferred avoidance method varies depending on the person's values. The action support server 1 may use the user's values to determine the avoidance method.
[0159] FIG. 26 is a diagram showing an example of a questionnaire screen displayed by the action support application.
[0160] In the example of Fig. 26, the questionnaire is designed to allow the user to select from two options the item that they think has poor cost performance. The user looks at the two options, instantly determines which item has poor cost performance, and selects one of the options.
[0161] For example, whether a "department manager" or an "employee" is considered to have poor (low) cost performance is a question that examines values regarding lifestyle. A user who thinks that a "department manager" is more cost-effective is likely to be a user who has ambition, seeks social status, and values that emphasize the organization. On the other hand, a user who thinks that an "employee" is more cost-effective is likely to be a user who has no ambition, thinks that a moderate social status is fine, and values that emphasize the self.
[0162] In the action support server 1, the user's answers to the questionnaire are analyzed to identify a value type, which is a type (group) according to the user's values.
[0163] FIG. 27 is a diagram showing examples of value types.
[0164] As shown in Fig. 27, for example, three value types, A type, B type, and C type, are prepared. Any one of the three value types is specified according to the user's value. Four or more value types may be prepared.
[0165] For example, Type A is a value type who chooses a way to avoid a situation that does not ruin the atmosphere and takes into consideration the boss's mood and convenience. Type B is a value type who chooses a way to avoid a situation no matter what, even if it makes them look bad. Type C is a value type who chooses a way to avoid a situation by deceiving the other person as best they can while maintaining a good relationship with them.
[0166] In the questionnaire in which the user selects either "Manager" or "Employee" as described with reference to Fig. 26, the value type of a user who thinks that "Manager" is more cost-effective is likely to be identified as Type A. Also, the value type of a user who thinks that "Employee" is more cost-effective is likely to be identified as Type B.
[0167] Using the value type thus identified, a avoidance method that takes into account the value of each user is determined. For example, by using the value type as an input of the avoidance method determination model M, a avoidance method that takes into account the value is determined.
[0168] FIG. 28 is a diagram showing examples of avoidance methods for each value type.
[0169] The avoidance method shown in FIG. 28 is used when the user is talking to his / her boss and wants to leave the situation.
[0170] For example, a user whose value type is type A may select the avoidance method of returning to desk work because an idea for work has come to his / her mind. In this case, the event of coming up with an idea for work becomes a fictitious event. In response to a notification from the action support server 1, the user may leave in front of his / her boss, saying something like, "I've come up with a great idea, so I'll hurry back to my desk and put it together before I forget!"
[0171] A user whose value type is type B selects an avoidance method of leaving the place because of an incoming call from a friend. In this case, the event of an incoming call from a friend becomes a fictitious event. In response to a notification from the action support server 1, the user, for example, leaves in front of the boss, saying something like "Oh no, there's a call."
[0172] The avoidance method selected by a user whose value type is type C is to leave the place by citing that the regular documents have not been completed and that they will be returning to desk work. In this case, the event that the regular documents have not been completed becomes a fictitious event. For example, in response to a notification from the action support server 1, the user leaves in front of the boss, saying, "The documents have not been completed. I need to hurry up. I am truly sorry. Excuse me."
[0173] By determining the avoidance method using the value type, the user can avoid the other party using an avoidance method that matches his / her own value. The avoidance method may be determined based on other attributes of the user, such as hobbies, preferences, etc., in addition to the value.
[0174] <<Configuration of each device>> Here, the configuration of a device that realizes the action support system will be described.
[0175] <Configuration of Action Support Server 1> FIG. 29 is a block diagram showing an example of the hardware configuration of the action support server 1. As shown in FIG.
[0176] 29, the action support server 1 is configured by a computer. The action support server 1 may be realized by a plurality of computers.
[0177] A central processing unit (CPU) 101, a read only memory (ROM) 102, and a random access memory (RAM) 103 are interconnected by a bus 104.
[0178] An input / output interface 105 is further connected to the bus 104. An input unit 106 including a keyboard, a mouse, etc., and an output unit 107 including a display, a speaker, etc. are connected to the input / output interface 105.
[0179] Furthermore, a storage unit 108 , a communication unit 109 , and a drive 110 are connected to the input / output interface 105 .
[0180] The storage unit 108 is configured with a hard disk, a non-volatile memory, etc. The storage unit 108 stores various information such as the programs executed by the CPU 101 and information on each user.
[0181] The communication unit 109 is configured with a network interface, etc. The communication unit 109 communicates with various devices for realizing the action support system, such as client terminals owned by each user and client terminals owned by collaborators, via the Internet.
[0182] FIG. 30 is a block diagram showing an example of the functional configuration of the action support server 1. As shown in FIG.
[0183] At least some of the functional units shown in Fig. 30 are realized by executing a predetermined program by the CPU 101 in Fig. 29. An information processing unit 121 is realized in the action support server 1. The information processing unit 121 is composed of a dialogue unit 131, a context detection unit 132, an event generation unit 133, a value judgment unit 134, a user attribute storage unit 135, an avoidance information acquisition unit 136, and a learning unit 137 in addition to the avoidance method determination unit 11 described above.
[0184] The dialogue unit 131 communicates with the client terminal and realizes dialogue with the user. The dialogue by the dialogue unit 131 is performed using voice or text. Various dialogues, such as a dialogue for requesting avoidance and a dialogue for confirming a desired level of avoidance, are performed with the user.
[0185] 8 is the process performed by the dialogue unit 131. Information representing that the user is making an avoidance request is supplied to the context detection unit 132. In addition, information representing the avoidance desire level confirmed by dialogue with the user is supplied to the avoidance method determination unit 11.
[0186] The context detection unit 132 acquires sensor data transmitted from the client terminal, and detects the user's context, including the external and internal situations described above.
[0187] For example, the context detection unit 132 detects the external situation by analyzing an image captured by a camera of the client terminal and a sound detected by a microphone of the client terminal, and detects the internal situation by analyzing an image captured by a camera of the client terminal, a sound detected by a microphone, and a biological reaction of the user detected by a biological sensor of the client terminal.
[0188] The context detection unit 132 also detects the location of the user, the direction of the user's movement, and the direction of the user's gaze as context based on sensor data detected by other sensors of the client terminal, such as a gyro sensor, an acceleration sensor, a positioning sensor, etc. The context detection unit 132 also detects contexts such as whether or not there is a possibility of contact with a suspicious person.
[0189] In this way, the context is detected using at least one of the multiple types of sensor data transmitted from the client terminal.
[0190] When an incident that becomes an event trigger occurs, the context detection unit 132 outputs information on the detected context to the avoidance method determination unit 11. The processes of steps S1, S2, and S3 in FIG.
[0191] The avoidance method determination unit 11 determines an avoidance method according to the context of the user. As described with reference to Fig. 6, the avoidance method according to the context is determined using the avoidance method determination model M. The output of the avoidance method determination model M obtained by inputting information representing the avoidance desire level supplied from the dialogue unit 131, information representing the context supplied from the context detection unit 132, information representing the value type read from the user attribute storage unit 135, and the like, becomes information representing the avoidance method.
[0192] Information indicating the avoidance method determined by the avoidance method determination section 11 is supplied to the event generation section 133. The process of step S5 in FIG.
[0193] The avoidance method may be determined based on information that indicates a correspondence relationship between the context or the like and the avoidance method, which is set in advance, instead of being determined by inference using the avoidance method determination model M. The avoidance method may be determined by performing a predetermined calculation based on the information such as the context. Various methods can be adopted as a method for determining an avoidance method according to the context.
[0194] The event generating unit 133 communicates with the client terminal, generates a fictitious event according to the avoidance method determined by the avoidance method determining unit 11, and presents the event to the user. As described above, the event is presented to the other person of the user and people around the user as appropriate. The process of step S6 in FIG. 8 is the process performed by the event generating unit 133.
[0195] The value judgment unit 134 acquires responses to a questionnaire conducted using the action support application, and identifies a value type according to the user's values. Information on the value type identified by the value judgment unit 134 is stored in the user attribute storage unit 135 together with other information on the user.
[0196] The user attribute storage unit 135 stores various attribute information related to the user, such as information on the client terminal, information on people registered by the user as people the user does not want to meet, information on value type, and information on collaborators, by linking them to, for example, the user's ID. The information on the client terminal includes the specifications and location of the client terminal, information for communicating with the client terminal, etc. The information for communicating with the client terminal includes the telephone number and email address of the client terminal.
[0197] Among the information stored in the user attribute storage unit 135, information used to determine a avoidance method, such as value type information, is read by the avoidance method determination unit 11. In addition, information used to generate an event, such as information on a client terminal used to present an event, is read by the event generation unit 133.
[0198] The avoidance information acquisition unit 136 receives and acquires the avoidance information transmitted from each client terminal. The avoidance information acquisition unit 136 also makes the avoidance information public and allows each user to share it. The avoidance information acquired by the avoidance information acquisition unit 136 is supplied to the learning unit 137.
[0199] The learning unit 137 learns the avoidance method determination model M (learns parameters constituting the avoidance method determination model M) based on the avoidance information acquired by the avoidance information acquisition unit 136. Information on the avoidance method determination model M obtained by the learning unit 137 is supplied to the avoidance method determination unit 11.
[0200] The avoidance method determination model M may be trained using only the avoidance information whose score calculated based on the evaluation of each user is higher than a threshold value, or may be trained using only the avoidance information relating to the avoidance methods that have been successful in avoiding an obstacle.
[0201] <Client terminal configuration> FIG. 31 is a block diagram showing an example of the configuration of the client terminal 201. As shown in FIG.
[0202] The client terminal 201 is configured by connecting a sensor unit 212, a storage unit 213, an operation unit 214, a communication unit 215, and an output unit 216 to a control unit 211. The client terminal 201 is an information processing terminal that constitutes the action support system.
[0203] The control unit 211 is composed of a CPU, a ROM, a RAM, etc. The control unit 211 executes a predetermined program by the CPU and controls the overall operation of the client terminal 201. In the control unit 211, a sensor data transmission unit 221 and an event presentation unit 222 are realized by executing a program such as an action support application.
[0204] The sensor data transmission unit 221 controls the communication unit 215 to communicate with the action support server 1 and transmits the sensor data supplied from the sensor unit 212 to the action support server 1 .
[0205] The sensor unit 212 supplies sensor data including an image captured by a camera 231, a voice detected by a microphone 232, a user's position detected by a positioning sensor 233, and biometric data detected by a biometric sensor 234. Data detected by other sensors, such as data detected by a gyro sensor or acceleration sensor, and data detected by a temperature sensor, may be included in the sensor data.
[0206] The event presentation unit 222 communicates with the action support server 1 by controlling the communication unit 215 , and presents events according to the control of the action support server 1 .
[0207] For example, when presenting that there is an incoming call, the event presenting unit 222 causes information about the caller to be displayed on the display 241 and causes the ringtone of the call to be output from the speaker 242. When guiding the user's travel direction, the event presenting unit 222 causes the speaker 242 to output a navigation voice or a voice of a third party calling the user.
[0208] When the client terminal 201 is an HMD, the event presenter 222 displays a virtual object on a display 241 provided in front of the user's eyes to guide the user.
[0209] The event presentation unit 222 presents the event by various other methods, such as displaying a message to call the user on the display 241. When the event is presented using a device external to the client terminal 201, the event presentation unit 222 communicates with the external device via the communication unit 215 and performs processing such as controlling the external device to present the event.
[0210] The sensor unit 212 is composed of a camera 231 , a microphone 232 , a positioning sensor 233 , and a biosensor 234 .
[0211] The camera 231 captures an image of the surroundings of a user who has the client terminal 201, and outputs the image obtained by capturing the image to the control unit 211. The image captured by the camera 231 may be a still image or a video image.
[0212] The microphone 232 detects various sounds such as the user's voice, the voice of the person speaking to the user, and surrounding environmental sounds, and outputs them to the control unit 211.
[0213] The positioning sensor 233 is configured by a GPS sensor etc. The positioning sensor 233 detects the position of the client terminal 201 and outputs it to the control unit 211.
[0214] The biosensor 234 is composed of a body temperature sensor, a heart rate sensor, etc. A sensor for detecting brain waves such as alpha waves and beta waves may be included in the biosensor 234. The biosensor 234 detects the user's biometric data such as body temperature, heart rate, brain waves, etc., and outputs the data to the control unit 211.
[0215] The storage unit 213 is configured with a flash memory, etc. The storage unit 213 stores various data such as data for the action support application.
[0216] The operation unit 214 is composed of a touch panel provided on the display 241, buttons provided at predetermined positions on the housing of the client terminal 201, etc. The operation unit 214 detects a user's operation and outputs information indicating the content of the operation to the control unit 211.
[0217] The communication unit 215 is an interface for short-distance wireless communication such as Bluetooth (registered trademark) and wireless LAN, and an interface for wireless communication using a mobile communication system (WAN) such as 4G and 5G. The communication unit 215 communicates with an external device such as the action support server 1.
[0218] The output unit 216 is composed of a display 241 and a speaker 242. The display 241 displays various information under the control of the control unit 211. The speaker 242 outputs various voices and sound effects under the control of the control unit 211.
[0219] Other modules that interface with the user, such as a vibration generating module and a robot arm, may be provided in the output unit 216. Each component of the output unit 216 is used to present an event.
[0220] The above-described configuration of the client terminal 201 is changed as appropriate depending on the type of the client terminal 201, such as a smartphone, a smart watch, an HMD, etc. Depending on the type of the client terminal 201, some of the configurations shown in Fig. 31 may not be provided, or other configurations not shown in Fig. 31 may be provided.
[0221] <<Modifications>> <Avoidance Reservation> The user may be allowed to set in advance a avoidance method according to the context. In this case, the user sets a future context and a avoidance method to be used when the context is detected. The user can, in a sense, reserve the avoidance method.
[0222] The reservation of an avoidance method is performed by setting the situation (context), the desired avoidance level, the details of the event, etc., using the menu screen of the behavioral support application. It is possible to set the settings related to places such as the way home, on the train, in front of the station, in the downtown area, etc., and the settings related to events such as picking up girls, solicitations, and drunk people, etc., using the menu screen.
[0223] When a context identical to the context set by the user is detected, the action support server 1 generates an event for causing the user to avoid the context by using a previously set avoidance method.
[0224] By being able to schedule a workaround, a user can prepare for the premonition that going to a certain location may cause annoyance.
[0225] <Support for choosing actions to bring two people closer together> Although the case has been described where an event is triggered to avoid a person, i.e., to distance the person, in response to the user feeling that the other person is bothersome, an event may also be triggered to bring the other person closer. An event to bring the other person closer is triggered in response to the user feeling that the other person is too far away. The event to bring the other person closer is also, for example, a fictitious event.
[0226] By the user selecting an action in response to the occurrence of an event, the distance between the user and the other person is brought closer, and the user and the other person can feel comforted by each other. The support provided by the action support server 1 is to support the user in selecting an action that brings the user and the other person closer and allows them to feel comforted by each other.
[0227] The content of the events, designed to help each other feel soothed, will also vary depending on the context, including whether the other person knows the other person, and the desired level of healing.
[0228] For example, if a user requests an event to occur because the user feels that a friend is not feeling well, a fictitious event such as a stranger calling will be generated by the action support server 1. By the user answering a wrong number call from a stranger and talking about the incident such as the wrong number call, the user can become closer to the other person and feel comforted.
[0229] If it is detected that the user is becoming excited after talking with a friend, the action support server 1 may suggest going to a nearby cafe and start providing directions using the screen of the client terminal.
[0230] Also, an event may be triggered in which a mutual friend of the user and the other person appears as a helper and suggests that the three of them go to a cafe. In this case, too, the action support server 1 notifies the helper of a fictitious event as the content of the call.
[0231] Instead of causing a fictitious event, the action support server 1 may simply notify the user of a certain question and suggest that the user ask the other person the same question. By asking a friend, "What has comforted you recently?" or a stranger eating ice cream on the street, "Where did you buy that?", it becomes possible to become closer to the other person.
[0232] In this way, it is also possible for the action support server 1 to trigger an event that brings the player closer to the other player, rather than an event that causes the player to distance themselves from the other player.
[0233] That is, the action support server 1 is an information processing device that supports the user's action selection by generating fictitious events that may increase or decrease the distance between the user and a person the user encounters. The distance between the user and a person includes not only physical distance but also mental distance.
[0234] <Other> 8, such as detecting the context and determining the avoidance method, may be performed by the client terminal 201. In this case, the information processing unit 121 in FIG. 30 is provided in the client terminal 201. The information processing unit 121 is realized in the client terminal 201 by executing an action support application.
[0235] About the Program The above-mentioned series of processes can be executed by hardware or software. When the series of processes is executed by software, the program constituting the software is installed in a computer incorporated in dedicated hardware or a general-purpose personal computer.
[0236] The program to be installed is provided by being recorded on a removable medium 111 such as an optical disk (CD-ROM (Compact Disc-Read Only Memory), DVD (Digital Versatile Disc), etc.) or a semiconductor memory. Alternatively, the program may be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital broadcasting. The program can be installed in advance in the ROM 102 or the storage unit 108.
[0237] In addition, the program executed by the computer may be a program in which processing is performed chronologically in the order described in this specification, or it may be a program in which processing is performed in parallel or at the required timing, such as when called.
[0238] In this specification, a system refers to a collection of multiple components (devices, modules (parts), etc.), regardless of whether all the components are in the same housing. Therefore, multiple devices housed in separate housings and connected via a network, and a single device in which multiple modules are housed in a single housing, are both systems.
[0239] The effects described herein are merely examples and are not limiting, and other effects may also be present.
[0240] The embodiments of the present technology are not limited to the above-described embodiments, and various modifications are possible without departing from the gist of the present technology.
[0241] For example, the present technology can be configured as cloud computing, in which a single function is shared and processed collaboratively by multiple devices via a network.
[0242] Furthermore, each step described in the above flow chart can be executed by one device, or can be shared and executed by a plurality of devices.
[0243] Furthermore, when a single step includes multiple processes, the multiple processes included in the single step can be executed by a single device, or can be shared and executed by multiple devices.
[0244] Example of configuration combination The present technology can also be configured as follows.
[0245] (1) An information processing unit is provided for generating a fictitious event that changes the distance between the user and a person encountered by the user according to the user's context and presenting the event to the user. Information processing device. (2) The information processing unit presents the event to the user and people around the user, including at least the other person. The information processing device according to (1). (3) The information processing unit generates the event with different contents depending on whether the other party is a person known to the user or a person unknown to the user. The information processing device according to (1) or (2). (4) When the other party is a person known to the user, the information processing unit generates the event having a content different from the event that has been generated with the same person as the other party. The information processing device according to (3). (5) The information processing unit generates the event by regarding a person who is the same as a person previously registered by the user as an acquaintance, and regarding a person different from the person previously registered as an unknown person. The information processing device according to (3) or (4). (6) The information processing unit generates the event having different contents according to a level indicating a desired degree of changing the distance between the user and the other person. The information processing device according to any one of (1) to (5). (7) The information processing unit generates the event having different contents according to the level designated by the user. The information processing device according to (6). (8) A context detection unit detects the context based on sensor data detected by a sensor, The information processing unit generates the event when the context indicating that the user has uttered a predetermined word that triggers the event is detected, or when the context indicating that a biological reaction of the user shows a predetermined reaction is detected. 8. The information processing device according to any one of (1) to (7). (9) The information processing unit generates the event that increases the distance between the user and the other person. The information processing device according to any one of (1) to (8). (10) The information processing unit generates the event when it is predicted that the user and the other person will come into contact with each other, and guides the user's traveling direction away from the other person. The information processing device according to (9). (11) The information processing unit notifies the user that contact with the other person is predicted, and generates the event in response to an instruction from the user to move away from the other person. The information processing device according to (9) or (10). (12) The information processing unit presents the event to the user by outputting a sound notifying the user of the content of the event from a device owned by the user. The information processing device according to any one of (9) to (11). (13) The information processing unit generates the event for increasing the distance between the user and the other person when the user and the other person are in contact with each other and the context of the user changes to a state in which the user desires to increase the distance between the user and the other person. The information processing device according to (9). (14) The information processing unit causes a third party to call the user as the event, and causes a device owned by the user to output information regarding the content of the call to the user. The information processing device according to (13). (15) The information processing unit generates an event for the user and outputs information indicating the content of the event from a device owned by the user. The information processing device according to (13). (16) An information processing device, generating fictitious events that change the distance between the user and people encountered by the user in response to the user's context; Presenting the event to the user Information processing methods. (17) On the computer, generating fictitious events that change the distance between the user and people encountered by the user in response to the user's context; Presenting the event to the user A program for executing a process. (18) An information processing device including an information processing unit that generates a fictitious event that changes a distance between a user and a person encountered by the user in accordance with a context of the user; an information processing terminal including an output unit that presents the event to the user under control of the information processing device; An information processing system consisting of: [Explanation of symbols]
[0246] 1 Action Support Server, 11 Avoidance Method Determination Unit, 121 Information Processing Unit, 131 Dialogue Unit, 132 Context Detection Unit, 133 Event Generation Unit, 134 Value Judgment Unit, 135 User Attribute Storage Unit, 136 Avoidance Information Acquisition Unit, 137 Learning Unit, 201 Client Terminal, 211 Control Unit, 221 Sensor Data Transmission Unit, 222 Event Presentation Unit
Claims
1. A context detection unit that detects a context based on sensor data detected by a sensor; an information processing unit that, when it is detected as the context that the user has uttered a word that triggers an event that changes the distance between the user and a person encountered by the user, presents information about the event having different content according to a level that indicates a desired degree of changing the distance between the user and the person, which is designated by the user; An information processing device comprising:
2. The information processing unit presents information about the event to the user and to people around the user, including at least the other person. The information processing device according to claim 1 .
3. The information processing unit presents information about the event with different contents depending on whether the other person is the same person as the person whose identification information is registered or a different person, based on the identification information registered in advance. The information processing device according to claim 1 .
4. When the other person is the same person whose identification information is registered, the information processing unit presents information about the event having a content different from that of the event for which information has been presented to the same person. The information processing device according to claim 3 .
5. The information processing unit presents information about the event when a biological reaction of the user showing a predetermined reaction is detected as the context. The information processing device according to claim 1 .
6. The information processing unit presents information about the event that increases the distance between the user and the other person. The information processing device according to claim 1 .
7. The information processing unit presents information about the event to the user by outputting a sound notifying the user of the content of the event from a device owned by the user. The information processing device according to claim 1 .
8. The information processing unit causes a device owned by the user to output information indicating that a third party is calling the user as information related to the event. The information processing device according to claim 1 .
9. The information processing unit outputs information on the user's business as information on the event from a device owned by the user. The information processing device according to claim 1 .
10. An information processing device, Detecting a context based on sensor data detected by a sensor; When it is detected as the context that the user has uttered a word that triggers an event that changes the distance between the user and a person encountered by the user, information about the event having different content according to a level that indicates a degree of desire to change the distance between the user and the person, which is designated by the user, is presented. Information processing methods.
11. On the computer, Detecting a context based on sensor data detected by a sensor; When it is detected as the context that the user has uttered a word that triggers an event that changes the distance between the user and a person encountered by the user, information about the event having different content according to a level that indicates a degree of desire to change the distance between the user and the person, which is designated by the user, is presented. A program for executing a process.
12. An information processing device comprising: a context detection unit which detects a context based on sensor data detected by a sensor; and an information processing unit which, when the context is detected to be the user uttering a word that triggers an event that changes the distance between the user and another person encountered by the user, controls the presentation of information relating to the event with different content according to a level designated by the user that indicates the degree to which the user wishes to change the distance between the other person; an information processing terminal including an output unit that presents information about the event to the user under control of the information processing device; An information processing system consisting of:
Citation Information
Patent Citations
High function telephone
JP2015050724A
Utterance system
JP2019158975A
Mental state analysis using wearable-camera devices
US20130245396A1
Display device and projection device
WO2013099407A1