Action analysis device

Abstract

To reduce mutual loads in regard to a communication between users.SOLUTION: A second image reading part 111 acquires a user image in which a first user U-1 is imaged. On the basis of a user image, a determination part 113 determines whether or not an action of the first user U-1 is either of: a first action that permits sharing of the user image to a second user U-2 and a conversation between the second user U-2 and the first user U-1; and a second action that permits only sharing of the user image. A permission notification part 114 is configured to: upon determination of the first action, transmits, to the second user terminal U-2, a first notification for notifying of permission of the sharing and the conversation of the user image; and, upon determination of the second action, transmits, to a second user terminal 20-2, a second notification for notifying of permission of the sharing of the user image.SELECTED DRAWING: Figure 6

Description

[Technical field]

[0001] The present invention relates to a behavior analysis device. [Background technology]

[0002] In recent years, the trend toward nuclear families has progressed, and in many homes, grandchildren and grandparents live separately. In many cases, grandparents watch over their grandchildren's growth by, for example, sharing photos taken by the grandchild's parents (the grandparents' daughters and sons) with the grandparents, or by talking to the grandparents on the phone, other than meeting in person.

[0003] For example, the information sharing system disclosed in Patent Document 1 below converts information input by voice into a mobile information terminal device into text data, and generates an association with photo data taken at that time as necessary. The information sharing system accumulates the data on a server via an Internet line, and notifies the mobile information terminals of members with whom the information should be shared, other than the person who input the data, that the information has been registered. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2022-095256 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, sharing photos may be delayed because parents have to take on the burden of selecting photos, uploading photos, etc. Also, when it comes to phone calls, parents may be concerned about each other's schedules and may not be able to talk casually.

[0006] An object of the present invention is to reduce the burden on users with regard to communication between them. [Means for solving the problem]

[0007] A behavioral analysis device according to one embodiment of the present invention includes an acquisition unit that acquires an image in which a first user appears; a determination unit that determines, based on the image, whether the behavior of the first user is either a first behavior in which sharing of the image with a second user different from the first user and a call between the second user and the first user are permitted, or a second behavior in which only sharing of the image is permitted; and a permission notification unit that, when the behavior is determined to be the first behavior, sends a first notification to a second user terminal used by the second user notifying permission for sharing of the image and the call, and, when the behavior is determined to be the second behavior, sends a second notification to the second user terminal notifying permission for sharing of the image. Effect of the Invention

[0008] According to one aspect of the present invention, it is possible to reduce the burden on users with regard to communication between them. [Brief description of the drawings]

[0009] [Figure 1] 1 is a block diagram showing a configuration of a system 1 according to an embodiment. [Diagram 2] FIG. 2 is a block diagram showing a configuration of a first user terminal 20-1. [Diagram 3] FIG. 2 is a block diagram showing a configuration of a second user terminal 20-2. [Figure 4] FIG. 13 is a block diagram showing a configuration of a third user terminal 20-3. [Diagram 5] FIG. 2 is a block diagram showing the configuration of a server 10. [Figure 6] FIG. 2 is a diagram illustrating data exchange between functional units. [Figure 7] 13 is a table showing an example of behavior classification. [Figure 8A] FIG. 11 is a schematic diagram showing an example of output of a first notification. [Figure 8B] FIG. 13 is a schematic diagram showing an example of output of a second notification. [Figure 9A] FIG. 11 is a schematic diagram showing another output example of the first notification. [Figure 9B]FIG. 11 is a schematic diagram showing another output example of the first notification. [Figure 10] FIG. 13 is a schematic diagram showing an example of output of a third notification. [Figure 11] 13 is a schematic diagram showing an example of an output of an access history to a user image; FIG. [Figure 12] FIG. 13 is a schematic diagram showing an example of output of a fourth notification. [Figure 13] 4 is a flowchart showing the operation of the processor 103 of the server 10. [Figure 14] 4 is a flowchart showing the operation of the processor 103 of the server 10. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] A. First embodiment A-1. System configuration 1 is a block diagram showing a configuration of a system 1 according to an embodiment. The system 1 includes a server 10 and a plurality of user terminals 20 (a first user terminal 20-1, a second user terminal 20-2, and a third user terminal 20-3). The server 10 is an example of a behavior analysis device. The first user terminal 20-1, the second user terminal 20-2, and the third user terminal 20-3 are connected to the server 10 via a network N.

[0011] The first user terminal 20-1 is used by the first user U-1. The second user terminal 20-2 is used by the second user U-2. The third user terminal 20-3 is used by the third user U-3. Hereinafter, when there is no need to distinguish between the first user terminal 20-1, the second user terminal 20-2, and the third user terminal 20-3, they may be simply referred to as "user terminal 20."

[0012] In this embodiment, the first user U-1, the second user U-2, and the third user U-3 are related by blood. Specifically, the second user U-2 is the parent of the third user U-3, and the third user U-3 is the parent of the first user U-1. In other words, the second user U-2 is the grandmother or grandfather of the first user U-1, and the first user U-1 is the grandchild of the second user U-2. The first user U-1 is a minor and lives under the supervision of the third user U-3, who is his parent. In this embodiment, the first user U-1 is one person, but there may be multiple people corresponding to the first user U-1. For example, if the third user U-3 has multiple children, the multiple people corresponding to the first user U-1 are siblings. The first user U-1 and the third user U-3 live together, but the second user U-2 lives in a different place. In addition, in this embodiment, the second user U-2 is assumed to be one person, but there may be multiple people corresponding to the second user U-2. The multiple people corresponding to the second user U-2 may be, for example, the grandfather and grandmother of the first user U-1.

[0013] The first user U-1 mainly uses the first user terminal 20-1 at the location K1. The location K1 is the "home" where the first user U-1 lives with the third user U-3, and is the living space of the first user U-1. The third user U-3 lives with the first user U-1 at the location K1, but spends his / her working hours, such as daytime hours on weekdays, at the location K3. The location K3 is the "workplace" of the third user U-3. The first user U-1 goes to school or kindergarten during the daytime on weekdays, and returns to the location K1 when his / her daily routine is completed. In this embodiment, it is assumed that the third user U-3 is at the location K3 when the first user U-1 returns home to the location K1. The second user U-2 mainly uses the second user terminal 20-2 at the location K2. The location K2 is the home of the second user U-2, and is the "grandparents' house" from the perspective of the first user U-1.

[0014] The server 10 assists in communication between a first user U-1, a second user U-2, and a third user U-3. Examples of communication between users U include direct communication such as conversation by videophone or normal voice call, communication in which one user U knows how the other user U is doing, such as sharing photos or videos, or communication in which one user U watches over whether the other user U is living a normal life.

[0015] A-2. First user terminal 20-1 2 is a block diagram showing the configuration of the first user terminal 20-1. Since the main configuration of the first user terminal 20-1, the second user terminal 20-2 and the third user terminal 20-3 is the same, the same reference numerals are used and the description will be cited.

[0016] In this embodiment, the first user terminal 20-1 is not used by the first user U-1 personally, but is installed at the base K1 (for example, the living room of the base K1) and is shared by the family living at the base K1. The first user terminal 20-1 is, for example, a tablet terminal, a personal computer, or a dedicated terminal such as a so-called "surveillance camera." The first user terminal 20-1 may be, for example, a smartphone or other terminal used by the first user U-1 personally. The first user terminal 20-1 may also be used in a place other than the base K1 (for example, a park where the first user U-1 went together with the third user U-3).

[0017] The first user terminal 20-1 includes a display device 201, an input device 202, a communication device 203, an imaging device 204, a microphone 205, a speaker 206, a storage device 207, a processing device 208, and a bus 209 that interconnects these devices.

[0018] The display device 201 is a display device (for example, various display panels such as a liquid crystal display panel or an organic EL display panel) that displays information to the outside. The input device 202 is an input device (for example, a keyboard, a mouse, a switch, a button, or a sensor) that accepts input from the outside. The input device 202 may be a microphone 205 described later. The display device 201 and the input device 202 may be integrated into one (for example, a touch panel).

[0019] The communication device 203 communicates with the server 10 or other user terminals 20 using wireless communication or wired communication. In this embodiment, the communication device 203 has an interface connectable to a network N, and communicates with the communication device 101 of the server 10 (see FIG. 5 ) or the communication device 203 of the other user terminals 20 via the network N.

[0020] The microphone 205 collects sounds emitted by the first user U-1 and sounds generated around the first user U-1, and generates voice data. The speaker 206 generates sounds based on voice data acquired from another information processing device (e.g., the second user terminal 20-2 or the third user terminal 20-3). For example, the first user U-1 uses the microphone 105 and the speaker 106 to converse with the second user U-2.

[0021] The imaging device 204 generates imaging data showing an image of a subject. In this embodiment, the subject captured by the imaging device 204 of the first user terminal 20-1 is, for example, the first user U-1. Also, for example, when a third user U-3 is at the location K1, the third user U-3 may be the subject. The imaging device 204 has, for example, an imaging optical system and an imaging element. The imaging optical system is an optical system including at least one imaging lens. For example, the imaging optical system may have various optical elements such as a prism, or may have a zoom lens or a focus lens. The imaging element is, for example, a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary MOS) image sensor.

[0022] The storage device 207 is a recording medium readable by the processing device 208. The storage device 207 includes, for example, a nonvolatile memory and a volatile memory. The nonvolatile memory is, for example, a Read Only Memory (ROM), an Erasable Programmable Read Only Memory (EPROM), and an Electrically Erasable Programmable Read Only Memory (EEPROM). The volatile memory is, for example, a Random Access Memory (RAM). The storage device 207 of the first user terminal 20-1 stores a program PG1. The program PG1 is a program for operating the first user terminal 20-1.

[0023] The processing device 208 includes one or more central processing units (CPUs). The one or more CPUs are an example of one or more processors. Each of the processor and the CPU is an example of a computer.

[0024] The processing device 208 of the first user terminal 20-1 executes the program PG1 to function as an image control unit 211 and a first call control unit 212. At least some of the functions of the image control unit 211 and the first call control unit 212 may be configured by circuits such as a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), and an FPGA (Field Programmable Gate Array). Details of the image control unit 211 and the first call control unit 212 will be described later.

[0025] A-3. Second user terminal 20-2 3 is a block diagram showing the configuration of the second user terminal 20-2. In this embodiment, the second user terminal 20-2 is, for example, a smartphone that is used personally by the second user U-2, or a tablet terminal that is shared by a family. Alternatively, the second user terminal 20-2 may be a dedicated terminal such as a "surveillance camera." The second user U-2 mainly uses the second user terminal 20-2 at a location K2, which is his / her home (grandparents' house).

[0026] The second user terminal 20-2 includes a display device 201, an input device 202, a communication device 203, an imaging device 204, a microphone 205, a speaker 206, a storage device 207, a processing device 208, and a bus 209 that interconnects these devices. These configurations are similar to those of the first user terminal 20-1, so detailed explanations will be omitted.

[0027] The storage device 207 of the second user terminal 20-2 stores a program PG2. The program PG2 is a program for operating the second user terminal 20-2. The processing device 208 of the second user terminal 20-2 executes the program PG2 to function as a first notification control unit 221, a first image acquisition unit 222, and a second call control unit 223. The first notification control unit 221, the first image acquisition unit 222, and the second call control unit 223 will be described in detail later.

[0028] A-4. Third user terminal 20-3 4 is a block diagram showing the configuration of the third user terminal 20-3. In this embodiment, the third user terminal 20-3 is, for example, a smartphone that is personally used by the third user U-3. When the third user U-3 is at the location K3, which is his / her workplace, he / she uses the third user terminal 20-3 at the location K3, and when the third user U-3 is at the location K1, which is his / her home, he / she uses the third user terminal 20-3 at the location K1.

[0029] The third user terminal 20-3 includes a display device 201, an input device 202, a communication device 203, an imaging device 204, a microphone 205, a speaker 206, a storage device 207, a processing device 208, and a bus 209 that interconnects these devices. These configurations are similar to those of the first user terminal 20-1, so detailed explanations will be omitted.

[0030] The storage device 207 of the third user terminal 20-3 stores a program PG3. The program PG3 is a program for operating the third user terminal 20-3. The processing device 208 of the third user terminal 20-3 executes the program PG3 to function as a second notification control unit 231 and a third notification control unit 232. The second notification control unit 231 and the third notification control unit 232 will be described in detail later.

[0031] A-5. Server 10 5 is a block diagram showing the configuration of the server 10. The server 10 includes a communication device 101, a storage device 102, a processing device 103, and a bus 109 that interconnects these devices.

[0032] The communication device 101 communicates with a first user terminal 20-1, a second user terminal 20-2, and a third user terminal 20-3 using wireless communication or wired communication. In this embodiment, the communication device 101 has an interface connectable to a network N, and communicates with the first user terminal 20-1, the second user terminal 20-2, and the third user terminal 20-3 via the network N.

[0033] The storage device 102 is a recording medium readable by the processing device 103. The storage device 102 includes, for example, a nonvolatile memory and a volatile memory. The nonvolatile memory is, for example, a ROM, an EPROM, and an EEPROM. The volatile memory is, for example, a RAM. The storage device 102 stores a program PG4. The program PG4 is a program for operating the server 10.

[0034] The processing unit 103 includes one or more CPUs. The one or more CPUs are examples of one or more processors. Each of the processor and the CPU is an example of a computer.

[0035] By executing the program PG4, the processing device 103 functions as a second image acquisition unit 111, a determination unit 113, a permission notification unit 114, a reception unit 115, a transmission control unit 117, a third call control unit 118, a reception notification unit 119, and a detection notification unit 120. Details of the second image acquisition unit 111, the determination unit 113, the permission notification unit 114, the reception unit 115, the transmission control unit 117, the third call control unit 118, the reception notification unit 119, and the detection notification unit 120 will be described later.

[0036] A-6. Details of Processing Devices 103 and 208 Next, the details of each functional unit realized by the processing device 103 of the server 10, and the processing device 208 of the first user terminal 20-1, the second user terminal 20-2, and the third user terminal 20-3 will be described.

[0037] 6 is a diagram showing data exchange between each functional unit. Below, the functional units realized by the processor 103 of the server 10 will be mainly described, and the functional units realized by the processor 208 of the first user terminal 20-1, the second user terminal 20-2, and the third user terminal 20-3 will also be described.

[0038] The second image acquisition unit 111 acquires an image in which the first user U-1 appears (hereinafter, referred to as a "user image"). The second image acquisition unit 111 is an example of an acquisition unit. In this embodiment, the second image acquisition unit 111 acquires a user image from the first user terminal 20-1. As described above, the first user terminal 20-1 is installed at the base K1, which is the living space of the first user U-1. Therefore, the second image acquisition unit 111 acquires a user image from an imaging device 204 installed in the living space of the first user U-1. The user image may be a video or a still image, but when the behavior of the first user U-1 is determined by the determination unit 113 described later, the user image is preferably a video or a still image that is continuously captured at a predetermined period of time.

[0039] The image control unit 211 of the first user terminal 20-1 transmits an image captured by the imaging device 204 to the server 10. The image control unit 211 may cause the imaging device 204 to capture images at all times and transmit the captured images as is to the server 10. In this case, the second image acquisition unit 111 determines by object identification processing whether or not a person appears in the image transmitted from the first user terminal 20-1, and further determines by face identification processing whether the person in the image is the first user U-1.

[0040] Furthermore, the image control unit 211 may use, for example, an infrared sensor to determine whether a person is present within the imaging range of the imaging device 204, and if a person is present, cause the imaging device 204 to capture an image and transmit the captured image to the server 10. In this case, the second image acquisition unit 111 determines whether the person appearing in the image is the first user U-1 by face identification processing.

[0041] Furthermore, the image control unit 211 may use, for example, an infrared sensor or the like to determine whether a person is present within the imaging range of the imaging device 204, and if a person is present, have the imaging device 204 capture an image, perform face recognition processing on the captured image, and if the person appearing in the image is the first user U-1, transmit the image to the server 10. In this case, the second image acquisition unit 111 uses the image acquired from the first user terminal 20-1 as a user image as is.

[0042] The imaging device 204 of the first user terminal 20-1 may be, for example, a camera capable of panning, tilting, and zooming. In this case, when a person is present within the imaging range of the imaging device 204, the image control unit 211 may change the imaging direction of the imaging device 204 so that the person is continuously captured in the image.

[0043] The determination unit 113 determines, based on the user image, whether the behavior of the first user U-1 is either a first behavior in which sharing of the user image with a second user U-2 different from the first user U-1 and a call between the second user U-2 and the first user U-1 are permitted, or a second behavior in which only sharing of the user image is permitted. In this embodiment, the behavior of the first user U-1 is classified into a first behavior, a second behavior, and a third behavior. A case in which the behavior of the first user U-1 is neither the first behavior nor the second behavior is, for example, a case in which the behavior of the first user U-1 is the third behavior.

[0044] The determination unit 113 analyzes the user image using, for example, AI (Artificial Intelligence) to determine the content of the behavior of the first user U-1. The determination unit 113 determines the content of the behavior of the first user U-1 based on, for example, whether the first user U-1 is standing, sitting, or lying down (posture), whether he / she is moving or standing still (presence or absence of movement), whether he / she is holding an object in his / her hand, or if he / she is holding an object, what he / she is holding (presence or absence of possession and the type of possession), whether he / she is talking (presence or absence of vocalization), etc.

[0045] 7 is a table showing an example of classification of behaviors. As described above, in this embodiment, the behaviors of the first user U-1 are classified into a first behavior, a second behavior, and a third behavior. As a very rough classification, the first behavior is behavior that the first user U-1 is considered to be "not busy," and the second and third behaviors are behaviors that the first user U-1 is considered to be "busy."

[0046] The first action is, for example, at least one of playing a game, watching a video, eating and drinking, or talking with a sibling of the first user U-1. When the first user U-1 is performing the first action, sharing of a user image with the second user U-2 and a call between the second user U-2 and the first user U-1 are permitted. When the first user U-1 is performing the first action, the first user U-1 is considered not to be busy, so a call with the second user U-2 is permitted. Note that the call may be an exchange of voice only (voice call), or may be a video call in which, in addition to voice, an image of the first user U-1 and an image of the second user U-2 captured by the imaging device 204 are exchanged. Also, when the first user U-1 is performing the first action, there is no particular problem in sharing the user image with the second user U-2, so sharing of the user image with the second user U-2 is permitted. The second user U-2 can obtain an image (user image) of the first user U-1 performing the first action, and can also talk to the first user U-1 via the user terminal 20. These two actions may be performed simultaneously.

[0047] The determination unit 113 determines that the first user U-1 is playing a game, for example, when the first user U-1 is facing a display such as a television with a remote controller in his / her hand, or is sitting with the game console in his / her hand.

[0048] The determination unit 113 determines that the first user U-1 is watching a video when, for example, the first user U-1 continues to look at (but does not operate) the screen of a television, tablet terminal, or smartphone for a predetermined time. Note that watching a video may be, for example, watching video content acquired via the network N, or watching a television broadcast, a DVD (Digital Versatile Disc), or recorded data.

[0049] For example, when the first user U-1 is holding food or drink to his / her mouth, the determination unit 113 determines that the first user U-1 is eating or drinking. For example, when a person registered as a sibling of the first user U-1 appears in the user image and the first user U-1 is talking to that person, the determination unit 113 determines that the first user U-1 is talking to a sibling.

[0050] The second action is at least one of studying, reading, and playing a musical instrument. When the first user U-1 is performing the second action, only the sharing of the user image with the second user U-2 is permitted. When performing the second action, the first user U-1 is considered to be busy, and therefore conversation with the second user U-2 is not permitted. On the other hand, since there is no particular problem in sharing the user image performing the second action with the second user U-2, the sharing of the user image with the second user U-2 is permitted. The second user U-2 can obtain the image of the first user U-1 performing the second action.

[0051] For example, when the first user U-1 is sitting at a desk with a writing implement in hand, the determination unit 113 determines that the first user U-1 is studying. For example, when the first user U-1 is holding a book in hand and looking at the book, the determination unit 113 determines that the first user U-1 is reading. Note that the determination unit 113 may determine whether the book is a comic book or a magazine based on the cover or the like of the book shown in the user image, and if the book is a comic book or a magazine, determine that the first user U-1 is performing the first behavior.

[0052] For example, when the first user U-1 is moving his / her hands toward an instrument such as a piano, or is moving his / her hands while holding an instrument such as a violin, the determination unit 113 determines that the first user U-1 is playing an instrument. In addition to playing an instrument, when the first user U-1 is taking up a lesson or a hobby, etc., the determination unit 113 may determine that the second behavior is stretching, strength training, dancing, swing practice, singing, drawing, etc.

[0053] The third behavior is at least one of sleeping, changing clothes, getting ready to go out, or a visit from a person other than the family of the first user U-1. The third behavior may be, for example, a behavior that does not fall into either the first behavior or the second behavior. When the first user U-1 is performing the third behavior, it is considered that the first user U-1 is busy and sharing of the user image is not appropriate. Therefore, sharing of the user image to the second user U-2 and conversation with the second user U-2 are not permitted.

[0054] For example, when the first user U-1 lies down and barely moves, the determination unit 113 determines that the first user U-1 is sleeping. For example, when the first user U-1 is putting on and taking off clothes, the determination unit 113 determines that the first user U-1 is changing clothes. For example, when the first user U-1 is taking things in and out of his / her bag or frequently going back and forth to other rooms, the determination unit 113 determines that the first user U-1 is preparing to go out. For example, when a person other than the family of the first user U-1 appears in the user image, the determination unit 113 determines that a person other than the family of the first user U-1 is visiting. In addition, the determination unit 113 may determine that the third behavior is a person who is talking to another person on the phone or a game machine, for example, as being on a call.

[0055] In addition, for example, the third user U-3 may be able to set what actions are the first action, the second action, and the third action.

[0056] In addition, the third user U-3 may be able to set whether to permit sharing of user images and calls when the third user U-3 is at the location K1. This is because the third user U-3, who is a parent (adult), may not want others to see images captured unexpectedly. In addition, when the third user U-3 is at home and receives a call from the second user U-2, not only the first user U-1 but also the third user U-3 may have to answer the call, which may be troublesome. Whether the third user U-3 is at the location K1 may be determined based on the captured image of the first user terminal 20-1, for example, or may be set by the third user U-3 via the first user terminal 20-1 or the third user terminal 20-3.

[0057] When the behavior of the first user U-1 is determined to be the first behavior, the permission notification unit 114 transmits a first notification notifying the second user terminal 20-2 used by the second user U-2 of permission to share the user image and to make a call. When the behavior of the first user U-1 is determined to be the second behavior, the permission notification unit 114 transmits a second notification notifying the second user terminal 20-2 of permission to share the user image.

[0058] If the behavior of the first user U-1 is determined to be the third behavior, neither sharing of the user image nor a call between the second user U-2 and the first user U-1 is permitted. Therefore, the permission notification unit 114 does not transmit a notification to the second user terminal 20-2.

[0059] When the first notification or the second notification is received, the first notification control unit 221 of the second user terminal 20-2 presents the content of the received notification to the second user U-2. Specifically, the first notification control unit 221 displays, for example, text, an icon, or an illustration indicating the content of the received notification on the display device 201. In addition, the first notification control unit 221 outputs, for example, a sound indicating the content of the received notification from the speaker 206, or an alarm sound prompting the second user U-2 to look at the display device 201. The first notification control unit 221 may output a notification to the second user U-2 immediately upon receiving the first notification or the second notification, or may output a notification that is valid at that time when the second user U-2 starts a predetermined application (an application for communication with the first user U-1).

[0060] FIG. 8A is a schematic diagram showing an example of output of the first notification. In the example of FIG. 8A, it is assumed that the name of the first user U-1 is "K (K-kun)". The first notification control unit 221 displays, on the display device 201 of the second user terminal 20-2, a message M1 indicating that there is a new image (a user image newly permitted to be shared) and a message M2 indicating that a call with the first user U-1 (K-kun) is possible. In addition, the first notification control unit 221 displays, on the display device 201, a first instruction button B1 instructing access to the user image and a second instruction button B2 instructing a call with the first user U-1. In addition, the first notification control unit 221 displays, on the display device 201, a third instruction button B3 for ending the first notification and returning the display to the original state. Restoring the display corresponds to returning to the screen immediately before the notification was made if the second user U-2 was using the second user terminal 20-2, and corresponds to returning to the home screen, lock screen, or the like if the second user terminal 20-2 was not being used.

[0061] If the second user U-2 wants to see the user image, he / she touches the first instruction button B1. When the first instruction button B1 is touched, the first image acquisition unit 222 of the second user terminal 20-2 transmits an image sharing instruction to the server 10. If the second user U-2 wants to talk to the first user U-1, he / she touches the second instruction button B2. When the second instruction button B2 is touched, the second call control unit 223 of the second user terminal 20-2 transmits a call start request to the server 10. If the second user U-2 does not need to share the user image or talk to the first user U-1, he / she touches the third instruction button B3. When the third instruction button B3 is touched, the display of the display device 201 is returned to the original state.

[0062] 8B is a schematic diagram showing an example of output of the second notification. The first notification control unit 221 displays a message M1 indicating that a new image is available on the display device 201 of the second user terminal 20-2. The first notification control unit 221 also displays a first instruction button B1 for instructing access to the user image on the display device 201. The first notification control unit 221 also displays a third instruction button B3 for ending the second notification and returning the display to the original state on the display device 201.

[0063] If the second user U-2 wishes to view the user image, he / she touches the first instruction button B1. When the first instruction button B1 is touched, the first image acquisition unit 222 of the second user terminal 20-2 transmits an instruction to share the image to the server 10. Furthermore, if the second user U-2 does not need to share the user image, he / she touches the third instruction button B3. When the third instruction button B3 is touched, the display of the display device 201 is returned to the original state.

[0064] FIG. 9A is a schematic diagram showing another output example of the first notification. The first notification control unit 221 displays the face image P1 of K on the display device 201 of the second user terminal 20-2. The first notification control unit 221 displays a message M1 indicating that there is a new user image. In addition, the first notification control unit 221 displays an icon P2 indicating the status of the first user U-1 near the face image P1. In the first notification, since the first user U-1 is available for a call, the first notification control unit 221 displays the icon P2 in green, for example. In addition, the first notification control unit 221 displays on the display device 201 a first instruction button B1 for instructing access to the user image, a second instruction button B2 for instructing a call with the first user U-1, and a third instruction button B3 for returning the display to the original state.

[0065] 9B is a schematic diagram showing another output example of the second notification. The first notification control unit 221 displays a message M1 indicating that a new image is available on the display device 201 of the second user terminal 20-2. The first notification control unit 221 also displays a first instruction button B1 instructing access to the user image on the display device 201. In the second notification, since the first user U-1 is not available for calls, the first notification control unit 221 displays the icon P2 in red, for example. The first notification control unit 221 also grays out the second instruction button B2, making it impossible to operate the second instruction button B2.

[0066] In the display mode as shown in FIG. 9A and FIG. 9B, if neither the first notification nor the second notification has been made, first notification control unit 221 displays a screen in which message M1 has been removed from the display of FIG. 9B.

[0067] The reception unit 115 receives at least one of an instruction to share a user image and an instruction to start a voice call sent by the second user terminal 20-2 in response to the first notification, and also receives an instruction to share a user image sent by the second user U-2 in response to the second notification.

[0068] When an instruction to share the user image is received, the transmission control unit 117 transmits the user image to the second user terminal 20-2. The file size of the user image transmitted to the second user terminal 20-2 may be reduced to a level that can be displayed on the second user terminal 20-2. The second user U-2 may be able to select the user images to be transmitted to the second user terminal 20-2, for example, by time period or date when the images were taken.

[0069] The first image acquisition unit 222 of the second user terminal 20-2 acquires the user image transmitted from the transmission control unit 117. The first image acquisition unit 222 displays the user image on the display device 201 of the second user terminal 20-2. The second user U-2 can view the user image displayed on the display device 201 of the second user terminal 20-2.

[0070] When the instruction to start a call is accepted, the third call control unit 118 connects the first user terminal 20-1 and the second user terminal 20-2 so that they can make a call. The third call control unit 118 transmits a call request to the first user terminal 20-1, for example. When the first call control unit 212 of the first user terminal 20-1 receives the call request, it displays text, an icon, an illustration, or the like indicating that a call is being received from the second user U-2 on the display device 201 of the first user terminal 20-1. In addition, the first call control unit 212 outputs, for example, from the speaker 206, a sound indicating that a call is being received from the second user U-2, or an alert sound prompting the first user U-1 to look at the display device 201.

[0071] Furthermore, the first call control unit 212 displays an operation button or the like for starting a call on the display device 201 of the first user terminal 20-1. A physical operation mechanism (such as a switch) for starting a call may be provided on the housing of the first user terminal 20-1. When the first user U-1 responds to an incoming call by pressing an operation button or the like, voice (in the case of a video call, an image showing the first user U-1 or the second user U-2 in addition to the voice) is transmitted and received between the first call control unit 212 of the first user terminal 20-1 and the second call control unit 223 of the second user terminal 20-2, and a call is made between the first user U-1 and the second user U-2.

[0072] When the first or second notification is made to the second user terminal 20-2, the reception notification unit 119 transmits a third notification indicating whether or not at least one of an instruction to share a user image or an instruction to start a call has been received from the second user terminal 20-2 to the third user terminal 20-3 used by a third user U-3 different from the first user U-1 and the second user U-2. In other words, when the first or second notification is made, the reception notification unit 119 transmits a third notification indicating whether or not there has been a response from the second user U-2 to the third user U-3.

[0073] Upon receiving the third notification from the reception notification unit 119, the second notification control unit 231 of the third user terminal 20-3 displays text, an icon, an illustration, or the like indicating the contents of the third notification on the display device 201 of the third user terminal 20-3. In addition, the second notification control unit 231 outputs, for example, from the speaker 206, a sound indicating the contents of the third notification, or an alert sound prompting the third user U-3 to look at the display device 201.

[0074] FIG. 10 is a schematic diagram showing an example of output of the third notification. In the example of FIG. 10, it is assumed that the name of the second user U-2 is "N (Mr. N)". The second notification control unit 231 displays, on the display device 201 of the third user terminal 20-3, a message M3 indicating that a new user image has been shared with the second user U-2 (Mr. N) and a message M4 indicating that the second user U-2 has accessed the shared user image. The message M3 includes the date and time when the user image was shared with the second user U-2 (the date and time when the first notification or the second notification was notified to the second user terminal 20-2), and the message M4 includes the date and time when the second user U-2 accessed the user image.

[0075] Furthermore, the second notification control unit 231 displays a fourth instruction button B4 for checking the access history to the user image of the second user U-2, and a fifth instruction button B5 for instructing a call with the second user U-2, on the display device 201. Furthermore, the second notification control unit 231 displays a third instruction button B3 for ending the third notification and returning the display to the original state, on the display device 201.

[0076] FIG. 11 is a schematic diagram showing an example of an output of an access history to a user image. When the third user U-3 presses the fourth instruction button B4, the access history shown in FIG. 11 is displayed. The access history includes an album name F1, a delivery date and time F2, and an access date and time F3. An album is a group consisting of a plurality of user images taken within a predetermined period. The album name is a phrase that succinctly indicates the contents of the album, and is determined, for example, by the third user U-3. In this case, immediately after the user image is taken, the album does not have an album name and is "Untitled". The server 10 may analyze the contents of the user image and automatically assign an album name.

[0077] The delivery date and time F2 indicates the date and time when the user image was shared with the second user U-2 (the date and time when the first notification or the second notification was notified to the second user terminal 20-2). The access date and time F3 indicates the date and time when the second user U-2 accessed the user image. If the access date and time F3 is blank, such as in the case of the album name "Birthday Party", it indicates that the second user U-2 has not accessed the user image in that album.

[0078] The notification by the reception notification unit 119 is made so that the third user U-3 can check whether the second user U-2 is living normally. For example, if the second user U-2 lives alone, he / she may not be able to call for help even if he / she becomes unwell or gets injured. Also, if the second user U-2 is elderly, he / she is more likely to have trouble than younger generations, even if he / she lives with multiple people. Since the second user U-2 is the parent of the third user U-3, the third user U-3 is concerned about whether the second user U-2 is living well. For example, the second user U-2 can check whether the second user U-2 is doing well by calling at a fixed time every week, but there may be cases where their schedules do not match, or the third user U-3 may forget to call in the midst of a busy daily life.

[0079] The third user U-3 can leisurely keep an eye on the second user U-2 by notifying the reception notification unit 119 of the presence or absence of a reaction to the first or second notification. For example, if there is no reaction to the first or second notification for a predetermined period of time (e.g., within the day of the notification), the second user U-2 may be in a different state than usual. In this case, the third user U-3 can check whether the second user U-2 has changed by pressing the fifth instruction button B5 in FIG. 10 to call the second user U-2 (or contact the second user U-2 using another message application, etc.).

[0080] The detection notification unit 120 transmits a fourth notification indicating that a change has occurred in whether or not the user image can be acquired to the third user terminal 20-3 used by a third user U-3 different from the first user U-1 and the second user U-2. Whether or not the user image can be acquired can be rephrased as whether or not an image in which the first user U-1 appears can be acquired by the second image acquisition unit 111. For example, if the first user U-1 is not at home, or if the first user U-1 is at home but in a room other than the living room where the first user terminal 20-1 is installed, the user image cannot be acquired. Examples of cases where a change occurs in whether or not the user image can be acquired include when the first user U-1 returns home from school or the like (when the user image changes from not available to available), or when the first user U-1 goes to a class or the like (when the user image changes from available to not available). In addition, in order to avoid the fourth notification being sent every time a very temporary change occurs, such as when the first user U-1 goes to the toilet, the fourth notification may be sent when a question arises about whether or not a user image can be acquired and this state continues for a predetermined period of time (for example, about 5 minutes).

[0081] Upon receiving the fourth notification from the detection notification unit 120, the third notification control unit 232 of the third user terminal 20-3 displays text, an icon, an illustration, or the like indicating the contents of the fourth notification on the display device 201 of the third user terminal 20-3. In addition, the second notification control unit 231 outputs, for example, from the speaker 206, a sound indicating the contents of the fourth notification, or an alert sound prompting the third user U-3 to look at the display device 201.

[0082] FIG. 12 is a schematic diagram showing an example of output of the fourth notification. The third notification control unit 232 displays a message M5 indicating that the user image of the first user U-1 (K-kun) can be acquired (K-kun has returned home) on the display device 201 of the third user terminal 20-3. The message M5 includes the date and time when the user image can be acquired. In addition, the third notification control unit 232 displays on the display device 201 a sixth instruction button B6 for instructing access to the current user image of the first user U-1 (a real-time image captured by the imaging device 204 of the first user terminal 20-1), a seventh instruction button B7 for instructing the start of a call with the first user U-1, and a third instruction button B3 for returning the display to the original state. When the third user U-3 presses the sixth instruction button B6, the latest user image is displayed on the display device 201. When the third user U-3 presses the seventh instruction button B7, a call is started between the third user terminal 20-3 and the first user terminal 20-1.

[0083] By sending the fourth notification, the third user U-3 can grasp the situation of the first user U-1 (whether the first user U-1 returned home safely, whether the first user U-1 left for lessons on time, etc.) while at the workplace K3. Furthermore, the third user U-3 can check the user image and talk to the first user U-1 as necessary, which makes it easy to keep an eye on the first user U-1.

[0084] A-7. Operation of the processing device 103 13 and 14 are flowcharts showing the operation of the processing device 103 of the server 10. The processing device 103 functions as the second image acquisition unit 111 and acquires an image from the first user terminal 20-1 (step S100). The processing device 103 functions as the second image acquisition unit 111 and determines whether the presence or absence of the first user U-1 (whether the first user U-1 is captured or not) in the image acquired in step S101 has changed (step S101). If there has been a change in the presence or absence of the first user U-1 (step S101: YES), the processing device 103 functions as the detection notification unit 120 and transmits a fourth notification to the third user terminal 20-3 (step S103). The third user U-3 checks the fourth notification output to the third user terminal 20-3 and checks whether the first user U-1 has returned home or the like. If there has been no change in the presence or absence of the first user U-1, the processing device 103 advances the process to step S103.

[0085] The processing device 103 functions as the second image acquisition unit 111 and determines whether the first user U-1 appears in the image acquired in step S101, that is, whether the image acquired in step S101 is a user image (step S103). If the first user U-1 does not appear in the image (step S103: NO), the processing device 103 returns to step S100 and continues acquiring images.

[0086] If the first user U-1 is in the image (step S102: YES), the processing device 103 functions as the determination unit 113 and determines whether the action of the first user U-1 is the first action, the second action, or the third action (step S104). If the action of the first user U-1 is the first action (step S105: YES), the processing device 103 functions as the permission notification unit 114 and transmits a first notification to the second user terminal 20-2 permitting sharing of the user image and a call with the first user U-1 (step S106). If the action of the first user U-1 is the second action (step S105: NO and step S107: YES), the processing device 103 functions as the permission notification unit 114 and transmits a second notification to the second user terminal 20-2 permitting sharing of the user image (step S108). If the action of the first user U-1 is the third action (step S105: NO and step S107: NO), the processor 103 does not issue a notification and returns the process to step S100.

[0087] Next, the processing device 103 functions as the reception unit 115 and receives an instruction from the second user terminal 20-2. If an instruction to share the user image is received (step S109: YES), the processing device 103 functions as the transmission control unit 117 and transmits the user image to the second user terminal 20-2 (step S110), and then proceeds to step S113. If an instruction to start a call is received (step S109: NO and step S111: YES), the processing device 103 functions as the third call control unit 118 and connects the first user terminal 20-1 and the second user terminal 20-2 so that they can make a call (step S112), and then proceeds to step S113.

[0088] If the user image is transmitted to the second user terminal 20-2 in step S110, if the first user terminal 20-1 and the second user terminal 20-2 are connected in step S112 so as to be able to communicate with each other, or if neither an instruction to share the user image nor an instruction to start a call is accepted (step S109: NO and step S111: NO), the processing device 103 functions as the acceptance notification unit 119 and transmits a third notification indicating the acceptance status of the instruction from the second user terminal 20-2 to the third user terminal 20-3 (step S113). After that, the processing device 103 returns the process to step S100.

[0089] A-8. Summary of embodiments As described above, the server 10 according to the embodiment judges whether the action of the first user U-1 is the first action or the second action based on the user image. Then, the server 10 transmits the first notification notifying the second user terminal 20-2 of permission to share the user image and to make a call if the action of the first user U-1 is the first action, and transmits the second notification notifying the second user terminal 20-2 of permission to share the user image if the action of the first user U-1 is the second action. Thus, an image in which the first user U-1 appears can be automatically shared, and compared with the third user U-3 transmitting the user image to the second user terminal 20-2 or uploading it to a photo sharing server, it is possible to reduce the effort. In addition, when the second user U-2 wants to talk to the first user U-1, he or she only needs to make a call at the timing of receiving the first notification, and there is no need to ask the first user U-1 about his or her availability in advance, improving convenience.

[0090] Furthermore, when the server 10 receives an instruction to share a user image from the second user terminal 20-2, it transmits the user image to the second user terminal 20-2, and when it receives an instruction to start a call, it connects the first user terminal 20-1 and the second user terminal 20-2 so that they can make a call. Therefore, the second user U-2 can obtain a user image and make a call with the first user U-1 with a single action, improving convenience.

[0091] Furthermore, when the first or second notification is transmitted to the second user terminal 20-2, the server 10 transmits to the third user terminal 20-3 a third notification indicating whether or not at least one of an instruction to share a user image or an instruction to start a notification has been received from the second user terminal 20-2. Thus, the third user U-3 can know whether or not there has been a reaction from the second user U-2 to the first or second notification. For example, if no reaction from the second user U-2 is observed for a predetermined period of time, the third user U-3 can contact the second user U-2 to check on his or her safety.

[0092] In addition, the server 10 transmits a fourth notification to the third user terminal 20-3, indicating that a change has occurred in whether the user image can be acquired. This allows the third user U-3 to check whether the first user U-1 has returned home or left for lessons on time, improving convenience.

[0093] B: Variation The following are modified aspects of the above-described embodiment. Two or more aspects selected from the following modified aspects may be combined as appropriate within the scope of not being mutually contradictory.

[0094] B1: First modified example In the above embodiment, based on the behavior of the first user U-1, it is determined whether the image of the first user U-1 can be shared with the second user U-2 and whether a call can be made with the first user U-1. In addition to this, for example, based on the behavior of the second user U-2, it may be determined whether the image of the second user U-2 can be shared with the first user U-1 and whether a call can be made with the second user U-2. That is, the first user U-1 may be able to talk to the second user U-2 or obtain a user image of the second user U-2.

[0095] In this case, the functional unit of the server 10 performs the following processes in addition to the processes of the above-mentioned embodiment. The second image acquisition unit 111 acquires a user image in which the second user U-2 appears. The determination unit 113 determines whether the behavior of the second user U-2 is either the first behavior or the second behavior based on the user image. The permission notification unit 114 transmits a first notification to the first user terminal 20-1 when the behavior is determined to be the first behavior, and transmits a second notification to the first user terminal 20-1 when the behavior is determined to be the second behavior.

[0096] In addition, the first user U-1, who is a grandchild, may not be interested in images of the second user U-2, who is a grandparent. In addition, the second user U-2, who is a grandparent, may not like others to see images taken unexpectedly. Therefore, with regard to the second user U-2, images may not be shared, and the first user U-1 may be notified only that the second user U-2 is "available for a call" when the second user U-2 is performing the first action.

[0097] Similarly, for the third user U-3, whether or not a call can be made or an image can be shared may be notified to at least one of the first user U-1 and the second user U-2 based on the current action.

[0098] According to the first modification, communication between users living apart becomes more active, and watching over each other can be realized with less burden.

[0099] B2: Second variant In the above-described embodiment, the behavior of the first user U-1 is determined by the server 10. However, the present invention is not limited to this, and the state of the first user U-1 may be estimated by the first user terminal 20-1, for example. In this case, the processing device 208 of the first user terminal 20-1 functions as the determination unit 113 and also functions as a transmission control unit that transmits information indicating whether the behavior of the first user U-1 is the first behavior, the second behavior, or the third behavior to the server 10. This reduces the processing load of the server 10.

[0100] Alternatively, not only the determination of an action but also the processes performed by the server 10 in the embodiment, such as the transmission of the first to fourth notifications, may be performed by the first user terminal 20-1. In this case, the processing device 208 of the first user terminal 20-1 functions as the second image acquisition unit 111, the determination unit 113, the permission notification unit 114, the reception unit 115, the transmission control unit 117, the third call control unit 118, the reception notification unit 119, and the detection notification unit 120. This eliminates the need for the server 10, simplifying the configuration of the system 1.

[0101] B3: Third variant In the above-described embodiment, the first user U-1 to the third user U-3 are assumed to be blood relatives. The relationship between the first user U-1 to the third user U-3 is not limited to this, and may be any group of people who agree to share mutual actions and images. For example, the first user U-1 to the third user U-3 may be friends or colleagues at work.

[0102] C:Other (1) In the above-described embodiment, ROM and RAM, etc. are given as examples of storage devices 102 and 207, but storage devices 102 and 207 may also be a flexible disk, a magneto-optical disk (e.g., a compact disk, a digital versatile disk, a Blu-ray (registered trademark) disc), a smart card, a flash memory device (e.g., a card, a stick, a key drive), a CD-ROM (Compact Disc-ROM), a register, a removable disk, a hard disk, a floppy (registered trademark) disk, a magnetic strip, a database, a server, or any other suitable storage medium.

[0103] (2) In the above-described embodiments, the described information, signals, etc. may be represented using any of a variety of different technologies. For example, data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the above description may be represented by voltages, currents, electromagnetic waves, magnetic fields or magnetic particles, optical fields or photons, or any combination thereof.

[0104] (3) In the above-described embodiment, the input / output information, etc. may be stored in a specific location (e.g., memory) or may be managed using a management table. The input / output information, etc. may be overwritten, updated, or added. The output information, etc. may be deleted. The input information, etc. may be transmitted to another device.

[0105] (4) In the above-described embodiments, the determination may be made based on a value represented by 1 bit (0 or 1), a Boolean (true or false) value, or a numerical comparison (e.g., comparison with a predetermined value).

[0106] (5) The order of the process steps, sequences, flow charts, etc. illustrated in the above-described embodiments may be changed without causing any inconsistency. For example, the methods described in this disclosure present elements of various steps using an example order, and are not limited to the particular order presented.

[0107] (6) Each function illustrated in Figures 2 to 5 is realized by any combination of at least one of hardware and software. Furthermore, the method of realizing each functional block is not particularly limited. That is, each functional block may be realized by using one device that is physically or logically combined, or may be realized by using two or more devices that are physically or logically separated and directly or indirectly connected (for example, by using wires, wirelessly, etc.). The functional block may be realized by combining the one device or the multiple devices with software.

[0108] (7) The programs exemplified in the above-described embodiments should be broadly interpreted to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, threads of execution, procedures, functions, etc., regardless of whether they are called software, firmware, middleware, microcode, hardware description language, or by other name.

[0109] Additionally, software, instructions, information, etc. may be transmitted or received over a transmission medium. For example, if the software is transmitted from a website, server, or other remote source using wired technologies (such as coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL)), and / or wireless technologies (such as infrared, microwave, etc.), then these wired and / or wireless technologies are included within the definition of transmission media.

[0110] (8) In each of the above embodiments, the terms “system” and “network” are used interchangeably.

[0111] (9) The information, parameters, etc. described in this disclosure may be expressed using absolute values, relative values ​​from a predetermined value, or corresponding other information.

[0112] (10) In the above-described embodiments, the portable device may be a mobile station (MS). A mobile station may be referred to by those skilled in the art as a subscriber station, a mobile unit, a subscriber unit, a wireless unit, a remote unit, a mobile device, a wireless device, a wireless communication device, a remote device, a mobile subscriber station, an access terminal, a mobile terminal, a wireless terminal, a remote terminal, a handset, a user agent, a mobile client, a client, or some other suitable term. In this disclosure, the terms "mobile station", "user terminal", "user equipment (UE)", "terminal", etc. may be used interchangeably.

[0113] (11) In the above-mentioned embodiments, the terms "connected" and "coupled" or any variation thereof refer to any direct or indirect connection or coupling between two or more elements, and may include the presence of one or more intermediate elements between two elements that are "connected" or "coupled" to each other. The coupling or connection between elements may be physical, logical, or a combination thereof. For example, "connected" may be read as "accessed." As used in this disclosure, two elements may be considered to be "connected" or "coupled" to each other using at least one of one or more wires, cables, and printed electrical connections, as well as electromagnetic energy having wavelengths in the radio frequency range, microwave range, and light (both visible and invisible) range, as some non-limiting and non-exhaustive examples.

[0114] (12) In the above embodiments, the phrase "based on" does not mean "based only on," unless otherwise specified. In other words, the phrase "based on" means both "based only on" and "based at least on."

[0115] (13) As used in this disclosure, the terms "determining" and "determining" may encompass a wide variety of actions. "Determining" and "determining" may include, for example, judging, calculating, computing, processing, deriving, investigating, looking up, search, inquiry (e.g., searching in a table, database, or other data structure), ascertaining, and the like. Also, "determining" and "determining" may include receiving (e.g., receiving information), transmitting (e.g., sending information), input, output, accessing (e.g., accessing data in a memory), and the like. In addition, "judgment" and "decision" can include considering resolving, selecting, choosing, establishing, comparing, etc., to be a "judgment" or "decision." In other words, "judgment" and "decision" can include considering some action to be a "judgment" or "decision." In addition, "judgment (decision)" can be interpreted as "assuming," "expecting," "considering," etc.

[0116] (14) In the above embodiments, when "include," "including," and variations thereof are used, these terms are intended to be inclusive, similar to the term "comprising." Furthermore, the term "or" used in this disclosure is not intended to be an exclusive or.

[0117] (15) In this disclosure, where articles have been added by translation, such as a, an, and the in English, the disclosure may include that the nouns following these articles are in the plural.

[0118] (16) In this disclosure, the term "A and B are different" may mean "A and B are different from each other." The term may also mean "A and B are each different from C." Terms such as "separate" and "combined" may also be interpreted in the same way as "different."

[0119] (17) Each aspect / embodiment described in this disclosure may be used alone, in combination, or switched according to execution. In addition, notification of specific information (e.g., notification that "X is the case") is not limited to being done explicitly, but may be done implicitly (e.g., not notifying the specific information). A combination of a plurality of aspects selected from the above may be used. [Explanation of symbols]

[0120] 1...system, 10...server, 20-1...first user terminal, 20-2...second user terminal, 20-3...third user terminal, 111...second image acquisition unit, 113...determination unit, 114...permission notification unit, 115...reception unit, 117...transmission control unit, 118...third call control unit, 119...reception notification unit, 120...detection notification unit, 211...image control unit, 212...first call control unit, 221...first notification control unit, 222...first image acquisition unit, 223...second call control unit, 231...second notification control unit, 232...third notification control unit, N...network, U-1...first user, U-2...second user, U-3...third user.

Claims

1. An acquisition unit that acquires an image in which a first user appears; a determination unit that determines, based on the image, whether the behavior of the first user is a first behavior that allows sharing of the image with a second user different from the first user and a call between the second user and the first user, or a second behavior that allows only sharing of the image; a permission notification unit that, when the action is determined to be the first action, transmits a first notification to a second user terminal used by the second user, notifying permission for sharing the image and the call, and, when the action is determined to be the second action, transmits a second notification to the second user terminal, notifying permission for sharing the image. Behavior analysis device.

2. a reception unit that receives at least one of an instruction to share the image and an instruction to start the call, which are transmitted by the second user terminal in response to the first notification, and receives the sharing instruction, which is transmitted by the second user terminal in response to the second notification; a transmission control unit that transmits the image to the second user terminal when the sharing instruction is accepted; and a call control unit that, when the start instruction is accepted, connects a first user terminal used by the first user and the second user terminal so that the first user terminal can make a call. The behavior analysis device according to claim 1.

3. a reception notification unit configured to, when the first notification or the second notification is transmitted to the second user terminal, transmit a third notification indicating whether or not at least one of the sharing instruction or the start instruction has been received from the second user terminal to a third user terminal used by a third user different from the first user and the second user; The behavior analysis device according to claim 2.

4. The acquisition unit acquires the image from an imaging device installed in a living space of the first user, a detection notification unit configured to transmit a fourth notification indicating that a change has occurred in whether the image can be acquired to a third user terminal used by a third user different from the first user and the second user; The behavior analysis device according to claim 1.

5. The first behavior is at least one of playing a game, watching a video, eating and drinking, or talking with a sibling of the first user. The behavior analysis device according to claim 1.

6. The second activity is at least one of studying, reading, or playing a musical instrument. The behavior analysis device according to claim 1.

Images