Action analysis device
The action analysis device automates the decision-making process for image sharing and calls based on user actions, addressing the burden and spontaneity issues in existing communication systems, thereby enhancing user convenience.
Patent Information
- Application Number
- JP2023093760
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-06-07
- Publication Date
- 2026-11-19
- Estimated Expiration
- 2043-06-07
AI Technical Summary
The burden on users, particularly parents, is increased due to delayed photo sharing and concerns about convenience during telephone calls in existing communication systems, leading to reduced spontaneity in interactions between grandparents and grandchildren.
An action analysis device that includes an acquisition unit to capture images, a determination unit to classify user actions, and a permission notification unit to send appropriate notifications for image sharing and calls based on user actions, reducing the burden by automating the decision-making process.
This solution reduces the burden on users by automating the decision-making process for image sharing and calls, enhancing spontaneity and convenience in communication between family members.
Smart Images

Figure 0007954118000001 
Figure 0007954118000002 
Figure 0007954118000003
Abstract
Description
Technical Field
[0001] The present invention relates to a behavior analysis device.
Background Art
[0002] In recent years, the nuclear family structure has become increasingly prevalent, and in many households, grandchildren and grandparents live separately. Aside from meeting in person, the means for grandparents to watch over their grandchildren's growth are often, for example, sharing photos of the grandchildren taken by the grandchild's parents (the daughter or son from the grandparents' perspective) with the grandparents, or having telephone conversations between the grandchildren and the grandparents.
[0003] For example, the information sharing system disclosed in the following Patent Document 1 converts information input by voice into a portable information terminal device into text data, and generates an association with photo data taken at that time as necessary. The information sharing system accumulates these data on a server via an Internet line, and notifies the portable information terminals of members other than the inputter who should share the information that the information has been registered.
Prior Art Documents
Patent Documents
[0004]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0005] However, sharing photos tends to be delayed as it places a burden on the parents, such as work for selecting photos and uploading the photos. In addition, regarding telephone calls, there are cases where users cannot make calls casually due to concern for each other's convenience.
[0006] An object of the present invention is to reduce the mutual burden related to communication between users.
Means for Solving the Problems
[0007] An action analysis device according to one aspect of the present invention includes: an acquisition unit that acquires an image of a first user; a determination unit that determines, based on the image, whether the action of the first user is a first action which allows sharing of the image with a second user different from the first user and making a call between the second user and the first user, or a second action which allows only sharing of the image; and a permission notification unit which, when the action is determined to be a first action, sends a first notification to a second user terminal used by the second user notifying permission for sharing the image and making the call, and when the action is determined to be a second action, sends a second notification to the second user terminal notifying permission for sharing the image. [Effects of the Invention]
[0008] According to one aspect of the present invention, the burden on users regarding communication can be reduced. [Brief explanation of the drawing]
[0009] [Figure 1] This is a block diagram showing the configuration of System 1 according to the embodiment. [Figure 2] This is a block diagram showing the configuration of the first user terminal 20-1. [Figure 3] This is a block diagram showing the configuration of the second user terminal 20-2. [Figure 4] This is a block diagram showing the configuration of the third user terminal 20-3. [Figure 5] This is a block diagram showing the configuration of server 10. [Figure 6] This diagram schematically illustrates the data exchange between each functional unit. [Figure 7] This table shows an example of a classification of behaviors. [Figure 8A] This is a schematic diagram showing an example of the output of the first notification. [Figure 8B] This is a schematic diagram showing an example of the output of the second notification. [Figure 9A] This is a schematic diagram showing other output examples of the first notification. [Figure 9B]It is a schematic diagram showing another output example of the first notification. [Figure 10] It is a schematic diagram showing an output example of the third notification. [Figure 11] It is a schematic diagram showing an output example of the access history to user images. [Figure 12] It is a schematic diagram showing an output example of the fourth notification. [Figure 13] It is a flowchart showing the operation of the processing device 103 of the server 10. [Figure 14] It is a flowchart showing the operation of the processing device 103 of the server 10. [Mode for Carrying Out the Invention]
[0010] A. First Embodiment A-1. System Configuration FIG. 1 is a block diagram showing the configuration of a system 1 according to an embodiment. The system 1 includes a server 10 and a plurality of user terminals 20 (a first user terminal 20-1, a second user terminal 20-2, and a third user terminal 20-3). The server 10 is an example of a behavior analysis device. The first user terminal 20-1, the second user terminal 20-2, the third user terminal 20-3, and the server 10 are connected via a network N.
[0011] The first user terminal 20-1 is used by a first user U-1. The second user terminal 20-2 is used by a second user U-2. The third user terminal 20-3 is used by a third user U-3. Hereinafter, when the first user terminal 20-1, the second user terminal 20-2, and the third user terminal 20-3 are not distinguished, they may be simply referred to as "user terminal 20".
[0012] In the present embodiment, the first user U-1, the second user U-2, and the third user U-3 are blood relatives. Specifically, the second user U-2 is the parent of the third user U-3, and the third user U-3 is the parent of the first user U-1. In other words, the second user U-2 is the grandmother or grandfather of the first user U-1, and the first user U-1 is the grandchild of the second user U-2. The first user U-1 is a minor and lives under the supervision of the third user U-3 who is his / her parent. In the present embodiment, it is assumed that there is one first user U-1, but there may be a plurality of persons corresponding to the first user U-1. For example, when the third user U-3 has a plurality of children, the plurality of persons corresponding to the first user U-1 are siblings. It is assumed that the first user U-1 and the third user U-3 live together, while the second user U-2 lives in a different location. Further, in the present embodiment, it is assumed that there is one second user U-2, but there may be a plurality of persons corresponding to the second user U-2. The plurality of persons corresponding to the second user U-2 are, for example, the grandfather and grandmother of the first user U-1.
[0013] The first user U-1 mainly uses the first user terminal 20-1 at the base K1. The base K1 is the "home" where the first user U-1 lives with the third user U-3, and is the living space of the first user U-1. The third user U-1 lives with the first user U-1 at the base K1, but spends working hours such as daytime on weekdays at the base K3. The base K3 is the "workplace" of the third user U-3. The first user U-1 attends school or kindergarten during daytime on weekdays, and returns to the base K1 after finishing the daily schedule. In the present embodiment, when the first user U-1 returns home to the base K1, the third user U-3 is assumed to be at the base K3. The second user U-2 mainly uses the second user terminal 20-2 at the base K2. The base K2 is the home of the second user U-2, which is the "grandparents' home" from the perspective of the first user U-1.
[0014] Server 10 assists in communication between the first user U-1, the second user U-2, and the third user U-3. Communication between users U includes, for example, direct communication such as video calls or regular voice calls, as well as communication in which one user U can learn about the other user U's activities, such as sharing photos or videos, or communication in which one user U monitors whether the other user U is living a normal life.
[0015] A-2. First user terminal 20-1 Figure 2 is a block diagram showing the configuration of the first user terminal 20-1. Since the main configurations of the first user terminal 20-1, the second user terminal 20-2, and the third user terminal 20-3 are the same, they are denoted by the same reference numerals and their descriptions are used accordingly.
[0016] In this embodiment, the first user terminal 20-1 is not used by the first user U-1 personally, but is installed in base K1 (for example, the living room of base K1) and is a terminal shared by the family living in base K1. The first user terminal 20-1 is, for example, a tablet terminal, a personal computer, or a dedicated terminal such as a so-called "monitoring camera." However, the first user terminal 20-1 may also be a terminal used by the first user U-1 personally, such as a smartphone. Furthermore, the first user terminal 20-1 may be used in a location other than base K1 (for example, a park where the first user U-1 goes with the third user U-3).
[0017] The first user terminal 20-1 includes a display device 201, an input device 202, a communication device 203, an imaging device 204, a microphone 205, a speaker 206, a storage device 207, a processing device 208, and a bus 209 that connects these devices to each other.
[0018] The display device 201 is a display device that displays information to the outside (for example, various display panels such as liquid crystal display panels or organic EL display panels). The input device 202 is an input device that accepts input from the outside (for example, a keyboard, mouse, switch, button, or sensor). The input device 202 may also be the microphone 205 described later. The display device 201 and the input device 202 may be configured as an integrated unit (for example, a touch panel).
[0019] The communication device 203 communicates with the server 10 or other user terminals 20 using wireless or wired communication. In this embodiment, the communication device 203 has an interface that can connect to the network N and communicates with the communication device 101 of the server 10 (see Figure 5) or the communication device 203 of the other user terminals 20 via the network N.
[0020] Microphone 205 captures sounds emitted by the first user U-1 and sounds generated around the first user U-1, and generates audio data. Speaker 206 generates sound based on audio data acquired from other information processing devices (e.g., second user terminal 20-2 or third user terminal 20-3). For example, the first user U-1 converses with the second user U-2 using microphone 105 and speaker 106.
[0021] The imaging device 204 generates imaging data showing an image of a subject. In this embodiment, the subject to be imaged by the imaging device 204 of the first user terminal 20-1 is, for example, the first user U-1. Also, if, for example, the third user U-3 is at base K1, the third user U-3 may be the subject. The imaging device 204 has, for example, an imaging optical system and an image sensor. The imaging optical system is an optical system that includes at least one imaging lens. For example, the imaging optical system may have various optical elements such as prisms, or it may have a zoom lens or a focus lens. The image sensor is, for example, a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary MOS) image sensor.
[0022] The storage device 207 is a recording medium that can be read by the processing device 208. The storage device 207 includes, for example, non-volatile memory and volatile memory. Non-volatile memory is, for example, ROM (Read Only Memory), EPROM (Erasable Programmable Read Only Memory), and EEPROM (Electrically Erasable Programmable Read Only Memory). Volatile memory is, for example, RAM (Random Access Memory). The storage device 207 of the first user terminal 20-1 stores program PG1. Program PG1 is a program for operating the first user terminal 20-1.
[0023] The processing unit 208 includes one or more CPUs (Central Processing Units). One or more CPUs are examples of one or more processors. Each processor and CPU is an example of a computer.
[0024] The processing unit 208 of the first user terminal 20-1 functions as an image control unit 211 and a first call control unit 212 by executing program PG1. At least some of the functions of the image control unit 211 and the first call control unit 212 may be configured by circuits such as a DSP (Digital Signal Processor), ASIC (Application Specific Integrated Circuit), PLD (Programmable Logic Device), and FPGA (Field Programmable Gate Array). Details of the image control unit 211 and the first call control unit 212 will be described later.
[0025] A-3. Second user terminal 20-2 Figure 3 is a block diagram showing the configuration of the second user terminal 20-2. In this embodiment, the second user terminal 20-2 is, for example, a smartphone used personally by the second user U-2, or a shared tablet device used by the family. Alternatively, the second user terminal 20-2 may be a dedicated device such as a "monitoring camera". The second user U-2 mainly uses the second user terminal 20-2 at base K2, which is their home (grandparents' house).
[0026] The second user terminal 20-2 comprises a display device 201, an input device 202, a communication device 203, an imaging device 204, a microphone 205, a speaker 206, a storage device 207, a processing device 208, and a bus 209 that connects these devices to each other. Since these configurations are the same as those of the first user terminal 20-1, a detailed explanation is omitted.
[0027] The storage device 207 of the second user terminal 20-2 stores program PG2. Program PG2 is a program for operating the second user terminal 20-2. The processing unit 208 of the second user terminal 20-2 functions as the first notification control unit 221, the first image acquisition unit 222, and the second call control unit 223 by executing program PG2. Details of the first notification control unit 221, the first image acquisition unit 222, and the second call control unit 223 will be described later.
[0028] A-4. Third user terminal 20-3 Figure 4 is a block diagram showing the configuration of the third user terminal 20-3. In this embodiment, the third user terminal 20-3 is, for example, a smartphone used personally by the third user U-3. When the third user U-3 is at the workplace, base K3, they use the third user terminal 20-3 at base K3, and when they are at home, base K1, they use the third user terminal 20-3 at base K1.
[0029] The third user terminal 20-3 comprises a display device 201, an input device 202, a communication device 203, an imaging device 204, a microphone 205, a speaker 206, a storage device 207, a processing device 208, and a bus 209 that connects these devices to each other. Since these configurations are the same as those of the first user terminal 20-1, a detailed explanation is omitted.
[0030] The storage device 207 of the third user terminal 20-3 stores program PG3. Program PG3 is a program for operating the third user terminal 20-3. The processing unit 208 of the third user terminal 20-3 functions as the second notification control unit 231 and the third notification control unit 232 by executing program PG3. Details of the second notification control unit 231 and the third notification control unit 232 will be described later.
[0031] A-5. Server 10 Figure 5 is a block diagram showing the configuration of server 10. Server 10 comprises a communication device 101, a storage device 102, a processing device 103, and a bus 109 that connects these devices to each other.
[0032] The communication device 101 communicates with the first user terminal 20-1, the second user terminal 20-2, and the third user terminal 20-3 using wireless or wired communication. In this embodiment, the communication device 101 has an interface that can be connected to the network N, and communicates with the first user terminal 20-1, the second user terminal 20-2, and the third user terminal 20-3 via the network N.
[0033] The storage device 102 is a recording medium that can be read by the processing device 103. The storage device 102 includes, for example, non-volatile memory and volatile memory. Non-volatile memory is, for example, ROM, EPROM, and EEPROM. Volatile memory is, for example, RAM. The storage device 102 stores program PG4. Program PG4 is a program for operating server 10.
[0034] The processing unit 103 includes one or more CPUs. One or more CPUs are examples of one or more processors. Each processor and CPU is an example of a computer.
[0035] The processing unit 103 functions as a second image acquisition unit 111, a determination unit 113, a permission notification unit 114, a reception unit 115, a transmission control unit 117, a third call control unit 118, a reception notification unit 119, and a detection notification unit 120 by executing the program PG4. Details of the second image acquisition unit 111, the determination unit 113, the permission notification unit 114, the reception unit 115, the transmission control unit 117, the third call control unit 118, the reception notification unit 119, and the detection notification unit 120 will be described later.
[0036] A-6. Details of Processing Units 103 and 208 Next, we will describe the details of each functional unit implemented by the processing unit 103 of the server 10, and the processing units 208 of the first user terminal 20-1, the second user terminal 20-2, and the third user terminal 20-3.
[0037] Figure 6 schematically illustrates the data exchange between each functional unit. Below, we will mainly describe the functional units implemented by the processing unit 103 of the server 10, but we will also describe the functional units implemented by the processing units 208 of the first user terminal 20-1, the second user terminal 20-2, and the third user terminal 20-3.
[0038] The second image acquisition unit 111 acquires an image of the first user U-1 (hereinafter referred to as "user image"). The second image acquisition unit 111 is an example of an acquisition unit. In this embodiment, the second image acquisition unit 111 acquires the user image from the first user terminal 20-1. As described above, the first user terminal 20-1 is installed at base K1, which is the living space of the first user U-1. Therefore, the second image acquisition unit 111 acquires the user image from the imaging device 204 installed in the living space of the first user U-1. The user image may be a video or a still image, but when the determination unit 113, which will be described later, determines the actions of the first user U-1, the user image is preferably a video or a still image that is continuously captured at predetermined intervals.
[0039] The image control unit 211 of the first user terminal 20-1 transmits the image captured by the imaging device 204 to the server 10. The image control unit 211 may also have the imaging device 204 continuously capture images and transmit the captured images directly to the server 10. In this case, the second image acquisition unit 111 determines whether or not a person is in the image transmitted from the first user terminal 20-1 through object recognition processing, and further determines whether the person in the image is the first user U-1 through face recognition processing.
[0040] Furthermore, the image control unit 211 may, for example, use an infrared sensor to determine whether a person is present within the imaging range of the imaging device 204, and if a person is present, cause the imaging device 204 to capture an image and transmit the captured image to the server 10. In this case, the second image acquisition unit 111 determines whether the person in the image is the first user U-1 through face recognition processing.
[0041] Furthermore, the image control unit 211 may, for example, use an infrared sensor or the like to determine if a person is present within the imaging range of the imaging device 204. If a person is present, the image control unit 211 may cause the imaging device 204 to capture an image, perform face recognition processing on the captured image, and transmit the image to the server 10 if the person in the image is the first user U-1. In this case, the second image acquisition unit 111 uses the image acquired from the first user terminal 20-1 as is, as the user image.
[0042] The imaging device 204 of the first user terminal 20-1 may be, for example, a camera capable of panning, tilting, and zooming. In this case, the image control unit 211 may change the imaging direction of the imaging device 204 so that if a person is present within the imaging range of the imaging device 204, the person will be continuously captured in the image.
[0043] The determination unit 113 determines, based on the user image, whether the action of the first user U-1 is a first action which allows sharing of the user image with a second user U-2 who is different from the first user U-1, and a call between the second user U-2 and the first user U-1, or a second action which only allows sharing of the user image. In this embodiment, the actions of the first user U-1 are classified into first actions, second actions, and third actions. If the action of the first user U-1 is neither a first action nor a second action, for example, the action of the first user U-1 is a third action.
[0044] The determination unit 113 analyzes the user image using, for example, AI (Artificial Intelligence) to determine the content of the first user U-1's actions. The determination unit 113 determines the content of the first user U-1's actions based on, for example, whether the first user U-1 is standing, sitting, or lying down (posture), whether they are moving or stationary (presence or absence of movement), whether they are holding something in their hand, and if so, what they are holding (presence or absence of possessions and their type), whether they are talking (presence or absence of vocalization), etc.
[0045] Figure 7 is a table showing an example of behavior classification. As described above, in this embodiment, the behavior of the first user U-1 is classified into first behavior, second behavior, and third behavior. In very broad terms, the first behavior is considered to be behavior in which the first user U-1 is "not busy," while the second and third behaviors are considered to be behavior in which the first user U-1 is "busy."
[0046] The first action is, for example, playing a game, watching a video, eating or drinking, or talking with a sibling of the first user U-1. If the first user U-1 is performing the first action, sharing the user image with the second user U-2 and making a call between the second user U-2 and the first user U-1 are permitted. If the first user U-1 is performing the first action, it is assumed that the first user U-1 is not busy, so a call with the second user U-2 is permitted. The call may be an audio-only exchange (voice call), or it may be a video call in addition to audio, where images of the first user U-1 and the second user U-2, respectively, captured by the imaging device 204, are exchanged. Also, if the first user U-1 is performing the first action, there is no particular problem with sharing the user image with the second user U-2, so sharing the user image with the second user U-2 is permitted. The second user U-2 can obtain an image (user image) of the first user U-1 performing the first action, or it can speak to the first user U-1 via the user terminal 20. These two actions may occur simultaneously.
[0047] The determination unit 113 determines that the first user U-1 is playing a game, for example, when the first user U-1 is holding a remote controller and facing a display such as a television, or when the first user U-1 is sitting with the game console itself in their hand.
[0048] The determination unit 113 determines, for example, that the first user U-1 is watching a video if they are continuously looking at the screen of a television, tablet device, or smartphone for a predetermined period of time (without performing any operations). Note that watching a video may include, for example, watching video content acquired via network N, or watching television broadcasts, DVDs (Digital Versatile Discs), or recorded data.
[0049] The determination unit 113 determines that, for example, the first user U-1 is eating or drinking if they are bringing food or drink to their mouth. The determination unit 113 determines that, for example, the first user U-1 is conversing with their sibling if a person registered as the first user U-1's sibling is visible in the user image and the first user U-1 is talking to that person.
[0050] The second activity is at least one of the following: studying, reading, or playing a musical instrument. If the first user U-1 is performing the second activity, only sharing of the user image with the second user U-2 is permitted. Since the first user U-1 is considered busy while performing the second activity, conversation with the second user U-2 is not permitted. On the other hand, since there is no particular problem with sharing the user image of the user performing the second activity with the second user U-2, sharing of the user image with the second user U-2 is permitted. The second user U-2 can obtain an image of the first user U-1 performing the second activity.
[0051] The determination unit 113 determines that, for example, the first user U-1 is studying if the first user U-1 is sitting at a desk and holding a writing instrument. The determination unit 113 determines that the first user U-1 is reading if, for example, the first user U-1 is holding a book and looking at it. The determination unit 113 may also determine whether the book is a comic or a magazine based on the cover of the book shown in the user image, and if it is a comic or a magazine, it may determine that the first user U-1 is performing the first action.
[0052] The determination unit 113 determines that, for example, if the first user U-1 is facing a musical instrument such as a piano and moving their hands, or is holding a musical instrument such as a violin and moving their hands, then the first user U-1 is playing a musical instrument. In addition to playing a musical instrument, the first user U-1 may also be determined to be engaging in lessons or hobbies other than playing a musical instrument as a second action. For example, stretching, strength training, dancing, practicing swings, singing, or drawing may be determined to be second actions.
[0053] The third action is at least one of the following: sleeping, getting dressed, preparing to go out, or a visit from someone other than the first user U-1's family. The third action may also be an action that does not fall under either the first or second action. If the first user U-1 is performing the third action, it is considered that the first user U-1 is busy and that sharing the user image is not appropriate. Therefore, neither sharing the user image with the second user U-2 nor conversing with the second user U-2 is permitted.
[0054] The determination unit 113 determines that, for example, if the first user U-1 is lying down and hardly moving, the first user U-1 is sleeping. The determination unit 113 determines that, for example, if the first user U-1 is putting on or taking off clothes, the first user U-1 is getting dressed. The determination unit 113 determines that, for example, if the first user U-1 is taking things in and out of their bag or frequently going back and forth to other rooms, the first user U-1 is preparing to go out. The determination unit 113 determines that, for example, if a person other than the first user U-1's family is visible in the user image, the first user U-1 is visiting. The determination unit 113 may also determine that, for example, if the first user U-1 is talking to another person on the phone or game console, it is on a call and therefore a third action.
[0055] Furthermore, the third user, U-3, may, for example, be able to set which actions constitute the first, second, and third actions.
[0056] Furthermore, the third user U-3 may be able to configure whether to allow sharing of user images and calls when the third user U-3 is at base K1. This is because the third user U-3, being a parent (adult), may not like others to see images that have been taken unexpectedly. Also, if the third user U-3 is at home and receives a call from the second user U-2, both the first user U-1 and the third user U-3 may have to answer the call, which may be inconvenient for them. Whether or not the third user U-3 is at base K1 may be determined, for example, based on the image taken by the first user terminal 20-1, or it may be configured by the third user U-3 via the first user terminal 20-1 or the third user terminal 20-3.
[0057] If the permission notification unit 114 determines that the action of the first user U-1 is a first action, it sends a first notification to the second user terminal 20-2 used by the second user U-2, notifying it of permission to share user images and make calls. Furthermore, if the permission notification unit 114 determines that the action of the first user U-1 is a second action, it sends a second notification to the second user terminal 20-2, notifying it of permission to share user images.
[0058] Furthermore, if the actions of the first user U-1 are determined to be third actions, neither sharing of the user image nor a call between the second user U-2 and the first user U-1 will be permitted. Therefore, the permission notification unit 114 will not send a notification to the second user terminal 20-2.
[0059] When the first notification control unit 221 of the second user terminal 20-2 receives a first notification or a second notification, it displays the content of the received notification to the second user U-2. Specifically, the first notification control unit 221 displays, for example, text, icons, or illustrations indicating the content of the received notification on the display device 201. The first notification control unit 221 also outputs, for example, an audio message from the speaker 206 indicating the content of the received notification, or an alert sound prompting the second user U-2 to look at the display device 201. The first notification control unit 221 may output a notification to the second user U-2 immediately upon receiving a first notification or a second notification, or it may output a notification that is valid at that time when the second user U-2 launches a predetermined application (an application for communication with the first user U-1).
[0060] Figure 8A is a schematic diagram showing an example of the output of the first notification. In the example in Figure 8A, the name of the first user U-1 is assumed to be "K (K-kun)". The first notification control unit 221 displays on the display device 201 of the second user terminal 20-2 a message M1 indicating that there is a new image (a user image that has been newly permitted to be shared) and a message M2 indicating that it is possible to make a call with the first user U-1 (K-kun). The first notification control unit 221 also displays on the display device 201 a first instruction button B1 to instruct access to the user image and a second instruction button B2 to instruct a call with the first user U-1. The first notification control unit 221 also displays on the display device 201 a third instruction button B3 to end the first notification and return the display to its original state. "Restoring the display" means, for example, if the second user U-2 was using the second user terminal 20-2, it means returning to the screen that was displayed immediately before the notification was sent. If the second user terminal 20-2 was not in use, it means returning to the home screen or lock screen, etc.
[0061] If the second user U-2 wants to view the user image, they touch the first instruction button B1. When the first instruction button B1 is touched, the first image acquisition unit 222 of the second user terminal 20-2 sends an image sharing instruction to the server 10. If the second user U-2 wants to talk to the first user U-1, they touch the second instruction button B2. When the second instruction button B2 is touched, the second call control unit 223 of the second user terminal 20-2 sends a call start request to the server 10. If the second user U-2 does not need to share the user image or talk to the first user U-1, they touch the third instruction button B3. When the third instruction button B3 is touched, the display on the display device 201 returns to its original state.
[0062] Figure 8B is a schematic diagram showing an example of the output of the second notification. The first notification control unit 221 displays a message M1 on the display device 201 of the second user terminal 20-2 indicating that there is a new image. The first notification control unit 221 also displays a first instruction button B1 on the display device 201 to instruct access to the user image. The first notification control unit 221 also displays a third instruction button B3 on the display device 201 to end the second notification and return the display to its original state.
[0063] If the second user U-2 wants to view the user image, they touch the first instruction button B1. When the first instruction button B1 is touched, the first image acquisition unit 222 of the second user terminal 20-2 sends an image sharing instruction to the server 10. If the second user U-2 does not need to share the user image, they touch the third instruction button B3. When the third instruction button B3 is touched, the display on the display device 201 returns to its original state.
[0064] Figure 9A is a schematic diagram showing another example of output for the first notification. The first notification control unit 221 displays K's face image P1 on the display device 201 of the second user terminal 20-2. The first notification control unit 221 displays a message M1 indicating that there is a new user image. The first notification control unit 221 also displays an icon P2 near the face image P1 indicating the status of the first user U-1. In the first notification, since the first user U-1 is available for a call, the first notification control unit 221 displays the icon P2 in green, for example. The first notification control unit 221 also displays a first instruction button B1 on the display device 201 to instruct access to the user image, a second instruction button B2 to instruct a call with the first user U-1, and a third instruction button B3 to return the display to its original state.
[0065] Figure 9B is a schematic diagram showing another output example of the second notification. The first notification control unit 221 displays a message M1 on the display device 201 of the second user terminal 20-2 indicating that there is a new image. The first notification control unit 221 also displays a first instruction button B1 on the display device 201 to instruct access to the user image. In the second notification, since the first user U-1 is unavailable for calls, the first notification control unit 221 displays the icon P2 in red, for example. The first notification control unit 221 also grays out the second instruction button B2 so that it cannot be operated.
[0066] In the display configurations shown in Figures 9A and 9B, if neither the first nor the second notification has been made, the first notification control unit 221 will display a screen similar to the one in Figure 9B, but with message M1 removed.
[0067] The reception unit 115 receives at least one of the user image sharing instruction and the voice call initiation instruction transmitted by the second user terminal 20-2 in response to the first notification, and also receives the user image sharing instruction transmitted by the second user U-2 in response to the second notification.
[0068] When the transmission control unit 117 receives a user image sharing instruction, it transmits the user image to the second user terminal 20-2. The user image transmitted to the second user terminal 20-2 may have its file size reduced to a level that is suitable for display on the second user terminal 20-2. The second user U-2 may also be able to select the user images transmitted to the second user terminal 20-2, for example, by the time of day or date in which they were taken.
[0069] The first image acquisition unit 222 of the second user terminal 20-2 acquires the user image transmitted from the transmission control unit 117. The first image acquisition unit 222 displays the user image on the display device 201 of the second user terminal 20-2. The second user U-2 can view the user image displayed on the display device 201 of the second user terminal 20-2.
[0070] When the third call control unit 118 receives a call initiation instruction, it connects the first user terminal 20-1 and the second user terminal 20-2 to enable communication. The third call control unit 118 sends a call request to the first user terminal 20-1, for example. When the first call control unit 212 of the first user terminal 20-1 receives the call request, it displays text, an icon, or an illustration on the display device 201 of the first user terminal 20-1 indicating that a call is being received from the second user U-2. The first call control unit 212 also outputs, for example, an audio message from the speaker 206 indicating that a call is being received from the second user U-2, or an alert sound prompting the first user U-1 to look at the display device 201.
[0071] Furthermore, the first call control unit 212 displays operation buttons for starting a call on the display device 201 of the first user terminal 20-1. A physical operation mechanism (such as a switch) for starting a call may also be provided on the housing of the first user terminal 20-1. When the first user U-1 responds to an incoming call by pressing an operation button, etc., audio (and in the case of a video call, an image of the first user U-1 or the second user U-2 in addition to the audio) is transmitted and received between the first call control unit 212 of the first user terminal 20-1 and the second call control unit 223 of the second user terminal 20-2, and a call is made between the first user U-1 and the second user U-2.
[0072] When the reception notification unit 119 receives the first or second notification from the second user terminal 20-2, it sends a third notification to the third user terminal 20-3, which is used by a third user U-3 that is different from both the first user U-1 and the second user U-2, indicating whether or not it has received at least one of the instructions to share a user image or to start a call from the second user terminal 20-2. In other words, when the reception notification unit 119 receives the first or second notification, it sends a third notification to the third user U-3 indicating whether or not it has received a response from the second user U-2.
[0073] When the second notification control unit 231 of the third user terminal 20-3 receives a third notification from the reception notification unit 119, it displays text, icons, or illustrations indicating the content of the third notification on the display device 201 of the third user terminal 20-3. The second notification control unit 231 also outputs, for example, an audio message indicating the content of the third notification, or an alert sound prompting the third user U-3 to look at the display device 201, from the speaker 206.
[0074] Figure 10 is a schematic diagram showing an example of the output of the third notification. In the example in Figure 10, the name of the second user U-2 is assumed to be "N (Mr. N)". The second notification control unit 231 displays on the display device 201 of the third user terminal 20-3 a message M3 indicating that a new user image has been shared with the second user U-2 (Mr. N), and a message M4 indicating that the second user U-2 has accessed the shared user image. Message M3 contains the date and time the user image was shared with the second user U-2 (the date and time the first or second notification was sent to the second user terminal 20-2), and message M4 contains the date and time the second user U-2 accessed the user image.
[0075] Furthermore, the second notification control unit 231 displays on the display device 201 a fourth instruction button B4 for checking the access history of the second user U-2's user image, and a fifth instruction button B5 for instructing a call with the second user U-2. The second notification control unit 231 also displays on the display device 201 a third instruction button B3 for ending the third notification and returning the display to its original state.
[0076] Figure 11 is a schematic diagram showing an example of the output of the user image access history. When the third user U-3 presses the fourth instruction button B4, the access history exemplified in Figure 11 is displayed. The access history includes the album name F1, delivery date and time F2, and access date and time F3. An album is a group consisting of multiple user images taken within a predetermined period. The album name is a phrase that concisely describes the contents of the album and is determined, for example, by the third user U-3. In this case, immediately after the user image is captured, the album will not have an album name and will be "Untitled". The server 10 may analyze the contents of the user image and automatically assign an album name.
[0077] The delivery date and time F2 indicates the date and time when the user image was shared with the second user U-2 (the date and time when the first or second notification was sent to the second user terminal 20-2). The access date and time F3 indicates the date and time when the second user U-2 accessed the user image. If the access date and time F3 is blank, such as in the case of the album name "Birthday Party", it indicates that the second user U-2 did not access the user image in that album.
[0078] The notification system 119 sends notifications so that the third user U-3 can confirm whether the second user U-2 is living their life as usual. For example, if the second user U-2 lives alone, they may not be able to call for help if they become ill or get injured. Also, if the second user U-2 is elderly, even if they live with other people, they are more likely to encounter difficulties compared to younger generations. Since the second user U-2 is the parent of the third user U-3, the third user U-3 is concerned about whether the second user U-2 is living a healthy life. For example, they could check on the second user U-2's well-being by calling at a set time every week, but there may be times when their schedules do not match, or they may forget to call in their busy daily lives.
[0079] By notifying the reception notification unit 119 of whether or not there has been a response to the first or second notification, the third user U-3 can monitor the status of the second user U-2 at a leisurely pace. For example, if there is no response to the first or second notification for a predetermined period of time (for example, within the day on which the notification was issued), the second user U-2 may be in an unusual state. In this case, the third user U-3 can check if there is any change in the second user U-2 by pressing the fifth instruction button B5 in Figure 10 to call the second user U-2 (or contacting them using another messaging application, etc.).
[0080] The detection notification unit 120 sends a fourth notification to the third user terminal 20-3, which is used by a third user U-3, who is different from both the first user U-1 and the second user U-2, indicating that there has been a change in whether or not a user image can be acquired. Whether or not a user image can be acquired can be rephrased as whether or not an image of the first user U-1 can be acquired by the second image acquisition unit 111. For example, if the first user U-1 is not at home, or is at home but in a room other than the living room where the first user terminal 20-1 is installed, the user image cannot be acquired. Situations in which the ability to acquire a user image can change include, for example, when the first user U-1 returns home from school, etc. (the user image changes from unacquirable to acquireable), or when the first user U-1 goes out for lessons, etc. (the user image changes from acquireable to unacquirable). Furthermore, to avoid sending a fourth notification every time a very temporary change occurs, such as when the first user U-1 goes to the toilet, the fourth notification may be sent only when the possibility of acquiring the user image arises and that state continues for a predetermined period (for example, about 5 minutes).
[0081] When the third notification control unit 232 of the third user terminal 20-3 receives the fourth notification from the detection notification unit 120, it displays text, icons, or illustrations indicating the content of the fourth notification on the display device 201 of the third user terminal 20-3. The second notification control unit 231 also outputs, for example, an audio message indicating the content of the fourth notification, or an alert sound prompting the third user U-3 to look at the display device 201, from the speaker 206.
[0082] Figure 12 is a schematic diagram showing an example of the output of the fourth notification. The third notification control unit 232 displays message M5 on the display device 201 of the third user terminal 20-3 indicating that the user image of the first user U-1 (K-kun) has become available (that K-kun has returned home). Message M5 includes the date and time when the user image became available. The third notification control unit 232 also displays on the display device 201 a sixth instruction button B6 to instruct access to the current user image of the first user U-1 (a real-time image captured by the imaging device 204 of the first user terminal 20-1), a seventh instruction button B7 to instruct the start of a call with the first user U-1, and a third instruction button B3 to return the display to its original state. When the third user U-3 presses the sixth instruction button B6, the latest user image is displayed on the display device 201. When the third user U-3 presses the seventh instruction button B7, a call is started between the third user terminal 20-3 and the first user terminal 20-1.
[0083] By sending the fourth notification, the third user U-3 can understand the status of the first user U-1 (whether they returned home safely, left for their lessons on time, etc.) while at their workplace, base K3. In addition, the third user U-3 can check the user's image and talk to the first user U-1 as needed, making it easier to monitor the first user U-1.
[0084] A-7. Operation of Processing Unit 103 Figures 13 and 14 are flowcharts showing the operation of the processing unit 103 of the server 10. The processing unit 103 functions as a second image acquisition unit 111 and acquires an image from the first user terminal 20-1 (step S100). The processing unit 103 functions as a second image acquisition unit 111 and determines whether or not the presence or absence of the first user U-1 (whether or not the first user U-1 is in the image) in the image acquired in step S101 has changed (step S101). If there has been a change in the presence or absence of the first user U-1 (step S101: YES), the processing unit 103 functions as a detection notification unit 120 and sends a fourth notification to the third user terminal 20-3 (step S103). The third user U-3 checks the fourth notification output to the third user terminal 20-3 and confirms that the first user U-1 has returned home, etc. If there has been no change in the presence or absence of the first user U-1, the processing unit 103 proceeds to step S103.
[0085] The processing unit 103 functions as a second image acquisition unit 111 and determines whether the first user U-1 is in the image acquired in step S101, that is, whether the image acquired in step S101 is a user image or not (step S103). If the first user U-1 is not in the image (step S103: NO), the processing unit 103 returns to step S100 and continues to acquire the image.
[0086] If the first user U-1 is visible in the image (step S102: YES), the processing unit 103 functions as a determination unit 113 and determines whether the first user U-1's action is a first action, a second action, or a third action (step S104). If the first user U-1's action is a first action (step S105: YES), the processing unit 103 functions as a permission notification unit 114 and sends a first notification to the second user terminal 20-2 that permits sharing of the user image and making a call with the first user U-1 (step S106). If the first user U-1's action is a second action (step S105: NO and step S107: YES), the processing unit 103 functions as a permission notification unit 114 and sends a second notification to the second user terminal 20-2 that permits sharing of the user image (step S108). If the action of the first user U-1 is the third action (step S105: NO and step S107: NO), the processing unit 103 does not issue a notification and returns the process to step S100.
[0087] Next, the processing unit 103 functions as a reception unit 115 and receives instructions from the second user terminal 20-2. If an instruction to share a user image is received (step S109: YES), the processing unit 103 functions as a transmission control unit 117 and transmits the user image to the second user terminal 20-2 (step S110), and then proceeds to step S113. Also, if an instruction to start a call is received (step S109: NO and step S111: YES), the processing unit 103 functions as a third call control unit 118 and connects the first user terminal 20-1 and the second user terminal 20-2 so that they can communicate (step S112), and then proceeds to step S113.
[0088] If a user image is sent to the second user terminal 20-2 in step S110, if the first user terminal 20-1 and the second user terminal 20-2 are connected for communication in step S112, or if neither a user image sharing instruction nor a call initiation instruction is received (step S109: NO and step S111: NO), the processing unit 103 functions as an acknowledgment unit 119 and sends a third notification to the third user terminal 20-3 indicating the status of the instruction received from the second user terminal 20-2 (step S113). After that, the processing unit 103 returns to step S100.
[0089] A-8. Summary of Embodiments As described above, the server 10 in this embodiment determines, based on the user image, whether the action of the first user U-1 is either a first action or a second action. The server 10 then sends a first notification to the second user terminal 20-2 granting permission to share the user image and make a call if the action of the first user U-1 is a first action, and a second notification granting permission to share the user image if the action is a second action. Thus, images of the first user U-1 can be automatically shared, reducing the effort required compared to the third user U-3 sending user images to the second user terminal 20-2 or uploading them to a photo sharing server. Furthermore, if the second user U-2 wants to make a call with the first user U-1, they only need to make the call when they receive the first notification, eliminating the need to ask the first user U-1 about their availability in advance, thus improving convenience.
[0090] Furthermore, when server 10 receives a user image sharing instruction from the second user terminal 20-2, it transmits the user image to the second user terminal 20-2. Additionally, when it receives a call initiation instruction, it connects the first user terminal 20-1 and the second user terminal 20-2 to enable communication. Therefore, the second user U-2 can acquire the user image and initiate a call with the first user U-1 in a single action, improving convenience.
[0091] Furthermore, when the server 10 receives either the first or second notification from the second user terminal 20-2, it sends a third notification to the third user terminal 20-3 indicating whether or not it has received at least one of the instructions from the second user terminal 20-2 to share a user image or to start a notification. Thus, the third user U-3 can find out whether or not the second user U-2 has reacted to the first or second notification. For example, if no reaction is received from the second user U-2 for a predetermined period, the third user U-3 can contact the second user U-2 to check on their safety.
[0092] Furthermore, server 10 sends a fourth notification to third user terminal 20-3 indicating that there has been a change in whether or not user images can be acquired. As a result, third user U-3 can confirm whether first user U-1 has returned home or left for their lessons on time, improving convenience.
[0093] B: Modification The following are examples of modifications in the above-described embodiment. Two or more modifications selected from the following examples may be combined as appropriate, provided they do not contradict each other.
[0094] B1: First variation In the embodiment described above, the ability to share an image of the first user U-1 with the second user U-2 and the ability to communicate with the first user U-1 were determined based on the actions of the first user U-1. In addition, for example, the ability to share an image of the second user U-2 with the first user U-1 and the ability to communicate with the second user U-2 may also be determined based on the actions of the second user U-2. That is, the first user U-1 may speak to the second user U-2 or obtain a user image of the second user U-2.
[0095] In this case, the functional unit of the server 10 performs the following processing in addition to the processing of the embodiment described above. The second image acquisition unit 111 acquires a user image of the second user U-2. The determination unit 113 determines, based on the user image, whether the action of the second user U-2 is either the first action or the second action. The permission notification unit 114 sends a first notification to the first user terminal 20-1 if the action is determined to be the first action, and sends a second notification to the first user terminal 20-1 if the action is determined to be the second action.
[0096] Furthermore, the grandchild, User 1 U-1, may not be interested in images of their grandparent, User 2 U-2. Also, User 2 U-2, the grandparent, may not like others seeing images that were taken unexpectedly. Therefore, for User 2 U-2, it may be acceptable to not share images and simply notify User 1 U-1 that User 2 U-2 is "available for calls" when performing the first action.
[0097] Furthermore, the same applies to the third user U-3; based on their current actions, at least one of the first user U-1 or the second user U-2 may be notified whether or not they are allowed to make a call or share images.
[0098] According to the first modification, communication between users living separately becomes more active, and mutual monitoring can be achieved with less burden.
[0099] B2: Second variation In the embodiment described above, the server 10 determined the actions of the first user U-1. However, the system is not limited to this, and for example, the state of the first user U-1 may be estimated at the first user terminal 20-1. In this case, the processing unit 208 of the first user terminal 20-1 functions as a determination unit 113 and also functions as a transmission control unit that transmits information to the server 10 indicating whether the first user U-1's actions are first actions, second actions, or third actions. This reduces the processing load on the server 10.
[0100] Alternatively, the processing performed by the server 10 in the embodiment, such as not only determining the action but also sending the first to fourth notifications, may be performed by the first user terminal 20-1. In this case, the processing unit 208 of the first user terminal 20-1 functions as a second image acquisition unit 111, a determination unit 113, a permission notification unit 114, a reception unit 115, a transmission control unit 117, a third call control unit 118, a reception notification unit 119, and a detection notification unit 120. This eliminates the need for the server 10 and simplifies the configuration of system 1.
[0101] B3: Third variation In the embodiment described above, the first user U-1 to the third user U-3 were assumed to be related by blood. However, the relationship between the first user U-1 to the third user U-3 is not limited to this; any group of people who have agreed to share each other's actions and images may be the first user U-1 to the third user U-3. For example, friends or colleagues at work may be the first user U-1 to the third user U-3.
[0102] C: Other (1) In the embodiments described above, ROM and RAM were given as examples of storage devices 102 and 207, but storage devices 102 and 207 may be flexible disks, magneto-optical disks (e.g., compact disks, digital multipurpose disks, Blu-ray® disks), smart cards, flash memory devices (e.g., cards, sticks, key drives), CD-ROMs (Compact Disc-ROMs), registers, removable disks, hard disks, floppy® disks, magnetic strips, databases, servers, or other suitable storage media.
[0103] (2) In the embodiments described above, the information, signals, etc. may be represented using any of the various different techniques. For example, the data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be mentioned throughout the above description may be represented by voltage, current, electromagnetic waves, magnetic fields or magnetic particles, optical fields or photons, or any combination thereof.
[0104] (3) In the embodiments described above, the input and output information may be stored in a specific location (e.g., memory) or managed using a management table. The input and output information may be overwritten, updated, or appended to. The output information may be deleted. The input information may be transmitted to other devices.
[0105] (4) In the embodiments described above, the determination may be made by a value represented by 1 bit (0 or 1), by a boolean value (true or false), or by a numerical comparison (for example, a comparison with a predetermined value).
[0106] (5) The processing procedures, sequences, flowcharts, etc., exemplified in the embodiments described above may be reordered, as long as they do not contradict each other. For example, in the methods described herein, the elements of various steps are presented using an exemplary order and are not limited to the specific order presented.
[0107] (6) Each function illustrated in Figures 2 to 5 is implemented by any combination of at least one of hardware and software. Furthermore, the method of implementing each functional block is not particularly limited. That is, each functional block may be implemented using one device that is physically or logically coupled, or it may be implemented using two or more physically or logically separated devices that are directly or indirectly connected (for example, using wired, wireless, etc.). A functional block may be implemented by combining the above one device or the above multiple devices with software.
[0108] (7) The programs illustrated in the embodiments described above should be broadly interpreted to mean instructions, instruction sets, codes, code segments, program codes, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, execution threads, procedures, functions, etc., whether they are called software, firmware, middleware, microcode, hardware description languages or by other names.
[0109] Furthermore, software, instructions, information, etc., may be transmitted and received via a transmission medium. For example, if software is transmitted from a website, server, or other remote source using at least one of wired technology (coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), etc.) and wireless technology (infrared, microwave, etc.), at least one of these wired and wireless technologies is included in the definition of a transmission medium.
[0110] (8) In each of the above-mentioned forms, the terms “system” and “network” shall be used interchangeably.
[0111] (9) The information, parameters, etc. described in this disclosure may be expressed using absolute values, relative values from a given value, or other corresponding information.
[0112] (10) In the embodiments described above, the portable device may be a Mobile Station (MS). A Mobile Station may also be referred to by those skilled in the art as a subscriber station, mobile unit, subscriber unit, wireless unit, remote unit, mobile device, wireless device, wireless communication device, remote device, mobile subscriber station, access terminal, mobile terminal, wireless terminal, remote terminal, handset, user agent, mobile client, client, or several other appropriate terms. In this disclosure, terms such as “Mobile Station,” “User Terminal,” “User Equipment (UE),” and “Terminal” may be used interchangeably.
[0113] (11) In the embodiments described above, the terms “connected,” “coupled,” or any variation thereof, mean any direct or indirect connection or coupling between two or more elements, and may include the presence of one or more intermediate elements between two elements that are “connected” or “coupled” with each other. The coupling or connection between elements may be physical, logical, or a combination thereof. For example, “connection” may be read as “access.” As used in this disclosure, two elements may be considered to be “connected” or “coupled” with each other using at least one of one or more wires, cables, and printed electrical connections, and, in some non-limiting and non-exclusive examples, electromagnetic energy having wavelengths in the radio frequency domain, microwave domain, and optical (both visible and invisible) domain, etc.
[0114] (12) In the embodiments described above, the phrase “based on” does not mean “based solely on” unless otherwise specified. In other words, the phrase “based on” means both “based solely on” and “based at least on.”
[0115] (13) The terms “determining” and “determining” as used in this disclosure may encompass a wide variety of actions. “Determining” may include, for example, judging, calculating, computing, processing, deriving, investigating, looking up, searching, inquiry (e.g., searching in a table, database or other data structure), ascertaining, etc. “Determining” may also include, for example, receiving (e.g., receiving information), transmitting (e.g., sending information), input, output, accessing (e.g., accessing data in memory), etc. Furthermore, "judgment" and "decision" can include considering something as having been "judged" or "decided" after resolving, selecting, choosing, establishing, comparing, etc. In other words, "judgment" and "decision" can include considering something as having been "judged" or "decided" after some action. Also, "judgment (decision)" can be reinterpreted as "assuming," "expecting," "considering," etc.
[0116] (14) Where the terms “include,” “including,” and variations thereof are used in the embodiments described above, these terms are intended to be inclusive, as is the term “comprising.” Furthermore, the term “or” as used in this disclosure is not intended to be exclusive OR.
[0117] (15) In the present disclosure, if articles are added by translation, such as a, an, and the in English, the present disclosure may include the fact that the noun following these articles is plural.
[0118] (16) In this disclosure, the term “A and B are different” may mean “A and B are different from each other.” The term may also mean “A and B are each different from C.” Terms such as “separate” and “combine” may be interpreted in the same way as “different.”
[0119] (17) Each aspect / embodiment described herein may be used individually, in combination, or switched between as needed in practice. Furthermore, notification of certain information (e.g., notification that "X is") is not limited to explicit notification, but may also be implicit (e.g., by not providing such notification). Multiple selected embodiments may be combined. [Explanation of symbols]
[0120] 1...System, 10...Server, 20-1...First User Terminal, 20-2...Second User Terminal, 20-3...Third User Terminal, 111...Second Image Acquisition Unit, 113...Determination Unit, 114...Permission Notification Unit, 115...Reception Unit, 117...Transmission Control Unit, 118...Third Call Control Unit, 119...Reception Notification Unit, 120...Detection Notification Unit, 211...Image Control Unit, 212...First Call Control Unit, 221...First Notification Control Unit, 222...First Image Acquisition Unit, 223...Second Call Control Unit, 231...Second Notification Control Unit, 232...Third Notification Control Unit, N...Network, U-1...First User, U-2...Second User, U-3...Third User.
Claims
1. An acquisition unit that acquires an image of the first user, A determination unit determines, based on the image, whether the action of the first user is a first action which allows sharing of the image with a second user different from the first user and a call between the second user and the first user, or a second action which only allows sharing of the image. The system includes a permission notification unit that, when the action is determined to be the first action, sends a first notification to the second user terminal used by the second user notifying permission to share the image and to make the call, and when the action is determined to be the second action, sends a second notification to the second user terminal notifying permission to share the image. Behavior analysis device.
2. A receiving unit that receives at least one of the image sharing instruction and the call initiation instruction transmitted by the second user terminal in response to the first notification, and that receives the sharing instruction transmitted by the second user terminal in response to the second notification, When the sharing instruction is received, the transmission control unit transmits the image to the second user terminal, The system further includes a call control unit that, upon receiving the aforementioned start instruction, connects the first user terminal used by the first user and the second user terminal in a call-enabled manner. The behavioral analysis device according to claim 1.
3. The system further includes an acknowledgment unit that, when the first notification or the second notification is sent to the second user terminal, sends a third notification to a third user terminal used by a third user different from both the first and second users, indicating whether or not the second user terminal has received at least one of the sharing instruction or the start instruction. The behavioral analysis device according to claim 2.
4. The acquisition unit acquires the image from the imaging device installed in the living space of the first user. The system further includes a detection notification unit that transmits a fourth notification indicating a change in whether or not the aforementioned image can be acquired to a third user terminal used by a third user who is different from both the first and second users. The behavioral analysis device according to claim 1.
5. The first activity is at least one of the following: playing a game, watching a video, eating or drinking, or having a conversation with the first user's siblings. The behavioral analysis device according to claim 1.
6. The two aforementioned activities are at least one of the following: studying, reading, or playing a musical instrument. The behavioral analysis device according to claim 1.
Citation Information
Patent Citations
Automatic answering video telephone set
JP1994197338A
Display control apparatus, display control method, and display control program
JP2022095256A
Nurse call system and state determination system
JP2023051150A
Videophone terminal and videophone system
JP3143731U
JPP7718492B
