Communication device, communication method, and program

Abstract

To assist communication of a plurality of persons with each other.SOLUTION: A communication device 10 includes an authentication unit 110 and a communication unit 120. The authentication unit 110 authenticates a target person. The communication unit 120 transmits and receives information to and from a first terminal 20 associated with the target person when the authentication is successful. In other words, the communication device 10 performs bidirectional communication with the first terminal 20. The first terminal 20 is operated, for example, by a person different from the target person. At least a part of information transmitted by the communication unit 120 to the first terminal 20 relates to the target person. At least a part of information received by the communication unit 120 from the first terminal 20 includes information from the person operating the first terminal 20 to the target person.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a communication device, a communication method, and a program.

Background Art

[0002] In recent years, various types of information have been transmitted between terminals. For example, Patent Document 1 discloses a data processing device for the purpose of notifying a guardian of an image related to a student. Specifically, this data processing device acquires image data indicating the activities of a student, analyzes this image data, and identifies the student associated with the image data. Then, the data processing device generates transmission data including the image data and having a terminal device corresponding to the identified student as the transmission destination.

[0003] Note that Patent Document 2 discloses an electric wheelchair having the following functions. This electric wheelchair moves in accordance with the walking of a user, and includes a seating seat on which the user can sit, a heart rate sensor that detects the heart rate of the user, a heart rate determination unit that determines the adequacy of the detected heart rate, and a message output means unit that outputs a predetermined message to the user based on the determination result by the heart rate determination unit.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0005] In order to assist communication between a plurality of people who cannot meet directly, it is preferable to enable two-way communication between these people. However, in Patent Document 1 described above, two-way communication is not considered.

[0006] One example of the object of the present invention is to provide a communication device, a communication method, and a program that can assist in communication between multiple people. [Means for solving the problem]

[0007] According to one aspect of the present invention, an authentication means for authenticating a subject, When the aforementioned authentication is successful, a communication means for sending and receiving information with a first terminal linked to the aforementioned subject and operated by a person other than the aforementioned subject, Equipped with, At least a portion of the information transmitted by the communication means to the first terminal relates to the subject, A communication device is provided in which at least a portion of the information that the communication means receives from the first terminal includes information from different people to the target person.

[0008] According to one aspect of the present invention, at least one computer, Authenticate the target person, Upon successful authentication, information is sent and received between the first terminal, which is linked to the subject and operated by a person other than the subject. At least a portion of the information transmitted to the aforementioned first terminal relates to the subject, A communication method is provided in which at least a portion of the information received from the first terminal includes information from different people to the subject.

[0009] According to one aspect of the present invention, a computer, Authenticate the target person, Upon successful authentication, information is sent and received between the first terminal, which is linked to the subject and operated by a person other than the subject. At least a portion of the information transmitted to the aforementioned first terminal relates to the subject, A program is provided in which at least a portion of the information received from the first terminal includes information from different people to the subject.

Advantages of the Invention

[0010] According to one aspect of the present invention, a communication device, a communication method, and a program capable of assisting communication between multiple people can be obtained.

Brief Description of the Drawings

[0011] [Figure 1] It is a diagram showing the main part of the communication device according to the embodiment. [Figure 2] It is a diagram showing an example of the usage environment of the communication device. [Figure 3] It is a diagram showing an example of the functional configuration of the first terminal. [Figure 4] It is a diagram showing an example of the functional configuration of the communication device. [Figure 5] It is a diagram showing an example of the information stored in the storage unit. [Figure 6] It is a diagram showing an example of the hardware configuration of the communication device. [Figure 7] It is a flowchart showing the operations performed by the communication device together with the operations performed by the first terminal and the second terminal. [Figure 8] It is a diagram showing a modification example of FIG. 7. [Figure 9] ) It is a flowchart showing the first specific example of step S50. [Figure 10] It is a flowchart showing the second specific example of step S50. [Figure 11] It is a flowchart showing the third specific example of step S50. [Figure 12] It is a flowchart showing the fourth specific example of step S50.

Modes for Carrying Out the Invention

[0012] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In all the drawings, the same components are denoted by the same reference numerals, and the description will be omitted as appropriate.

[0013] Figure 1 shows the main components of a communication device 10 according to an embodiment. The communication device 10 includes an authentication unit 110 and a communication unit 120. The authentication unit 110 authenticates the target person. When authentication is successful, the communication unit 120 sends and receives information with a first terminal 20 associated with the target person. That is, the communication device 10 communicates bidirectionally with the first terminal 20. The first terminal 20 is operated, for example, by a person other than the target person. At least a portion of the information that the communication unit 120 transmits to the first terminal 20 is related to the target person. Also, at least a portion of the information that the communication unit 120 receives from the first terminal 20 includes information from the person operating the first terminal 20 to the target person. For this reason, the communication device 10 can be used to assist communication between the target person and other people, i.e., between multiple people.

[0014] One example of someone operating the first terminal 20 is a relative of the subject.

[0015] For example, if the target person is a resident of a facility such as a nursing home or hospital, it is difficult for the resident's relatives to communicate with the resident easily. However, by using the communication device 10, relatives can easily communicate with the resident. The same effect can be obtained even if the target person is a relative of the resident and the first terminal 20 is operated by the resident or their assistant. Here, the assistant is, for example, a caregiver in a nursing home or a nurse in a medical institution.

[0016] Furthermore, if the target user is a child and the person operating the first terminal 20 is the child's guardian, it facilitates communication between the child or their supervisor (e.g., a teacher) and the guardian.

[0017] The details of the communication device 10 are described below.

[0018] In the example shown in Figure 1, the communication device 10 is used together with the first terminal 20. The first terminal 20 is operated by someone other than the subject. On the other hand, the communication device 10 is operated by the subject or an assistant. That is, the communication device 10 assists communication between the subject and people other than the subject by communicating with the first terminal 20. For example, if the subject is a resident of a facility, the first terminal 20 is operated by a relative of the resident, and the communication device 10 is operated by the resident, a caregiver, or a nurse. Also, if the subject is a relative of a resident of a facility, the first terminal 20 is operated by the resident, a caregiver, or a nurse, and the communication device 10 is operated by a relative of the resident.

[0019] Figure 2 shows a second example of the usage environment for the communication device 10. In the example shown in this figure, the communication device 10 is used together with the second terminal 30 in addition to the first terminal 20. In this case, one of the communication device 10 and the second terminal 30 is operated by a caregiver or nurse, and the other is operated by the person receiving care.

[0020] In the example shown in Figure 2, the communication device 10 may be, for example, a fixed terminal operated by a caregiver or nurse, or it may be a cloud server.

[0021] Furthermore, in the examples shown in Figures 1 and 2, a cloud server may also be used in addition to the communication device 10, the first terminal 20, and the second terminal 30. In this case, at least a portion of the processing performed by any one of the communication device 10, the first terminal 20, and the second terminal 30 may be performed by the cloud server. When a cloud server is used, the communication device 10 is used together with the cloud server and a terminal that serves as the interface for the cloud server.

[0022] Figure 3 shows an example of the functional configuration of the first terminal 20. The first terminal 20 has an input unit 210, a communication unit 220, and an output unit 230. An example of the first terminal 20 is a mobile terminal such as a smartphone or a tablet.

[0023] The input unit 210 also functions as an imaging unit, and various types of information are input to it. For example, the input unit 210 has an imaging device and generates images. The images may be videos, still images, or a combination of both. The input unit 210 may also generate audio data along with the images. Furthermore, text data may be input to the input unit 210 from the user.

[0024] The communication unit 220 transmits and receives information with external devices. An example of an external device is the communication device 10.

[0025] The output unit 230 has an output device, which it uses to output information. Examples of this output device include a display such as a touch panel and a speaker. If the output unit 230 has a touch panel, it also functions as an input device operated by the user of the first terminal 20.

[0026] The functional configuration of the second terminal 30 shown in Figure 2 is the same as that of the first terminal 20. That is, the second terminal 30 has an input unit 310, a communication unit 320, and an output unit 330. The input unit 310 is the same as the input unit 210, the communication unit 320 is the same as the communication unit 220, and the output unit 330 is the same as the output unit 230.

[0027] The first terminal 20 and the second terminal 30 may have other configurations. For example, if iris information, fingerprint information, or vein information is used during authentication by the communication device 10, the first terminal 20 and the second terminal 30 may have devices for acquiring this information. The information acquired by these devices is then transmitted to the communication device 10 by the output unit 230 or the output unit 330.

[0028] Figure 4 shows an example of the functional configuration of the communication device 10. The communication device 10 includes an authentication unit 110, a communication unit 120, and a determination unit 130, and can utilize a storage unit 140. In the example shown in this figure, the storage unit 140 is part of the communication device 10, but it may be located outside the communication device 10.

[0029] The authentication unit 110 authenticates the subject as explained with reference to Figure 1. The authentication unit 110 may authenticate the subject using the subject's identification information, such as an ID, or it may authenticate the subject using the subject's biometric information. Examples of biometric information include, but are not limited to, at least one of facial information, iris information, fingerprint information, and vein information. The authentication unit 110 obtains the information necessary for authentication from the second terminal 30 via the communication unit 120. The authentication unit 110 also obtains master information for authentication from the storage unit 140.

[0030] The communication unit 120 transmits and receives information with the first terminal 20, and also transmits and receives information with the second terminal 30. Specific examples of the information transmitted and received by the communication unit 120 will be explained in the usage examples of the communication device 10 described later.

[0031] The decision unit 130 determines whether or not to allow the communication unit 120 to send and receive information with the first terminal 20. For example, if a predetermined condition is not met, the decision unit 130 does not allow the communication unit 120 to communicate with the first terminal 20. In other words, the communication unit 120 does not communicate with the first terminal 20 if the predetermined condition is not met. For example, if the subject is a resident of a facility, the predetermined condition is that there is a predetermined input from the resident's assistant. The predetermined input might indicate, for example, permission to contact relatives.

[0032] The memory unit 140 stores information about each individual. One example of this information is the master information used for authentication.

[0033] In the example shown in Figure 1, the communication device 10 is preferably a mobile device such as a smartphone or tablet. Furthermore, the communication device 10 also has the functions shown for the second terminal 30.

[0034] Figure 5 shows an example of the information stored in the memory unit 140. The memory unit 140 stores, for each individual, the name, identification information, master biometric information, first terminal information, transmission timing information, information to be transmitted, and whether or not a prohibition request has been set.

[0035] The identification information and the master biometric information are used by the authentication unit 110 when performing authentication processing. The storage unit 140 does not need to store either the identification information or the biometric information. The storage unit 140 may also store the password along with the identification information. In this case, the authentication unit 110 authenticates the target person using the combination of the identification information and the password.

[0036] The first terminal information stores the information necessary for the communication unit 120 to connect to the first terminal 20 associated with the target person. The first terminal information includes, for example, at least one of the following: a telephone number, an email address, and an SNS account.

[0037] The transmission timing information indicates the timing at which the user of the first terminal 20 is most likely to operate the first terminal 20. In other words, the transmission timing information indicates the timing at which it is preferable to transmit information from the communication device 10 to the first terminal 20. This timing is indicated, for example, by time slot on a specific day of the week, but is not limited to this.

[0038] The transmission timing information may be set by manual input from the target person, assistant, or user of the first terminal 20, or it may be set based on the operation history of the first terminal 20. In the latter case, for example, the determination unit 130 of the communication device 10 obtains the access history of the information transmitted by the communication unit 120 from the first terminal 20, aggregates the time periods with high access frequency in this access history by day of the week, and sets the transmission timing information using this aggregation result. The determination unit 130 may also set the transmission timing information using the access history of the first terminal 20 to SNS.

[0039] Note that transmission timing information does not need to be set.

[0040] The "information to be transmitted" area is a region that stores information to be transmitted to the first terminal 20. The communication unit 120 obtains information to be transmitted to the first terminal 20 from, for example, the second terminal 30, but may not immediately transmit this information to the first terminal 20. One example of this is when the transmission timing information described above is set. In such a case, the communication unit 120 stores the information obtained from the second terminal 30 in the "information to be transmitted" area of ​​the storage unit 140. This information to be transmitted may be deleted after being transmitted to the second terminal 30, or it may remain as is.

[0041] Whether or not a prohibition request is set indicates whether or not it is permissible for the reply information, which is the information that the second terminal 30 should output, to be seen by someone other than the target person, such as an assistant, when the first terminal 20 receives the reply information. If this setting exists, the communication unit 120 transmits the reply information to the second terminal 30 along with prohibition request information indicating that the information should not be seen by anyone other than the target person.

[0042] Furthermore, the setting of prohibition requests may be configured separately for each type of information. Examples of information types include, but are not limited to, text data, images, and audio. For example, it may be possible to set it so that viewing of text data is not prohibited for anyone other than the target user, but viewing of images is prohibited for anyone other than the target user.

[0043] Figure 6 shows an example of the hardware configuration of the communication device 10. The communication device 10 includes a bus 1010, a processor 1020, a memory 1030, a storage device 1040, an input / output interface 1050, and a network interface 1060.

[0044] Bus 1010 is a data transmission path for the processor 1020, memory 1030, storage device 1040, input / output interface 1050, and network interface 1060 to send and receive data to and from each other. However, the method of connecting the processor 1020 and the other components to each other is not limited to bus connection.

[0045] The 1020 processor is a processor implemented in components such as the CPU (Central Processing Unit) and GPU (Graphics Processing Unit).

[0046] Memory 1030 is a main memory device implemented using RAM (Random Access Memory), etc.

[0047] The storage device 1040 is an auxiliary storage device implemented as a removable media such as an HDD (Hard Disk Drive), SSD (Solid State Drive), or memory card, or as ROM (Read Only Memory), and has a recording medium. The recording medium of the storage device 1040 stores program modules that implement each function of the communication device 10 (for example, the authentication unit 110, the communication unit 120, and the determination unit 130). The processor 1020 reads each of these program modules into the memory 1030 and executes them, thereby realizing each function corresponding to that program module. The storage device 1040 may also function as a storage unit 140.

[0048] The input / output interface 1050 is an interface for connecting the communication device 10 with various input / output devices.

[0049] The network interface 1060 is an interface for connecting the communication device 10 to a network. This network may be, for example, a LAN (Local Area Network) or a WAN (Wide Area Network). The method by which the network interface 1060 connects to the network may be wireless or wired. The communication device 10 communicates with the first terminal 20 and the second terminal 30, for example, via the network interface 1060.

[0050] The hardware configurations of the first terminal 20 and the second terminal 30 are the same as those shown in Figure 6. In this case, the recording medium of the storage device 1040 stores program modules that implement the respective functions of the first terminal 20 and the second terminal 30.

[0051] Figure 7 is a flowchart illustrating an example of the operation performed by the communication device 10. The example shown in this figure corresponds to the example shown in Figure 2.

[0052] However, in the example shown in Figure 1, the communication device 10 also performs the process shown in step S10 of this figure. Furthermore, the process shown in step S20 is not performed. This is also true in the example shown in Figure 8, which will be described later.

[0053] When it is necessary for the subject or assistant to communicate with the user of the first terminal 20, the second terminal 30 first acquires the information necessary to authenticate the subject, i.e., authentication information. For example, if the authentication information is facial information, the input unit 310 of the second terminal 30 generates an image including the subject's face. This image may be a video or a still image. On the other hand, if the authentication information is identification information such as an ID, the second terminal 30 acquires this identification information via an input device such as a touch panel (step S10).

[0054] Then, the communication unit 320 of the second terminal 30 transmits authentication information to the communication device 10 (step S20). The communication unit 120 of the communication device 10 acquires this authentication information. Next, the authentication unit 110 of the communication device 10 authenticates the target person using the authentication information and the information stored in the storage unit 140. At this time, the target person is also identified (step S30).

[0055] Next, the communication unit 120 of the communication device 10 reads the first terminal information corresponding to the person identified in step S30 from the storage unit 140. This identifies the first terminal 20 that will be the recipient of this communication (step S40).

[0056] Subsequently, the communication device 10 transmits and receives information with the first terminal 20 and with the second terminal 30. The transmitted and received information includes at least one of voice, image, and text data. This allows the first terminal 20 and the second terminal 30 to transmit and receive information via the communication device 10. A specific example of the processing performed here will be described later using other diagrams (step S50).

[0057] In step S20, the communication unit 320 of the second terminal 30 may transmit information to be sent to the first terminal 20 along with the authentication information to the communication device 10. An example of the information transmitted here is a message to be notified from the target person to the user of the first terminal 20. This message may be a video message, audio only, or text data. If the authentication information is an image, this authentication information may also serve as the message. Such an example is preferable when the image is a video.

[0058] Figure 8 shows a modified version of Figure 7. In the example shown in this figure, the processing up to step S30 is the same as in the example shown in Figure 7. After the authentication of the target person by the authentication unit 110 of the communication device 10 is successful (step S30), the determination unit 130 of the communication device 10 confirms that communication with the first terminal 20 is permitted (step S32).

[0059] For example, consider a case where the target person is a resident of a facility, and the communication device 10 is operated by the resident's assistant. In this case, the decision unit 130 determines that communication with the first terminal 20 is permitted when the assistant inputs information indicating that communication is permitted. In this example, the communication device 10 may be a mobile terminal, a desktop computer, or a laptop computer. Furthermore, the assistant may input information via a terminal other than the communication device 10.

[0060] The subsequent processing (steps S40 and S50) is as explained with reference to Figure 7. Note that if it is not possible to confirm in step S32 that communication with the first terminal 20 is permitted, the processing shown in steps S40 and S50 will not be performed.

[0061] (First specific example of step S50) Figure 9 is a flowchart illustrating the first specific example of step S50. The example shown in this figure illustrates a case where the subject requests a specific permission from the user of the first terminal 20. For example, if the subject is a resident of a facility and the user of the first terminal 20 is a relative of the resident, the relative's permission may be required to fulfill the resident's wishes. The example shown in Figure 9 illustrates the communication that takes place in such a case. The second terminal 30 may be operated by the resident or by an assistant.

[0062] The example shown in this figure corresponds to the example shown in Figure 2. However, in the example shown in Figure 1, the communication device 10 also performs the processes shown in steps S110 and S170 of this figure. Also, the processes shown in steps S120 and S160 are not performed. This is also the case in the example shown in Figure 10, which will be described later.

[0063] First, the communication unit 320 of the second terminal 30 acquires permission request information (step S110). This acquisition is performed, for example, via an input device of the second terminal 30. The permission request information indicates that a relative is requesting a specific permission from the subject. The specific permission could be, for example, that the resident is allowed to purchase a specific product or service, but is not limited to these. For example, the specific permission could be permission for the resident to go out. The permission request information may be, for example, text data or video.

[0064] Then, the communication unit 320 of the second terminal 30 transmits permission request information to the communication device 10 (step S120). When the communication unit 120 of the communication device 10 receives this permission request information, it transmits this permission request information to the first terminal 20 (step S130). In the example shown in this figure, this transmission is performed in real time.

[0065] The communication unit 220 of the first terminal 20 acquires permission request information from the communication device 10. The output unit 230 then outputs this permission request information, allowing the user of the first terminal 20 to recognize it. At this time, the first terminal 20 may also cause other terminals, such as a television or intercom, to make the user aware that permission request information has been transmitted. In this way, the user of the first terminal 20 can easily recognize that information has been transmitted from the communication device 10.

[0066] The output unit 230 may first output only that permission request information has been transmitted, and then output the permission request information after a predetermined input has been made. The communication unit 220 may also send information indicating this, such as an acknowledgment, to the communication device 10 after the permission request information has been output. In this case, it is preferable for the communication device 10 to send this information to the second terminal 30.

[0067] When the user of the first terminal 20 decides whether or not to comply with the permission request information, they input information indicating their decision into the first terminal 20. Hereinafter, the information entered here will be referred to as the reply information (step S140). If the output unit 230 has a touch panel, it may display a button indicating permission and a button indicating denial on the touch panel. In this case, the user of the first terminal 20 makes an input to the first terminal 20 by selecting one of these buttons.

[0068] The communication unit 220 of the first terminal 20 then transmits the input reply information to the communication device 10 (step S150). The communication unit 120 of the communication device 10 transmits the reply information obtained from the first terminal 20 to the second terminal 30 (step S160). The output unit 330 of the second terminal 30 then outputs the reply information. The second terminal 30 also performs predetermined processing according to the reply information (step S170).

[0069] For example, if the permission request information indicates that the subject is requesting permission to purchase a specific product or service, and the reply information indicates that this purchase is permitted, the second terminal 30 will perform the necessary steps to proceed with the purchase, such as accessing the page for the specific product or service on an e-commerce site. The URL for the specific product or service on this e-commerce site is included, for example, in the permission request information. In this case, the reply information may also include this URL. The second terminal 30 then accesses the e-commerce site using the URL included in the permission request information or the reply information. The second terminal 30 may also perform the purchase process for this product or service. The item to be purchased may be an e-book or a game license.

[0070] Furthermore, the communication unit 120 of the communication device 10 or the output unit 330 of the second terminal 30 may generate recommendation information for the target person using information about the goods or services indicated in the permission request information, for example, the type of goods or services. This recommendation information is, for example, information for introducing goods or services similar to the goods or services indicated in the permission request information. The second terminal 30 then outputs, for example, displays, this recommendation information. The recommendation information may include search results for the goods or services indicated in the permission request information.

[0071] For example, if the target person is an elderly person residing in a care facility, this e-commerce site could be a site specifically for the elderly. This site would display only products and services suitable for the elderly. As a result, the target person or the user of the first terminal 20 could easily select the product or service they desire. Furthermore, the possibility of the target person or the user of the first terminal 20 mistakenly purchasing products or services unsuitable for the elderly would be reduced.

[0072] Furthermore, in the example shown in Figure 9, the first terminal 20 may be operated by a resident or assistant of the facility, and the second terminal 30 may be operated by a relative of the resident. In this case, the permission request information indicates a product or service that the relative recommends to the resident. The reply information indicates whether or not the resident wishes to purchase that product or service. The actual purchase process may be carried out by the resident, assistant, or relative.

[0073] Furthermore, if the person in question is a resident of a facility and requires medication, the timing of outputting the reply information and performing the prescribed processing, i.e., the timing of step S170, may be the timing of when the medication is administered.

[0074] (Second specific example of step S50) Figure 10 is a flowchart showing a second specific example of step S50. The example shown in this figure is similar to the specific example shown in Figure 9, except that the timing at which the communication device 10 transmits permission request information to the first terminal 20 is not in real time, but is predetermined for each target person.

[0075] In this figure, the processing up to step S120 is the same as in the example shown in Figure 9. When the communication unit 120 of the communication device 10 obtains permission request information from the second terminal 30, it reads from the storage unit 140 the transmission timing associated with the target person identified in step S30 of Figure 7. As a result, the communication unit 120 identifies the date and time on which the permission request information should be transmitted (step S122). The communication unit 120 then transmits the permission request information to the first terminal 20 at the identified date and time (step S130).

[0076] The subsequent processing (steps S140 to S170) is the same as in the example shown in Figure 9. In other examples described later, the processing shown in steps S122 and S130 may also be performed in the same way as in this example.

[0077] (The third specific example of Step S50) Figure 11 is a flowchart showing a third specific example of step S50. The example shown in this figure illustrates a case where the subject and the user of the first terminal 20 send each other images they have taken. The images are preferably videos, but they may also be still images. Alternatively, text data may be used instead of images.

[0078] The example shown in this figure corresponds to the example shown in Figure 2. However, in the example shown in Figure 1, the communication device 10 also performs the processes shown in steps S210 and S280 of this figure. Also, the processes shown in steps S220 and S270 are not performed.

[0079] One example of a target individual is a resident of a facility. In this case, the user of terminal 1 20 is a relative of the target individual. Conversely, the target individual may be a relative of a resident of the facility, and the user of terminal 1 20 may be a resident of the facility.

[0080] First, the subject or assistant causes the second terminal 30 to generate an image, such as a video message, to be sent from the subject to the user of the first terminal 20. Hereinafter, this image will be referred to as the first image. The first image is generated, for example, by taking a photograph of the subject. The first image may be a message from the subject to the user of the first terminal 20, or it may be an image of the subject's daily activities (step S210). Next, the communication unit 320 of the second terminal 30 transmits the first image to the communication device 10 (step S220). If the communication device 10 has a shooting function, the communication device 10 may generate the first image directly.

[0081] The first image may be the image used to authenticate the subject. As explained with reference to Figure 7, this image may be a video or a still image. In this case, the processes shown in steps S210 and S220 may be omitted.

[0082] Next, the communication unit 120 of the communication device 10 transmits the first image to the first terminal 20 (step S230).

[0083] The communication unit 220 of the first terminal 20 acquires the first image from the communication device 10. Then, the output unit 230 of the first terminal 20 outputs the first image (step S240). As a result, the user of the first terminal 20 can recognize the first image.

[0084] The user of the first terminal 20 then inputs information to be sent to the target person into the first terminal 20. Hereinafter, this information will be referred to as the reply information. For example, the first terminal 20 uses the input unit 210 to generate a second image, which is at least part of the reply information. The second image may be an image of the user taken while they are looking at the first image, or an image of the user taken after they have finished looking at the first image. This example is suitable, for example, when the first image is a message from a relative of a resident of the facility to that resident (step S250).

[0085] The communication unit 220 of the first terminal 20 then transmits the reply information to the communication device 10 (step S260). When the communication unit 120 of the communication device 10 receives the reply information from the first terminal 20, it transmits this reply information to the second terminal 30 (step S270).

[0086] The communication unit 320 of the second terminal 30 acquires this reply information. The output unit 330 of the second terminal 30 then outputs this reply information to make it known to the target person (step S280). If the reply information includes a video and the playback time of this video is greater than or equal to a standard value, the communication unit 320 may output the video in segments or fast forward it.

[0087] (Fourth specific example of step S50) Figure 12 is a flowchart showing a fourth specific example of step S50. The example shown in this figure is the same as the specific example shown in Figure 11, except that the communication device 10 transmits prohibition request information along with the reply information, and the output unit 330 of the second terminal 30 operates based on the prohibition request information. The prohibition request information indicates that it is forbidden for anyone other than the target person to recognize the reply information.

[0088] The example shown in this figure corresponds to the example shown in Figure 2. However, in the example shown in Figure 1, the communication device 10 also performs the processes shown in steps S210 and S282 of this figure. Also, the processes shown in steps S220 and S272 are not performed.

[0089] In this figure, the processing up to step S260 is the same as in the example shown in Figure 11. When the communication unit 120 of the communication device 10 obtains the reply information from the communication device 10, it checks with the storage unit 140 whether or not a prohibition request has been set for the target person identified in step S30 of Figure 7. That is, the communication unit 120 determines, based on the target person, whether or not it is necessary to prohibit anyone other than the resident from recognizing the reply information. If there is no prohibition request set, the processing from this point onward is the same as in Figure 11. On the other hand, if there is a prohibition request set, the communication unit 120 performs processing to prohibit anyone other than the resident from recognizing the reply information. In the example shown in this figure, the communication unit 120 transmits the reply information to the second terminal 30 along with the prohibition request information (step S272). In this process, the communication unit 120 determines, based on the target person, whether or not it is necessary to transmit the prohibition request information.

[0090] Subsequently, the output unit 330 of the second terminal 30 outputs reply information while the input unit 310 is capturing images. Here, the output unit 330 outputs reply information only while the subject's face is detected in the image captured by the input unit 310. The output unit 330 does not output reply information if a person other than the subject is detected in the image captured by the input unit 310. Furthermore, if a person other than the subject is detected in the image captured by the input unit 310 while reply information is being output, the output of reply information is interrupted, and then the output of reply information is resumed when only the subject is detected in the image captured by the input unit 310 (step S282).

[0091] In the example shown in Figure 12, the processing of the image captured by the input unit 310 is performed by the second terminal 30. However, this processing may also be performed by the communication device 10. In this case, the input unit 310 transmits the image to the communication device 10 each time it generates an image, such as a frame image. The authentication unit 110 of the communication device 10 then determines whether or not the image of the subject has been detected from the acquired image, and whether or not a person other than the subject has been detected from the image, and transmits the determination result to the second terminal 30. The output unit 330 of the second terminal 30 then controls the output of reply information using the determination result acquired from the communication device 10.

[0092] The information transmitted and received in step S50 is not limited to the first to fourth specific examples described above. For example, if the subject is a resident of the facility, the second terminal 30 is operated by the subject's assistant, and the user of the first terminal 20 is a relative of the subject, the information transmitted and received in step S50 may be communications between the facility and the relative, such as requests from the facility to the relative and replies thereto. Furthermore, if facial recognition is used in step S30, the information transmitted to the first terminal 20 in step S50 after the same subject has used the communication device 10 multiple times may be generated by automatically editing the images used in step S30.

[0093] As described above, this embodiment can assist in communication between multiple people. Furthermore, if reply information is sent from the first terminal 20 to the second terminal 30 and a prohibition request is set for the target person, the second terminal 30 will not output the reply information if it detects a person other than the target person from the image captured by the input unit 310. In this way, the privacy of the target person can also be ensured.

[0094] The embodiments of the present invention have been described above with reference to the drawings, but these are merely examples of the present invention, and various other configurations can also be adopted.

[0095] Furthermore, while the flowcharts used in the above description show multiple steps (processes) in sequence, the execution order of the steps performed in each embodiment is not limited to the order in which they are described. In each embodiment, the order of the illustrated steps can be changed to the extent that it does not impede the content. Also, the above embodiments can be combined to the extent that their contents do not conflict.

[0096] Some or all of the above embodiments may also be described as follows, but are not limited to the following: 1. Authentication means for authenticating the target person, When the aforementioned authentication is successful, a communication means for sending and receiving information with a first terminal linked to the aforementioned subject and operated by a person other than the aforementioned subject, Equipped with, At least a portion of the information transmitted by the communication means to the first terminal relates to the subject, A communication device in which at least a portion of the information that the communication means receives from the first terminal includes information from different people to the target person. 2. In the communication device described in item 1 above, The first terminal is a communication device operated by a relative of the subject. 3. In the communication device described in item 2 above, The aforementioned communication means is The first terminal receives permission request information indicating that the relative is requesting the subject to grant a prescribed permission. A communication device that receives reply information to the permission request information from the first terminal. 4. In the communication device described in item 3 above, The aforementioned permission is permission to purchase goods or services. The communication means is a communication device that generates recommendation information for the target person using information about the product or service. 5. In the communication device described in item 2 above, The communication means is a communication device that transmits a first image of the subject to the first terminal. 6. In the communication device described in item 5 above, The communication means is a communication device that acquires the first image from a camera that photographs the subject. 7. In the communication device described in item 5 or 6 above, The aforementioned communication means is A communication device that, after transmitting the first image, receives a second image of the relative from the first terminal. 8. In any of the communication devices described in items 1 to 7 above, A communication device comprising a determination means for determining whether or not to send and receive information with the first terminal, with respect to the communication means. 9. In any of the communication devices described in items 1 to 8 above, The aforementioned communication means is a communication device that transmits information to the first terminal at a predetermined timing for the subject. 10. In a communication device described in any one of items 1 to 9 above, The first terminal is operated by a relative of the facility's resident. The aforementioned communication means is After the authentication is successful, the first terminal receives the reply information to be notified to the resident, A communication device that performs processing to prevent anyone other than the aforementioned resident from recognizing the aforementioned reply information. 11. In the communication device described in item 10 above, The aforementioned communication means is a communication device that determines whether or not the prohibition is necessary based on the subject. 12. At least one computer, Authenticate the target person, Upon successful authentication, information is sent and received between the first terminal, which is linked to the subject and operated by a person other than the subject. At least a portion of the information transmitted to the aforementioned first terminal relates to the subject, A communication method wherein at least a portion of the information received from the first terminal includes information from a different person to the subject. 13. In the communication method described in item 12 above, The first terminal is operated by a relative of the subject, and the communication method is as follows: 14. In the communication method described in item 13 above, The aforementioned computer, The first terminal receives permission request information indicating that the relative is requesting the subject to grant a prescribed permission. A communication method for receiving reply information to the permission request information from the first terminal. 15. In the communication method described in item 14 above, The aforementioned permission is permission to purchase goods or services. A communication method comprising the computer generating recommendation information for the target person using information about the product or service. 16. In the communication method described in item 13 above, A communication method comprising the computer transmitting a first image of the subject to the first terminal. 17. In the communication method described in item 16 above, A communication method for the computer to acquire the first image from a camera that photographs the subject. 18. In the communication method described in item 16 or 17 above, The aforementioned computer, A communication method comprising transmitting the first image and then receiving a second image of the relative from the first terminal. 19. In any of the communication methods described in items 12 to 18 above, The computer provides a communication method for determining whether or not to send and receive information with the first terminal. 20. In any of the communication methods described in items 12 to 19 above, A communication method comprising the computer transmitting information to the first terminal at a predetermined timing for the subject. 21. In any of the communication methods described in items 12 to 20 above, The first terminal is operated by a relative of the facility's resident. The aforementioned computer, After the authentication is successful, the first terminal receives the reply information to be notified to the resident, A communication method that performs processing to prevent anyone other than the aforementioned resident from recognizing the aforementioned reply information. 22. In the communication method described in item 21 above, The computer is a communication method that determines whether the prohibition is necessary based on the subject. 23. To the computer, Authenticate the target person, Upon successful authentication, information is sent and received between the first terminal, which is linked to the subject and operated by a person other than the subject. At least a portion of the information transmitted to the aforementioned first terminal relates to the subject, A program in which at least a portion of the information received from the first terminal includes information from different people to the subject. 24. In the program described in 23 above, The first terminal is a program operated by a relative of the subject. 25. In the program described in 24 above, To the aforementioned computer, The first terminal is instructed to transmit permission request information indicating that the relative is requesting the subject to grant a predetermined permission. A program that causes the first terminal to receive reply information in response to the permission request information. 26. In the program described in item 25 above, The aforementioned permission is permission to purchase goods or services. A program that causes the computer to generate recommendation information for the target person using information about the product or service. 27. In the program described in 24 above, A program that causes the computer to transmit a first image of the subject to the first terminal. 28. In the program described in item 27 above, A program that causes the computer to acquire the first image from a camera that photographs the subject. 29. In the program described in 27 or 28 above, To the aforementioned computer, A program that, after transmitting the first image, causes the first terminal to receive a second image of the relative. 30. In any of the programs described in items 23 to 29 above, A program that causes the computer to decide whether or not to send and receive information with the first terminal. 31. In any of the programs described in items 23 to 30 above, A program that causes the computer to transmit information to the first terminal at a predetermined timing for the target person. 32. In any of the programs described in items 23 to 31 above, The first terminal is operated by a relative of the facility's resident. To the aforementioned computer, After the authentication is successful, the first terminal receives the reply information to be notified to the resident. A program that performs a process to prevent anyone other than the aforementioned resident from seeing the aforementioned reply information. 33. In the program described in 32 above, A program that causes the computer to determine whether the prohibition is necessary based on the subject. 34. A recording medium on which any of the programs described in items 23 to 33 above are recorded. [Explanation of Symbols]

[0097] 10. Communication equipment 20 First Terminal 30 Second Terminal 110 Authentication Department 120 Communications Department 130 Decision Section 140 Storage section 210 Input section 220 Communications Department 230 Output section 310 Input section 320 Communications Department 330 Output section

Claims

1. Authentication means for authenticating the target person, When the aforementioned authentication is successful, a communication means for sending and receiving information with a first terminal linked to the aforementioned subject and operated by a person other than the aforementioned subject, Equipped with, At least a portion of the information transmitted by the communication means to the first terminal relates to the subject, At least a portion of the information that the communication means receives from the first terminal includes information from different people to the subject, The first terminal is operated by a relative of the subject, The aforementioned communication means further, The first terminal receives permission request information indicating that the relative is requesting the subject to grant a predetermined permission. The first terminal receives a reply to the permission request information, The permission request information or the reply information includes a URL relating to a specific product or service on an e-commerce site, and the communication device performs the process of accessing the e-commerce site using the said URL.

2. In the communication device described in claim 1, The aforementioned permission is permission to purchase goods or services. The communication means is a communication device that generates recommendation information for the target person using information about the product or service.

3. In the communication device described in claim 1, The communication means is a communication device that transmits a first image of the subject to the first terminal.

4. In the communication device described in claim 3, The communication means is a communication device that acquires the first image from a camera that photographs the subject.

5. In the communication device according to any one of claims 1 to 4, A communication device comprising a determination means for determining whether or not to send and receive information with the first terminal, with respect to the communication means.

6. In the communication device according to any one of claims 1 to 4, The aforementioned communication means is a communication device that transmits information to the first terminal at a predetermined timing for the subject.

7. In the communication device according to any one of claims 1 to 4, The aforementioned subject is a resident of the facility, The aforementioned communication means is After the authentication is successful, the first terminal receives the reply information to be notified to the resident, A communication device that performs processing to prevent anyone other than the aforementioned resident from recognizing the aforementioned reply information.

8. At least one computer, Authenticate the target person, Upon successful authentication, information is sent and received between the first terminal, which is linked to the subject and operated by a person other than the subject, At least a portion of the information transmitted to the aforementioned first terminal relates to the subject, At least a portion of the information received from the first terminal includes information from different people to the subject, The first terminal is operated by a relative of the subject, The aforementioned at least one computer further, The first terminal receives permission request information indicating that the relative is requesting the subject to grant a predetermined permission. The first terminal receives a reply to the permission request information, The permission request information or the reply information includes a URL relating to a specific product or service on the e-commerce site. The aforementioned at least one computer, A communication method for performing the process of accessing the e-commerce site using the aforementioned URL.

9. On the computer, Authenticate the target person, When the authentication is successful, information is sent and received between the first terminal, which is linked to the subject and operated by a person other than the subject, At least a portion of the information transmitted to the aforementioned first terminal relates to the subject, At least a portion of the information received from the first terminal includes information from different people to the subject, The first terminal is operated by a relative of the subject, The aforementioned computer further, The first terminal is instructed to transmit permission request information indicating that the relative is requesting the subject to grant a predetermined permission. The first terminal receives a reply to the permission request information, The permission request information or the reply information includes a URL relating to a specific product or service on the e-commerce site. To the aforementioned computer, A program that uses the aforementioned URL to perform the process of accessing the aforementioned e-commerce site.

Images