Call assistance method and call assistance device

Abstract

This call assistance method is executed by a call assistance device (100) that comprises a processor, a speaker, and a microphone, and assists a call in cooperation with a communication terminal (200a) of a user (URa) in a state where a call connection between communication terminals (200a, 200b) of the user (URa) and another user (URb) serving as a call partner is established. The processor acquires first call possibility / impossibility information indicating whether or not the user (URa) can make a call, acquires second call possibility / impossibility information indicating whether or not the other user (URb) can make a call, and controls the speaker and the microphone on the basis of the first call possibility / impossibility information and the second call possibility / impossibility information.

Description

Call support method and call support device

[0001] The present invention relates to a communication assistance method and a communication assistance device.

[0002] Technologies are being developed that allow a call to be made when both parties are available to make a call, and stop the call when one of the parties is unavailable. For example, Patent Literature 1 discloses a technology that prompts the other party to make a call when it is detected that the other party has changed from an unavailable state to an available state.

[0003] Patent No. 5317164

[0004] The technology disclosed in Patent Document 1 notifies the user of a change in the status of the other party, but does not necessarily mean that the user will be able to make a call at that time, making it difficult to realize a smooth call with the other party.

[0005] The present invention has been made in view of the above circumstances, and has as its object to realize a smooth call with the other party.

[0006] In order to achieve the above-mentioned object, the call assistance method of the present invention is a call assistance method executed by a call assistance device that includes a processor, a speaker, and a microphone, and that assists in a call in cooperation with the user's communication terminal when a call connection is established between the user and the communication terminal of another user who is the call partner, wherein the processor acquires first call availability information indicating whether the user is available to make a call, acquires second call availability information indicating whether the other user is available to make a call, and controls the speaker and microphone based on the first call availability information and the second call availability information.

[0007] According to the present invention, it is possible to provide a call support method and a call support device that can realize a smooth call with a call partner.

[0008] It is a block diagram showing an example of the configuration of a call assistance system according to an embodiment. It is a front view of a call assistance device. It is a block diagram showing an example of the hardware configuration of the call assistance device. It is a diagram showing an example of a call control table. It is a block diagram showing an example of the functional configuration of the call assistance device. It is a flowchart showing the flow of call assistance processing.

[0009] A call support method and a call support device according to an embodiment of the present invention will be described in detail below with reference to the drawings. The call support method and the call support device according to an embodiment of the present invention support smooth call execution according to the convenience of each user.

[0010] As shown in Fig. 1, a call assistance system 1 according to an embodiment of the present invention includes a call assistance device 100 and a communication terminal 200a used by a user URa, and a communication terminal 200b used by a user URb. In the following description, user URa may be referred to as the "own user" and user URb as the "other user." Furthermore, when there is no particular distinction between communication terminal 200a and communication terminal 200b, or when describing a communication terminal other than communication terminal 200a and communication terminal 200b, they may be referred to as "communication terminal 200."

[0011] The communication terminal 200a is an information processing device that transmits and receives various information to and from other devices, such as a smartphone or tablet terminal used by the user URa and portable by the user URa. The communication terminal 200a has at least communication and call functions, as well as input and output functions for images, voice, and the like. In this embodiment, the communication terminal 200a is described as a smartphone. For example, the communication terminal 200a transmits to the communication terminal 200b its own user call availability information (first call availability information) indicating the call availability status of the user URa, as well as the user URa's voice data, image data, and the like, acquired from the call assistance device 100. The communication terminal 200a also transmits to the call assistance device 100 other user call availability information (second call availability information) indicating the call availability status of the user URb, as well as the user URb's voice data, image data, and the like, acquired from the communication terminal 200b.

[0012] The communication terminal 200b is an information processing device used by the user URb, such as a smartphone, tablet terminal, or personal computer. The communication terminal 200a has at least communication and call functions, and input / output functions for images, voice, and the like. In this embodiment, the communication terminal 200b is described as a laptop personal computer. For example, the communication terminal 200b transmits to the communication terminal 200a other user call availability information indicating the call availability status of the user URa, input by the user URb, as well as voice data and image data of the user URb. The communication terminal 200b also receives own user call availability information indicating the call availability status of the user URa, as well as voice data and image data of the user URa, transmitted from the communication terminal 200a. The communication terminal 200b appropriately processes various information and data related to the received call.

[0013] The communication support device 100 is a robotic device with an appearance resembling a stuffed bear, as shown in FIG. 2 . The communication support device 100 has a head 100a and a torso 100b connected to the lower part of the head 100a. The head 100a has a pair of ears 100c, eyes 100d, and a muzzle 100e. The torso 100b has hands 100f connected to the left and right sides of the torso 100b, two legs 100g connected to the lower part of the torso 100b, and an abdomen 100h located in the center of the torso 100b. The communication support device 100 acts as a surrogate for the user URb, and by carrying the communication support device 100, the user URa can feel as if they are out and about with the user URb.

[0014] The network NW is connected to the communication terminals 200a, 200b, etc., and is a communication network for transmitting information of each of the connected devices. The network NW is configured by, for example, an Internet network, a mobile phone network, a mobile communication network, a local area network (LAN), a wide area network (WAN), a virtual private network (VPN), etc., and may include various network relay devices such as antennas, gateways, routers, and hubs.

[0015] In this embodiment, it is assumed that user URa is out and about visiting a tourist spot or the like while carrying communication assistance device 100 and communication terminal 200a, while user URb is using communication terminal 200b at home, in an office, or other building. It is also assumed that communication terminals 200a and 200b are connected via network NW so that they can communicate via packet communication using an Internet line. It is also assumed that a short-range wireless communication connection is automatically established between communication assistance device 100 and communication terminal 200a when each is powered on.

[0016] (Example of Hardware Configuration of Communication Support Device 100) Next, an example of the hardware configuration of the communication support device 100 will be described. As shown in Fig. 3, the communication support device 100 physically includes a processor 101, a memory 102, a storage 103, a communication interface (communication I / F (InterFace)) 104, a microphone 105, a speaker 106, a camera 107, a touch sensor 108, and a performance unit 109. These components are electrically connected to each other via a bus line BL.

[0017] The processor 101 is an arithmetic unit that controls the overall operation of the communication assistance device 100. The processor 101 is a general-purpose processor such as a central processing unit (CPU), a micro processing unit (MPU), or a graphics processing unit (GPU).

[0018] The memory 102 is a main storage device and includes a ROM (Read Only Memory) that stores various programs and data, a RAM (Random Access Memory) that temporarily stores various programs and rewritably stores various data, etc. The processor 101 reads programs and various data from the ROM or storage 103 onto the RAM and executes the processing, thereby realizing the overall control and functions of the communication assistance device 100.

[0019] The memory 102 stores, for example, a call connection flag, a user's own call availability flag, and a different user's call availability flag.

[0020] The call connection flag is a flag indicating whether communication terminal 200a and communication terminal 200b are connected so that they can make a call. For example, when communication terminal 200a and communication terminal 200b are connected so that they can make a call by the other responding with an acceptance to a call connection request (call start request) sent from either communication terminal 200a or communication terminal 200b based on the operation of user URa or user URb, the call connection flag is set to on ("1"). Also, when communication terminal 200a and communication terminal 200b are not connected so that they can make a call because neither communication terminal 200a nor communication terminal 200b has made a call connection request or an acceptance response, or because a call disconnection request (call stop request) has been sent from either communication terminal 200a or communication terminal 200b based on the operation of user URa or user URb while the call connection has been established, the call connection flag is set to off ("0").

[0021] The user's own call availability flag is a flag indicating whether the user URa is available for calls or not. For example, when the user URa is available for calls, the user's own call availability flag is set to on, and when the user URa is not available for calls, the user's own call availability flag is set to off.

[0022] The other user call availability flag is a flag indicating whether the user URb is available for calls or unavailable for calls. For example, when the user URb is available for calls, the other user call availability flag is set to on, and when the user URb is unavailable for calls, the other user call availability flag is set to off.

[0023] The storage 103 is an auxiliary storage device that stores programs and various data required for program execution, and includes non-volatile storage devices such as hard disk drives (HDDs) and solid state drives (SSDs). The storage 103 stores, for example, an operating system (OS), which is basic software that controls the entire communication assistance device 100, and applications that run on the OS and provide various functions. The storage 103 also stores, for example, a call control table. Note that some of the programs and various data required for program execution may be stored in ROM.

[0024] The call control table is a table showing the control content of each device provided in the call support device 100 according to the call availability status between user URa and user URb. As shown in Fig. 4, the call control table sets "microphone, camera," "speaker," "LED," and "motor" to on or off according to the combination of the call availability status between "own user" corresponding to user URa and "other user" corresponding to user URb. Here, "on" means that each device is operated (running), and "off" means that each device is not operated (stopped).

[0025] In the call control table, for example, when neither the user (user URa) nor the other user (user URb) can make a call, or when the user can make a call but the other user cannot, the "microphone, camera," "speaker," "LED," and "motor" are all set to "off." Also, when the user cannot make a call but the other user can, the "microphone, camera" and "speaker" are set to "off," and the "LED" and "motor" are set to "on." Also, when the user and the other user can make a call, the "microphone, camera," "speaker," "LED," and "motor" are all set to "on." Note that when the user can make a call, even if the other user cannot make a call, the "microphone, camera" can be set to "on" to transmit the user's voice and image to communication terminal 200b via communication terminal 200a, thereby providing the other user with the voice and image.

[0026] The communication interface 104 is an interface for performing short-range wireless communication with the communication terminal 200a. The short-range wireless communication method is not particularly limited, and examples thereof include Bluetooth (registered trademark), Wi-Fi (registered trademark), ZigBee (registered trademark), and infrared communication.

[0027] The microphone 105, under the control of the processor 101, inputs audio around the communication assistance device 100 and converts the input audio into an audio signal (audio data).

[0028] The speaker 106 converts the audio signal (audio data) into audio and outputs it to the outside of the communication assistance device 100 under the control of the processor 101 .

[0029] The camera 107 is an imaging device that captures images of the surroundings of the communication support device 100. The camera 107 is installed, for example, at the nose and mouth portion 100e, captures images in front of the head 100a, and generates and outputs digital image data. Note that the images captured by the camera 107 include still images and moving images.

[0030] The touch sensor 108 is an operation device that accepts input operations from the user URa and outputs operation signals. The touch sensor 108 accepts, for example, an input operation that switches between whether the user URa is available for communication and whether he or she is unavailable for communication. The touch sensor 108 is disposed, for example, on a portion of the head 100a of the communication assistance device 100 corresponding to the forehead, a portion of the torso 100b corresponding to the abdomen 100h or the back, or the like. The touch sensor 108 may be combined with an image display device such as an LCD (Liquid Crystal Display), a PDP (Plasma Display Panel), or an organic EL (Electro-Luminescence) display. In this case, the input operations of the user URa on the touch sensor 108 include various operations such as a touch operation, a slide operation, a swipe operation, a tap operation, and a drag operation. The image display device may also display a video of the user URb acquired via the communication terminal 200a under the control of the processor 101.

[0031] The rendering unit 109 is composed of multiple devices that represent the status of the call partner, user URb, whether or not the call is possible. The rendering unit 109 includes, for example, an LED (Light-Emitting Diode) 109a and a motor 109b. The LED 109a is a light-emitting element that represents the call status, etc., by changing the lighting pattern, for example, under the control of the processor 101. The LED 109a is arranged, for example, in the eye area 100d, the cheeks of the head 100a, or the top of the head. The LED 109a blinks, for example, when the communication terminal 200a of user URa and the communication terminal 200b of user URb are connected so that they can communicate. Furthermore, the LED 109a lights up when user URa and user URb are able to communicate and are both talking. Furthermore, the LED 109a blinks when user URa and user URb stop (interrupt) the call while maintaining the call connection. When the user URa and the user URb release the call connection, the LED 109a is turned off. The LED 109a may be turned on in different ways depending on the user who is the call partner (for each of multiple users including the user URb).

[0032] The motor 109b is disposed, for example, inside the abdomen 100h of the communication support device 100, and vibrates under the control of the processor 101 to simulate the operation of the communication support device 100. For example, the motor 109b vibrates at regular intervals to simulate the heartbeat of the communication support device 100. This allows the user URa to intuitively recognize the presence of the communication support device 100.

[0033] Next, a description will be given of the functional configuration of the communication assistance device 100. As shown in Fig. 5 , the communication assistance device 100 functionally includes a control unit 110, a storage unit 120, a communication unit 130, an audio input / output unit 140, an imaging unit 150, an operation unit 160, and a performance unit 170.

[0034] The control unit 110 is realized, for example, by the processor 101 and memory 102 shown in FIG. 3. The storage unit 120 is realized, for example, by the memory 102 and storage 103 shown in FIG. 3. The communication unit 130 is realized, for example, by the communication interface 104 shown in FIG. 3. The audio input / output unit 140 is realized, for example, by the microphone 105, speaker 106, and touch sensor 108 shown in FIG. 3. The imaging unit 150 is realized, for example, by the camera 107 shown in FIG. 3. The operation unit 160 is realized, for example, by the touch sensor 108. The performance unit 170 is realized, for example, by the performance unit 109 shown in FIG. 3.

[0035] The control unit 110 controls the overall functions of the communication assistance device 100. The control unit 110 includes a call connection management unit 111, a user's own call availability acquisition unit 112, a different user's call availability acquisition unit 113, a voice input / output control unit 114, an imaging control unit 115, and a performance control unit 116.

[0036] The call connection management unit 111 manages the state of the call connection between the communication terminal 200a and the communication terminal 200b. The call connection management unit 111 updates the call connection flag every time it receives call connection state information indicating the state of the call connection between the communication terminal 200a and the communication terminal 200b from the communication terminal 200a. More specifically, the call connection management unit 111 sets the call connection flag to ON when the call connection state information received from the communication terminal 200a indicates that the call is connected to the communication terminal 200b. On the other hand, the call connection management unit 111 sets the call connection flag to OFF when the call connection state information received from the communication terminal 200a indicates that the call is not connected to the communication terminal 200b.

[0037] The own user call permission acquisition unit 112 acquires own user call permission information (first call permission information) indicating whether the user URa can make a call. The own user call permission acquisition unit 112 acquires the own user call permission information based on, for example, an operation signal generated by the touch sensor 108 functioning as the operation unit 160 in response to an operation by the user URa. The own user call permission acquisition unit 112 updates the own user call permission flag stored in the storage unit 120 every time it acquires the own user call permission information.

[0038] The other user call permission acquisition unit 113 acquires other user call permission information (second call permission information) indicating whether or not the user URb can make a call. The other user call permission acquisition unit 113 acquires the other user call permission information, for example, by receiving the other user call permission information acquired by the communication terminal 200a from the communication terminal 200b via the communication unit 130. The other user call permission acquisition unit 113 updates the other user call permission flag stored in the storage unit 120 every time it acquires other user call permission information.

[0039] The audio input / output control unit 114 controls the audio input / output unit 140 based on the user call availability information and the other user call availability information. Specifically, when the user call availability information and the other user call availability information indicate that a call is possible, i.e., when both user URa and user URb are in a call available state, the audio input / output control unit 114 activates (turns on) the microphone 105 and the speaker 106, which function as the audio input / output unit 140. Furthermore, when the user call availability information and the other user call availability information indicate that a call is not possible, i.e., when both user URa and user URb are in a call unavailable state, the audio input / output control unit 114 stops (turns off) the microphone 105 and the speaker 106. Furthermore, when either the user call availability information or the other user call availability information indicates that a call is not possible, i.e., when either user URa or user URb is in a call unavailable state, the audio input / output control unit 114 stops (turns off) the microphone 105 and the speaker 106.

[0040] The imaging control unit 115 controls the imaging unit 150 based on the user call availability information and the other user call availability information. Specifically, when the user call availability information and the other user call availability information indicate that a call is possible, i.e., when both user URa and user URb are in a call availability state, the imaging control unit 115 activates (turns on) the camera 107 functioning as the imaging unit 150. Furthermore, when the user call availability information and the other user call availability information indicate that a call is not possible, i.e., when both user URa and user URb are in a call availability state, the imaging control unit 115 stops (turns off) the camera 107. Furthermore, when either the user call availability information or the other user call availability information indicates that a call is not possible, i.e., when either user URa or user URb is in a call availability state, the imaging control unit 115 stops (turns off) the camera 107.

[0041] Based on the user call availability information and the other user call availability information, the performance control unit 116 controls the performance unit 170. Specifically, when the user call availability information and the other user call availability information indicate that a call is not possible, that is, when both the user URa and the user URb are in a call unavailable state, the performance control unit 116 stops (turns off) the LED 109a and the motor 109b included in the performance unit 109 functioning as the performance unit 170.

[0042] Furthermore, when the other user call availability information indicates that a call is available, i.e., when user URb is available for a call, the performance control unit 116 activates (turns on) the LED 109a and the motor 109b. For example, the performance control unit 116 switches the LED 109a from off to blinking when user URb changes from an unavailable state to an available state for a call (when the call starts). The performance control unit 116 also shortens the vibration cycle of the motor 109b or increases the vibration intensity at the above-mentioned timing.

[0043] If the user call availability information and other user call availability information indicate that a call is possible, i.e., if both user URa and user URb are in a call available state, the performance control unit 116 lights up (turns on) LED 109a and operates (turns on) motor 109b.

[0044] If the user call availability information and the other user call availability information indicate that a call is possible, i.e., if both user URa and user URb are in a call availability state, the performance control unit 116 activates (turns on) the LED 109a and the motor 109b included in the performance unit 109 functioning as the performance unit 170. Also, if the user call availability information and the other user call availability information indicate that a call is not possible, i.e., if both user URa and user URb are in a call availability state, the imaging control unit 115 stops (turns off) the camera 107. Furthermore, if either the user call availability information or the other user call availability information indicates that a call is not possible, i.e., if either user URa or user URb is in a call availability state, the imaging control unit 115 stops (turns off) the camera 107.

[0045] The storage unit 120 stores control programs executed by the control unit 110 and various data. The communication unit 130 transmits and receives various data, including call voice data and captured image data, to and from the communication terminal 200a under the control of the control unit 110. The audio input / output unit 140 inputs and outputs voice under the control of the control unit 110. The imaging unit 150 captures images of the outside of the call assistance device 100 under the control of the control unit 110. The operation unit 160 accepts operations by the user URa and outputs an operation signal. The performance unit 170 operates the performance unit 109 under the control of the control unit 110 to represent the status of whether or not the call can be made with the user URb, who is the call partner.

[0046] Next, the operation of the call support system 1 according to the embodiment having the above configuration will be described. The flowchart shown in Fig. 6 is a flowchart relating to a call support process for supporting a call between user URa and user URb, which is an example of the operation of the call support system 1 according to the embodiment. This operation corresponds to the call support method of the call support system 1 according to the present embodiment.

[0047] The control unit 110 of the communication support device 100 starts the communication support process in response to, for example, the power of the communication support device 100 being turned on.

[0048] First, the control unit 110 determines whether the communication terminal 200a of the user (user URa) and the communication terminal 200b of the other user (user URb) are connected by a call (step S101). The call connection management unit 111 of the control unit 110 refers to the call connection flag stored in the storage unit 120 and makes the determination of this step according to the state of the call connection flag.

[0049] When it is determined that the communication terminal 200a of the user (user URa) and the communication terminal 200b of the other user (user URb) are not connected for a call (step S101: NO), the control unit 110 turns off the microphone 105, speaker 106, and camera 107 of the communication assistance device 100 (step S102). The audio input / output control unit 114 of the control unit 110 deactivates the microphone 105 and speaker 106, which function as the audio input / output unit 140. In addition, the imaging control unit 115 of the control unit 110 deactivates the camera 107, which functions as the imaging unit 150.

[0050] Furthermore, the control unit 110 turns off the LED 109a and the motor 109b of the communication support device 100 (step S103). The performance control unit 116 of the control unit 110 deactivates the LED 109a and the motor 109b included in the performance unit 109 functioning as the performance unit 170.

[0051] After executing the processes of steps S102 and S103, control unit 110 returns the process to step S101 and repeats the processes of steps S101 to S103 until it determines that communication terminal 200a and communication terminal 200b have been connected. Note that control unit 110 may omit the processes of steps S102 and S103 if there is no change in the call connection state between communication terminal 200a and communication terminal 200b, i.e., if the call unconnected state is maintained.

[0052] On the other hand, if it is determined that the communication terminal 200a of the user (user URa) and the communication terminal 200b of the other user (user URb) are connected for a call (step S101: YES), the control unit 110 determines whether the user (user URa) is available for a call (step S104). The user's call availability acquisition unit 112 of the control unit 110 references the user's call availability flag stored in the storage unit 120 and makes the determination in this step according to the state of the user's call availability flag.

[0053] If it is determined that the user (user URa) is available for communication (step S104: YES), the control unit 110 determines whether the other user (user URb) is available for communication (step S105). The other user call permission acquisition unit 113 of the control unit 110 refers to the other user call permission flag stored in the storage unit 120, and makes the determination of this step according to the state of the other user call permission flag.

[0054] If it is determined that the other user (user URb) is available for communication (step S105: YES), that is, if both the user (user URa) and the other user (user URb) are available for communication, the control unit 110 turns on the microphone 105, speaker 106, and camera 107 of the communication support device 100 (step S106).

[0055] The audio input / output control unit 114 of the control unit 110 controls the microphone 105, which functions as the audio input / output unit 140, to collect the voice of the user (user URa) and supply the voice data to the communication terminal 200a via the communication unit 130. The communication terminal 200a transmits the acquired voice data to the communication terminal 200b via the network NW. The audio input / output control unit 114 also controls the speaker 106 to convert the voice data acquired from the communication terminal 200b via the communication terminal 200a and output the voice of the other user (user URb). Furthermore, the imaging control unit 115 controls the camera 107, which functions as the imaging unit 150, to capture an image of the surroundings of the communication assistance device 100 and supply the image data to the communication terminal 200a via the communication unit 130. The communication terminal 200a transmits the acquired image data to the communication terminal 200b via the network NW.

[0056] The control unit 110 also turns on the LED 109a and the motor 109b of the communication support device 100 (step S107). The performance control unit 116 of the control unit 110 operates the LED 109a and the motor 109b included in the performance unit 109 functioning as the performance unit 170 in a preset manner.

[0057] If it is determined in step S105 that the other user (user URb) is unavailable for communication (step S105: NO), i.e., if the user (user URa) is available for communication but the other user (user URb) is unavailable for communication, the control unit 110 turns off the microphone 105, speaker 106, and camera 107 of the communication support device 100 (step S108). The control unit 110 also turns off the LED 109a and motor 109b of the communication support device 100 (step S109). The processes of steps S108 and S109 are the same as those of steps S102 and S103 described above.

[0058] In step S104, if it is determined that the user (user URa) is unable to make a call (step S104: NO), the control unit 110 turns off the microphone 105, the speaker 106, and the camera 107 of the communication assistance device 100 (step S110). The process of step S110 is the same as that of step S102 described above.

[0059] After executing the process of step S110, the control unit 110 determines whether the other user (user URb) is available for a call (step S111). The other user call availability acquisition unit 113 of the control unit 110 refers to the other user call availability flag stored in the storage unit 120, and makes the determination of this step according to the state of the other user call availability flag.

[0060] If it is determined that the other user (user URb) is available for communication (step S111: YES), that is, if the user (user URa) is unable to make a call but the other user (user URb) is available for communication, the control unit 110 turns on the LED 109a and the motor 109b of the communication support device 100 (step S112). The processing of step S112 is the same as that of step S107 described above. Note that the control unit 110 (performance control unit 116) may operate the LED 109a and the motor 109b in a manner (e.g., light color, blinking speed, vibration intensity, vibration period) different from that of step S107.

[0061] On the other hand, if it is determined that the other user (user URb) is unavailable for communication (step S111: NO), that is, if both the user (user URa) and the other user (user URb) are unavailable for communication, the control unit 110 turns off the LED 109a and the motor 109b of the communication support device 100 (step S113). The process of step S113 is the same as that of step S103 described above.

[0062] After executing any one of the processes of step S107, step S109, step S112, and step S113, the control unit 110 returns the process to step S101. The control unit 110 appropriately repeats the series of processes from step S101 to step S113 until the power of the communication assistance device 100 is turned off, for example.

[0063] The operation of the communication support device 100 described above is performed by the control unit 110 of the communication support device 100, which controls each device (microphone 105, speaker 106, camera 107, etc.) according to the combination of whether or not users URa and URb can make a call, based on the branching conditions and branching destination processing included in the flowchart shown in Fig. 6. This is the same operation as referring to the call control table shown in Fig. 4 and executing the control content of each device set for the combination of whether or not users URa and URb can make a call.

[0064] As described above, the call support device 100 included in the call support system 1 according to the embodiment acquires information indicating whether or not a call between the user URa and the user URb is possible when a call connection is established between the communication terminal 200a and the communication terminal 200b, and controls the microphone 105 and the speaker 106, which function as the audio input / output unit 140, according to the combination of whether or not the user URa and the user URb are possible to call. This allows the user URa and the user URb to intuitively (auditorily) understand the situation of the other party through audio communication, thereby enabling a smooth call.

[0065] More specifically, when user URa is available for communication and user URb is available for communication, the communication support device 100 transmits the voice of user URa acquired by the microphone 105 to communication terminal 200b via communication terminal 200a. In addition, the communication support device 100 outputs the voice of user URb from speaker 106. In this way, the communication support device 100 can switch between communicating and blocking voice when the situations regarding the call between user URa and user URb match.

[0066] Furthermore, the communication support device 100 controls the LED 109a and the motor 109b included in the performance unit 109, which represents the call availability status of the user URb, based on the other user's call availability information. This allows the user URa to intuitively (visually or physically) understand the status of the user URb, who is the call partner. Furthermore, the user URa can feel as if the communication support device 100 is a living being (an alter ego) that expresses the emotions of the user URb, thereby deepening their interest.

[0067] The present invention is not limited to the above-described embodiment, and various modifications and applications are possible without departing from the gist of the present invention.

[0068] (Modification) In the above embodiment, the communication assistance system 1 has been described as an example in which the communication terminals 200a and 200b are connected to each other so that they can communicate with each other via packet communication using an Internet line. However, the communication mode between the communication terminals 200a and 200b is not limited to this. For example, the communication terminals 200a and 200b may be connected to each other so that they can communicate with each other via a telephone line network. Furthermore, the communication terminal 200a may be connected to not only the communication terminal 200b but also other communication terminals 200a other than the communication terminal 200b at the same time.

[0069] Furthermore, for example, when multiple users carrying the communication assistance device 100 and the communication terminal 200 and a user at home using the communication terminal 200 use the communication assistance system 1, the voice of one of the users who is speaking and the captured image captured by the communication assistance device 100 carried by that user may be switched and output / displayed on the communication terminal 200 at home as needed. Switching between the voice and the captured image output / displayed on the communication terminal 200 at home may be triggered by the operation of the touch sensor 108 of each of the communication assistance devices 100 of the multiple users who are at home. This allows the user at home to share the scenery they want to show their home, as well as the voice and gestures introducing that scenery, in real time. Furthermore, the head 100a, hand 100f, foot 100g, etc. of the communication assistance device 100 may be configured to be drivable so that the communication assistance device 100 of the other user can reproduce the gestures of each user. Furthermore, the captured image captured by the communication assistance device 100 may be displayed on the display screen of the communication terminal 200.

[0070] In the above embodiment, an example was described in which user URa goes out carrying communication terminal 200a and communication assistance device 100, and user URb uses communication terminal 200b at home or the like. However, the configuration of call assistance system 1 is not limited to this example, and various configurations are possible, such as when user URa and user URb are both staying indoors at home or the like, when user URa and user URb go out together, or when user URb uses call assistance device 100 in conjunction with communication terminal 200b like user URa. Furthermore, convenience may be improved by having communication functions that communication terminal 200a and communication terminal 200b have, allowing call connections between call assistance devices 100 without going through communication terminal 200a or the like.

[0071] In the above embodiment, for example, the control program executed by the processor 101 of the communication assistance device 100 is stored in advance mainly in the storage 103. However, the present invention is not limited to this, and the control program for executing the above-described various processes may be implemented in an existing general-purpose computer, framework, workstation, or the like, to function as a device equivalent to the communication assistance device 100 according to the above embodiment.

[0072] Such a program may be provided in any manner, and for example, it may be stored on a computer-readable recording medium (flexible disk, CD (Compact Disc)-ROM, DVD (Digital Versatile Disc)-ROM) and distributed, or it may be stored in storage on a network such as the Internet and provided by downloading it.

[0073] Furthermore, when the above processing is performed by sharing the work between an OS (Operating System) and an application program, or by cooperation between the OS and the application program, only the application program may be stored on a recording medium or storage. It is also possible to superimpose the program on a carrier wave and distribute it over a network. For example, the program may be posted on a bulletin board system (BBS) on a network and distributed over the network. The program may then be launched and run under the control of the OS in the same way as other application programs, thereby enabling the above processing to be performed.

[0074] The present invention allows various embodiments and modifications without departing from the broad spirit and scope of the present invention. Furthermore, the above-described embodiments are intended to explain the present invention and do not limit the scope of the present invention. In other words, the scope of the present invention is defined by the claims, not the embodiments. Various modifications made within the scope of the claims and within the scope of the meaning of the invention equivalent thereto are considered to be within the scope of the present invention.

[0075] 1...Call support system, 100...Call support device, 100a...Head, 100b...Torso, 100c...Ear, 100d...Eyes, 100e...Muzzle, 100f...Hand, 100g...Foot, 100h...Abdomen, 101...Processor, 102...Memory, 103...Storage, 104...Communication interface, 105...Microphone, 106...Speaker, 107...Camera, 108...Touch sensor, 109...Performance unit, 109a...LED, 109b... Motor, 110...control unit, 111...call connection management unit, 112...own user call availability acquisition unit, 113...other user call availability acquisition unit, 114...audio input / output control unit, 115...imaging control unit, 116...performance control unit, 120...memory unit, 130...communication unit, 140...audio input / output unit, 150...imaging unit, 160...operation unit, 170...performance unit, 200, 200a, 200b...communication terminal, BL...bus line, NW...network, URa, URb...users.

Claims

1. A call assistance method executed by a call assistance device that has a processor, a speaker, and a microphone and that assists in a call in cooperation with the user's communication terminal when a call connection is established between the user and the communication terminal of another user who is the call partner, wherein the processor: acquires first call availability information indicating whether the user is available to make a call; acquires second call availability information indicating whether the other user is available to make a call; and controls the speaker and the microphone based on the first call availability information and the second call availability information.

2. The call assistance method of claim 1, wherein, when the user is able to make a call and the other user is also able to make a call, the processor transmits the user's voice captured by the microphone to the other user's communication terminal via the user's communication terminal.

3. The communication assistance method according to claim 1 or 2, wherein the processor outputs the voice of the other user from the speaker when the user is available to make a call and the other user is also available to make a call.

4. A call assistance method as described in any one of claims 1 to 3, wherein the processor controls a presentation unit further provided in the call assistance device that represents the call availability status of the other user based on the second call availability information.

5. A call support device that supports a call in cooperation with a user's communication terminal when a call connection is established between the user and the communication terminal of another user who is the call partner, the call support device comprising a processor, a speaker, and a microphone, wherein the processor: acquires first call availability information indicating whether the user is available for a call; acquires second call availability information indicating whether the other user is available for a call; and controls the speaker and the microphone based on the first call availability information and the second call availability information.

Images