Communication device, communication method, and program

The communication device facilitates easy selection of the next communication partner by displaying main and sub-image data with privacy controls, addressing the challenge of situational awareness in multi-base communication.

WO2026063325A1PCT designated stage Publication Date: 2026-03-26TONARI CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2025-09-10
Publication Date
2026-03-26

AI Technical Summary

Technical Problem

Users of communication devices struggle to specify another base for communication due to lack of situational awareness of other bases during communication.

Method used

A communication device that transmits and receives image data with multiple bases, displaying main and sub-image data to facilitate easy selection of the next communication partner, with features like image blurring and audio volume control to maintain privacy and reduce distractions.

Benefits of technology

Enhances user ability to seamlessly switch communication to another base by providing clear situational awareness and privacy controls, ensuring smooth transitions and mental preparation for video calls.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2025032071_26032026_PF_FP_ABST
    Figure JP2025032071_26032026_PF_FP_ABST
Patent Text Reader

Abstract

A communication device 100 that transmits and receives image data to and from a plurality of other communication devices installed at a plurality of bases includes a communication processing portion 134 that transmits and receives image data to and from a main communication device and one or more sub-communication devices among the plurality of other communication devices, a display processing portion 135 that causes a display portion to display main image data, which are image data received by the communication processing portion 134 from the main communication device, and an operation accepting portion 131 that accepts an operation for designating the next main communication device from among the one or more sub-communication devices while the main image data are being displayed by the display portion, wherein, when the operation accepting portion 131 accepts a designation start operation for starting designation of the next main communication device, the display processing portion 135 causes the display portion to display sub-image data, which are the image data received from the sub-communication devices, together with an image based on the main image data.
Need to check novelty before this filing date? Find Prior Art

Description

Communication device, communication method, and program

[0001] The present invention relates to a communication device, a communication method, and a program.

[0002] There is known a technique in which a communication device at a first base transmits a captured image of the first base captured by a camera to a communication device at a second base, and the communication device at the first base receives and displays on a display a captured image transmitted from the communication device at the second base (for example, Patent Document 1).

[0003] Japanese Unexamined Patent Application Publication No. 2023-123745

[0004] In the technique described in Patent Document 1, while a user of the communication device at the first base is communicating with a user of the communication device at the second base, the user of the communication device at the first base cannot know the situation of other bases. Therefore, there is a problem that it is difficult for the user of the communication device at the first base to specify another base to start communication next.

[0005] Therefore, the present invention has been made in view of these points, and an object thereof is to make it easy for a user of a communication device to specify another base to start communication next.

[0006] A communication device according to a first aspect of the present invention is a communication device that transmits and receives image data to and from a plurality of other communication devices installed at a plurality of bases, and includes a communication processing unit that transmits and receives the image data to and from a main communication device and one or more sub-communication devices among the plurality of other communication devices, a display processing unit that causes the display unit to display main image data that is the image data received by the communication processing unit from the main communication device, and an operation reception unit that receives an operation for designating a next main communication device from among the one or more sub-communication devices while the main image data is being displayed by the display unit. When the operation reception unit receives a designation start operation for starting the designation of the next main communication device, the display processing unit causes the display unit to display sub-image data that is the image data received from the sub-communication device together with an image based on the main image data.

[0007] When the operation reception unit receives the designation start operation, the display processing unit may display on the display unit sub-image data that is less clear than the main image data.

[0008] The communication processing unit may receive sub-image data from one or more sub-communication devices that is less clear than the main image data, and the display processing unit may display the sub-image data together with reference image data that has been processed to make the main image data less clear on the display unit.

[0009] The communication device may further include an output unit that outputs the main audio transmitted from the main communication device while the main image data is displayed on the display unit, and outputs the secondary audio transmitted from the secondary communication device while the secondary image data is displayed on the display unit together with the main image data, in a state that is less audible than the main audio.

[0010] The communication processing unit may transmit the main image data of first quality to the main communication device and receive the main image data of first quality from the main communication device, transmit the sub-image data of second quality which is lower than the first quality to the sub-communication device and receive the sub-image data of second quality which is lower from the sub-communication device.

[0011] The communication device further comprises an acquisition unit that acquires environmental information including at least one of an image captured of the area around the communication device and sound around the communication device, and a determination unit that determines whether or not there are people around the communication device based on the environmental information. The communication processing unit may, while transmitting the main image data, continue transmitting the main image data to the main communication device without transmitting the main image data to the sub-communication device if the determination unit determines that there are people around the communication device and the sub-communication device requests the transmission of the main image data, and may stop transmitting the main image data to the main communication device and start transmitting the main image data to the sub-communication device if the determination unit determines that there are no people around the communication device and the sub-communication device requests the transmission of the main image data.

[0012] The communication device includes an acquisition unit that acquires environmental information including at least one of an image captured of the area around the communication device and sound around the communication device, and a determination unit that determines whether or not there is a person around the communication device based on the environmental information, and the communication processing unit may transmit the determination result of the determination unit to one or more sub-communication devices.

[0013] The determination unit may determine whether or not there are people around the communication device by recognizing the faces of people captured in the captured images included in the environmental information.

[0014] The communication processing unit may receive information from one or more of the sub-communication devices indicating whether or not there are people around each of the sub-communication devices, and if it receives information from any of the sub-communication devices indicating that there are no people around that sub-communication device, it may prioritize that sub-communication device as the next main communication device.

[0015] The communication device further includes a storage unit that stores the business hours associated with each of the plurality of other communication devices and the business hours during which the base where the other communication devices are installed performs its business. The communication processing unit may refer to the storage unit and start sending and receiving the sub-image data with the sub-communication device installed at the base when it enters the business hours.

[0016] The display processing unit displays the sub-image data received by the communication processing unit from the sub-communication device installed at the base that is within business hours at the time the operation reception unit receives the designated start operation, together with the image based on the main image data, on the display unit. However, it does not have to display the sub-image data received from the sub-communication device installed at the base that is outside business hours at the time the operation reception unit receives the designated start operation.

[0017] If the reception of the main image data from the main communication device is interrupted because the transmission and reception of the main image data between the main communication device and the other communication device has started, the communication processing unit may designate the other communication device that was transmitting and receiving the main image data with the other communication device until the transmission and reception of the main image data between the main communication device and the other communication device started as the next main communication device.

[0018] The communication processing unit may, if the reception of the main image data from the main communication device is interrupted and the communication processing unit receives information from the main communication device specifying the next destination for the main image data, designate the other communication device specified as the next main communication device. The communication device further includes a storage unit that stores in association with each of the plurality of other communication devices and a time period for sending and receiving main image data between the other communication devices, and the communication processing unit may, by referring to the storage unit, designate the other communication device stored in association with the time period including the current time as the main communication device.

[0019] The communication device further includes a storage unit that stores each of the plurality of other communication devices in association with the business hours during which the base where the other communication devices are installed performs its business. The communication processing unit may refer to the storage unit and prioritize the other communication devices stored in association with the business hours during which the overlap with the business hours of the base where the communication device is installed is shorter, designating them as the primary communication device.

[0020] A second aspect of the present invention is a communication method performed by a computer for sending and receiving image data with a plurality of other communication devices installed at a plurality of locations, comprising the steps of: sending and receiving the image data with a main communication device and one or more sub-communication devices among the plurality of other communication devices; displaying the main image data, which is the image data received from the main communication device, on a display unit; and while the main image data is being displayed on the display unit, receiving an operation to specify the next main communication device from among the one or more sub-communication devices, wherein in the step of displaying the main image data on the display unit, when a specification start operation to start specifying the next main communication device is received, the sub-image data, which is the image data received from the sub-communication device together with the main image data, is displayed on the display unit together with an image based on the main image data.

[0021] A third aspect of the present invention is a program that causes a computer to perform the following steps: sending and receiving image data between a main communication device and one or more sub-communication devices among a plurality of other communication devices installed at a plurality of locations; displaying the main image data, which is the image data received from the main communication device, on a display unit; and accepting an operation to specify the next main communication device from among the one or more sub-communication devices while the main image data is being displayed on the display unit, wherein in the step of displaying the main image data on the display unit, when a specification start operation to start specifying the next main communication device is accepted, the sub-image data, which is the image data received from the sub-communication devices, is displayed on the display unit together with the main image data and an image based on the main image data.

[0022] According to the present invention, the effect is to make it easier for the user of the communication device to specify the next location from which to initiate communication.

[0023] This is a diagram showing an overview of the communication device of this embodiment. This is a diagram showing an overview of the communication device of this embodiment. This is a diagram showing an overview of the communication device of this embodiment. This is a diagram showing an overview of the communication device of this embodiment. This shows a more detailed configuration of the communication device. This shows an example of main communication schedule data. This shows an example of business time data. This is a diagram showing how the operation reception unit accepts a specified operation. This is a diagram showing how the operation reception unit accepts a specified operation. This shows an example of a screen for the user to set whether or not to allow the transmission and reception of main image data. This is a diagram showing an example of how the communication device determines the destination of the main image data. This is a diagram showing an example of how the communication device determines the destination of the main image data. This is a flowchart showing the processing procedure for changing the destination of image data transmission and reception by the communication device.

[0024] [Overview of Communication System S] Figures 1, 2, 3, and 4 are diagrams illustrating the overview of the communication device 100 of this embodiment. Figure 1 shows the configuration of the communication device 100. The communication device 100 is installed, for example, at a company or public institution's base. The communication device 100 comprises a main unit 1, a first display unit 2, a screen 3, a second display unit 4, an imaging unit 5, one or more speakers 6, and one or more microphones 7.

[0025] The first display unit 2 is, for example, a projector provided on the main unit 1. The first display unit 2 projects images of other locations where other communication devices 200 to 400, shown in Figure 2, are installed, onto the screen 3, which are connected to the communication device 100 via a network.

[0026] The second display unit 4 is a display for showing screens for performing various operations related to the communication device 100. The communication device 100 does not necessarily have the second display unit 4, and the first display unit 2 may also perform the role of the second display unit 4. The first display unit 2 may instead display the image displayed by the second display unit 4 in a part of the display area of ​​the screen 3. The imaging unit 5 is, for example, a small camera. The imaging unit 5 images the area around the communication device 100 through a hole formed in the screen 3. The imaging unit 5 may be installed in the main unit 1 or in any other location. The speaker 6 outputs sound picked up at other locations where other communication devices 200 to 400 are installed. The microphone 7 picks up sound around the communication device 100. As shown by the dashed line in Figure 1, the microphone 7 is built into the back of the screen 3. The microphone 7 may also be installed in any location, for example, on the ceiling of the room where the communication device 100 is installed.

[0027] The main unit 1 includes a CPU (Central processing unit), a DSP (Digital signal processor), and memory, etc. The main unit 1 generates main image data or sub-image data captured by the imaging unit 5 in front of the screen 3. The main image data and sub-image data are image data showing the location where the communication device 100 is installed. The sub-image data is image data obtained by blurring the main image data, and the image quality of the sub-image data is lower than that of the main image data.

[0028] The main unit 1 acquires sound from the surrounding area of ​​the communication device 100 using the microphone 7 and generates main audio data based on the acquired sound. The main unit 1 may also generate secondary audio data corresponding to a secondary audio that is less clear than the main audio, based on the main audio data.

[0029] Figure 2 shows an example of a communication system S including the communication device 100 shown in Figure 1. The communication system S comprises the communication device 100 and a plurality of other communication devices 200 to 400 other than the communication device 100. In the example in Figure 2, the communication system S comprises three other communication devices 200 to 400, but it may also comprise one or two other communication devices, or four or more other communication devices. The configuration of the other communication devices 200 to 400 is the same as that of the communication device 100, so a description is omitted.

[0030] Communication device 100 communicates with multiple other communication devices 200-400 in a peer-to-peer manner via a mesh network. The other communication devices 200-400 are installed at multiple locations of a company or public organization, etc. Communication device 100 sends and receives main image data or sub-image data to and from the multiple other communication devices 200-400.

[0031] The main unit 1 of the communication device 100 transmits and receives main image data and main voice data with one of the main communication devices among the multiple other communication devices 200 to 400. Here, it is assumed that the other communication device 200 is the main communication device. The main unit 1 of the communication device 100 transmits and receives sub-image data and sub-voice data with a sub-communication device, which is a communication device other than the main communication device among the multiple other communication devices 200 to 400.

[0032] The main unit 1 displays the received main image data on the screen 3 (see Figure 1) using the first display unit 2. The main unit 1 outputs the received main audio data through multiple speakers 6. When the operation to start designating another communication device as the next main communication device is performed, the main unit 1 displays the sub-image data received from the other communication device on the screen 3 using the first display unit 2. The main unit 1 may also output the sub-audio data received from the other communication device through the speakers 6 when the operation to start designating another communication device as the next main communication device is performed. In this case, the sub-audio data received from the first other communication device may be output from the first speaker 6, and the sub-audio data received from the second other communication device may be output from the second speaker 6 to make it easier to distinguish the audio for each location.

[0033] In this way, the main unit 1 transmits and receives main image data and main audio data to and from the main communication device 200. As a result, users of the communication device 100 can make video calls with users of the main communication device 200. At this time, the first display unit 2 can display users of the main communication device 200 at the same size as the user themselves, so users of the communication device 100 can make video calls as if they were in the same space as users of the main communication device 200. In addition, since the main unit 1 transmits and receives main image data and main audio data to and from the main communication device 200 in a peer-to-peer manner, the transmission delay time is smaller compared to when main image data and main audio data are transmitted and received via other devices. Therefore, users can make video calls as if users at other locations were in the same place.

[0034] As shown in Figure 2, the communication device 100 transmits and receives main image data and main voice data with the other communication device 200, which functions as the main communication device, while simultaneously transmitting and receiving sub-image data with the other communication devices 300 and 400, which function as sub-communication devices. As will be described in detail later, even while the communication device 100 is transmitting and receiving main image data and main voice data with the other communication device 200, it transmits and receives sub-image data with the other communication devices 300 and 400. This allows the user of the communication device 100 to easily specify the next location to start a video call by understanding the status of the locations where the other communication devices 300 and 400 are installed based on the sub-image data when the user of the communication device 100 wants to switch to another location to make a video call.

[0035] The following describes the processing flow for sending and receiving image data by the communication system S. Figure 3 is a sequence diagram showing the processing procedure when the destination for sending and receiving main image data by the communication device 100 is changed. The processing procedure in Figure 3 is started, for example, while the communication device 100 is communicating with another communication device 200 via peer-to-peer communication with the other communication device 200 as the main communication device. First, the main unit 1 of the communication device 100 sends and receives main image data with the other communication device 200, which is the main communication device. The main unit 1 then sends and receives sub-image data with the other communication device 300, which is the sub-communication device.

[0036] While the main image data is being displayed on the first display unit 2, the main unit 1 receives a designation operation in which the user designates another communication device 300 as the next main communication device (S101). When the main unit 1 receives a designation operation in which the user designates another communication device 300 as the next main communication device, it sends a designation notification to the other communication device 300 indicating that it is designated as the next main communication device. After sending the designation notification, the main unit 1 starts transmitting and receiving the main image data with the other communication device 300. The main unit 1 starts transmitting and receiving the sub-image data with the other communication device 200.

[0037] Figure 4 shows an example of a preview screen displayed on the first display unit 2 when an operation to specify the next main communication device is received. The preview screen is for the user to specify the next main communication device from among multiple other communication devices 200 to 400. The preview screen shown in Figure 4 displays sub-image data A1, reference image data A2, and sub-image data A3. Reference image data A2 is the main image data received from the main communication device 200 that has been processed by the main unit 1 to make it blurry. For example, blurring can be used to make the main image data blurry.

[0038] Sub-image data A1 is image data received from sub-communication device 300. Sub-image data A3 is image data received from sub-communication device 400. Since both the reference image data and the sub-image data are unclear, the user of communication device 100 can determine whether or not there is a person in front of the other communication devices 200-400, but cannot determine who is in front of the other communication devices 200-400. In this way, the main unit 1 can prevent the user of communication device 100 from unilaterally peeking at the surroundings of the other communication devices 200-400.

[0039] Furthermore, the degree to which the reference image data and secondary image data are blurred is not limited to a degree where it is possible to determine whether or not there are people, but it is not possible to determine who they are. For example, the degree to which the reference image data and secondary image data are blurred may be such that individuals can be identified, or the movement of people may be vaguely discernible, but the number of people may not be determined. The degree to which the reference image data and secondary image data are blurred can be adjusted, for example, by the degree of blurring applied.

[0040] The main unit 1 accepts the user's operation to select one of the image data from sub-image data A1, reference image data A2, and sub-image data A3 on this preview screen. The main unit 1 determines the other communication device that is the source of the image data selected by the user as the next main communication device. The main unit 1 sends a designation notification to this other communication device indicating that it has been designated as the next main communication device.

[0041] In this way, communication device 100 makes it easier for users to understand the situation at the locations where other communication devices 200-400 are installed before starting to send and receive main image data with users of other communication devices 200-400. Therefore, communication device 100 makes it easier for users to specify the other communication device at another location to start sending and receiving main image data next. In addition, users of communication device 100 can check the secondary image data from the time they specify the main communication device. Therefore, the flow from actually confirming the switch of the main communication device to when the user of communication device 100 starts a conversation with the user of the other communication device becomes seamless. When the user of communication device 100 starts a meeting with the user of the next main communication device, they can see in advance on the preview screen whether there is a person there, so they can prepare themselves mentally for initial greetings, etc.

[0042] [Detailed Configuration of Communication Device 100] Figure 5 shows the detailed configuration of the communication device 100. The communication device 100 comprises a main unit 1, an imaging unit 5, a microphone 7, a speaker 6, an operation unit 8, and a second display unit 4. The main unit 1 comprises a communication unit 11, a first display unit 2, a storage unit 12, and a control unit 13.

[0043] The microphone 7 converts the sound around the communication device 100 into an electrical signal. The communication device 100 includes, for example, a plurality of microphones 7. The microphone 7 is connected to the main body unit 1 by, for example, wireless communication. The microphone 7 may be connected to the main body unit 1 by a cable. The microphone 7 inputs information indicating the converted electrical signal to the communication processing unit 134. The operation unit 8 is a dial, keys, or a touch panel provided on the main body unit 1.

[0044] The communication unit 11 is an interface for communicating with a plurality of other communication devices 200 to 400 by peer-to-peer communication via a network. The communication unit 11 inputs the information received from the other communication devices 200 to 400 to the communication processing unit 134. The communication unit 11 transmits the information output by the communication processing unit 134 to the other communication devices 200 to 400.

[0045] The storage unit 12 is a storage medium including a ROM (Read Only Memory) and a RAM (Random Access Memory) and the like. The storage unit 12 stores the programs executed by the control unit 13. In order for the communication device 100 to be able to transmit and receive image data and audio data to and from the other communication devices 200 to 400 in a peer-to-peer manner, the IP addresses of a plurality of other communication devices 200 to 400 are stored in the storage unit 12.

[0046] The storage unit 12 may store main communication schedule data in which each of a plurality of other communication devices is associated with a time zone for transmitting and receiving main image data to and from the other communication device. FIG. 6 shows an example of the main communication schedule data. In the first example from the top in FIG. 6, the base ID "A001", the base name "WW London Office" where the other communication device is installed, and the time zone "9:00 to 10:00" for transmitting and receiving the main image data are associated. In this main communication schedule data, the identification ID of the other communication device may be stored instead of the base ID. The main communication schedule data is referred to by the communication processing unit 134 to determine the transmission and reception destination of the main image data.

[0047] The storage unit 12 may store operation time data in which each of a plurality of other communication devices 200 to 400 is associated with the operation time during which the base where the other communication device is installed conducts operations. The operation is, for example, an activity for obtaining remuneration, but may also be a non-profit activity. FIG. 7 shows an example of the operation time data. In the uppermost example in FIG. 7, the base ID "A001", the base name "WW London Office" where the other communication device is installed, and the operation time "1:00 to 10:00" are associated. In this operation time data, the identification ID of the other communication device may be stored instead of the base ID. The operation time data is referred to by the communication processing unit 134 to determine the transmission / reception destination of the main image data.

[0048] The storage unit 12 stores main communication history data in which the base ID of the base where the main communication device that transmitted / received the main image data is installed is associated with the date and time when the main image data was transmitted / received in the past. In this main communication history data, the identification ID of the other communication device may be stored instead of the base ID. This main communication history data is referred to by the communication processing unit 134 to determine the transmission / reception destination of the main image data.

[0049] The control unit 13 includes, for example, a CPU and a DSP. The control unit 13 functions as an operation reception unit 131, an acquisition unit 132, a determination unit 133, a communication processing unit 134, a display processing unit 135, and an output unit 136 by executing a program stored in the storage unit 12.

[0050] The operation reception unit 131 receives a user's operation via the operation unit 8. For example, the operation reception unit 131 receives a designation operation for designating the next main communication device from one or more sub-communication devices while the main image data is being displayed by the first display unit 2.

[0051] Before accepting this designation operation, the operation reception unit 131 accepts a designation start operation to initiate the designation of the next main communication device. This designation start operation causes the first display unit 2 to display a preview screen for the user to designate the next main communication device from among multiple other communication devices 200 to 400. The operation reception unit 131 inputs information indicating the accepted designation start operation to the display processing unit 135. The operation reception unit 131 inputs information indicating the accepted designation operation to the communication processing unit 134.

[0052] Figures 8 and 9 show how the operation reception unit 131 receives a specified operation. Figure 8 shows a screen for the user to configure various settings of the communication device 100. This screen is displayed on the second display unit 4, for example, while the main image data is being displayed on the first display unit 2. In the example in Figure 8, a cursor (a rectangular solid line) is placed on the display area A4 for the item "Location". When "Location" is selected, the screen shown in Figure 9 is displayed.

[0053] Figure 9 shows an example of a screen for a user to specify the next primary communication device. When the operation reception unit 131 receives a user's operation to specify the "Location" item in Figure 8, the screen in Figure 9 is displayed by the second display unit 4. In the example in Figure 9, the names of the locations where multiple other communication devices are installed are shown. In the example in Figure 9, a cursor (a rectangular solid line) is placed on display area A5, which corresponds to the first location from the top, "XX Tokyo Lab". The operation reception unit 131 receives a user's operation to specify a communication device installed at one of the locations "XX Tokyo Lab", "YY Kanagawa Office", or "ZZ Berlin Studio" as the next primary communication device in Figure 9.

[0054] The circle (〇) at the left edge of display area A5 for the location "XX Tokyo Lab" indicates that the location is in an open state, allowing the other communication device to transmit and receive the main image data when a designated notification is sent to that device. The triangle (△) at the left edge of the display area for the second location from the top, "YY Kanagawa Office," indicates that the communication device installed at "YY Kanagawa Office" is in a busy state, not allowing a change in the destination for transmitting and receiving the main image data. A busy state means that there are people around the communication device, or that human voices are being acquired around the communication device.

[0055] The "X" mark (×) at the left edge of the display area for the third location from the top, "ZZ Berlin Studio," indicates that the communication equipment installed at "ZZ Berlin Studio" is in a sleep state with reduced power consumption. Other communication equipment also enters a sleep state, for example, when the location where it is installed is outside of business hours. In sleep mode, other communication equipment does not allow the transmission or reception of main image data.

[0056] Figure 10 shows an example of a screen for users to pre-set whether or not to allow changes to the destination of sending and receiving main image data. In the example in Figure 10, the display area for the "Status Change" item, which allows the user to set whether or not to allow changes to the destination of sending and receiving main image data with other communication devices 200 to 400 in the communication device 100, is selected. In this example, the cursor is positioned on display area A5, which corresponds to the "Open" state, which allows changes to the destination of sending and receiving main image data. In the example in Figure 10, the operation reception unit 131 receives user operations to set either the "Open" state, "Confirm Once", or "Call Disallowed".

[0057] The "Confirm Once" option indicates a state where the communication device 100 requires user confirmation before changing the destination for sending and receiving the main image data. The "Call Denied" option indicates a state where changing the destination for sending and receiving the main image data is not permitted.

[0058] The acquisition unit 132 acquires environmental information that includes at least one of either an image captured of the area around the communication device 100 or sound from the area around the communication device 100. The acquisition unit 132 acquires the image captured in this environmental information from the imaging unit 5. The acquisition unit 132 acquires the sound included in this environmental information from the microphone 7. The acquisition unit 132 outputs the acquired environmental information to the determination unit 133.

[0059] As described above, the main communication device 200, which is the destination for sending and receiving the main image data, is switched to another communication device 300 or 400 based on the specified operation received by the operation reception unit 131. Similarly, if the communication device 100 receives a notification from one of the other communication devices among the sub-communication devices 300 or 400 designating the communication device 100 as the destination for sending and receiving the main image data, the transmission and reception of the main image data between the communication device 100 and the sub-communication device 300 or 400 will begin, and the transmission and reception of the main image data between the communication device 100 and the main communication device 200 will be interrupted.

[0060] However, when a video call is taking place between the user of communication device 100 and the user of main communication device 200, it is undesirable to interrupt the transmission and reception of main image data between communication device 100 and main communication device 200. However, if there are no people around communication device 100, the possibility of a video call taking place between the user of communication device 100 and the user of main communication device 200 is low, so it is possible to interrupt the transmission and reception of main image data between communication device 100 and main communication device 200. Therefore, the determination unit 133 determines whether or not there are people around communication device 100 based on the environmental information acquired by the acquisition unit 132.

[0061] For example, the determination unit 133 analyzes the captured image included in the environmental information to recognize a person's face in the captured image. If the determination unit 133 is able to recognize a person's face in the captured image, it determines that there is a person around the communication device 100. If the determination unit 133 is unable to recognize a person's face in the captured image, it determines that there is no person around the communication device 100.

[0062] The determination unit 133 may determine whether the volume of sound included in the environmental information is above a predetermined threshold. The threshold is the minimum value assumed to be the volume of sound when there is a person emitting sound around the communication device 100. The determination unit 133 determines that there is a person around the first display unit 2 if the volume of sound included in the environmental information is above the threshold. The determination unit 133 determines that there is no person around the first display unit 2 if the volume of sound included in the environmental information is below the threshold. The determination unit 133 outputs information indicating the determination result to the communication processing unit 134.

[0063] The communication processing unit 134 communicates with multiple other communication devices 200 to 400 via the communication unit 11. The communication processing unit 134 sends and receives various data with the multiple other communication devices 200 to 400, along with the IP addresses of each of them. For example, when the operation reception unit 131 receives an operation from a user to designate one of the multiple other communication devices 200 to 400 as the next main communication device, the communication processing unit 134 sends a designation notification to that other communication device indicating that it has been designated as the main communication device. For example, when the operation reception unit 131 receives an operation from a user to designate the location "XX Tokyo Lab" where the cursor is placed in Figure 9, the communication processing unit 134 sends a designation notification to the other communication device corresponding to the location "XX Tokyo Lab" indicating that it has been designated as the main communication device.

[0064] The communication processing unit 134 transmits and receives image data between the main communication device and one or more sub-communication devices among a plurality of other communication devices 200 to 400. The communication processing unit 134 transmits main image data of first quality to the main communication device and receives main image data of first quality from the main communication device. The communication processing unit 134 transmits sub-image data of second quality to the sub-communication devices and receives sub-image data of second quality from the sub-communication devices. The second quality is of lower quality than the first quality. The sub-image data may have lower quality due to lower resolution or higher compression intensity than the main image data, or it may have lower quality due to processing that blurs image data of the same quality as the main image data. An example of processing that blurs image data is blurring.

[0065] The communication processing unit 134 receives main audio data from the main communication device 200 indicating the main audio around the main communication device 200. Meanwhile, the communication processing unit 134 transmits main audio data indicating the main audio around the communication device 100 to the main communication device 200. The communication processing unit 134 receives secondary audio data indicating the secondary audio around the secondary communication device 300 or 400 from the secondary communication device 300 or 400, respectively. The secondary audio is audio that is harder to hear than the main audio. For example, the secondary audio is audio that is harder to hear than the main audio because its volume is lower than the main audio. The secondary audio may be in a muffled and hard-to-hear state than the main audio due to various processing to narrow the frequency bandwidth compared to the main audio. The communication processing unit 134 transmits secondary audio data indicating the secondary audio around the communication device 100 to the secondary communication device 300 or 400.

[0066] The communication processing unit 134 prefers not to interrupt the transmission and reception of main image data with the main communication device 200 when the user of the communication device 100 is having a video conversation with the user of the main communication device 200. Therefore, when the user of the communication device 100 is having a video conversation with the user of the main communication device 200, the communication processing unit 134 operates in a busy state, not allowing changes to the destination of the main image data. On the other hand, when the user of the communication device 100 is not having a video conversation with the user of the main communication device 200, the communication processing unit 134 operates in an open state, allowing changes to the destination of the main image data.

[0067] In the examples of this specification, the communication processing unit 134 estimates that the user of the communication device 100 is having a video conversation with the user of the main communication device 200 when there are people around the communication device 100. Therefore, when the determination unit 133 determines that there are people around the communication device 100 while the main image data is being transmitted, and the sub-communication device 300 requests the transmission of the main image data, the communication processing unit 134 operates in a busy state that does not allow a change in the destination of the main image data, and continues to transmit the main image data to the main communication device 200 without transmitting the main image data to the sub-communication device 300.

[0068] On the other hand, the communication processing unit 134 estimates that the user of the communication device 100 is not having a video conversation with the user of the main communication device 200 if there are no people around the communication device 100. Therefore, when the determination unit 133 determines that there are no people around the communication device 100 while the main image data is being transmitted, and the sub-communication device 300 requests the transmission of the main image data, the communication processing unit 134 operates in an open state that allows a change in the destination of the main image data, stops transmitting the main image data to the main communication device 200, and starts transmitting the main image data to the sub-communication device 300. In this way, the communication processing unit 134 can prevent interruption of transmission and reception of main image data when the user of the communication device 100 is having a video conversation with the user of the main communication device 200.

[0069] The communication processing unit 134 transmits the determination result of the determination unit 133 to one or more sub-communication devices 300 or 400. If the determination unit 133 determines that there are people around the communication device 100 while the main image data is being transmitted, the communication processing unit 134 notifies the sub-communication devices 300 and 400 that it will operate in a busy state, which does not allow changes to the destination of the main image data. On the other hand, if the determination unit 133 determines that there are no people around the communication device 100 while the main image data is being transmitted, the communication processing unit 134 notifies the sub-communication devices 300 and 400 that it will operate in an open state, which allows changes to the destination of the main image data. In this way, the communication processing unit 134 can enable users of the sub-communication devices 300 or 400 to know whether or not it is possible to change the destination of the main image data transmitted by the communication device 100.

[0070] [Determination of the next main communication device based on priority] The communication processing unit 134 may determine the destination of the main image data based on a predetermined priority. More specifically, the communication processing unit 134 receives environmental information from one or more sub-communication devices 300 or 400 indicating whether or not there are people around each of them. If the environmental information received from any of the sub-communication devices 300 or 400 indicates that there are people around that sub-communication device, the communication processing unit 134 may prioritize designating that sub-communication device as the next main communication device.

[0071] For example, if the user has not separately specified the next main communication device, the communication processing unit 134 starts sending and receiving main image data with the sub-communication device that indicates there are people nearby. When the user lists multiple other communication devices as candidates for specifying the next main communication device on the preview screen displayed by the first display unit 2, the communication processing unit 134 may make it easier to specify the sub-communication device by placing the sub-communication device that is the source of environmental information indicating there are people nearby as the first option from the top.

[0072] The communication processing unit 134 may prioritize another communication device that functioned as the primary communication device before the current primary communication device as the next primary communication device. For example, the communication processing unit 134 reads primary communication history data from the storage unit 12 by associating the site ID of the site where the primary communication device that sent and received primary image data is installed with the date and time when the primary image data was sent and received. The communication processing unit 134 refers to the read primary communication history data to identify another communication device that functioned as the primary communication device before the current primary communication device. The communication processing unit 134 makes it easier to prioritize the identified other communication device as the next primary communication device.

[0073] The communication processing unit 134 may prioritize designating other communication devices installed at locations that are within business hours at the time the operation reception unit 131 receives the designated start operation as the primary communication device. For example, the communication processing unit 134 reads business time data from the storage unit 12 that associates each of the multiple other communication devices 200 to 400 with the business hours during which the locations where the other communication devices are installed perform their business. The communication processing unit 134 may refer to the read business time data to prioritize designating other communication devices that are within business hours at the time the operation reception unit 131 receives the designated start operation as the next primary communication device.

[0074] The communication processing unit 134 may refer to the business time data (see Figure 7) stored in the storage unit 12 to identify other communication devices stored in association with business hours that have less overlap with the business hours of the location where the communication device 100 is installed, and may prioritize the identified other communication devices as the next primary communication device. If the business hours of the location where the communication device 100 is installed are 9:00 to 18:00, the overlap time between the business hours of the location where the communication device 100 is installed and the business hours of the location "WW London Office" with location ID "A001" (the first location from the top in Figure 7) is 1 hour.

[0075] On the other hand, the overlap time between the business hours of the location where the communication device 100 is installed and the business hours of the location "XX Tokyo Lab" with location ID "A002" (second from the top in Figure 7), which is "9:00 to 18:00", is 9 hours. The overlap time between the business hours of the location where the communication device 100 is installed and the business hours of the location "YY Kanagawa Office" with location ID "A003" (third from the top in Figure 7), which is "8:30 to 17:30", is 8 hours and 30 minutes. The overlap time between the business hours of the location where the communication device 100 is installed and the business hours of the location "ZZ Berlin Studio" with location ID "A004" (fourth from the top in Figure 7), which is "2:00 to 11:00", is 2 hours.

[0076] In this way, the communication processing unit 134 identifies the time when the business hours of the location where the communication device 100 is installed overlap with the business hours of the locations where the other communication devices 200 to 400 are installed. The communication processing unit 134 makes it easier to designate the other communication device installed at location ID "A001", which has the shortest overlap of identified business hours, as the next primary communication device, with priority over the other communication devices installed at locations "A002", "A003", and "A004".

[0077] [Determination of destination for sending and receiving secondary image data based on business hours] Even if another communication device at a location outside of business hours is designated as the primary communication device, it is not possible to make video calls with people at that location. Therefore, the communication processing unit 134 may refer to the business hours data stored in the storage unit 12 and refrain from sending and receiving primary image data, primary audio data, secondary image data, and secondary audio data to or from other communication devices installed at locations that are outside of business hours at the time the operation reception unit 131 receives the designated start operation.

[0078] In this case, the communication processing unit 134 may start sending and receiving sub-image data with the sub-communication device installed at the location that has entered business hours. The communication processing unit 134 may start sending and receiving sub-image data with the sub-communication device installed at the location that has entered business hours as soon as the operation reception unit 131 receives the specified start operation. On the other hand, the communication processing unit 134 does not have to start sending and receiving sub-image data with the sub-communication device installed at the location that is outside business hours at the time the operation reception unit 131 receives the specified start operation. This prevents unnecessary image data from being sent and received with locations where video calls are not possible.

[0079] In the example in Figure 7, if the operation reception unit 131 receives the specified start operation at 12:00, then the location with the first location ID "A001" from the top in Figure 7, "WW London Office," is outside of business hours at that time. Therefore, the communication processing unit 134 does not send or receive sub-image data between itself and the communication device installed at location ID "A001." In the example in Figure 7, at the time the operation reception unit 131 receives the specified start operation (12:00), the location with the second location ID "A002" from the top in Figure 7, "XX Tokyo Lab," is within business hours. Therefore, the communication processing unit 134 sends and receives sub-image data between itself and the communication device installed at location ID "A002."

[0080] [Determination of the next main communication device based on the schedule] The communication processing unit 134 may change the destination of the main image data based on the instructed schedule. For example, the communication processing unit 134 reads from the storage unit 12 main communication schedule data (see Figure 6) which associates each of the multiple other communication devices with the time period for sending and receiving main image data between the other communication devices. The communication processing unit 134 may refer to the main communication schedule data read from the storage unit 12 and designate the other communication device stored in association with the time period including the current time as the main communication device.

[0081] In the example shown in Figure 6, when the current time is 9:30, the communication processing unit 134 starts transmitting and receiving main image data, using the other communication device located at the "WW London Office" location with location ID "A001," which is associated with the time period including the current time (9:30) in the main communication schedule data, as the next main communication device. When the current time is 10:30, the communication processing unit 134 starts transmitting and receiving main image data, using the other communication device located at the "ZZ Berlin Studio" location with location ID "A004," which is associated with the time period including the current time (10:30) in the main communication schedule data, as the next main communication device.

[0082] [Determination of the next main communication device based on interruption of reception of main image data from the main communication device] The communication device 100 displays the main image data received from the main communication device on a relatively large screen 3, so that the user can get the impression that the space in which the communication device 100 is installed has become larger. With this effect in mind, it is preferable that the communication device 100 is in a state of sending and receiving main image data with any of the other communication devices 200 to 400 as much as possible. For this reason, if the reception of main image data from the main communication device 200 is interrupted because the transmission and reception of main image data between the main communication device 200 and the other communication device 300 has started, the communication processing unit 134 may designate the other communication device 400, which had been sending and receiving main image data with the other communication device 300 until the transmission and reception of main image data between the main communication device 200 and the other communication device 300 started, as the next main communication device.

[0083] Figures 11(a), 11(b), and 12 illustrate an example of how the communication device 100 determines the destination of the main image data. In the state shown in Figure 11(a), the communication device 100 is sending and receiving main image data with another communication device 200. The other communication device 300 is sending and receiving main image data with another communication device 400. In the state shown in Figure 11(a), suppose the other communication device 200 performs an operation to stop sending and receiving main image data with the communication device 100 and to start sending and receiving main image data with the other communication device 300, as shown in Figure 11(b).

[0084] In this case, as shown in Figure 11(b), the main communication device 200 starts transmitting and receiving main image data with the other communication devices 300. Whenever the destination for transmitting and receiving the main image data changes, the communication device 100 and the other communication devices 200 to 400 each transmit connection information indicating the new destination for transmitting and receiving the main image data. Whenever the transmission and reception of the main image data is interrupted, the communication device 100 and the other communication devices 200 to 400 each transmit connection information indicating that the transmission and reception of the main image data has been interrupted.

[0085] Therefore, as shown in Figure 11(b), the other communication device 200 transmits connection information to the communication device 100 indicating that the new destination for transmitting and receiving the main image data is the other communication device 300. The other communication device 300 transmits connection information to the communication device 100 indicating that the new destination for transmitting and receiving the main image data is the other communication device 200. The other communication device 400 transmits connection information to the communication device 100 indicating that the transmission and reception of the main image data has been interrupted.

[0086] The communication processing unit 134 identifies that other communication device 400 is not transmitting or receiving main image data based on connection information received from other communication devices 200 to 400. In this case, the communication processing unit 134 sends a designation notification to other communication device 400 designating it as the next main communication device. The communication processing unit 134 then starts transmitting and receiving main image data with other communication device 400. In this way, the communication processing unit 134 can simplify the process of determining the next main communication device when the transmission and reception of main image data with the main communication device is interrupted.

[0087] Furthermore, if the communication processing unit 134 is interrupted from receiving main image data from the main communication device 200 and receives information from the main communication device specifying the next destination for the main image data of the communication device 100, it may designate the other communication device specified as the next main communication device. For example, if the communication processing unit 134 is sending and receiving main image data with the main communication device 200 and the transmission and reception of main image data with the main communication device 200 is interrupted, and the main communication device 200 receives information from the main communication device 200 designating the other communication device 400 as the next main communication device of the communication device 100, it sends a designation notification to the other communication device 400 designating the other communication device 400 as the next main communication device. The communication processing unit 134 then starts sending and receiving main image data with the other communication device 400.

[0088] [Display of various images] The display processing unit 135 displays various images using the first display unit 2 or the second display unit 4. The display processing unit 135 displays the main image data, which is image data received by the communication processing unit 134 from the main communication device 200, on the first display unit 2. The display processing unit 135 displays a screen (see Figures 8, 9, and 10) for the user to configure various settings of the communication device 100 on the second display unit 4.

[0089] When the operation reception unit 131 receives a designation start operation to initiate the designation of the next main communication device, the display processing unit 135 displays the sub-image data, which is image data received from the sub-communication device, on the first display unit 2 together with the reference image data based on the main image data, as shown in Figure 4. In this case, the display processing unit 135 displays the sub-image data, which is less clear than the main image data, on the first display unit 2. For example, when the operation reception unit 131 receives a designation start operation, the display processing unit 135 displays the preview screen shown in Figure 4, and displays the reference image data and the sub-image data, respectively, on this preview screen.

[0090] The display processing unit 135 refers to each of the multiple other communication devices 200 to 400 and the business hours data of the locations where the other communication devices 200 to 400 are installed, and identifies the sub-communication devices installed at locations that are within business hours at the time the operation reception unit 131 receives the specified start operation. The display processing unit 135 may display the sub-image data received by the communication processing unit 134 from the identified sub-communication device on the first display unit 2 along with the reference data. The display processing unit 135 does not display the sub-image data received by the communication processing unit 134 from sub-communication devices installed at locations that are outside business hours at the time the operation reception unit 131 receives the specified start operation on the first display unit 2.

[0091] In the example in Figure 7, if the operation reception unit 131 receives the specified start operation at 12:00, then the location "WW London Office" with location ID "A001", the first location from the top in Figure 7, is outside of business hours at that time. Therefore, the display processing unit 135 does not include the sub-image data received from the communication device installed at location ID "A001" in the preview screen displayed by the first display unit 2. In the example in Figure 7, at the time the operation reception unit 131 receives the specified start operation (12:00), the location "XX Tokyo Lab" with location ID "A002", the second location from the top in Figure 7, is within business hours. Therefore, the display processing unit 135 includes the sub-image data received from another communication device installed at location ID "A002" in the preview screen displayed on the first display unit 2.

[0092] Furthermore, other communication devices 200 to 400 often enter a sleep state outside of business hours to reduce their power consumption. For this reason, when the communication processing unit 134 receives information from any of the other communication devices 200 to 400 indicating that this other communication device has entered a sleep state, the display processing unit 135 may choose not to include the sub-image data received from this other communication device in the preview screen.

[0093] On the other hand, the display processing unit 135 may include the sub-image data received from one of the other communication devices 200 to 400 in the preview screen if the communication processing unit 134 has not received information from that other communication device indicating that it has entered a sleep state. In this way, the display processing unit 135 can prevent users of the communication device 100 from peeking at locations outside of business hours.

[0094] [Audio Output] The output unit 136 outputs various types of audio through one or more speakers 6. For example, the output unit 136 outputs the main audio transmitted from the main communication device while the main image data is displayed on the first display unit 2. The main audio is, for example, the sound around the main communication device. The output unit 136 outputs the secondary audio transmitted from the secondary communication device while the secondary image data is displayed on the first display unit 2 along with the main image data, in a state that is less audible than the main audio. The secondary audio is, for example, the sound around the secondary communication device. The output unit 136 may be muted while the secondary image data is displayed on the first display unit 2 along with the main image data.

[0095] <Processing procedure for changing the destination of image data transmission and reception by communication device 100> Figure 13 is a flowchart showing the processing procedure for changing the destination of image data transmission and reception by communication device 100. The processing procedure in Figure 13 is started, for example, while the communication processing unit 134 is transmitting and receiving main image data with any of the other communication devices 200 to 400.

[0096] First, the operation reception unit 131 determines whether or not it has received a designation start operation to begin designating the next main communication device (S201). If the operation reception unit 131 has received a designation start operation to begin designating the next main communication device (YES in S201), the display processing unit 135 displays a preview screen on the first display unit 2 for the user to designate one of the multiple other communication devices 200 to 400 as the next main communication device (S202).

[0097] The operation reception unit 131 determines whether or not it has received an operation from the user to specify the next main communication device (S203). If the operation reception unit 131 has received an operation from the user to specify the next main communication device (YES in S203), the communication processing unit 134 sends a designation notification to the other communication device designated as the next main communication device, indicating that it is designated as the next main communication device (S204). The communication processing unit 134 starts sending and receiving main image data with the other communication device designated as the next main communication device (S205). The operation reception unit 131 determines whether or not it has received a sleep operation from the user to transition the communication device 100 to a sleep state that reduces power consumption (S206).

[0098] If the operation reception unit 131 receives a sleep operation from the user (YES in S206), it stops sending and receiving main image data with other communication devices and terminates processing. If the operation reception unit 131 has not received a specified start operation in the determination in S201 (NO in S201), it repeats the determination in S201. If the operation reception unit 131 has not received an operation in the determination in S203 in which the user specifies the next main communication device (NO in S203), the communication processing unit 134 returns to processing in S202. If the operation reception unit 131 has not received a sleep operation from the user in the determination in S206 (NO in S206), it returns to processing in S201.

[0099] [Effects of the communication device 100 of this embodiment] In the communication device 100 of this embodiment, the display processing unit 135 makes it easier for the user to understand the status of the locations where the other communication devices 200 to 400 are installed before starting to send and receive main image data with the users of the other communication devices 200 to 400. For this reason, the display processing unit 135 makes it easier for the user to specify the other communication device at the other location from which to start sending and receiving main image data next.

[0100] Although the present invention has been described above using embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments, and various modifications and changes are possible within the scope of its gist. For example, all or part of the apparatus can be configured by functionally or physically distributing and integrating in any unit. Furthermore, new embodiments resulting from any combination of multiple embodiments are also included in the embodiments of the present invention. The effects of the new embodiments resulting from the combinations are combined with the effects of the original embodiments.

[0101] For example, the above description illustrates a case where multiple communication devices 100 transmit and receive image data and audio data peer-to-peer, but the multiple communication devices 100 may also transmit and receive image data and audio data via other devices (e.g., servers).

[0102] 1 Main unit 2 First display unit 3 Screen 4 Second display unit 5 Imaging unit 6 Speaker 7 Microphone 8 Operation unit 11 Communication unit 12 Storage unit 13 Control unit 100 Communication device 131 Operation reception unit 132 Acquisition unit 133 Judgment unit 134 Communication processing unit 135 Display processing unit 136 Output unit 200 Other communication device 300 Other communication device 400 Other communication device S Communication system

Claims

1. A communication device for sending and receiving image data with multiple other communication devices installed at multiple locations, comprising: a communication processing unit that sends and receives the image data with a main communication device and one or more sub-communication devices among the multiple other communication devices; a display processing unit that displays the main image data, which is the image data received by the communication processing unit from the main communication device, on a display unit; and an operation receiving unit that accepts an operation to specify the next main communication device from among the one or more sub-communication devices while the main image data is being displayed on the display unit, wherein when the operation receiving unit accepts a specification start operation to start specifying the next main communication device, the display processing unit displays the sub-image data, which is the image data received from the sub-communication device, on the display unit together with an image based on the main image data.

2. The communication device according to claim 1, wherein the display processing unit displays sub-image data that is less clear than the main image data on the display unit when the operation receiving unit receives the specified start operation.

3. The communication device according to claim 2, wherein the communication processing unit receives sub-image data that is less clear than the main image data from one or more sub-communication devices, and the display processing unit displays the sub-image data together with reference image data that has been processed to make the main image data less clear on the display unit.

4. The communication device according to claim 1 or 2, further comprising an output unit that outputs the main audio transmitted from the main communication device while the main image data is displayed on the display unit, and outputs the secondary audio transmitted from the secondary communication device while the secondary image data is displayed on the display unit together with the main image data, in a state that is less audible than the main audio.

5. The communication device according to claim 1, wherein the communication processing unit transmits the main image data of first quality to the main communication device, receives the main image data of first quality from the main communication device, transmits the sub-image data of second quality which is lower than the first quality to the sub-communication device, and receives the sub-image data of second quality which is lower from the sub-communication device.

6. The communication device according to claim 5, further comprising: an acquisition unit that acquires environmental information including at least one of an image captured of the area around the communication device and sound around the communication device; and a determination unit that determines whether or not there are people around the communication device based on the environmental information, wherein the communication processing unit, while transmitting the main image data, continues transmitting the main image data to the main communication device without transmitting the main image data to the sub-communication device if the determination unit determines that there are people around the communication device and the sub-communication device requests the transmission of the main image data, and stops transmitting the main image data to the main communication device and starts transmitting the main image data to the sub-communication device while transmitting the main image data, if the determination unit determines that there are no people around the communication device and the sub-communication device requests the transmission of the main image data, 7. A communication device according to claim 1 or 2, comprising: an acquisition unit that acquires environmental information including at least one of an image captured of the area around the communication device and sound around the communication device; and a determination unit that determines whether or not there is a person around the communication device based on the environmental information, wherein the communication processing unit transmits the determination result of the determination unit to one or more sub-communication devices.

8. The communication device according to claim 7, wherein the determination unit determines whether or not there are people around the communication device by recognizing the faces of people captured in the captured images included in the environmental information.

9. The communication device according to claim 1 or 2, wherein the communication processing unit receives information from one or more subcommunication devices indicating whether or not there are people around each of the subcommunication devices, and when it receives information from any of the one or more subcommunication devices indicating that there are no people around that subcommunication device, it prioritizes that subcommunication device as the next main communication device.

10. The communication device according to claim 1 or 2, further comprising a storage unit that stores each of the plurality of other communication devices in association with the business hours during which the base where the other communication devices are installed performs its business, wherein the communication processing unit refers to the storage unit and starts transmitting and receiving the sub-image data with the sub-communication device installed at the base when it enters the business hours.

11. The communication device according to claim 10, wherein the display processing unit displays the sub-image data received by the communication processing unit from the sub-communication device installed at the base that is within business hours at the time the operation receiving unit receives the designated start operation, together with the image based on the main image data, on the display unit, and does not display the sub-image data received from the sub-communication device installed at the base that is outside business hours at the time the operation receiving unit receives the designated start operation.

12. The communication device according to claim 1 or 2, wherein, if the reception of main image data from the main communication device is interrupted because the transmission and reception of main image data between the main communication device and the other communication device has started, the other communication device that was transmitting and receiving the main image data with the other communication device until the transmission and reception of the main image data between the main communication device and the other communication device started becomes the next main communication device.

13. The communication device according to claim 1 or 2, wherein the communication processing unit, when the reception of the main image data from the main communication device is interrupted and information specifying the next destination for the main image data of the communication device is received from the main communication device, designates the specified other communication device as the next main communication device.

14. The communication device according to claim 1 or 2, further comprising a storage unit that stores in association with each of the plurality of other communication devices a time period for sending and receiving main image data between the other communication devices, wherein the communication processing unit refers to the storage unit and sets the other communication device stored in association with the time period including the current time as the main communication device.

15. The communication device according to claim 1 or 2, further comprising a storage unit that stores each of the plurality of other communication devices in association with the business hours during which the base where the other communication devices are installed performs its business, wherein the communication processing unit refers to the storage unit and prioritizes the other communication devices stored in association with the business hours during which the overlap with the business hours of the base where the communication device is installed is shorter, and designates them as the main communication device.

16. A communication method for sending and receiving image data between a computer and a plurality of other communication devices installed at multiple locations, comprising: a step of sending and receiving the image data between a main communication device and one or more sub-communication devices among the plurality of other communication devices; a step of displaying the main image data, which is the image data received from the main communication device, on a display unit; and a step of receiving an operation to specify the next main communication device from among the one or more sub-communication devices while the main image data is being displayed on the display unit, wherein in the step of displaying the main image data on the display unit, when a specification start operation to start specifying the next main communication device is received, the sub-image data, which is the image data received from the sub-communication devices together with the main image data, is displayed on the display unit together with an image based on the main image data.

17. A program that causes a computer to perform the following steps: sending and receiving image data between a main communication device and one or more sub-communication devices among a plurality of other communication devices installed at multiple locations; displaying the main image data, which is the image data received from the main communication device, on a display unit; and while the main image data is being displayed on the display unit, accepting an operation to specify the next main communication device from among the one or more sub-communication devices, wherein in the step of displaying the main image data on the display unit, when a specification start operation to start specifying the next main communication device is accepted, the program displays the sub-image data, which is the image data received from the sub-communication devices, together with the main image data on the display unit along with an image based on the main image data.

Citation Information

Patent Citations

  • Video call system, master-side terminal, slave-side terminal, and program

    JP2011029731A

  • Information processing device, display device, information processing method, and program

    JP2022060330A

  • Methods, servers and devices for providing video calls

    KR102459864B1

  • Conveying gaze information in virtual conference

    US20130271560A1