Communication device and control method for communication device

Abstract

To provide a communication device and the like that can prevent information from leaking in a conference using the communication device.SOLUTION: A communication device includes a determination unit that determines whether the environment surrounding a connection destination communication device satisfies specified environmental conditions based on sound data received from the connection destination communication device that is communicatively connected to the communication device, and a notification control unit that issues an alert when it is determined that the environment surrounding the connection destination communication device does not satisfy the specified environmental conditions.SELECTED DRAWING: Figure 2A

Description

[Technical Field]

[0001] The present invention relates to a communication device and a method for controlling the communication device. [Background technology]

[0002] Patent document 1 proposes a technology for reducing the visibility of information displayed on a mobile device based on its relative positional relationship and level of secrecy when the information displayed on the display can be seen from outside through a window. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-026442 Summary of the Invention [Problem to be solved by the invention]

[0004] In recent years, remote conferences, in which users located in different locations hold a conference using communication devices, have become common. In a remote conference, a user located in a different location cannot recognize the surrounding environment of the other user with whom the remote conference is being held. For this reason, it is difficult for the user located in a different location to recognize the possibility that the contents of the remote conference may be leaked to a third party. This makes it difficult to prevent the contents of a conference using communication devices from being leaked. Patent Document 1 does not solve this problem.

[0005] In one aspect, an object of the present disclosure is to provide a communication device or the like that can prevent information from leaking from a conference using the communication device. [Means for solving the problem]

[0006] A communication device according to one aspect of the present invention includes a determination unit that determines, based on sound data received from a destination communication device that is communicatively connected to the communication device, whether the environment surrounding the destination communication device satisfies specified environmental conditions, and a notification control unit that issues a warning when it is determined that the environment surrounding the destination communication device does not satisfy the specified environmental conditions.

[0007] A communication device according to another aspect of the present invention includes a determination unit that determines whether an environment surrounding a destination communication device that is communicatively connected to the communication device satisfies a predetermined environmental condition based on sound data received from the destination communication device, and a communication control unit that performs control to stop communication with the destination communication device when it is determined that the environment surrounding the destination communication device does not satisfy the predetermined environmental condition. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 illustrates an example of a system. [Figure 2A] FIG. 2 illustrates an example of a communication device according to the first embodiment. [Figure 2B] FIG. 2 is a diagram illustrating an example of a connection destination communication device in the first embodiment. [Figure 3] FIG. 10 is a diagram showing an example of voice feature data for each registered user. [Figure 4] 4 is a flowchart showing an example of a processing flow according to the first embodiment. [Figure 5] This is a flowchart continuing from FIG. 4. [Figure 6A] 10 is a screen example showing a first example of an attention calling screen. [Figure 6B] 10 is a screen example showing a second example of the attention calling screen. [Figure 7] 10 is a flowchart showing an example of a processing flow according to a second embodiment. [Figure 8] FIG. 10 is a diagram illustrating an example of an environmental sound table. [Figure 9A] 10 is a screen example showing a third example of the attention calling screen. [Figure 9B]10 is a screen example showing a fourth example of a warning screen. [Figure 10A] FIG. 10 is a diagram illustrating an example of a communication device according to a third embodiment. [Figure 10B] FIG. 11 is a diagram illustrating an example of a connection destination communication device according to the third embodiment. [Figure 11] 11 is a flowchart showing an example of a processing flow according to a third embodiment. [Figure 12A] 10 is a screen example showing a first example of a communication suspension screen. [Figure 12B] 10 is a screen example showing a second example of a communication suspension screen. [Figure 13] 13 is a flowchart showing an example of a processing flow according to a fourth embodiment. [Figure 14A] 10 is a screen example showing a third example of a communication suspension screen. [Figure 14B] 10 is a screen example showing a fourth example of a communication suspension screen. [Figure 15] FIG. 10 is a diagram illustrating an example of a determination table. DETAILED DESCRIPTION OF THE INVENTION

[0009] First Embodiment The first embodiment will be described below. Fig. 1 is a diagram showing an example of a system 100. The system 100 includes a communication device 101 and a destination communication device 102. The communication device 101 and the destination communication device 102 are connected to each other so that they can communicate with each other, for example, via an Internet line or the like. The communication device 101 may be connected to multiple destination communication devices 102 so that they can communicate with each other.

[0010] The communication device 101 and the destination communication device 102 are devices capable of communication, such as a personal computer, a tablet terminal, a smartphone, etc. In each embodiment, the communication device 101 and the destination communication device 102 are devices used for online conferences.

[0011] 2A is a diagram showing an example of a communication device 101 according to the first embodiment. The communication device 101 includes a control unit 121, a microphone 122, a speaker 123, a camera 124, a storage unit 125, an operation unit 126, a display unit 127, and a communication unit 128. The control unit 121 also includes a sound analysis unit 131, a conference control unit 132, a determination unit 133, a notification control unit 134, and a time difference detection unit 135.

[0012] The microphone 122 is a sound collection device that collects sounds around the communication device 101. The speaker 123 is a sound output device that outputs sounds. The camera 124 is an imaging device that captures an image of a predetermined field of view around the communication device 101. The microphone 122 and the speaker 123 may be devices built into the communication device 101, or may be devices connected to the communication device 101. For example, the microphone 122 may be a microphone that is connected to the communication device 101 via a cable or short-range wireless communication. Furthermore, the speaker 123 may be headphones, a headset, or the like that is connected to the communication device 101 via a cable or short-range wireless communication.

[0013] The memory unit 125 is a storage device that stores predetermined information. The operation unit 126 is a device that accepts operations from a user. The operation unit 126 is, for example, a keyboard, a mouse, a touchpad, etc. The display unit 127 is a display that displays predetermined information. The operation unit 126 and the display unit 127 may be an integrated touch panel display. The communication unit 128 is a communication circuit for communicating with the destination communication device 102.

[0014] The control unit 121 executes various processes of the communication device 101. The control unit 121 has a processor and a memory. The processor of the control unit 121 executes a plurality of instruction sets (programs) stored in the memory of the control unit 121, thereby realizing various controls of the control unit 121. Any processor such as a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or an FPGA (Field Programmable Gate Array) may be used as the processor.

[0015] 2B is a diagram showing an example of the destination communication device 102 according to the first embodiment. The destination communication device 102 includes a control unit 221, a microphone 222, a speaker 223, a camera 224, a storage unit 225, an operation unit 226, a display unit 227, and a communication unit 228. The control unit 221 also includes a sound analysis unit 231, a conference control unit 232, a determination unit 233, a notification control unit 234, and a time difference detection unit 235.

[0016] The microphone 222 and the speaker 223 may be devices built into the destination communication device 102, or may be devices connected to the destination communication device 102. For example, the microphone 222 may be a microphone connected to the destination communication device 102 via a cable or short-range wireless communication. The speaker 223 may be headphones, a headset, or the like connected to the destination communication device 102 via a cable or short-range wireless communication.

[0017] 2B shows the same configuration as communication device 101 in Fig. 2A, but the configuration of connection destination communication device 102 may be different from the configuration of communication device 101. For example, control unit 221 of connection destination communication device 102 may not have some or all of the functions of sound analysis unit 231, conference control unit 232, determination unit 233, notification control unit 234, and time difference detection unit 235.

[0018] In each embodiment, an online conference is held using communication device 101 and destination communication device 102. Assume that communication device 101 is used by users X and Y, and destination communication device 102 is used by users A, B, and C. Users A, B, and C are, for example, first users. Users X and Y are, for example, second users.

[0019] Furthermore, communication device 101 and destination communication device 102 are located at separate locations. The participants in the online conference will be described as users X and Y who use communication device 101, and users A, B, and C who use destination communication device 102. The number of users is not limited to the above example.

[0020] The sound analysis unit 131 analyzes the sound data received from the destination communication device 102. The destination communication device 102 transmits the sound data collected by the microphone 222 to the communication device 101. The communication device 101 receives the sound data.

[0021] The sound analysis unit 131 analyzes the received sound data, that is, the sound around the destination communication device 102. For example, when an online conference is taking place, the received sound data includes voice data of users A, B, and C. In this case, the sound analysis unit 131 uses any voice analysis method to analyze data indicating the characteristics of the voices of users A, B, and C (voice feature data) included in the received sound data. The voice feature data is, for example, data indicating voiceprints or respiratory sound features. The data indicating respiratory sound features may be, for example, data indicating respiratory sound frequency features.

[0022] The conference control unit 132 controls the online conference. For example, assume that the operation unit 126 of the communication device 101 receives an operation to start an online conference. In response to receiving the operation, the conference control unit 132 starts an application for holding the online conference and controls the online conference.

[0023] Before the online conference starts or immediately after the online conference starts, the conference control unit 132 controls the acquisition of audio data from the destination communication device 102. For example, before the online conference starts, the conference control unit 132 may cause the display unit 227 of the destination communication device 102 to display a message for acquiring the user's voice. Based on the message, the communication device 101 may acquire audio data of the voices produced by users A, B, and C.

[0024] The sound analysis unit 131 analyzes the voice feature data of each of the users A, B, and C from the acquired sound data including the voice data of the users A, B, and C. The conference control unit 132 stores the voice feature data of each of the users A, B, and C in the storage unit 125 as voice feature data of registered users.

[0025] The determination unit 133 determines whether the environment surrounding the destination communication device 102 satisfies a predetermined environmental condition. The predetermined environmental condition is, for example, an environment in which the content of an online conference is unlikely to be leaked to a third party other than registered users.

[0026] For example, when there is no voice feature data of any user other than the registered user in the sound data received from the destination communication device 102, the determination unit 133 determines that the environment around the destination communication device 102 satisfies a predetermined environmental condition. In this case, it is assumed that there are no third parties other than the registered user around the destination communication device 102, so the content of the online conference is unlikely to be leaked to a third party.

[0027] On the other hand, when the sound data received from the destination communication device 102 contains voice feature data of a user other than the registered user, the determination unit 133 determines that the environment around the destination communication device 102 does not satisfy the predetermined environmental conditions. In this case, it is assumed that a third party other than the registered user is present around the destination communication device 102, and therefore there is a high possibility that the contents of the online conference will be leaked to the third party.

[0028] The notification control unit 134 performs control to issue a warning when the determination unit 133 determines that the environment around the destination communication device 102 does not satisfy a predetermined environmental condition. The warning is a notification indicating that the audio of the online conference may be leaking.

[0029] In this embodiment, notification control unit 134 notifies display unit 127 of information indicating a warning. As a result, the information indicating the warning is displayed on display unit 127. Users X and Y participating in an online conference using communication device 101 can recognize the possibility that the contents of the online conference may be leaked due to the environment around destination communication device 102 not satisfying predetermined environmental conditions.

[0030] The time difference detection unit 135 detects the time from when the speaker 223 of the destination communication device 102 outputs a specific sound to when the reflected sound of the output sound is input into the microphone 222 of the destination communication device 102. Details will be described later.

[0031] Next, the voice feature data will be described. Fig. 3 is a diagram showing an example of voice feature data for each registered user. In the example of Fig. 3, the voice feature data is voiceprint data and respiratory sound feature data. The voice feature data is data that enables voice-based biometric authentication. Based on the voice feature data, the user is uniquely identified.

[0032] As described above, the conference control unit 132 acquires, from the destination communication device 102, the voices of users (users A, B, and C) participating in an online conference using the destination communication device 102. The sound analysis unit 131 analyzes the voice feature data of each user contained in the acquired sound data. For example, the sound analysis unit 131 analyzes voiceprint data and respiratory sound feature data as the voice feature data of users A, B, and C. The voiceprint data is data indicating the voiceprint of each user. The respiratory sound feature data is, for example, data indicating the breathing frequency of each user.

[0033] The conference control unit 132 assigns a user ID to each of users A, B, and C, and stores the voiceprint data and respiratory sound feature data analyzed by the sound analysis unit 131 for each user ID in, for example, a table format in the storage unit 125. The respiratory sound feature data may be either voiceprint data or respiratory sound feature data.

[0034] The conference control unit 132 may perform control to acquire the voices of users X and Y collected by the microphone 122 of the communication device 101. In this case, the sound analysis unit 131 analyzes the voiceprint data and respiratory sound feature data of users X and Y. The conference control unit 132 may then assign user IDs to users X and Y and store the voiceprint data and respiratory sound feature data for each user ID in the storage unit 125. As a result, the voiceprint data and respiratory sound feature data of users A, B, C, X, and Y are stored in the storage unit 125.

[0035] Next, a description will be given of the processing flow of the first embodiment. Fig. 4 is a flowchart showing an example of the processing flow of the first embodiment. The conference control unit 132 determines whether an operation to start an online conference has been accepted (step S101).

[0036] For example, after starting an application for holding an online conference, the conference control unit 132 may cause a screen asking whether to start the online conference to be displayed on the display unit 127. If an operation to start the online conference using the operation unit 126 has not been received, the conference control unit 132 determines No in step S101 and returns the process to step S101.

[0037] When an operation to start an online conference using the operation unit 126 is accepted, the conference control unit 132 determines Yes in step S101 and advances the process to step S102. The conference control unit 132 starts a voice registration process (step S102).

[0038] As part of the above-mentioned voice registration process, the conference control unit 132 may cause the display unit 227 of the destination communication device 102 to display a message for acquiring voice data of users who will participate in the online conference using the destination communication device 102 before starting the online conference.

[0039] For example, assume that each user participating in the online conference using the destination communication device 102 speaks based on the above message. The microphone 222 of the destination communication device 102 collects the voice of each user. The destination communication device 102 transmits the voice data of the collected voice to the communication device 101 as sound data.

[0040] The communication unit 128 of the communication device 101 receives the sound data transmitted by the destination communication device 102. The control unit 121 acquires the sound data received by the communication unit 128 (step S103). The sound data includes voice data of each user (users A, B, and C) participating in the online conference using the destination communication device 102.

[0041] The sound analysis unit 131 analyzes the received sound data and generates voice feature data for each of the above users (step S104). In each embodiment, the voice feature data is described as being voiceprint data and respiratory sound feature data, but the voice feature data may be other data indicating the user's voice.

[0042] The conference control unit 132 stores the voice data of the users who will participate in the online conference using the destination communication device 102 in the storage unit 125, and then ends the voice registration process (step S Then, the conference control unit 132 performs control to start the online conference (step S107). The processes from step S102 to step S106 may be performed during the online conference.

[0043] The communication unit 128 transmits and receives video and audio (step S108). The communication unit 128 transmits audio data collected by the microphone 122 and video data captured by the camera 124 to the destination communication device 102.

[0044] Furthermore, destination communication device 102 transmits audio data collected by microphone 222 and video data captured by camera 224 to communication device 101. As a result, communication unit 128 receives the video and audio transmitted by destination communication device 102. The object transmitted and received in step S108 may be either video or audio.

[0045] After step S108, the process proceeds from "A" to step S109 in Fig. 5. Fig. 5 is a flowchart continuing from Fig. 4. The sound analysis unit 131 analyzes a voiceprint from the audio data included in the sound data received by the communication unit 128 (step S109). If the sound data includes multiple voiceprints, the sound analysis unit 131 analyzes each of the multiple voiceprints.

[0046] The determination unit 133 determines whether there is an unregistered voiceprint (step S110). At this time, the determination unit 133 acquires the voiceprint data of each user (users A, B, and C) stored in the storage unit 125.

[0047] Determination unit 133 compares the voiceprint data of each registered user acquired from storage unit 125 with the voiceprint data of the voiceprint analyzed in step S109. If the comparison results in mismatched voiceprint data, determination unit 133 determines Yes in step S110 and proceeds to step S113. On the other hand, if the comparison results in no mismatched voiceprint data, determination unit 133 determines No in step S110 and proceeds to step S111.

[0048] The sound analysis unit 131 analyzes the respiratory sound feature data included in the sound data received by the communication unit 128 (step S111). When the received sound data includes multiple respiratory sounds, the sound analysis unit 131 analyzes each of the multiple respiratory sounds.

[0049] The determination unit 133 compares the respiratory sound feature data of each registered user acquired from the storage unit 125 with the respiratory sound feature data of the respiratory sound analyzed in step S111. If the comparison results in mismatched respiratory sound feature data, the determination unit 133 determines Yes in step S112 and proceeds to step S113.

[0050] On the other hand, if the comparison result shows that there is no mismatched respiratory sound feature data, the determination unit 133 determines No in step S112 and returns the process from "B" to step S108 in Fig. 4. As described above, while the determination unit 133 determines No in step S110 and No in step S112, the transmission and reception of video and audio in step S108 continues. In this case, the online conference continues.

[0051] If the judgment unit 133 judges No in step S110, the voiceprint data contained in the sound data received from the destination communication device 102 does not include voiceprint data other than the voiceprint data of registered users (e.g., users A, B, and C) stored in the memory unit 125.

[0052] Therefore, there is a low risk that the contents of the online conference will be leaked to a third party other than a registered user who is near the destination communication device 102. In this case, the online conference continues on condition that the determination unit 133 determines No in step S112.

[0053] The determination unit 133 further performs a determination at step S112. If the determination unit 133 determines No at step S112, the respiratory sound feature data included in the sound data received from the destination communication device 102 does not include any respiratory sound feature data other than the respiratory sound feature data of the registered users (users A, B, and C) stored in the storage unit 125.

[0054] The determination unit 133 performs a double voice feature data determination using not only the voiceprint data but also the respiratory sound feature data, thereby enabling a more accurate determination of the risk that the contents of the online conference will be leaked to a third party other than the registered user around the destination communication device 102.

[0055] As described above, if the determination unit 133 determines "Yes" in step S110 or "Yes" in step S112, the process proceeds to step S113. In this case, the determination unit 133 determines that the environment around the destination communication device 102 does not satisfy the predetermined environmental condition (step S113).

[0056] As described above, the predetermined environmental condition in this embodiment is an environmental condition in which the environment around the destination communication device 102 has a low risk of the contents of the online conference being leaked to a third party other than the registered user. If the determination unit 133 determines Yes in step S110 or Yes in step S112, there is a mismatch in the voiceprint data or the respiratory sound feature data. Therefore, there is a possibility that a third party other than the registered user is present around the destination communication device 102, and the determination unit 133 determines that the predetermined environmental condition is not satisfied.

[0057] If the determination unit 133 determines that the above-mentioned predetermined environmental condition is not satisfied, the notification control unit 134 performs display control to display an attention-calling screen for calling attention on the display unit 127 (step S114).

[0058] 6A is a screen example showing a first example of the warning screen. When determining Yes in step S110 of FIG. 5, the notification control unit 134 causes the display unit 127 to display a screen 201 indicating the possibility that the contents of the online conference may have been leaked due to the recognition of a voiceprint of a user other than a registered user.

[0059] 6B is a screen example showing a second example of the warning screen. When determining Yes in step S112 of FIG. 5, the notification control unit 134 causes the display unit 127 to display a screen 202 indicating that the content of the online conference may have been leaked due to the recognition of respiratory sound feature data of a user other than a registered user.

[0060] By displaying the above-mentioned screen 201 or screen 202 on the display unit 127, a user participating in an online conference using the communication device 101 can recognize that the contents of the online conference may be leaked to a third party in the vicinity of the connected communication device 102.

[0061] Second Embodiment Next, a second embodiment will be described. Fig. 7 is a flowchart showing an example of the processing flow of the second embodiment. The conference control unit 132 determines whether an operation to start an online conference has been accepted (step S201). Step S201 is the same as step S101 in Fig. 4. If an operation to start an online conference using the operation unit 126 has not been accepted, the conference control unit 132 judges No in step S201 and returns the processing to step S201.

[0062] When an operation to start an online conference using the operation unit 126 is accepted, the conference control unit 132 determines Yes in step S201 and proceeds to step S202. The conference control unit 132 performs control to start the online conference (step S202). Step S202 is the same as step S107 in FIG. 4. When the online conference starts, the communication unit 128 transmits and receives video and audio (step S203). As a result, an online conference is held using the communication device 101 and the destination communication device 102.

[0063] The sound analysis unit 131 extracts a measurement sound from the voice input to the microphone 122 of the communication device 101 (step S204). The measurement sound is, for example, a specific sound input to the microphone 122. The specific sound may be the voice of a registered user. For example, the sound analysis unit 131 may perform voice recognition on the voice of the registered user input to the microphone 122, and extract any one word from the voice data obtained by the voice recognition as the measurement sound.

[0064] The measurement sound may also be generated by the control unit 121. For example, the control unit 121 may generate a predetermined sound outside the frequency band of the human voice as the measurement sound. In this case, the process of step S204 is not necessary.

[0065] The control unit 121 transmits the measurement sound to the destination communication device 102 via the communication unit 128. The time difference detection unit 135 detects the time difference between the time when the communication unit 128 transmits the measurement sound to the destination communication device 102 and the time when the reflected sound of the measurement sound is received.

[0066] The destination communication device 102 outputs the measurement sound received from the communication device 101 from the speaker 223. For example, if the destination communication device 102 is located indoors, the measurement sound output from the speaker 223 is reflected by a wall or the like, and the reflected sound is input to the microphone 222 of the destination communication device 102.

[0067] The destination communication device 102 transmits reflected sound data of the reflected sound input to the microphone 222 to the communication device 101. The communication unit 128 of the communication device 101 receives the reflected sound data transmitted by the destination communication device 102 (step S205). The sound analysis unit 131 analyzes the sound data received from the destination communication device 102, and may determine that reflected sound data is being received if the analyzed sound data contains the same sound as the measurement sound.

[0068] Here, the time difference detection unit 135 counts the time that has elapsed since the communication unit 128 transmitted the measurement sound to the connected communication device 102. The sound analysis unit 131 stops counting the time when it determines that reflected sound data has been received. As a result, the time from the time when the communication unit 128 transmitted the measurement sound to the connected communication device 102 to the time when the reflected sound of the measurement sound is received is detected as the time difference.

[0069] Here, a predetermined communication delay occurs in sending and receiving data between communication device 101 and destination communication device 102. Before executing the process of step S201, control unit 121 obtains the communication delay time between communication device 101 and destination communication device 102 in advance.

[0070] For example, the control unit 121 causes the communication unit 128 to transmit a response command to the destination communications device 102. Upon receiving the response command, the destination communications device 102 transmits information corresponding to the response command to the communications device 101.

[0071] The control unit 121 counts the time from when the response command is transmitted until when information corresponding to the response command is received as the delay time. The control unit 121 stores the counted delay time in the storage unit 125.

[0072] As described above, the time difference detection unit 135 detects the time from when the communication device 101 transmits the measurement sound to the destination communication device 102 until the communication device 101 receives the reflected sound from the destination communication device 102 as the time difference. The time difference detection unit 135 subtracts the delay time stored in the storage unit 125 from the time difference.

[0073] This allows the time difference detection unit 135 to obtain the time difference between when the speaker 223 of the destination communication device 102 outputs the measurement sound and when the reflected sound is input to the microphone 222 of the destination communication device 102. This time difference takes into account the communication delay time.

[0074] For example, if the destination communication device 102 is located in a small room, the time difference will be short. If the destination communication device 102 is located in a large room, the time difference will be long. Furthermore, if the destination communication device 102 is located in an open space other than a room, the reflected sound of the measurement sound will not be input to the microphone 222 of the destination communication device 102.

[0075] As described above, the time difference detection unit 135 detects the time difference between the measurement sound and the reflected sound (step S206). The determination unit 133 determines whether the detected time difference is equal to or greater than a predetermined time (step S207). The predetermined time can be set to any time, and may be set manually by the user, for example.

[0076] If the detected time difference is less than the predetermined time, the determination unit 133 determines No in step S207 and proceeds to step S208. In this case, since the detected time difference is short, it is assumed that the destination communication device 102 is located in a narrow space. If the determination unit 133 determines No in step S209, it determines that the content of the online conference is unlikely to be leaked to a third party.

[0077] The determination unit 133 refers to the environmental sound table (step S208). The environmental sound table is stored in advance in the storage unit 125. FIG. 8 is a diagram showing an example of the environmental sound table. For example, the environmental sound table may be stored in an external server, and the communication device 101 may acquire the environmental sound table from the external server in advance and store the acquired environmental sound table in the storage unit 125.

[0078] 8, the environmental sound table has items of environmental sound ID, location, and sound data. The environmental sound table is a table that stores sound data for each of a plurality of public places.

[0079] The environmental sound ID is information for identifying each environmental sound. The location is information indicating the type of public place. In the example of FIG. 8, the locations in the environmental sound table include trains, cafes, parks, automobiles, and restaurants. The sound data is sound data corresponding to each location.

[0080] For example, sounds specific to trains include the sounds of train doors opening and closing, the sound of the train running, the sound of the train arriving, and the sound of announcements on the train. Also, sounds specific to parks include the sounds of playground equipment and birdsong. Various types of sound data that are assumed to be found in public places are pre-registered as dictionary data in the environmental sound table.

[0081] The sound data in the environmental sound table may include sound data from various public places, such as sound data from airplane takeoff and landing, jet engines, and the like.

[0082] As described above, the communication unit 128 of the communication device 101 receives sound data from the destination communication device 102. The determination unit 133 determines whether the received sound data matches any of the sound data in the environmental sound table (step S209).

[0083] If the received sound does not match any of the sound data in the environmental sound table, the determination unit 133 returns the process to step S203. In this case, since the destination communication device 102 is not located in a public place, it is assumed that the content of the online conference is unlikely to be leaked to a third party. Therefore, the process returns to step S203, and transmission and reception of video and audio between the communication device 101 and the destination communication device 102 continues. In other words, the online conference continues.

[0084] If the time difference detected in step S206 is equal to or greater than the predetermined time, determination unit 133 determines Yes in step S207 and proceeds to step S210. In this case, determination unit 133 determines that the environment around destination communication device 102 does not satisfy the predetermined environmental condition (step S210). Then, notification control unit 134 performs display control to display an alert screen on display unit 127 to call attention (step S114).

[0085] If the received sound matches any of the sound data in the environmental sound table, the determination unit 133 determines "Yes" in step S209 and proceeds to step S210, whereupon the processes of steps S210 and S211 are performed.

[0086] 9A is a screen example showing a third example of the warning screen. When determining Yes in step S207 of FIG. 7, the notification control unit 134 causes the display unit 127 to display a screen 311 indicating the possibility that the contents of the online conference may have been leaked. In this case, because the time difference is equal to or greater than the predetermined time, the notification control unit 134 causes the display unit 127 to display a message indicating that the destination communication device 102 may be located in a large space.

[0087] 9B is a screen example showing a fourth example of the warning screen. When determining Yes in step S209 of FIG. 7, the notification control unit 134 causes the display unit 127 to display a screen 312 indicating the possibility that the contents of the online conference have been leaked. The screen 312 indicates the possibility that the contents of the online conference have been leaked due to the location of the destination communication device 102 in a public place.

[0088] By displaying the above-mentioned screen 311 or screen 312 on the display unit 127, a user participating in an online conference using the communication device 101 can recognize that the contents of the online conference may be leaked to a third party in the vicinity of the connected communication device 102.

[0089] Third Embodiment Next, a third embodiment will be described. Fig. 10A is a diagram showing an example of a communication device 101 according to the third embodiment. The communication device 101 according to the third embodiment has a communication control unit 401 instead of the notification control unit 134 shown in Fig. 2A. Other configurations of the communication device 101 according to the third embodiment are similar to those of the communication device 101 according to the first embodiment.

[0090] Fig. 10B is a diagram showing an example of a destination communication device 102 according to the third embodiment. The communication device 101 according to the third embodiment has a communication control unit 402 instead of the notification control unit 234 shown in Fig. 2B. Other configurations of the destination communication device 102 according to the third embodiment are similar to those of the destination communication device 102 according to the first embodiment.

[0091] When the determination unit 133 determines that the environment around the destination communication device 102 does not satisfy the predetermined environmental conditions, the communication control unit 401 of the communication device 101 performs control to stop communication between the communication device 101 and the destination communication device 102. The determination of whether the environment around the destination communication device 102 satisfies the predetermined environmental conditions is the same as in the first embodiment.

[0092] 11 is a flowchart showing an example of the processing flow of the third embodiment. In FIG. 11, the processing before step S109 is the processing of steps S101 to S108 in FIG.

[0093] 11, in step S113, the determination unit 133 determines that the environment around the destination communication device 102 does not satisfy a predetermined environmental condition. In this case, the communication control unit 401 disconnects communication between the communication device 101 and the destination communication device 102 (step S301). This stops communication between the communication device 101 and the destination communication device 102.

[0094] In the first embodiment, when the determination unit 133 determines that the environment around the destination communication device 102 does not satisfy the predetermined environmental conditions, a warning screen is displayed on the display unit 127. On the other hand, in the third embodiment, when the determination unit 133 determines that the environment around the destination communication device 102 does not satisfy the predetermined environmental conditions, communication between the communication device 101 and the destination communication device 102 is stopped.

[0095] As a result, if the environment around the destination communication device 102 does not meet specified environmental conditions, communication between the communication device 101 and the destination communication device 102 is stopped, thereby preventing the contents of the online conference from being leaked to third parties around the destination communication device 102.

[0096] 12A is a screen example showing a first example of the communication suspension screen. If the determination in step 110 is Yes, communication control unit 401 causes display unit 127 to display screen 321 indicating that video and audio communication has been suspended due to the recognition of a voiceprint of a user other than a registered user.

[0097] 12B is a screen example showing a second example of the communication stop screen. If the determination in step 112 is Yes, the communication control unit 401 causes the display unit 127 to display a screen 322 indicating that video and audio communication has been stopped due to the recognition of respiratory sound feature data of a user other than a registered user.

[0098] <Fourth embodiment> Next, a fourth embodiment will be described. Fig. 13 is a flowchart showing an example of the processing flow of the fourth embodiment. The processing in steps S201 to S210 in the flowchart in Fig. 13 is the same as that in steps S201 to S210 in the flowchart in Fig. 7.

[0099] 13, in step S210, determination unit 133 determines that the environment around destination communication device 102 does not satisfy a predetermined environmental condition. In this case, communication control unit 401 disconnects communication between communication device 101 and destination communication device 102 (step S401). As a result, communication between communication device 101 and destination communication device 102 stops.

[0100] As a result, if the judgment unit 133 determines that the environment surrounding the destination communication device 102 does not satisfy specified environmental conditions, communication between the communication device 101 and the destination communication device 102 is stopped, thereby preventing the contents of the online conference from being leaked to third parties around the destination communication device 102.

[0101] 14A is a screen example showing a third example of the communication suspension screen. If the determination in step S207 of FIG. 13 is Yes, communication control unit 401 causes display unit 127 to display screen 331 indicating that the content of the online conference has been leaked. In this case, because the time difference is equal to or greater than the predetermined time, notification control unit 134 causes display unit 127 to display a message indicating that destination communication device 102 may be located in a large space.

[0102] 14B is a screen example showing a fourth example of the communication suspension screen. If the determination in step S209 of FIG. 13 is Yes, communication control unit 401 causes display unit 127 to display screen 332 indicating that the contents of the online conference have been leaked due to the location of destination communication device 102 in a public place.

[0103] Fifth Embodiment Next, a fifth embodiment will be described. The speaker 223 of the destination communication device 102 outputs the voice of the voice data of the users (users A, B, and C) transmitted by the communication device 101.

[0104] In this embodiment, the speaker 223 of the destination communication device 102 is a non-wearable speaker or a wearable speaker. The non-wearable speaker is, for example, a speaker built into the communication device 101. Multiple users positioned around the non-wearable speaker can hear the sound output from the non-wearable speaker. The non-wearable speaker may be a stationary speaker connected to the destination communication device 102 via a cable or the like.

[0105] A wearable speaker is a speaker that is worn on a user's ear, such as headphones or a headset, and the sound output from the wearable speaker can only be heard by the user wearing the wearable speaker.

[0106] In the fifth embodiment, the determination unit 133 of the communication device 101 determines whether the speaker 223 of the destination communication device 102 is a non-wearable speaker or a wearable speaker. The determination unit 133 also determines whether the contents of the online conference may be leaked.

[0107] 15 is a diagram showing an example of a determination table. The determination table includes items for reflected sound, voices other than those of registered users, an environmental sound table, device determination, and the possibility of leakage. The determination table is used to determine whether a device is a non-wearable speaker or a wearable speaker, and to determine the possibility of leakage of the contents of an online conference. The determination table is stored in advance in the storage unit 125, for example.

[0108] The reflected sound is information indicating whether the reflected sound of the measurement sound output by the speaker 223 of the connected communication device 102 was detected by the communication device 101 before a predetermined time elapsed. For example, when an online conference is being held, the sound analysis unit 131 extracts sound data of a specific sound from among sounds input to the microphone 122 (for example, the user's voice) as the measurement sound. The measurement sound may be generated by the control unit 121.

[0109] The control unit 121 controls transmission of the measurement sound to the destination communication device 102 via the communication unit 128. The speaker 223 of the destination communication device 102 outputs the measurement sound. For example, the destination communication device 102 transmits, to the communication device 101, sound data that has been input to the microphone 222 since the measurement sound was output, for the predetermined period of time.

[0110] If the destination communication device 102 is located in a small room, the measurement sound output from the speaker 223 is reflected in the room and input to the microphone 222 before the predetermined period has elapsed. In this case, the reflected sound of the measurement sound is transmitted to the communication device 101. The predetermined period may be a time period that takes into account the delay time described above.

[0111] The determination unit 133 of the communication device 101 determines whether the sound data received from the destination communication device 102 during the predetermined period contains the same sound as the measurement sound. The same sound is a reflected sound reflected in the room in which the destination communication device 102 is located.

[0112] For example, when the determination unit 133 determines that the same sound as the measurement sound is included in the sound data received from the destination communication device 102 during the above-mentioned predetermined period, the determination unit 133 refers to the determination table. Based on the device determination corresponding to "present" reflected sound in the determination table, the determination unit 133 determines that the type of the speaker 223 of the destination communication device 102 is a non-wearable speaker.

[0113] Furthermore, if the determination unit 133 determines that the same sound as the measurement sound is included in the sound data received from the connected communication device 102 during a predetermined period, the same sound is assumed to be a sound reflected in a small room. Therefore, the determination unit 133 determines that the possibility of leakage is low based on the determination table.

[0114] For example, if the determination unit 133 determines that the sound data received from the connected communication device 102 during the predetermined period does not contain the same sound as the measurement sound, it refers to the determination table. Here, the device determination corresponding to "none" reflected sound in the determination table is either "non-wearable speaker" or "wearable speaker."

[0115] If the determination unit 133 determines that the same sound as the measurement sound is not present in the sound data received from the destination communication device 102 during the above-mentioned predetermined period, it refers to the item for voice other than the voice of the registered user in the determination table. In the item for voice other than the voice of the registered user, "Yes" indicates that there is voice feature data for voice other than the voice of the registered user. In the item for voice other than the voice of the registered user, "No" indicates that there is no voice feature data for voice other than the voice of the registered user. The voice feature data may be the voiceprint data described above or respiratory sound feature data.

[0116] If there is no reflected sound and there is no voice feature data of voices other than the voices of registered users, it is assumed that the type of speaker 223 of the destination communication device 102 is a wearable speaker. On the other hand, if there is no reflected sound and there is voice feature data of voices other than the voices of registered users, it is assumed that the type of speaker 223 of the destination communication device 102 is a non-wearable speaker.

[0117] For example, suppose the speaker 223 of the destination communication device 102 is a headphone. In this case, the sound output from the speaker 223 during an online conference is output directly to the ears of the user wearing the speaker 223. Therefore, the reflected sound described above is not detected.

[0118] For example, when the destination communication device 102 is located in a small room where there are no third parties other than the registered user, the sound data that the destination communication device 102 transmits to the communication device 101 does not include sound data having sound feature data of sound other than the sound of the registered user.

[0119] If there is no reflected sound and no voice feature data of voices other than the voice of the registered user, the determination unit 133 determines based on the determination table that the type of the speaker 223 of the destination communication device 102 is a wearable speaker. In this case, the determination unit 133 determines that the possibility of leakage is low because the speaker 223 is assumed to be a headphone or the like.

[0120] Also, assume that the speaker 223 of the destination communication device 102 is a speaker that outputs sound over a certain range, and that the destination communication device 102 and the speaker 223 are located in a large room. In this case, the sound output from the speaker 223 during an online conference is hardly reflected.

[0121] For example, if the destination communication device 102 is located in a large room where a third party other than the registered user is present, the sound data transmitted from the destination communication device 102 to the communication device 101 includes sound data having sound feature data of a sound other than that of the registered user. The above-mentioned large room is, for example, a room other than a conference room.

[0122] If there is no reflected sound and there is sound feature data of a sound other than the sound of a registered user, the determination unit 133 determines based on the determination table that the type of the speaker 223 of the destination communication device 102 is a non-wearable speaker. In this case, the determination unit 133 determines that there is a high possibility that the contents of the online conference will be leaked to a third party other than the registered user.

[0123] If the sound data received from the destination communication device 102 during the above-mentioned predetermined period contains sound data that matches sound data in the environmental sound table, the determination unit 133 determines that the destination communication device 102 is located in a public place. Furthermore, if the sound data contains sound data that matches sound data in the environmental sound table, the determination unit 133 does not determine whether the sound is a reflected sound or whether the sound is from a user other than a registered user.

[0124] If the above sound data contains sound data that matches sound data in the environmental sound table, the type of the speaker 223 of the destination communication device 102 may correspond to both a non-wearable speaker and a wearable speaker. Therefore, if the above sound data contains sound data that matches sound data in the environmental sound table, the determination unit 133 does not need to determine the type of the speaker 223 of the destination communication device 102.

[0125] Furthermore, when the determining unit 133 determines that the destination communication device 102 and the speaker 223 are located in a public place, it determines that there is a high possibility that the contents of the online conference will be leaked to a third party other than the registered user.

[0126] As described above, in the fifth embodiment, the determination unit 133 can perform device determination as to whether the type of the speaker 223 of the destination communication device 102 is a non-wearable speaker or a wearable speaker. In addition, the determination unit 133 determines whether there is a high or low possibility that the contents of the online conference will be leaked to a third party other than registered users.

[0127] Control unit 121 may cause the result of the determination made by determination unit 133 to be displayed on display unit 127, for example. This allows a user participating in an online conference using communication device 101 to recognize the possibility that the contents of the online conference may be leaked to destination communication device 102.

[0128] Based on the determination table, the control unit 121 may display not only whether the possibility of leakage is high or low, but also accompanying information on the display unit 127. For example, assume that there is reflected sound, there is no sound feature data of any sound other than the voice of the registered user, and there is no sound data in the sound data that matches the sound data in the environmental sound table. In this case, the control unit 121 may display, on the display unit 127, information indicating that the possibility of leakage is low, as well as accompanying information indicating that the destination communication device 102 is located in a small room.

[0129] In other words, based on the judgment table of Figure 15, the control unit 121 may display on the display unit 127 not only information indicating whether the possibility of leakage is high or low, but also accompanying information indicating whether the destination communication device 102 is located in a small room, a large room, or a public place.

[0130] <Other> The present disclosure is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present invention. Furthermore, new technical features can be formed by combining the technical means disclosed in each embodiment. Furthermore, the order of the processes in the flowcharts described in the above-described embodiments can be changed as much as possible.

[0131] The program that realizes the functions of this embodiment is stored in a non-transitory recording medium such as a semiconductor medium, an optical recording medium, or a magneto-optical recording medium. For example, a non-volatile memory card can be used as the semiconductor medium. For example, a CD (Compact Disc) or a DVD (Digital Versatile Disc) can be used as the optical recording medium or magneto-optical recording medium. The program may also be supplied to a computer via any transmission medium that can transmit the program. [Explanation of symbols]

[0132] 100 system, 101 communication device, 102 destination communication device, 121 control unit, 122 microphone, 123 speaker, 124 camera, 125 memory unit, 126 operation unit, 127 display unit, 128 communication unit, 131 sound analysis unit, 132 conference control unit, 133 determination unit, 134 notification control unit, 135 time difference detection unit, 221 control unit, 222 microphone, 223 speaker, 224 camera, 225 memory unit, 226 operation unit, 227 display unit, 228 communication unit

Claims

1. A communication device, a determination unit that determines whether the surrounding environment of the destination communication device satisfies a predetermined environmental condition based on sound data received from the destination communication device that is communicably connected to the communication device; a notification control unit that issues a warning when it is determined that the environment around the destination communication device does not satisfy the predetermined environmental condition; A communication device comprising:

2. A communication device, a determination unit that determines whether the surrounding environment of the destination communication device satisfies a predetermined environmental condition based on sound data received from the destination communication device that is communicably connected to the communication device; a communication control unit that performs control to stop communication with the destination communication device when it is determined that the environment around the destination communication device does not satisfy the predetermined environmental condition; A communication device comprising:

3. a storage unit that stores voice feature data relating to the voices of each of a plurality of registered users; the determination unit determines that the environment around the destination communication device does not satisfy the predetermined environmental condition when the voice feature data related to the voice of the first user as the sound data received from the destination communication device does not match any of the voice feature data of the plurality of registered users stored in the storage unit.

3. A communication device according to claim 1 or 2.

4. a conference control unit that controls when a conference is held using communication with the destination communication device, The communication device according to claim 3 , wherein the conference control unit stores voice feature data relating to the voice of the first user received from the destination communication device in the storage unit.

5. The communication device according to claim 3 , wherein the voice characteristic data is at least one of voiceprint data and respiratory sound characteristic data.

6. a sound collecting device that collects sounds around the communication device; The communication device according to claim 1 or 2, wherein the determination unit determines that the predetermined environmental conditions are not met if the time between when the sound data of the sound acquired by the sound collecting device is transmitted to the connected communication device and when the reflected sound data of the reflected sound of the sound is received from the connected communication device is longer than a predetermined time.

7. a storage unit that stores environmental sound data; 3. The communication device according to claim 1, wherein the determination unit determines that the environment surrounding the destination communication device does not satisfy the predetermined environmental conditions when the sound data received from the destination communication device matches the environmental sound data stored in the memory unit.

8. a sound collecting device that collects sounds around the communication device; a storage unit that stores voice feature data relating to the voices of each of the plurality of registered users; 3. The communication device according to claim 1, wherein the determination unit determines the type of sound collection device of the destination communication device based on whether the time between transmitting the sound data of the sound acquired by the sound collection device to the destination communication device and receiving reflected sound data of the reflected sound of the sound from the destination communication device is greater than or equal to a predetermined time, and whether the sound feature data related to the voice of a first user as the sound data received from the destination communication device matches any of the sound feature data of the multiple registered users stored in the memory unit.

9. A method for controlling a communication device, comprising: determining whether the surrounding environment of the destination communication device satisfies a predetermined environmental condition based on sound data received from the destination communication device communicably connected to the communication device; issuing a warning when it is determined that the environment around the destination communication device does not satisfy the predetermined environmental condition; A method for controlling communication devices.

10. A method for controlling a communication device, comprising: determining whether the surrounding environment of the destination communication device satisfies a predetermined environmental condition based on sound data received from the destination communication device communicably connected to the communication device; When it is determined that the environment around the destination communication device does not satisfy the predetermined environmental condition, control is performed to stop communication with the destination communication device. A method for controlling communication devices.

Images