Communication device and display method

By generating icons based on participant actions, expressions or reactions in a web meeting to replace the video stream, the poor communication problem caused by the non-speaker camera turnoff in a multi-person web meeting is solved, and smooth communication without displaying the camera image is achieved.

JP2025071357AActive Publication Date: 2025-05-02JVC KENWOOD CORP
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
JP2025029931
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2025-02-27
Publication Date
2025-05-02
Estimated Expiration
2040-12-17

AI Technical Summary

Technical Problem

In multi-person web meetings, non-speakers' camera function may be turned off, causing speakers to be unable to see other users' facial expressions and reactions, affecting smooth communication.

Method used

By acquiring voice or video data from multiple terminals on the communication device and generating corresponding icons based on the participants' predetermined actions, expressions or reactions, displaying these icons to replace the actual video stream, ensuring that the participants can understand the reactions of other users even if the camera image is not displayed.

Benefits of technology

This enables communication smoothness without displaying camera images, allowing participants to understand other users' reactions and attitudes, thereby improving the communication efficiency of the meeting.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025071357000001_ABST
    Figure 2025071357000001_ABST
Patent Text Reader

Abstract

To perform smooth communication even without displaying camera videos.SOLUTION: A communication device 10 acquires speech sounds or videos of people from a plurality of other terminals, and when the number of people reaches a predetermined number or more, displays an icon generated based on the number or ratio of people showing a predetermined action, a predetermined facial expression, or a predetermined reaction. Alternatively, a computer acquires speech sounds or videos of people from the plurality of other terminals, and when the number of people reaches the predetermined number or more, displays an icon generated based on the number or ratio of people showing the predetermined action, the predetermined facial expression, or the predetermined reaction.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a communication device and a display method. [Background technology]

[0002] A WEB conferencing device that allows you to hold conferences with people in remote locations via a network is known. It has been reported (for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2018-93315 A Summary of the Invention [Problem to be solved by the invention]

[0004] The WEB conference device allows participants to share images captured from the direction of the user's face. However, if necessary, the camera function may be turned off. For example, when using a Web browser in a multi-person meeting, In B conferences, the camera function of the person other than the speaker may be turned off. The speaker cannot see the facial expressions of other users and cannot understand their reactions to what is being said. Therefore, communication may not be smooth.

[0005] The present invention allows smooth communication without displaying camera images. A communication device and a display method are provided. [Means for solving the problem]

[0006] The communication device of the present invention acquires speech or video of people from multiple other terminals, and when the number of people reaches a predetermined number or more, displays an icon generated based on the number or percentage of people exhibiting a predetermined action, a predetermined facial expression, or a predetermined reaction.

[0007] The display method of the present invention involves a computer acquiring speech or video of people from multiple other terminals, and when the number of people reaches a predetermined number or more, displaying an icon generated based on the number or proportion of people exhibiting a predetermined action, a predetermined facial expression, or a predetermined reaction. Effect of the Invention

[0008] According to the present invention, it is possible to carry out smooth communication without displaying camera images. can. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a block diagram showing an example of the configuration of a video communication device according to an embodiment. [Diagram 2] FIG. 2 is a flowchart showing an example of a process flow of the video communication device according to the embodiment. [Diagram 3] FIG. 3 is a diagram for explaining an image that the display control unit causes to be displayed on the display unit. [Figure 4] FIG. 4 is a diagram for explaining a method for displaying images or icons of individual participants in sequence. [Diagram 5] FIG. 5 is a diagram for explaining a method of displaying an icon reflecting a ratio of a predetermined action or facial expression. [Figure 6] FIG. 6 is a diagram for explaining a method of reflecting a nodding motion in a gesture icon. [Figure 7] FIG. 7 is a diagram for explaining a method of displaying an icon reflecting the proportion of a predetermined action or facial expression. [Figure 8] FIG. 8 is a diagram for explaining a method of reflecting the action of shaking one's head from side to side in the gesture icon. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. The present invention is not limited to the embodiments.

[0011] [Embodiment] A video communication device according to an embodiment will be described with reference to FIG. FIG. 1 is a block diagram showing an example of the configuration of a video communication device.

[0012] As shown in FIG. 1, a video communication device 10 includes a camera 12, a microphone 14, and an operating A reception unit 16, a communication unit 18, a display unit 20, an audio output unit 22, and a control unit (video communication control The video communication device 10 includes, for example, a PC (Personal Computer), A display screen that displays images, such as a smartphone or tablet device, and a display device that is displayed near the display screen The video communication device 10 is a device equipped with a camera facing in the same direction as the display screen. For example, it can be used in web conferences, allowing participants to communicate using video and audio. It is a device that allows communication.

[0013] The camera 12 captures an image of the periphery of the video communication device 10. The camera 12 is, for example, The camera 12 is arranged so as to capture an image in the direction in which the camera 12 is facing. The camera 12 captures a series of images in time series, i.e., a moving image. The camera 12 is an external camera connected to the video communication device 10. It's fine.

[0014] The microphone 14 picks up sounds around the video communication device 10. The microphone 4 picks up the voice of a person speaking into the microphone 14. The microphone 14 outputs the collected voice to the voice acquisition unit 32. It may also be an external microphone connected to the device 10 .

[0015] The operation reception unit 16 receives various operations for the video communication device 10 by a user. The operation reception unit 16 may include, for example, a touch panel, a switch, a button, etc. The operation receiving unit 16 outputs operation information related to an operation received from a user or the like to the operation control unit 34. To exert effort.

[0016] The communication unit 18 is connected to a communication network such as the Internet (not shown) by wire or wirelessly. The communication unit 18 transmits and receives information to and from other external devices via a communication network. The communication unit 18 transmits and receives information to and from, for example, another video communication device. The video captured by the camera 12 and the audio picked up by the microphone 14 are sent to other video communication devices. The communication unit 18 receives, for example, images captured by a camera and a microphone of another video communication device. The communication unit 18 receives, for example, a voice from another video communication device. The communication unit 18 receives information for restricting the image captured by the camera of the video communication device. For example, the actions or facial expressions of a person captured in a video captured by another video communication device may be analyzed. In the following description, the communication unit 18 receives the analysis result of the video communication device. When it is described that the communication unit 18 transmits the video communication device, the communication unit 18 transmits the video communication device. The images and other data transmitted by the 18 are stored on an external server that can be accessed by other video communication devices. Also, the communication unit 18 may transmit images, etc. from other video communication devices. In the case where it is described that the other video communication device is connected, the communication unit 18 You can also receive video from an external server that can access the video you have sent. include.

[0017] The display unit 20 displays various information. For example, the display unit 20 displays a picture of the user taken by the camera 12. Video captured by a person participating in a web conference, or video of other users captured by other video communication devices The display unit 20 displays, for example, a predetermined icon indicating the user of the video communication device 10. The display unit 101 displays icons indicating the users of the other video communication devices participating in the Web conference, as well as other users of the video communication devices participating in the Web conference. The display unit 20 is, for example, a liquid crystal display (LCD) or This type of display includes organic EL (Electro-Luminescence) displays.

[0018] The audio output unit 22 is a speaker, a headphone, or the like, and is provided in the video communication device 10. The audio input may be an external speaker or a headphone connected to the video communication device 10. The audio output unit 22 outputs various sounds. For example, the audio output unit 22 outputs The video communication device outputs voices and the like uttered by other users transmitted from other video communication devices connected to the device.

[0019] The control unit 24 is a so-called video communication control device that controls the operation of each unit of the video communication device 10. The control unit 24 is, for example, a CPU (Central Processing Unit) or an MPU (Microprocessor Unit). A program stored in a storage unit (not shown) is executed by a RAM or the like. By executing the program as a work area, various functions are realized. The control unit 24 executes the program according to the present invention. The control unit 24 is, for example, an ASIC (Application Specific Integrated Circuit). Specific Integrated Circuit) and FPGA (Field Programmable Gate Array) The control unit 24 may be realized by an integrated circuit such as a may be realized by a combination of the above.

[0020] The control unit 24 includes a video acquisition unit 30, a voice acquisition unit 32, an operation control unit 34, and a communication control unit. 36, a display control unit 38, a voice output control unit 40, an analysis unit 42, and an icon generation unit 44. In other words, the control unit 24 includes a video acquisition unit 30, a sound acquisition unit 32, and an operation A production control unit 34, a communication control unit 36, a display control unit 38, a voice output control unit 40, and an analysis unit 42 and the icon generating unit 44.

[0021] The image acquisition unit 30 acquires the image output by the camera 12. The image acquisition unit 30, for example, Then, the camera 12 captures an image of the area including the face of the user of the video communication device 10. You will benefit.

[0022] The voice acquisition unit 32 acquires the voice output by the microphone 14. The voice acquisition unit 32 For example, the voice of the user of the video communication device 10 captured by the microphone 14 is Get it.

[0023] The operation control unit 34 acquires operation information related to the operation accepted by the operation acceptance unit 16 .

[0024] The communication control unit 36 ​​controls the communication unit 18. The communication control unit 36 ​​controls the communication unit 18. The communication control unit 36 ​​controls the communication unit 18, for example. It controls transmission and reception of video and audio to and from other video communication devices.

[0025] The display control unit 38 causes the display unit 20 to display various images. The display control unit 38, for example, The user of the video communication device 10 and the users of other video communication devices participating in the WEB conference The display control unit 38, for example, transmits information for limiting the image display by the communication unit 18. When the image of the other user is received, the icon generated by the icon generating unit 44 is displayed instead of the image of the other user. is displayed on the display unit 20.

[0026] The audio output control unit 40 causes the audio output unit 22 to output various sounds. For example, the voice of other users participating in the WEB conference is output from the voice output unit 22. do.

[0027] The analysis unit 42 analyzes the video captured by the camera of the other video communication device received by the communication unit 18. The analysis unit 42 analyzes the sound picked up by the microphone of the other video communication device received by the communication unit 18. The analysis unit 42 analyzes the voice captured by the camera of another video communication device. The analysis unit 42 recognizes a person from, for example, an image captured by a camera of another video communication device. When the person is recognized from the image, at least one of the recognized actions and facial expressions is analyzed. The unit 42 analyzes the information received by the communication unit 18 and detects a person who shows a predetermined action or a predetermined facial expression. The percentage of the number of actions is obtained. The predetermined actions are, for example, positive actions in response to the speaker's utterance or The analysis unit 42 may include, but is not limited to, a negative action. 8 performs a predetermined action or The percentage of the facial expression that indicates a predetermined facial expression may be obtained.

[0028] The icon generating unit 44 generates various icons. For example, the icon generating unit 44 The icon generating unit 44 generates an icon according to the analysis result of the analysis unit 42. The icon generating unit 44 generates an icon reflecting the ratio acquired by the analysis unit 42. The analysis unit 42 determines that the proportion of the predetermined motion or facial expression is equal to or greater than a predetermined threshold. The icon generating unit 44 generates an icon that reflects the action or expression. In this case, the icon generating unit 44 may display the icon Execute the function to get the data.

[0029] [Video communication device processing] The process of the video communication device according to the embodiment will be described with reference to FIG. 10 is a flowchart showing an example of a process flow of the video communication device according to the embodiment.

[0030] The process in FIG. 2 is started, for example, when a WEB conference is started. The control unit 17 starts communication with other participants in the WEB conference by using the communication unit 18. The unit 24 receives images captured by other video communication devices or images captured by the video communication devices of each participant. The captured image is analyzed to obtain information indicating the action or facial expression (step S10). Specifically, in this embodiment, the communication control unit 36 ​​controls the video communication device of the other participants to In this embodiment, the other video communication devices receive information according to the video mode. "Image On Mode", "Image Limited Mode" or "Image Off Mode" is set. do.

[0031] For example, the communication control unit 36 ​​detects that the other video communication device is set to the "video on mode." In this case, the video captured by the other video communication device is transmitted, and the video is acquired. For example, when the "video restriction mode" is set in the other video communication device, the control unit 36 , which shows the actions or expressions of other participants as a result of analysis of the images captured by other video communication devices. The communication control unit 36 ​​acquires information on the other video communication device, for example, when the other video communication device is in the “video off mode.” If this is set, the attribute information of other participants is obtained. Attribute information includes name, participation number, etc. It may include various information such as name.

[0032] The control unit 24 determines whether the number of participants in the WEB conference is equal to or greater than a predetermined number (step Specifically, the communication control unit 36 ​​determines whether or not a user is participating in the Web conference at the time of the determination in step S12. The decision is based on the number of participants, but it may also be based on the number of people requested to participate by the organizer of the web conference. The predetermined number of people is, for example, 10 people, but is not limited to this. Participants can grasp the overall situation by viewing the images and voices of other participants in the WEB conference on the display unit 20. It is sufficient to set an upper limit on the number of participants that can participate in a web conference. If the participant of the WEB conference is a designated person (step S12; Yes), the process proceeds to step S14. If it is not determined that the number is equal to or greater than the predetermined number (step S12; No), the process proceeds to step S16.

[0033] If the determination in step S12 is Yes, the control unit 24 determines whether the other participants are Specifically, the analysis unit 42 starts analyzing the information of the other video communication devices. For video communication devices that are set to "Video On Mode" or "Video Restriction Mode" For example, if 30 participants in a web conference If there are 0 people and only one speaker, the speaker should automatically be in "video on mode". For example, in a lecture using a web conference, the speaker's image can be transmitted to other participants through video communication. This is because the video needs to be displayed on a device. Assume that 15 people will be in "on mode", 10 in "video restricted mode", and 4 in "video off mode". Then, the process proceeds to step S18.

[0034] If the determination in step S12 is No, the control unit 24 The display control unit 38 displays the icon (step S16). The image acquired by the display control unit 38 is displayed on the display unit 20. The display screen 20a shown in FIG. The screen displayed when a WEB conference is being held with four people including the user U1 of the communication device 10. This is an example. The video communication device of the other three users other than the user of the video communication device 10 also displays the The display screen 20a shown in FIG. Common to all participants.

[0035] The display screen 20a includes a first display area 50, a second display area 52, and a third display area 54. and a fourth display area 56. The first display area 50 may be, for example, a display area for displaying the first of the four users. The second display area 52 displays information about the first user U1 who is the speaker. For example, information about the second user out of the four users is displayed. For example, the fourth display area displays information about the third user out of the four users. 56 displays, for example, information about a fourth user out of four users.

[0036] In the first display area 50, an image of the user U1 and an icon I1 are displayed. The icon U1 is displayed, for example, in the center of the first display area 50. The icon I1 is displayed in the The icon I1 is displayed in the upper right corner of the area 50. The icon I1 is an icon showing information about the user U1. Icon I1 displays the initials of the user U1's name, for example "YS". It can be done.

[0037] In the second display area 52, an icon I2 is displayed in the center. The icon I2 indicates the information of the second user. For example, the icon I2 is "RS" The second user's first initial may be displayed.

[0038] An icon I3 is displayed in the center of the third display area 54. These are icons that show user information. For example, icon I3 is "KT" The third user's first initial may be displayed.

[0039] In the fourth display area 56, an icon I4 is displayed in the center. These are icons that show user information. Icon I4 is, for example, "CJ" The fourth user's first initial may be displayed.

[0040] That is, on the display screen 20a, the first user who is the speaker selects “video on mode” and the second to fourth users select "Video Restriction Mode" or "Video Off Mode." If the result of the determination in step S12 is No, the selection of the "video restriction mode" is is not necessary.

[0041] After step S14, the control unit 24 determines whether the predetermined action or facial expression of the other participants is greater than or equal to a predetermined ratio. Specifically, the analysis unit 42 determines whether the value is above the threshold (step S18). Based on the analysis results of 14, whether other participants have a certain action or facial expression at a certain rate or more The predetermined percentage is, for example, 10% or more of all participants who are in "video on mode". or participants who are set to "video restriction mode" are more than 20% of all participants. It is preferable that the ratio be such that you can understand to some extent the reactions of other participants to the content of your speech. If the predetermined action or facial expression is not determined to be equal to or greater than the predetermined ratio (step S18; No), If it is determined that the predetermined motion or facial expression is greater than or equal to a predetermined ratio, the process proceeds to step S20. (Step S18; Yes), proceed to step S22.

[0042] If the determination in step S18 is No, the control unit 24 The display control unit 38 sequentially displays the icons (step S20). The video or icon of each participant is displayed in sequence. FIG. 4 is a diagram for explaining a method of displaying icons in sequence on the display screen 20. The display screen 20b is a common image for all participants of the WEB conference. In this example, the number of participants in the meeting is 30. As shown in FIG. 4, the display screen 20b has a first display area 50A, a second display area 52A, a third display area 54A, a fourth display area 56A, and a fifth display area 57A. and a display area 58A.

[0043] In the example shown in FIG. 4, the first display area 50A displays a user U The image of the first user 1A and an icon I1A representing the first user are displayed. For example, the first initial of the first user is displayed in the fourth display area 56A. The image of user U2A and an icon I4A representing the fourth user are displayed. Icon I4A For example, the first user and the fourth user may use the following: It is set to "Picture On Mode".

[0044] The second display area 52A, the third display area 54A, and the fifth display area 58A are, Icon I2A indicates a second user, icon I3A indicates a third user, and icon I4A indicates a fifth user. Icon I5A is displayed. For example, icon I2A, icon I3A, and icon I5A are the initials of the names of the second, third, and fifth users, respectively. The second user, the third user, and the fifth user each enter the “video restricted mode.” Or it is set to "Picture Off Mode".

[0045] In the example shown in FIG. 4, the display control unit 38 displays the 25 users other than the first user to the fifth user. The images or icons of the participants are displayed in a predetermined order or randomly by the first user who is the speaker. The display control unit 38 displays the image in an area other than the first display area 50A in which the image is displayed. The size of the area for displaying the images or icons of participants other than the speaker can be set to the number of participants. After step S20, the process proceeds to step S24.

[0046] If the determination in step S18 is Yes, the control unit 24 controls the user to perform a predetermined action or facial expression. The icon reflecting the ratio is displayed (step S22). displays icons reflecting the proportions of the actions or facial expressions of participants in a web conference. FIG. 5 illustrates a method for displaying an icon reflecting the proportion of a given action or facial expression. The display screen 20c shown in FIG. 5 displays an image common to all participants of the Web conference. Specifically, the display screen 20c shown in FIG. 5 displays a positive response to the speaker's remark. The display screen 20c shows an example of a method for displaying a desired action or ratio. As shown in FIG. 5, the display screen 20c has a first display area 5 0B, the second display area 52B, the third display area 54B, the fourth display area 56B, and the first moving image and a production information display area 60.

[0047] In the example shown in FIG. 5, the first display area 50B displays a user U The image of 1B and an icon I1B representing the first user are displayed. The icon I1B is For example, the first initial of the first user is displayed in the third display area 54B. The image of user U2B and an icon I3B representing a third user are displayed. Icon I3B For example, the first user and the third user may use the following: It is set to "Picture On Mode".

[0048] The second display area 52B and the fourth display area 56B each display an icon representing a second user. icon I2B and icon I4B representing the fourth user are displayed. For example, icon I Icons 2B and I4B represent the initials of the second and fourth users' names, respectively. The second user and the fourth user are in “video restricted mode” or It is set to "Picture Off Mode".

[0049] The first movement information display area 60 displays the movements or facial expressions of all participants participating in the WEB conference. This is an area where information about the ratio is displayed. Specifically, the first action information display area 60 is This is the area that displays information about the proportion of positive actions or facial expressions toward the speaker. The first action information display area 60 includes a gesture icon GI1, a character icon LI1, and Includes.

[0050] Gesture icon GI1 represents the movements or facial expressions of participants participating in a web conference. Specifically, the gesture icon GI1 is an icon that indicates a gesture in response to the speaker's utterance. In the example shown in Figure 5, The gesture icon GI1 is an icon of a nodding motion. The gesture icon GI1 indicates an action of agreeing with what the speaker has said. The gesture icon GI1 is generated by the icon generating unit 44. The expression generating unit 44 generates the expression when the analysis unit 42 judges that the other participants have a predetermined action or facial expression at a predetermined rate or more. An icon of the specified action or expression is generated.

[0051] The character icon LI1 is the gesture icon of all participants in the WEB conference. In the example shown in Figure 5, the character icon indicates the number of participants performing the action shown in GI1. In the example shown in FIG. 5, the character icon LI1 indicates “12 People.” Of the 25 other participants in "Video On Mode" and "Video Control Mode," 12 nodded in agreement. Indicates that an action is being performed.

[0052] In the example shown in FIG. 5, the icon I2B faces forward. This is because the second user is It shows that the speaker is not responding to the speaker's comments with positive actions or facial expressions. In the example shown in FIG. 5, icon I4B is tilted as if nodding. This means that the fourth user , indicates a positive gesture or facial expression in response to what the speaker is saying.

[0053] A method for reflecting a nodding motion in a gesture icon will be described with reference to FIG. FIG. 6 is a diagram for explaining a method of reflecting a nodding motion in a gesture icon.

[0054] As shown in FIG. 6, first, the display control unit 38 detects, for example, a gesture of tilting the screen as if nodding. The icon GI1 is displayed in the first action information display area 60 (step S1). The display control unit 38 may set, for example, the gesture icon GI1 facing forward as the first action information. The display control unit 38 displays the image in the display area 60 (step S2). The state of step S1 and the state of step S2 are switched every second to display the gesture. -Give icon GI1 a nodding motion to mirror the nodding motions of other participants in the web conference The display control unit 38 also displays the icon I4B shown in FIG. 5 in the manner shown in FIG. , it can reflect a nodding action.

[0055] In addition, in the display screen 20c shown in FIG. 5, when all 12 people are nodding, Not only that, but 12 people showed positive emotions, such as nodding and smiling. may be indicated.

[0056] FIG. 7 shows an example of a display of icons reflecting a ratio of a predetermined action or facial expression different from that shown in FIG. A display screen 20d shown in FIG. Specifically, the display screen 20d shown in FIG. 7 displays the image in response to the speaker's utterance. How to display positive and negative actions or percentages An example is shown in FIG. 7. In the example shown in FIG. 7, the method of displaying a positive action or percentage Since this method is the same as the method shown in FIG. 5, the explanation will be omitted.

[0057] As shown in FIG. 7, the display screen 20d includes a first display area 50B and a second display area 52B. , a third display area 54B, a fourth display area 56B, a first action information display area 60, and a second action information display area 62. The display screen 20d includes a second operation information display area 62. 5. In other words, it is different from the display screen 20c shown in FIG.

[0058] The second movement information display area 62 displays the movements or facial expressions of all the participants participating in the WEB conference. This is an area where information about the ratio is displayed. Specifically, the second action information display area 62 is This is the area that displays information about the proportion of negative actions or facial expressions toward the speaker. The second action information display area 62 includes a gesture icon GI2 and a character icon LI2. Includes.

[0059] Gesture icon GI2 represents the movements or facial expressions of participants participating in a web conference. Specifically, the gesture icon GI2 is an icon that indicates a gesture in response to the speaker's utterance. In the example shown in Figure 7, The gesture icon GI2 is an icon of shaking the head. The gesture icon GI2 indicates a gesture of disagreement with what the speaker has said. The icon GI2 is generated by the icon generating unit 44.

[0060] The character icon LI2 is the gesture icon of all participants in the WEB conference. In the example shown in Figure 7, the character icon indicates the number of participants performing the action shown in GI2. In the example shown in FIG. 7, the character icon LI2 indicates “8 People.” Of the 25 other participants in "video on mode" and "video control mode," 8 participants shook their heads. This indicates that the camera is shaking.

[0061] Using Figure 8, we will explain how to reflect the head shaking action on the gesture icon. Figure 8 shows how to reflect the head shaking action in the gesture icon. This is a diagram for explaining the method.

[0062] As shown in FIG. 8, first, the display control unit 38 performs a gesture action such as turning the face to the right. The icon GI2 is displayed in the second action information display area 62 (step S3). The control unit 38 may display, for example, a gesture icon GI2 in which the face is turned to the left as the second action information display. The display control unit 38 displays the image in the area 62 (step S4). The gesture action is performed by switching between the state of step S1 and the state of step S2 every second. Give the Ikon GI2 a head-shaking motion to shake the heads of other participants in a web conference. Reflect the action.

[0063] After step S16, step S20, or step S22, the control unit 24 performs the process shown in FIG. The control unit 24 determines whether or not to end the process (step S24). When the unit 16 receives an operation to end the process of FIG. 2 and an operation to turn off the power, If it is determined that the process is to be ended (step S24; Y es), the process of FIG. 2 is terminated. If it is not determined that the process is to be terminated (step S24; No), proceed to step S10. The end of the process determined in step S24 is, for example, The EB conference is over. Even if the WEB conference is not over, some users may still be in the WEB conference. When the connection with the user is terminated, the process of FIG. 2 for that user is terminated.

[0064] As described above, this embodiment is suitable for cases where video display is restricted during a web conference, etc. In addition, the icon of the user who has restricted the video display is displayed reflecting the user's actions or facial expressions. In this embodiment, other users participating in the WEB conference can view the camera images. Even if the user's reaction is not displayed, the user's reaction can be properly understood, and communication can be improved. This can facilitate smooth operations.

[0065] In addition, in the present embodiment, when video display is restricted in a web conference or the like, Participants who responded positively to the speaker's comments and participants who responded negatively In this way, the present embodiment displays the number of users who are participating in the Web conference. Even when the camera footage is not displayed, you can get a better understanding of the reactions of web participants.

[0066] Although the embodiments of the present invention have been described above, the present invention is not limited to the contents of these embodiments. In addition, the above-mentioned components are not those that a person skilled in the art can easily imagine, and are not substantially different from the above-mentioned components. In addition, the above-mentioned components are appropriately Furthermore, the above-described embodiments may be combined without departing from the spirit of the present invention. Various omissions, substitutions or modifications of components may be made. [Explanation of symbols]

[0067] 10. Video communication equipment 12 Camera 14 Microphones 16 Operation reception section 18 Communications Department 20 Display section 22 Audio output section 24 Control unit (video communication control device) 30 Video Acquisition Unit 32 Voice Acquisition Unit 34 Operation control section 36 Communication control section 38 Display control section 40 Audio output control unit 42 Analysis Department 44 Icon Generation Section

Claims

1. Acquire a person's speech or video from multiple other devices, When the number of the persons reaches or exceeds a predetermined number, an icon generated based on the number or the ratio of the persons exhibiting a predetermined action, a predetermined facial expression, or a predetermined reaction is displayed. Communications equipment.

2. The computer Acquire a person's speech or video from multiple other devices, When the number of the persons reaches or exceeds a predetermined number, an icon generated based on the number or the ratio of the persons exhibiting a predetermined action, a predetermined facial expression, or a predetermined reaction is displayed. Display method.

Citation Information

Patent Citations

  • Display apparatus, system, and display method

    JP2005354541A

  • Device, system, and program for supporting dialogue

    JP2020173714A

  • Web CONFERENCE SYSTEM, CONTROL METHOD THEREOF, AND PROGRAM

    JP2018093315A