Information processing device, information processing method, and information processing program

Abstract

To provide an information processing device, information processing method, and information processing program, which enable further streamlining of online meetings.SOLUTION: An information processing device disclosed herein comprises a determination unit and a participation processing unit. The determination unit determines meeting efficiency representing efficiency of an online meeting. The participation processing unit allows a specific user to virtually participate in an online meeting when the meeting efficiency determined by the determination unit fails to meet a predetermined condition.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing method, and an information processing program. [Background technology]

[0002] BACKGROUND ART In recent years, with the development of information processing technology, online conference technology using multiple terminal devices connected via a network has been attracting attention, and techniques for improving the efficiency of online conferences have been proposed.

[0003] For example, Patent Document 1 discloses a technology that supports the efficiency of online meetings by transmitting an online meeting screen that has been laid out so that a video chat screen, a sharing screen, and a communication screen other than the video chat screen are displayed side by side on a terminal device. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Publication No. 2022-074159 Summary of the Invention [Problem to be solved by the invention]

[0005] The above-mentioned conventional technology can support online conferences by transmitting an online conference screen that displays multiple screens to promote smooth two-way communication during online conferences, but there is room for improvement in terms of further improving the efficiency of online conferences.

[0006] The present application has been made in view of the above, and aims to provide an information processing device, an information processing method, and an information processing program that can further improve the efficiency of online conferences. [Means for solving the problem]

[0007] The information processing device according to the present application includes a determination unit and a participation processing unit. The determination unit determines conference efficiency, which is the efficiency of an online conference. If the conference efficiency determined by the determination unit does not satisfy a predetermined condition, the participation processing unit virtually allows a specific user to participate in the online conference. [Effects of the Invention]

[0008] According to one aspect of the embodiment, an effect is achieved in that the efficiency of online conferences can be further improved. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram for explaining an information processing method performed by an information processing device according to an embodiment. [Figure 2] FIG. 2 is a diagram illustrating an example of the configuration of an information processing system according to the embodiment. [Figure 3] FIG. 3 is a diagram illustrating an example of the configuration of the information processing device according to the embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of a user information table stored in a user information storage unit according to the embodiment. [Figure 5] FIG. 5 is a diagram illustrating an example of a conference information table stored in the conference information storage unit according to the embodiment. [Figure 6] FIG. 6 is a diagram illustrating an example of a meeting efficiency information table stored in the meeting efficiency information storage unit according to the embodiment. [Figure 7] FIG. 7 is a flowchart showing an example of information processing by the processing unit of the information processing device according to the embodiment. [Figure 8] FIG. 8 is a hardware configuration diagram illustrating an example of a computer that realizes the functions of the information processing device according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, modes for implementing an information processing device, an information processing method, and an information processing program according to the present application (hereinafter referred to as "embodiments") will be described in detail with reference to the drawings. Note that the information processing device, the information processing method, and the information processing program according to the present application are not limited to these embodiments. Furthermore, the respective embodiments can be appropriately combined within the scope of not causing any contradiction in the processing content. Furthermore, the same components in the following embodiments will be assigned the same reference numerals, and redundant explanations will be omitted.

[0011] [1. An example of information processing] First, an information processing method performed by the information processing device according to the embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram for explaining the information processing method performed by the information processing device according to the embodiment.

[0012] An information processing device 1 shown in Fig. 1 provides an online conference service. Such an online conference service is also called a Web conference service. Fig. 1 shows an example in which an online conference service is provided to users U1, U2, and U3 of terminal devices 21, 22, and 23. Hereinafter, when referring to multiple terminal devices including terminal devices 21, 22, and 23 without distinguishing between them, they may be referred to as terminal device 2, and when referring to multiple users including users U1, U2, and U3 without distinguishing between them, they may be referred to as user U.

[0013] Terminal device 21 transmits user information, which is information about user U1, to information processing device 1 (step S11), terminal device 22 transmits user information, which is information about user U2, to information processing device 1 (step S12), and terminal device 23 transmits user information, which is information about user U3, to information processing device 1 (step S13). Each terminal device 2 is equipped with a microphone, a camera, a display unit, a speaker, etc., and the user information includes real-time information such as audio information of user U collected in real time by the microphone and captured video information, which is information about video of user U captured in real time by the camera.

[0014] The information processing device 1 generates conference information based on the user information of users U1, U2, and U3 transmitted from terminal devices 21, 22, and 23 (step S2). The information processing device 1 generates the audio information in the conference information by mixing the audio information included in the user information of each user U. Note that the information processing device 1 can also select one piece of audio information from the audio information included in the user information of multiple users U and use it as the audio information in the conference information.

[0015] Furthermore, the information processing device 1 can convert voice information of the user U into text information by voice recognition, and convert the converted text information into voice information of a character designated by the user U by voice synthesis.

[0016] In addition, the speech synthesis of the information processing device 1 allows the speaking style (volume, speed, intonation (emphasis), speaking intervals (pauses), etc.) and sound quality to be adjusted using parameters, and the information processing device 1 can convert text information into audio information using speech synthesis with the speaking style and sound quality specified by the user U.

[0017] Furthermore, the information processing device 1 generates image information of the conference information using captured video information included in the user information of each user U. For example, the information processing device 1 performs image processing on a body image that is an image of the body of the user U included in the captured video information of the user U, to generate video information of the user U in the conference information.

[0018] For example, the information processing device 1 identifies the coordinates of each feature point from an image of the user U's body using a learning model or the like, and generates video information of the user U in the conference information by reconstructing the body of the user U in a three-dimensional space based on the identification results. The body of the user U is, for example, the face and neck of the user U, but may also include the torso, hands, arms, legs, etc. of the user U in addition to the face and neck of the user U.

[0019] Furthermore, the information processing device 1 can also generate video information of the user U in the conference information by, for example, transforming a three-dimensional body model of a character designated by the user U to fit a body shape estimated from an image of the user U. The character designated by the user U is shown as the avatar of the user U in the conference information. Each user U can designate a desired character from among multiple types of characters.

[0020] The information processing device 1 transmits the conference information generated in the process of step S2 to the terminal devices 21, 22, and 23, and causes the terminal devices 21, 22, and 23 to reproduce the conference information (steps S31, S32, and S33). The information processing device 1 repeats the processes of steps S11, S12, S13, S2, S31, S32, and S33, thereby providing an online conference service to users U1, U2, and U3.

[0021] 1(a), avatars of users U1, U2, and U3 are displayed on the conference screen displayed on each terminal device 2, but this is not limiting. For example, instead of the avatars of users U1, U2, and U3, the information processing device 1 can use captured video information of user U as is as the video information of user U included in the conference information, or can process the captured video information of user U using effect processing or the like to create video information of user U included in the conference information.

[0022] The information processing device 1 determines the efficiency of the online conference while providing the online conference service (step S4). Hereinafter, the efficiency of the online conference may be referred to as conference efficiency.

[0023] In the process of step S4, the information processing device 1 has, for example, meeting efficiency information that is information indicating the relationship between meeting efficiency and participating users of the online meeting, and determines the meeting efficiency based on the meeting efficiency information.

[0024] The meeting efficiency information includes, for example, information on meeting efficiency for each combination of users U for each meeting type. In the example shown in Figure 1, the information processing device 1 determines the meeting efficiency associated with the meeting type, which is a type of online meeting, among the meeting efficiencies associated with the combination of users U1, U2, and U3 in the meeting efficiency information as the meeting efficiency of the online meeting shown in Figure 1.

[0025] The meeting efficiency information is generated for each meeting type based on the meeting efficiency of past online meetings, for example. Note that the meeting efficiency information may include information on the meeting efficiency index value for each user U, instead of information on the meeting efficiency for each combination of users U. The meeting efficiency index value is a value that serves as an index of meeting efficiency. In this case, for example, the information processing device 1 may determine the sum of the meeting efficiency index values ​​of users U1, U2, and U3 as the meeting efficiency of the online conference shown in FIG.

[0026] The information processing device 1 can also determine the efficiency of a conference based on the number of comments per unit time in an online conference. For example, the information processing device 1 determines that the efficiency of a conference is lower as the number of comments per unit time in an online conference is lower.

[0027] The information processing device 1 can also determine the efficiency of a conference based on information indicating the efficiency of the online conference that is input by a user U participating in the online conference using the terminal device 2. For example, the information processing device 1 determines the average value of the efficiency of the online conference input by each of users U1, U2, and U3 shown in FIG. 1 as the efficiency of the conference.

[0028] The information processing device 1 can also determine the conference efficiency as the result of weighting the online conference efficiency input by each of the users U1, U2, and U3 shown in Fig. 1. The weight in the weighting is, for example, a value determined in advance for each user U, but may be a value that increases as the number of comments per unit time by the user U increases or decreases.

[0029] Furthermore, the information processing device 1 can determine the conference efficiency as a result of weighting and adding two or more of the conference efficiency corresponding to the combination of participating users, the number of remarks per unit time, and the conference efficiency input by user U. The weight in the weighting and addition in this case is a predetermined value, but is not limited to this example.

[0030] Next, the information processing device 1 determines whether the meeting efficiency determined in step S4 does not satisfy a predetermined condition (step S5). The predetermined condition is, for example, that the meeting efficiency is equal to or greater than a predetermined threshold, and the threshold is set for each type of meeting. If the meeting efficiency determined in step S4 is less than the threshold, the information processing device 1 determines that the meeting efficiency determined in step S4 does not satisfy the predetermined condition.

[0031] Furthermore, if the meeting efficiency determined in step S4 fluctuates while the online meeting is in progress, the predetermined condition may be, for example, a condition that the state in which the meeting efficiency is equal to or greater than a predetermined threshold does not occur more than a predetermined number of times, or a condition that the average value of the meeting efficiency is equal to or greater than a predetermined threshold.

[0032] Next, if the information processing device 1 determines that the meeting efficiency determined in step S4 does not satisfy the predetermined condition, it determines another user U who is estimated to improve the efficiency of the online meeting as a specific user (step S6).

[0033] In step S6, for example, the information processing device 1 can determine the specific user based on the meeting efficiency information. For example, the information processing device 1 determines, as the specific user, another user U whose meeting efficiency associated with the combination of multiple users U participating in the online conference is equal to or greater than a threshold, or another user U whose meeting efficiency associated with the combination of multiple users U participating in the online conference is the highest.

[0034] For example, in the example shown in Figure 1, another user U whose meeting efficiency associated with the combination of users U1, U2, and U3 is above a threshold value or another user U whose meeting efficiency associated with the combination of users U1, U2, and U3 is the highest is determined as the specific user.

[0035] Furthermore, the information processing device 1 can also determine, for example, a predetermined other user U as a specific user. For example, the information processing device 1 determines a predetermined other user U for each conference type or each combination of participating users as a specific user. Furthermore, the information processing device 1 can also determine, as a specific user, another user U whose total or weighted sum of conference efficiency index values ​​with users U1, U2, and U3 is equal to or greater than the above-described predetermined threshold.

[0036] Next, when it is determined in step S5 that the meeting efficiency does not satisfy the predetermined condition, the information processing device 1 virtually allows the specific user to participate in the online meeting (step S7). Virtually allowing the specific user to participate in the online meeting means including information about the specific user in the meeting information as if the specific user were participating in the online meeting without using the above-mentioned real-time information about the specific user.

[0037] For example, the information processing device 1 allows a specific user to virtually participate in an online conference by making the avatar of the specific user appear in the online conference. The avatar of the specific user is, for example, an avatar of a character designated by the specific user. In the example shown in FIG. 1(b), the conference screen displayed on each terminal device 2 displays the avatar of the specific user in addition to the avatars of users U1, U2, and U3.

[0038] The information processing device 1 stores, for example, multiple types of preset information that are information indicating actions (body movements and speech) set in advance by specific users. The multiple types of preset information are, for example, preset information for each situation of a conference, such as information indicating an action of nodding in response to a statement made by a participating user, information indicating an action of encouraging the participating user to speak, information indicating an action of praising the participating user, and the like, but are not limited to these examples.

[0039] The information processing device 1 can make the avatar of a specific user appear in an online conference by including conversion information, which converts pre-set information into the behavior of the avatar of the specific user, in the conference information. The conversion information is information such as audio information and video information of the avatar. Note that the information processing device 1 can also make the specific user appear in an online conference by using the pre-set information as is without converting it.

[0040] The information processing device 1 can also make a specific user's avatar appear in the online conference so that it can be operated by some of the participating users of the online conference. For example, some of the participating users can select desired preset information from multiple types of preset information, and the information processing device 1 can include conversion information in the conference information, in which the preset information selected by some of the participating users is converted into the behavior of the specific user's avatar. In this case, the information processing device 1 can also make the specific user appear in the online conference using the preset information as is without converting it.

[0041] Furthermore, the information processing device 1 can include, in the conference information, conversion information obtained by converting the user information of some of the participating users into the behavior of the avatar of a specific user. The some of the participating users are the participating users who host the conference, but are not limited to this example, and may be, for example, the participating users who make the most comments, or the participating users other than the participant user with the highest conference efficiency index value.

[0042] Furthermore, the information processing device 1 notifies the specific user of virtual participation information, which is information indicating that the specific user is virtually participating in the online conference (step S8). For example, the information processing device 1 notifies the specific user of the virtual participation information by sending the virtual participation information to the specific user's terminal device 2 or the specific user's email address. This allows the specific user to understand that the virtual participation information has been used virtually to improve the efficiency of the online conference in which the specific user is not actually participating.

[0043] In this way, the information processing device 1 determines the meeting efficiency, which is the efficiency of the online conference, and if it determines that the meeting efficiency does not satisfy the predetermined condition, virtually allows the specific user to participate in the online conference. As a result, the users U participating in the online conference are more likely to try to improve the efficiency of the online conference due to the presence of the specific user, and the information processing device 1 can further improve the efficiency of the online conference.

[0044] The configuration of an information processing system including the information processing device 1 and terminal device 2 that perform such processing will be described in detail below.

[0045] [2. Information Processing System Configuration] 2 is a diagram showing an example of the configuration of an information processing system according to an embodiment. As shown in FIG. 2, the information processing system 100 according to the embodiment includes an information processing device 1 that provides an online conference service, and a plurality of terminal devices 21 to 22 that are owned by a plurality of users U that participate in the online conference service. n The terminal device 2 includes a plurality of terminal devices 2 including n, where n is an integer of 3 or more, for example.

[0046] The information processing device 1 and the multiple terminal devices 2 are connected to each other via a network N so as to be able to communicate with each other via a wired or wireless connection. The information processing system 100 shown in Fig. 2 may include multiple information processing devices 1. The network N is, for example, a LAN (Local Area Network) or a WAN (Wide Area Network) such as the Internet.

[0047] Each terminal device 2 is equipped with a microphone, a camera, a display unit, a speaker, etc. Each terminal device 2 transmits real-time information including voice information of the user U collected in real time by the microphone and captured video information which is information on video of the user U captured in real time by the camera to the information processing device 1 via the network N.

[0048] In addition, each terminal device 2 receives conference information transmitted from the information processing device 1 via the network N, displays the video information contained in the conference information on a display unit not shown, and outputs the audio information contained in the conference information from a speaker.

[0049] Each terminal device 2 is, for example, a desktop PC (Personal Computer), a notebook PC, a tablet terminal, a smartphone, a mobile phone, or a PDA (Personal Digital Assistant). Each terminal device 2 is operated by a user U. Note that each terminal device 2 is not limited to the above-mentioned examples, and may be, for example, a wearable device.

[0050] In addition, the terminal device 2 can connect to the network N via a wireless communication network such as LTE (Long Term Evolution), 4G (4th Generation), or 5G (5th Generation: 5th generation mobile communication system), or via short-range wireless communication such as Bluetooth (registered trademark) or wireless LAN, and communicate with the information processing device 1.

[0051] 3. Configuration of Information Processing Device 1 The following describes an example of the functional configuration of the information processing device 1. Fig. 3 is a diagram showing an example of the configuration of the information processing device 1 according to an embodiment. As shown in Fig. 3, the information processing device 1 has a communication unit 10, a storage unit 11, and a processing unit 12.

[0052] [3.1. Communication Unit 10] The communication unit 10 is realized by, for example, a network interface card (NIC). The communication unit 10 is connected to a network N by wire or wirelessly, and transmits and receives information to and from various other devices. For example, the communication unit 10 transmits and receives information to and from each of a plurality of terminal devices 2 via the network N.

[0053] [3.2. Storage section 11] The storage unit 11 is realized by, for example, a semiconductor memory element such as a random access memory (RAM) or a flash memory, or a storage device such as a hard disk or an optical disk. The storage unit 11 also has a user information storage unit 20, a meeting information storage unit 21, and a meeting efficiency information storage unit 22.

[0054] 3.2.1. User Information Storage Unit 20 The user information storage unit 20 stores various types of information related to the user U. Fig. 4 is a diagram showing an example of a user information table stored in the user information storage unit 20 according to the embodiment. In the example shown in Fig. 4, the user information table stored in the user information storage unit 20 includes information on items such as "user ID (identifier)," "attribute information," and "history information."

[0055] "User ID" is an identifier that identifies user U. "Attribute information" is attribute information related to the attributes of user U that is associated with "user ID." The attributes of user U include, for example, demographic attributes and psychographic attributes. Demographic attributes are demographic attributes, such as age, gender, affiliation, occupation, place of residence, annual income, and family composition. Psychographic attributes are psychological attributes, such as lifestyle, values, and interests.

[0056] "History information" is information such as the usage history of the online conference service of user U associated with "user ID," and includes information such as the conference ID of online conferences that user U previously participated in, the date and time of the conference, and the participation results of user U. The participation results of user U include information such as the number of comments made by user U in online conferences and the content of the comments.

[0057] The information stored in the user information storage unit 20 is not limited to the above and may include various types of information depending on the purpose. For example, the information stored in the user information storage unit 20 may include information indicating the context history of the user U.

[0058] 3.2.2. Conference Information Storage Unit 21 The conference information storage unit 21 stores various types of information related to reserved online conferences. Fig. 5 is a diagram showing an example of a conference information table stored in the conference information storage unit 21 according to the embodiment.

[0059] In the example shown in FIG. 5, the conference information table stored in the conference information storage unit 21 includes information items such as "conference ID," "user ID," "held date and time," and "host." "Conference ID" is an identifier that identifies an online conference. "User ID" is the user ID of a user U who will participate in the online conference associated with the "conference ID." "held date and time" is information that indicates the held date and time of the online conference associated with the "conference ID."

[0060] "Host" is the user ID of the user U who hosts the online conference associated with the "Conference ID." Note that the information stored in the conference information storage unit 21 is not limited to the above and may include various information depending on the purpose.

[0061] 3.2.3. Meeting Efficiency Information Storage Unit 22 The meeting efficiency information storage unit 22 stores meeting efficiency information, which is information indicating the relationship between meeting efficiency and participating users of an online meeting. Fig. 6 is a diagram showing an example of a meeting efficiency information table stored in the meeting efficiency information storage unit 22 according to the embodiment.

[0062] 6, the meeting efficiency information table stored in the meeting efficiency information storage unit 22 includes information on the items of "combination ID," "user ID," and "efficiency." The "combination ID" is an identifier that identifies a user combination, which is a combination of multiple users U.

[0063] "User ID" is the user ID of multiple users U who make up the user combination associated with the "combination ID." "Efficiency" is information indicating the predicted conference efficiency when multiple users U who make up the user combination associated with the "combination ID" hold an online conference. Conference efficiency is indicated, for example, within the range from 0 to 1, with the larger the value, the higher the conference efficiency.

[0064] The above-described meeting efficiency information table is stored in the meeting efficiency information storage unit 22 for each meeting type. The meeting type is, for example, a regular meeting such as a business report, a development meeting, a business improvement meeting, or an employee training meeting, depending on the content of the meeting subject, but is not limited to these examples. For example, the meeting type may be a type depending on the length of the meeting, a type depending on the time of day, a type depending on the day of the week, or a type based on a combination of two or more of the meeting content, the length of the meeting, the time of day, and the day of the week, or any other type.

[0065] In this way, the meeting efficiency information storage unit 22 stores information on the meeting efficiency for each combination of users U for each meeting type. Note that the information stored in the meeting efficiency information storage unit 22 is not limited to the above, and may include various information depending on the purpose.

[0066] [3.3. Processing Unit 12] The processing unit 12 is a controller, and is realized by a processor such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit) using RAM as a work area to execute various programs (one example of an information processing program) stored in a storage device inside the information processing device 1. The processing unit 12 is also a controller, and is realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0067] 3, the processing unit 12 has an acquisition unit 30, a reception unit 31, a determination unit 32, an estimation unit 33, a conference processing unit 34, and a notification unit 35, and realizes or executes the functions and actions of information processing described below. Note that the internal configuration of the processing unit 12 is not limited to the configuration shown in FIG. 3, and may be any other configuration as long as it performs the information processing described below.

[0068] [3.3.1. Acquisition part 30] The acquisition unit 30 acquires various types of information. The acquisition unit 30 acquires various types of information from the storage unit 11. The acquisition unit 30 acquires various types of information from the user information storage unit 20, the conference information storage unit 21, the conference efficiency information storage unit 22, etc.

[0069] The acquisition unit 30 receives various information from an external information processing device via the communication unit 10. The acquisition unit 30 receives various information from the terminal device 2. For example, the acquisition unit 30 acquires information about the user U from the terminal device 2, stores the acquired information about the user U in the user information storage unit 20, and updates the user information table.

[0070] Furthermore, the acquisition unit 30 acquires information related to the online conference from the terminal device 2 or other external devices, and stores the acquired information related to the online conference in the conference information storage unit 21 to update the conference information table. Furthermore, the acquisition unit 30 acquires information related to the efficiency of the online conference from the terminal device 2 or other external devices, and stores the acquired information related to the efficiency of the online conference in the conference efficiency information storage unit 22 to update the conference efficiency information table.

[0071] [3.3.2. Reception Unit 31] The reception unit 31 receives various requests. The reception unit 31 receives various requests from the terminal device 2. The reception unit 31 receives information indicating the various requests from the terminal device 2 via the communication unit 10.

[0072] For example, the reception unit 31 receives a conference participation request, a conference setting request, etc. from the terminal device 2. The conference participation request includes information such as a conference ID, and the conference setting request includes the user ID of a user U who will participate in the online conference, information on the date and time of the conference, and the user ID of the user U who will host the online conference.

[0073] The conference setting request does not necessarily include the user ID of the user U who will participate in the online conference. In this case, when the user U participates in the online conference, the reception unit 31 adds the user ID of the user U who participated in the online conference to the conference information table stored in the conference information storage unit 21.

[0074] [3.3.3. Judgment unit 32] The determining unit 32 determines the meeting efficiency, which is the efficiency of the online meeting. For example, the determining unit 32 determines the meeting efficiency based on the meeting efficiency information stored in the meeting efficiency information storage unit 22.

[0075] 6 is used, and the combination of participating users in the online conference is a combination with a combination ID of "G1," that is, a combination of a user U with a user ID of "U1," a user U with a user ID of "U2," and a user U with a user ID of "U3." In this case, the determination unit 32 determines that the conference efficiency is "0.8."

[0076] The meeting efficiency information is generated for each meeting type based on the meeting efficiency of past online meetings, for example. Note that the meeting efficiency information may include information on the meeting efficiency index value for each user U, instead of information on the meeting efficiency for each combination of users U. The meeting efficiency index value is a value that serves as an index of meeting efficiency, and in this case, for example, the determination unit 32 may determine the meeting efficiency as a value obtained by adding up the meeting efficiency index values ​​of the users U participating in the online meeting.

[0077] The determination unit 32 can also determine the efficiency of a conference based on the number of comments per unit time in an online conference. For example, the determination unit 32 determines that the efficiency of a conference is lower as the number of comments per unit time in an online conference is lower.

[0078] The determination unit 32 can also determine the conference efficiency based on information indicating the efficiency of the online conference that is input by a user U participating in the online conference using the terminal device 2. For example, the determination unit 32 determines the conference efficiency to be the average value of the online conference efficiencies input by a plurality of users U participating in the online conference.

[0079] The determination unit 32 can also determine the conference efficiency as the result of weighting the online conference efficiencies input by multiple users U participating in the online conference. The weight in the weighting is, for example, a value determined in advance for each user U, but may be a value that increases as the number of comments per unit time by the user U increases or decreases.

[0080] Furthermore, the determination unit 32 can determine the conference efficiency as the result of weighting two or more of the conference efficiency corresponding to the combination of participating users, the number of comments per unit time, and the conference efficiency input by user U. The weight in the weighting in this case is a predetermined value, but is not limited to this example.

[0081] The determination unit 32 determines whether the meeting efficiency determined as described above does not satisfy a predetermined condition. The predetermined condition is, for example, that the meeting efficiency is equal to or greater than a predetermined threshold, and the threshold is set for each type of meeting. For example, if the meeting efficiency is less than the threshold, the determination unit 32 determines that the meeting efficiency does not satisfy the predetermined condition.

[0082] In addition, when the meeting efficiency fluctuates while the online meeting is in progress, the predetermined condition may be, for example, a condition that the state in which the meeting efficiency is equal to or greater than a predetermined threshold does not occur more than a predetermined number of times, or a condition that the average value of the meeting efficiency is equal to or greater than a predetermined threshold.

[0083] [3.3.4. Estimation part 33] The estimation unit 33 estimates other users U who improve the meeting efficiency for each meeting type, which is the type of online meeting, as efficiency-improving users. The other users U are users U who are not participating in the online meeting for which the meeting efficiency is to be improved, and users U who are not participating in other online meetings, but may also be users U who are participating in other online meetings.

[0084] For example, the estimation unit 33 can estimate an efficiency-improvement user based on the meeting efficiency information stored in the meeting efficiency information storage unit 22. For example, the estimation unit 33 estimates, as an efficiency-improvement user, another user U whose meeting efficiency associated with a combination of multiple users U participating in an online meeting is equal to or greater than a threshold, or another user U whose meeting efficiency associated with a combination of multiple users U participating in an online meeting is the highest.

[0085] Assume that users U1, U2, and U3 are participating in an online conference whose efficiency is to be improved. In addition, assume that, in the conference efficiency information table, the conference efficiency associated with the combination of users U1, U2, U3, and U4 is "0.7," the conference efficiency associated with the combination of users U1, U2, U3, and U5 is "0.8," and the conference efficiency associated with the combination of users U1, U2, U3, and U6 is "0.9." Furthermore, assume that the threshold is "0.8." In this case, the estimation unit 33 estimates user U4 or U5 or user U5 as an efficiency-improvement user.

[0086] The estimation unit 33 can also estimate, for example, predetermined other users U as efficiency-improvement users. For example, the estimation unit 33 estimates predetermined other users U as efficiency-improvement users for each conference type or each combination of participating users. The estimation unit 33 can also estimate, as efficiency-improvement users, other users U whose total or weighted sum of conference efficiency index values ​​with multiple users U participating in the online conference is equal to or greater than the above-described predetermined threshold.

[0087] [3.3.5. Conference Processing Unit 34] The conference processing unit 34 receives user information, which is information about multiple users U, from multiple terminal devices 2 via the network N and the communication unit 10. The user information includes real-time information such as voice information of the users U collected in real time by a microphone and captured video information, which is information about videos of the users U captured in real time by a camera.

[0088] The conference processing unit 34 generates conference information based on the received user information of the multiple users U. The conference processing unit 34 generates the audio information in the conference information by mixing the audio information included in the user information of each user U. Note that the conference processing unit 34 can also select one piece of audio information from the audio information included in the user information of the multiple users U and use it as the audio information in the conference information.

[0089] Furthermore, the conference processing unit 34 can convert the voice information of the user U into text information by voice recognition, and convert the converted text information into voice information of a character designated by the user U by voice synthesis.

[0090] In addition, the speech synthesis of the conference processing unit 34 can adjust the speaking style (volume, speed, intonation (emphasis), speech intervals (pauses), etc.) and sound quality using parameters, and the conference processing unit 34 can convert text information into audio information by speech synthesis using the speaking style and sound quality specified by the user U.

[0091] Furthermore, the conference processing unit 34 generates image information of the conference information using captured video information included in the user information of each user U. For example, the conference processing unit 34 performs image processing on a body image that is an image of the body of the user U included in the captured video information of the user U, to generate video information of the user U in the conference information.

[0092] For example, the conference processing unit 34 identifies the coordinates of each feature point from an image of the user U's body using a learning model or the like, and generates video information of the user U in the conference information by reconstructing the body of the user U in a three-dimensional space based on the identification results. The body of the user U is, for example, the face and neck of the user U, but may also include the torso, hands, arms, legs, etc. of the user U in addition to the face and neck of the user U.

[0093] The conference processing unit 34 can also generate video information of the user U in the conference information by, for example, transforming a three-dimensional body model of a character designated by the user U so that it matches a body shape estimated from an image of the user U's body. The character designated by the user U is shown as the user U's avatar in the conference information. Each user U can designate a desired character from among multiple types of characters.

[0094] The conference processing unit 34 transmits the generated conference information to the plurality of terminal devices 2 via the communication unit 10 and the network N, and repeats the process of causing the plurality of terminal devices 2 to play back the conference information, thereby providing an online conference service to the plurality of users U. Note that the conference processing unit 34 changes the position and size of the video information of the user U that constitutes the conference screen for each user U, but is not limited to this example.

[0095] 3, the conference processing unit 34 includes a participation processing unit 40. When the determination unit 32 determines that the conference efficiency does not satisfy a predetermined condition, the participation processing unit 40 virtually causes an efficiency improvement user estimated by the estimation unit 33 to participate in the online conference as a specific user.

[0096] Virtually allowing a specific user to participate in an online conference means including information about the specific user in the conference information as if the specific user were participating in the online conference without using the above-mentioned real-time information about the specific user.

[0097] For example, the participation processing unit 40 causes an avatar of the specific user to appear in the online conference, thereby virtually allowing the specific user to participate in the online conference. The avatar of the specific user is, for example, an avatar of a character designated by the specific user.

[0098] The participation processing unit 40 stores, for example, multiple types of preset information, which is information indicating actions (body movements and speech) set in advance by specific users. The multiple types of preset information are, for example, preset information for each situation of the conference, such as information indicating actions of nodding in response to comments made by participating users, information indicating actions of encouraging participating users to speak, information indicating actions of praising participating users, and the like, but are not limited to these examples.

[0099] The participation processing unit 40 can make a specific user's avatar appear in an online conference by including conversion information, which converts pre-set information into the behavior of the specific user's avatar, in the conference information. The conversion information is information such as audio information and video information of the avatar.

[0100] For example, the participation processing unit 40 can determine preset information corresponding to the progress of the online conference from multiple types of preset information, and include converted information obtained by converting the determined preset information into the behavior of a specific user's avatar in the conference information. The progress of the online conference can be determined, for example, by the number of comments per unit time, the facial expressions of participating users, the tone of their speech, etc.

[0101] The participation processing unit 40 can also make a specific user's avatar appear in the online conference so that it can be operated by some of the participating users of the online conference. For example, some of the participating users can select desired preset information from multiple types of preset information, and the participation processing unit 40 can include conversion information in the conference information that converts the preset information selected by some of the participating users into the behavior of the specific user's avatar. Note that the participation processing unit 40 can also make a specific user appear in the online conference using the preset information as is without converting it.

[0102] The participation processor 40 can also include in the conference information conversion information obtained by converting the user information of some participating users into the behavior of the avatar of a specific user. The some participating users are the participating users who host the conference, but are not limited to this example. For example, the some participating users may be the participating users who make the most comments, or the participating users other than the participant user with the highest conference efficiency index value. In this case, the participation processor 40 can also make the specific user appear in the online conference by using the pre-set information as is without converting it.

[0103] Furthermore, the participation processing unit 40 can also include in the conference information conversion information obtained by converting the user information of some of the participating users into the behavior of the avatar of a specific user. The some of the participating users are the participant users who host the conference, but are not limited to this example, and may be, for example, the participant user who made the most comments, or a participant user other than the participant user with the highest conference efficiency index value.

[0104] After virtually allowing a specific user to participate in an online conference, if the conference efficiency satisfies a preset cancellation condition, the participation processing unit 40 terminates the virtual specific user's participation in the online conference by making the specific user's avatar disappear from the online conference. The preset cancellation condition is, for example, a condition that the conference efficiency is equal to or greater than a predetermined threshold, and the threshold is set for each conference type.

[0105] Furthermore, if the conference efficiency does not satisfy a predetermined condition within a predetermined period of time after virtually allowing a specific user to participate in an online conference, the participation processing unit 40 can raise the tone of the speech from the specific user's avatar or change the facial expression of the specific user's avatar to a negative one, such as an angry or sad expression.

[0106] [3.3.6. Notification section 35] The notification unit 35 notifies the specific user, who has been estimated by the estimation unit 33 as an efficiency improvement user, of virtual participation information, which is information indicating participation in a virtual online conference.

[0107] For example, the notification unit 35 notifies the specific user of the virtual participation information by sending the virtual participation information to the specific user's terminal device 2 or the specific user's email address, thereby allowing the specific user to understand that the virtual participation information was used virtually to improve the efficiency of an online conference in which the specific user did not actually participate.

[0108] [4. Processing Procedure] Next, a procedure of information processing by the processing unit 12 of the information processing device 1 according to the embodiment will be described. Fig. 7 is a flowchart showing an example of information processing by the processing unit 12 of the information processing device 1 according to the embodiment. The processing shown in Fig. 7 is repeatedly executed by the processing unit 12.

[0109] 7, the processing unit 12 of the information processing device 1 determines whether a meeting efficiency timing has arrived (step S10). The meeting efficiency timing is, for example, a timing that arrives at a predetermined cycle, but is not limited to this example. For example, the meeting efficiency timing may be a timing that occurs when the number of utterances per unit time falls below a threshold, or may be another timing.

[0110] When the processing unit 12 determines that the meeting efficiency timing has arrived (step S10: Yes), the processing unit 12 determines the meeting efficiency, which is the efficiency of the online meeting (step S11). Then, the processing unit 12 determines whether the meeting efficiency determined in step S11 satisfies a predetermined condition (step S12).

[0111] If the processing unit 12 determines that the meeting efficiency does not satisfy the predetermined condition (step S12: No), it estimates another user U who improves the meeting efficiency as an efficiency-improving user and determines the estimated efficiency-improving user as a specific user (step S13). Then, the processing unit 12 performs a process of virtually having the specific user participate in the online meeting (step S14).

[0112] The processing unit 12 terminates the processing shown in FIG. 7 when the processing of step S14 is completed, when it determines that the meeting efficiency timing has not arrived (step S10: No), or when it determines that the meeting efficiency satisfies the predetermined condition (step S12: Yes).

[0113] [5. Hardware Configuration] The information processing device 1 according to the embodiment described above is realized by, for example, a computer 80 configured as shown in Fig. 8. Fig. 8 is a hardware configuration diagram showing an example of the computer 80 that realizes the functions of the information processing device 1 according to the embodiment. The computer 80 has a CPU 81, a RAM 82, a ROM (Read Only Memory) 83, an HDD (Hard Disk Drive) 84, a communication interface (I / F) 85, an input / output interface (I / F) 86, and a media interface (I / F) 87.

[0114] The CPU 81 operates and controls each part based on programs stored in the ROM 83 or the HDD 84. The ROM 83 stores a boot program executed by the CPU 81 when the computer 80 starts up, programs that depend on the hardware of the computer 80, and the like.

[0115] The HDD 84 stores programs executed by the CPU 81, data used by such programs, etc. The communication interface 85 receives data from other devices via the network N (see FIG. 2) and sends it to the CPU 81, and transmits data generated by the CPU 81 to other devices via the network N.

[0116] The CPU 81 controls output devices such as a display and a printer, and input devices such as a keyboard and a mouse, via the input / output interface 86. The CPU 81 acquires data from the input devices via the input / output interface 86. The CPU 81 also outputs generated data to the output devices via the input / output interface 86.

[0117] The media interface 87 reads a program or data stored in a recording medium 88 and provides it to the CPU 81 via the RAM 82. The CPU 81 loads the program or data from the recording medium 88 onto the RAM 82 via the media interface 87 and executes the loaded program. The recording medium 88 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or a PD (Phase Change Rewritable Disc), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory.

[0118] For example, when the computer 80 functions as the information processing device 1 according to the embodiment, the CPU 81 of the computer 80 executes programs loaded onto the RAM 82 to realize the functions of the processing unit 12. In addition, the HDD 84 stores data in the storage unit 11. The CPU 81 of the computer 80 reads and executes these programs from a recording medium 88, but as another example, the CPU 81 may obtain these programs from another device via the network N.

[0119] [6. Other] Furthermore, among the processes described in the above embodiments, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically using known methods. In addition, the information including the processing procedures, specific names, various data, and parameters shown in the above documents and drawings can be changed as desired unless otherwise specified. For example, the various information shown in each drawing is not limited to the information shown in the drawings.

[0120] Furthermore, the components of each device shown in the figure are conceptual functional components and do not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit depending on various loads, usage conditions, etc.

[0121] For example, the information processing device 1 described above may be realized by a plurality of server computers, and depending on the function, the configuration can be flexibly changed, such as by calling an external platform using an API or network computing.

[0122] Furthermore, the above-described embodiments and modifications can be combined as appropriate within the scope of not causing any contradiction in the processing content.

[0123] [7. Effects] As described above, the information processing device 1 according to the embodiment includes the determination unit 32 and the participation processing unit 40. The determination unit 32 determines the meeting efficiency, which is the efficiency of an online conference. If the meeting efficiency determined by the determination unit 32 does not satisfy a predetermined condition, the participation processing unit 40 virtually allows a specific user to participate in the online conference. This allows the information processing device 1 to further improve the efficiency of online conferences.

[0124] Furthermore, the participation processing unit 40 causes the avatar of the specific user to appear in the online conference, thereby enabling the information processing device 1 to further improve the efficiency of the online conference.

[0125] Furthermore, the participation processing unit 40 makes the avatar of a specific user appear in the online conference so that it can be operated by some of the participating users of the online conference. This allows the information processing device 1 to further improve the efficiency of the online conference.

[0126] The participation processing unit 40 also includes an estimation unit 33 that estimates a user U who improves conference efficiency as a specific user, thereby enabling the information processing device 1 to further improve the efficiency of online conferences.

[0127] Furthermore, the estimation unit 33 estimates a user U who improves the efficiency of a conference for each type of online conference as a specific user, thereby enabling the information processing device 1 to further improve the efficiency of online conferences.

[0128] The information processing device 1 also includes a notification unit 35 that notifies the specific user estimated by the estimation unit 33 of information indicating participation in a virtual online conference, to the specific user. This enables the information processing device 1 to further improve the efficiency of online conferences.

[0129] Furthermore, the determination unit 32 determines the meeting efficiency from the participating users of the online conference based on information indicating the relationship between the meeting efficiency and the participating users of the online conference, thereby enabling the information processing device 1 to further improve the efficiency of the online conference.

[0130] Furthermore, the determination unit 32 determines the efficiency of the conference based on the number of comments per unit time, thereby enabling the information processing device 1 to further improve the efficiency of the online conference.

[0131] Furthermore, the determination unit 32 determines the conference efficiency based on information indicating the efficiency of the online conference input by the participating users in the online conference, thereby enabling the information processing device 1 to further improve the efficiency of the online conference.

[0132] The above describes the embodiments of the present application in detail based on the drawings, but this is merely an example, and the present invention can be implemented in other forms that include the embodiments described in the Disclosure of the Invention section and that have been modified and improved in various ways based on the knowledge of those skilled in the art.

[0133] Furthermore, the above-mentioned "section, module, unit" can be read as "means" or "circuit," etc. For example, an acquisition unit can be read as an acquisition means or an acquisition circuit. [Explanation of symbols]

[0134] 1. Information processing equipment 2,21~2 n terminal device 10. Communications Department 11 Storage section 12 Processing section 20 User information storage unit 21 Conference information storage unit 22 Meeting Efficiency Information Storage Unit 30 Acquisition Department 31 Reception 32 Judgment section 33 Estimation part 34 Conference Processing Unit 35 Notification Department 40 Participation Processing Unit 100 Information Processing Systems

Claims

1. A determination unit that determines the meeting efficiency, which is the efficiency of the online conference, based on one or more of information indicating the relationship between meeting efficiency and users, information on participating users of the online conference, the number of comments per unit time in the online conference, and information indicating the efficiency of the online conference input by participating users in the online conference; a participation processing unit that, when the relationship between the meeting efficiency determined by the determination unit and a predetermined threshold does not satisfy a predetermined condition, causes an avatar of the specific user to virtually participate in the online conference by making the specific user appear in the online conference.

1. An information processing device comprising:

2. The joining processing unit The avatar of the specific user is made to appear in the online conference so as to be operable by some of the participating users of the online conference.

2. The information processing apparatus according to claim 1, wherein:

3. The joining processing unit an estimation unit that estimates a user who improves the efficiency of the meeting as the specific user; The user who improves the efficiency of the meeting is The other user is a user whose meeting efficiency associated with a combination of multiple users participating in the online conference is equal to or greater than a threshold value, a user whose meeting efficiency is the highest associated with a combination of multiple users participating in the online conference, a user who is predetermined for each type of online conference or each combination of multiple users participating in the online conference, or a user whose total or weighted sum of meeting efficiency index values ​​with multiple users participating in the online conference is equal to or greater than a threshold value or is the highest.

3. The information processing apparatus according to claim 1, wherein the information processing apparatus is a computer.

4. a notification unit that notifies the specific user estimated by the estimation unit of information indicating the specific user's virtual participation in the online conference; 4. The information processing apparatus according to claim 3,

5. The predetermined condition is: The condition is that the meeting efficiency is equal to or greater than a predetermined threshold, or the condition is that the average value of the meeting efficiency is equal to or greater than a predetermined threshold.

3. The information processing apparatus according to claim 1, wherein the information processing apparatus is a computer.

6. 1. A computer-implemented information processing method, comprising: a determination step of determining conference efficiency, which is the efficiency of the online conference, based on one or more of information indicating a relationship between conference efficiency and users, information on participating users of the online conference, the number of comments per unit time in the online conference, and information indicating the efficiency of the online conference input by participating users in the online conference; and a participation processing step of virtually having the specific user participate in the online conference by making an avatar of the specific user appear in the online conference when the relationship between the conference efficiency determined in the determination step and a predetermined threshold does not satisfy a predetermined condition.

1. An information processing method comprising:

7. A determination procedure for determining the meeting efficiency, which is the efficiency of the online conference, based on one or more of information indicating the relationship between meeting efficiency and users, information on participating users of the online conference, the number of comments per unit time in the online conference, and information indicating the efficiency of the online conference input by participating users in the online conference; and a participation processing procedure for virtually allowing a specific user to participate in the online conference by making an avatar of the specific user appear in the online conference, if the relationship between the conference efficiency determined by the determination procedure and a predetermined threshold does not satisfy a predetermined condition. An information processing program characterized by:

Images