Multi-user audio and video system and method

Abstract

The embodiment of the invention provides a multi-user audio and video system and method, in the scheme, a user terminal receives and analyzes data sent by a server side, and a scheduling control unit of the server side controls interaction of audio and video data with each user terminal, so that the multi-user audio and video is realized. And scheduling each user to realize audio and video chat with the user with another feature in turn. Visibly, in the scheme, each user completes the audio and video chat with a plurality of other users participating in the activity, and the problems that mutual interference is generated by communication and the sound source cannot be distinguished are solved.

Description

Technical Field

[0001] The present invention relates to the field of audio and video chat, and in particular to a multi-person audio and video system and method. Background Art

[0002] At present, the multi-person audio and video technology is mostly used in the needs of multi-person audio and video conferences. In this scenario, one person is often speaking and other users are listening. At most, only a few people speak at the same time. When there are many people speaking at the same time, it is often impossible to distinguish which person is the source of the sound. This multi-person audio and video technology cannot solve the scenarios of multi-person audio and video scenes such as job fairs, singles dating meetings, volunteer application meetings, and question-and-answer sessions where multiple people communicate at the same time. If it is still applied according to the existing multi-person audio and video technology, the interference is so great that it is impossible to distinguish the source of the sound, and the purpose of multi-person audio and video activities cannot be achieved. Summary of the invention

[0003] The purpose of the embodiments of the present invention is to provide a multi-person audio and video system and method to solve the problem that multiple people communicating simultaneously in a multi-person audio and video scene will interfere with each other and the sound source cannot be distinguished.

[0004] To achieve the above object, an embodiment of the present invention provides a multi-person audio and video system, including: a user terminal and a server, wherein:

[0005] The user terminal is used to collect, receive, send and output audio and video data;

[0006] The server side includes a data collection unit, a data transceiver unit, and a scheduling control unit, wherein:

[0007] The data collection unit is used to collect audio and video data from the user terminal;

[0008] The data transceiver unit is used for connection and data exchange between the user terminal and the server;

[0009] The scheduling control unit is used to classify the users performing audio and video into first characteristic users and second characteristic users according to preset characteristic classification;

[0010] By controlling the interaction of audio and video data with each user terminal, each user is scheduled to take turns to realize audio and video chat with another feature user.

[0011] Optionally, the scheduling control unit is further used to group the users with the first characteristic, with the number of people in each group not exceeding the first preset upper limit of the number of people, and to group the users with the second characteristic, with the number of people in each group not exceeding the second preset upper limit of the number of people;

[0012] The scheduling controls the rotation of the group of each feature to realize audio and video chat with the group of another feature.

[0013] Optionally, the scheduling control unit is further used to obtain the minimum number of first feature groups according to the number of first feature users and the first preset upper limit of the number of people, and to obtain the minimum number of second feature groups according to the number of second feature users and the second preset upper limit of the number of people;

[0014] The larger number of groups between the minimum number of first feature groups and the minimum number of second feature groups is taken as the number of groups when grouping the first feature users and the second feature users.

[0015] Optionally, the scheduling control unit is further used to, during the process of rotating audio and video, when a new user enters the audio and video system, identify the characteristics of the user according to a preset characteristic classification;

[0016] Determine whether the number of groups of the feature to which the user who has just entered the audio and video system belongs is less than the number of groups of another feature. If so, the newly entered user is divided into a new group, and the waiting group in the other feature is selected for audio and video chat. If not, continue to determine whether all the groups in the feature to which the newly entered user belongs have reached the preset upper limit of the number of people when grouping the feature. If not, select any group that has not reached the preset upper limit of the number of people, and divide the newly entered user into this group, and have audio and video chat with other people in this group and the group of another feature. If so, the newly entered user is divided into a group alone, and is scheduled to join the subsequent rounds of audio and video.

[0017] Optionally, the scheduling control unit is also used to schedule each user to rotate audio and video synchronously.

[0018] Optionally, the user terminal also includes a VR unit, and the VR unit is used to collect and display VR video data.

[0019] To achieve the above object, an embodiment of the present invention further provides a multi-person audio and video method, which is applied to a server and includes:

[0020] Classifying the users who are performing audio and video into first characteristic users and second characteristic users according to the preset characteristic classification;

[0021] By controlling the interaction of audio and video data with each user terminal, each user is scheduled to take turns to realize audio and video chat with another feature user.

[0022] Optionally, the step of scheduling each user to take turns to chat with another user with an audio or video feature includes:

[0023] Grouping the users with the first characteristic into groups, with the number of people in each group not exceeding a first preset upper limit of the number of people, and grouping the users with the second characteristic into groups, with the number of people in each group not exceeding a second preset upper limit of the number of people;

[0024] The scheduling controls the rotation of the group of each feature to realize audio and video chat with the group of another feature.

[0025] Optionally, the method further includes:

[0026] According to the number of users with the first characteristic and the first preset upper limit of the number of users, the minimum number of first characteristic groups is obtained, and according to the number of users with the second characteristic and the second preset upper limit of the number of users, the minimum number of second characteristic groups is obtained;

[0027] The larger number of groups between the minimum number of first feature groups and the minimum number of second feature groups is taken as the number of groups when grouping the first feature users and the second feature users.

[0028] Optionally, the method further includes:

[0029] During the audio and video rotation process, when a new user enters the audio and video system, the user's characteristics are identified according to the preset characteristic classification;

[0030] Determine whether the number of groups of the feature to which the user who has just entered the audio and video system belongs is less than the number of groups of another feature. If so, the newly entered user is divided into a new group, and the waiting group in the other feature is selected for audio and video chat. If not, continue to determine whether all the groups in the feature to which the newly entered user belongs have reached the preset upper limit of the number of people when grouping the feature. If not, select any group that has not reached the preset upper limit of the number of people, and divide the newly entered user into this group, and have audio and video chat with other people in this group and the group of another feature. If so, the newly entered user is divided into a group alone, and is scheduled to join the subsequent rounds of audio and video.

[0031] Optionally, the scheduling of each user to take turns to realize audio and video chat with a user of another feature is that each user takes turns synchronously.

[0032] By applying the embodiment of the present invention, the user terminal receives and analyzes the data sent by the server, and the scheduling control unit of the server schedules each user to take turns to chat with another user of another feature by controlling the interaction of audio and video data with each user terminal. It can be seen that in this solution, each user completes the audio and video chat with multiple other users participating in the audio and video activity in a multi-person audio and video scene, and there will be no mutual interference caused by audio and video communication, and the problem of being unable to distinguish the source of the sound will not occur. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0034] Figure 1 A schematic diagram of the structure of a multi-person audio and video system provided by an embodiment of the present invention;

[0035] Figure 2 A schematic diagram of scheduling user rotation videos provided by an embodiment of the present invention;

[0036] Figure 3 A schematic diagram of determining audio and video chat by queue rotation provided by an embodiment of the present invention;

[0037] Figure 4 A schematic diagram of a flow chart of a multi-person audio and video method provided by an embodiment of the present invention;

[0038] Figure 5 A schematic diagram of a process of rotating audio and video among user groups provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0039] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0040] In some multi-person audio and video scenarios, such as online singles dating parties and online job fairs, according to the current multi-person video solution, simultaneous communication will cause mutual interference and the problem of inability to distinguish the sound.

[0041] In order to solve the above problems, a system and method for multi-person audio and video are provided for the embodiment of the present application. The multi-person audio and video system provided by the embodiment of the present invention is first introduced in detail below.

[0042] Figure 1 A schematic diagram of the structure of a multi-person audio and video system provided by an embodiment of the present invention includes:

[0043] User terminal, used to collect, receive, send and output audio and video data;

[0044] The server side includes a data acquisition unit, a data transceiver unit, and a scheduling control unit;

[0045] A data collection unit, used to collect audio and video data from a user terminal;

[0046] Data transceiver unit, used for connection and data exchange between user terminal and server;

[0047] The scheduling control unit is used to classify the users performing audio and video into first characteristic users and second characteristic users according to preset characteristic classification;

[0048] By controlling the interaction of audio and video data with each user terminal, each user is scheduled to take turns to realize audio and video chat with another feature user.

[0049] In implementation, the user terminal can be a mobile device, a computer, or other device with computing and processing functions. There is no limitation here. The following is an example of a mobile phone. The user's video and audio data are collected in real time through the camera and microphone of the mobile phone, and the video and audio data are connected to the server terminal through the communication unit in the mobile phone device and the data is sent. In audio and video activities, when the user terminal is connected, the audio and video data collected by the user terminal will be continuously sent to the server in real time, and the audio and video data sent from the server will be received. After parsing, the video data will be presented on the screen of the mobile phone, and the audio data will be played through the loudspeaker of the mobile phone. The server will receive and collect audio and video data from each user terminal that has been connected to the audio and video system in real time.

[0050] The scheduling control unit will classify users who are engaged in audio and video activities according to the preset feature classification. The feature can be gender, in which case the users can be classified as male users with the first feature and female users with the second feature. The feature can also be a role, such as job seekers and recruiters, in which case the users can be classified as job seekers with the first feature and recruiters with the second feature. Therefore, the features can be preset according to the purpose of the video, and are not limited here.

[0051] The determination of features can be selected by the user, or it can be judged based on the information pre-stored by the user in the system. Of course, it can also be judged based on the information pre-stored by the user in the system. If the user has not pre-stored it, the user can make the selection when entering the audio and video activity. There is no limitation here. The determination of features can also be accompanied by an authentication step. For example, when the preset feature classification is job seekers and recruiters, when the user selects a recruiter, he can choose to upload relevant certificates for authentication, and then determine his identity as a recruiter. For another example, when the preset feature classification is gender, after the user selects gender, identity authentication can be assisted to determine his gender.

[0052] In one implementation, the scheduling control unit sends all video data of each user terminal acquired by the server to each user terminal in real time. As for audio data, the scheduling control unit only sends the audio data of the user currently chatting with it to each user terminal. Then, each user terminal can display the video of all users participating in the audio and video activity, but the audio played is the audio of the user currently chatting with it. For example, Figure 2 For example, 201, 203, 205, 207 are first characteristic users, 202, 204, 206, 208 are second characteristic users, and the first round of audio and video chat is between 201 and 202, 203 and 204, 205 and 206, 207 and 208. Then the user terminals of 201, 202, 203, 204, 205, 206, 207, 208 transmit the collected audio and video data to the server in real time, and the scheduling control unit sends the video data of all the above users collected by the server to the terminals of each user in real time, that is, the terminal devices of all the above users can receive the video data of any other user, and can display the video of any other user through analysis. Regarding audio data, the scheduling control unit sends the audio data of 201 to the terminal of user 202 in real time, and sends the audio data of 202 to the terminal of user 201 in real time, thereby realizing the audio and video chat between 201 and 202, and the same is true for 203 and 204, 205 and 206, 207 and 208, so that the problem of multi-person audio and video communication is achieved without interference of sound. In the second and subsequent rounds of communication, the scheduling unit sends audio and video data to each terminal, which is the same as the first round of audio and video chat, and will not be described in detail here.

[0053] In another embodiment, the scheduling control unit sends the audio and video data of the user currently chatting with it to each user terminal. Then, each user terminal only receives and displays the video of the user currently chatting with it, and plays the audio of the user currently chatting with it.

[0054] In another embodiment, the scheduling control unit associates the audio and video data of each user terminal obtained by the server with the user identification code and sends all of them to each user terminal in real time, and sends the user identification code of the user with whom the audio and video chat is currently to be conducted to each user terminal. At this time, the user terminal needs to match the audio and video data of the user with whom the audio and video chat is currently to be conducted from all the received audio and video data associated with the user identification code, and parse and display the video and play the audio. For the video data that is not matched, the user terminal can choose to display it or not, depending on the actual needs of the audio and video activities and the UI interface. The unmatched audio data will not be parsed and played.

[0055] During implementation, the scheduling control unit is used to schedule each user to rotate and realize audio and video chat with a user of another feature. It is not difficult to understand that the scheduling control unit, through the above-mentioned interaction between the server and the user terminal audio and video data, changes the sending of audio and video data of a different user of another feature to each user terminal in each round, or changes the sending of identification codes of different users of another feature, thereby scheduling each user to rotate and realize audio and video chat with a user of another feature. Each user is scheduled to rotate and realize audio and video chat with a user of another feature. In each round, the user of another feature with which each user conducts audio and video chat can be random. In this case, in order to avoid repeated audio and video, a judgment is required during matching. If the user has been matched in the previous round, the match is performed again. It is also possible to generate a queue sequence for the user of each feature, and generate a user of another feature for the initial audio and video chat for each user based on the two queue sequences, and then select any direction in any of the queue sequences for rotation to generate a user of another feature for each user's other rounds of audio and video chat. For example, if Figure 3 As shown, 301, 303, 305, 307 are first characteristic users, and 302, 304, 306, 308 are second characteristic users. The queue order generated for the first characteristic users is 303, 305, 301, 307, and the queue order generated for the second characteristic users is 302, 304, 306, 308. The two queue orders are used as the basis, and the first round is generated by 303 and 302, 305 and 304, 301 and 306, 307 and 308 for audio and video chat. The queue order of the second characteristic is rotated to the left, and the second round is generated by 304 having audio and video with 303, 306 having audio and video with 305, 308 having audio and video with 301, and 302 having audio and video with 307. Similarly, the third round is for 303 and 306, 305 and 308, 301 and 302, 307 and 304 to have audio and video chats, and the fourth round is for 303 and 308, 305 and 302, 301 and 304, 307 and 306 to have audio and video chats.

[0056] Of course, the above-mentioned scheduling control unit scheduling each user to rotate and realize audio and video chat with the user of another feature is only one implementation method. During implementation, it may also happen that the number of users of the first feature is not equal to the number of users of the second feature. For example, according to the rule that each user only conducts audio and video chat with one user of another feature in each round, when users of the feature with a larger number of users rotate, it may happen that users of another feature cannot be matched. At this time, the unmatched users wait.

[0057] Optionally, the scheduling control unit is further used to group the users with the first characteristic, with the number of people in each group not exceeding the first preset upper limit of the number of people, and to group the users with the second characteristic, with the number of people in each group not exceeding the second preset upper limit of the number of people.

[0058] The scheduling controls the rotation of the group of each feature to realize audio and video chat with the group of another feature.

[0059] During implementation, users with the same characteristics may be grouped randomly or in combination with other situations. For example, if two people form a team to participate in an audio or video activity, the two users who register as a team may be grouped in the same group.

[0060] The first preset upper limit of the number of people and the second preset upper limit of the number of people can be equal or unequal, and there is no restriction here. For example, the first preset upper limit of the number of people and the second preset upper limit of the number of people can both be 2, or the first preset upper limit of the number of people can be 2 and the second preset upper limit of the number of people can be 3, or the first preset upper limit of the number of people can be 1, that is, no grouping, and the second preset upper limit of the number of people can be 3.

[0061] After grouping, the scheduling controls the group of each feature to alternate with the group of another feature to realize audio and video chat, so that the users of each feature can alternate with the users of another feature to realize audio and video chat. The minimum unit of scheduling is from each person to each group, such as Figure 3 As shown, 301, 303, 305, and 307 are the groups with the first characteristic after grouping, and 302, 304, 306, and 308 are the groups with the second characteristic after grouping. The above-mentioned scheduling of each user to alternately chat with another characteristic user to realize audio and video chat is also applicable here, and will not be repeated here. Each terminal device in the two groups performing audio and video chat will receive and parse the audio and video data of all other users in the two groups.

[0062] Optionally, the scheduling control unit is further used to obtain the minimum number of first feature groups based on the number of first feature users and the first preset upper limit of the number of people, and to obtain the minimum number of second feature groups based on the number of second feature users and the second preset upper limit of the number of people.

[0063] The larger number of groups between the minimum number of first feature groups and the minimum number of second feature groups is taken as the number of groups when grouping the first feature users and the second feature users.

[0064] For example, if the number of first feature users and second feature users is 10 and 15 respectively, and the first preset upper limit and the second preset upper limit are both 2. According to the number of first feature users and the first preset upper limit, the minimum number of first feature groups is 5, and according to the number of second feature users and the second preset upper limit, the minimum number of second feature groups is 8. 8 is used as the number of groups when the first feature users and the second feature users are grouped. At this time, the number of people in the 8 groups of the first feature users is 2, 2, 1, 1, 1, 1, 1, respectively. The number of people in the 8 groups of the second feature users is 2, 2, 2, 2, 2, 2, 2, 1 respectively.

[0065] In implementation, when the number of first feature users or the number of second feature users is less than the larger number of groups mentioned above, the number of feature users is used as the number of groups, that is, each group of this feature is 1 person. For example, if the number of first feature users and second feature users is 7 and 15 respectively, the first preset upper limit of the number of people and the second preset upper limit of the number of people are both 2. The minimum first feature group number and the second feature group number are 4 and 8 respectively, and the larger number of groups is 8, but the number of first feature users is 7, which is less than the number of groups 8, that is, even if grouping is performed according to 1 person per group, it can only be divided into 7 groups, so the number of first feature users 7 is used as the number of groups for the first feature.

[0066] During implementation, for users participating in audio and video activities, it cannot be guaranteed that every user will participate in the audio and video activities on time, nor can it be guaranteed that every user will exit the system after the audio and video activities end. In one implementation, the above-mentioned scheduling of rotating audio and video is for all users participating in audio and video activities, even if the user terminal is not connected to the system. If the user participating in the audio and video activity has not entered the system, the server will not be able to obtain the audio and video data of the user terminal, and the user of another feature that should conduct audio and video with the user will not be able to receive the audio and video data of the user and will be in a waiting state. When the user enters the system, the server will obtain the audio and video data of the user terminal, and the user of another feature that is currently conducting an audio and video chat with the user can receive and parse its audio and video data. For example, taking Figure 2For example, 201, 203, 205, 207 are first characteristic users, 202, 204, 206, 208 are second characteristic users, and 201 enters the system during the second round of audio and video. In the first round of video, 201 and 202 have an audio and video chat. Since 201 has not entered the system, the server cannot obtain the audio and video data of the user terminal at this time. The data pushed by the server received by 202 does not contain the audio and video data of 201. At this time, 202 is actually in a waiting state. In the second round, the scheduling unit schedules 201 and 204 to have an audio and video chat. Since 201 enters the system during the second round of audio and video, 204 is in a waiting state at the beginning because the data pushed by the server does not contain the audio and video data of the 201 user terminal. After 201 enters the system, the server can receive the audio and video data sent by the 201 user terminal and send this data to 204. The 204 user terminal can receive and parse the audio and video data of the 201 user terminal. At the same time, 201 will also receive and parse the audio and video data from the 204 user terminal through the server. In this way, the rotation process will not be affected by any user entering and exiting the system.

[0067] In another embodiment, the above-mentioned object of scheduling the audio and video rotation is a user who has entered the audio and video system. The scheduling control unit is also used to, during the process of rotating the audio and video, when there is a new user entering the audio and video system, identify its characteristics according to the preset characteristic classification.

[0068] Get the number of groups of this feature and compare it with the number of groups of another feature.

[0069] If the number of groups is less than that of another feature, the new users entering the system will be divided into a separate group, and the waiting group in another feature will be selected for audio and video chat.

[0070] If it is greater than or equal to the number of groups of another feature, then determine whether all groups in the feature to which the new user belongs have reached the preset upper limit of the number of people when grouping with the feature. If not all groups have reached the preset upper limit of the number of people when grouping with the feature, then select any of the above groups that has not reached the preset upper limit of the number of people, and assign the new user to this group, and conduct audio or video chat with other people in this group and the group of another feature.

[0071] If the number of people in all groups in the characteristics to which the user who has just entered the system belongs has reached the preset upper limit, the user who has just entered the system will be divided into a separate group and scheduled to join the audio and video in subsequent rounds.

[0072] Optionally, the scheduling control unit schedules each user to change audio and video in a synchronous manner, that is, the scheduling control unit schedules each user to change another user with whom the audio and video chat is conducted, or schedules each group to change another group with whom the audio and video chat is conducted is synchronous. That is, for each person or group, from the first round of audio and video to the last round of audio and video, the start and end time of each round of audio and video chat is the same. For example, Figure 2 For example, the first round of audio and video chats are 201 and 202, 203 and 204, 205 and 206, 207 and 208. After a preset time length, such as 10 minutes, the scheduling control unit schedules all users to have a second round of audio and video chats, that is, 201 and 204, 203 and 206, 205 and 208, 207 and 202. Synchronous rotation audio and video chats will not cause other users to wait because of the long chat time of individual users.

[0073] In one embodiment, the user terminal further includes a VR unit, which may include a VR video acquisition unit and a VR video display unit, such as a VR camera and VR glasses, which are externally connected to a mobile phone or a computer via a data cable. The user terminal acquires video data that can be parsed by the VR display unit through the VR video acquisition unit, and parses and displays the received video data through the VR video display unit.

[0074] By applying the embodiment of the present invention, the user terminal receives and analyzes the data sent by the server, and the scheduling control unit of the server schedules each user to take turns to chat with another user of another feature by controlling the interaction of audio and video data with each user terminal. It can be seen that in this solution, each user completes the audio and video chat with multiple other users participating in the audio and video activity in a multi-person audio and video scene, and there will be no mutual interference caused by audio and video communication, and the problem of being unable to distinguish the source of the sound will not occur.

[0075] Corresponding to the above system embodiment, the embodiment of the present invention further provides a method for multi-person audio and video, which can be applied to a server, without specific limitation. The following content is described by taking the execution subject as a server as an example.

[0076] Figure 4 A schematic flow chart of a multi-person audio and video method provided by an embodiment of the present invention includes:

[0077] S401, classifying users who perform audio and video communication into first characteristic users and second characteristic users according to preset characteristic classification.

[0078] Users who conduct audio and video activities are classified according to preset feature classification. The feature can be gender, so users with the first feature can be classified as males and users with the second feature can be classified as females. Features can also be roles, such as job seekers and recruiters, so users with the first feature can be classified as job seekers and users with the second feature can be classified as recruiters. Therefore, features can be preset according to the purpose of audio and video activities, and are not limited here.

[0079] The determination of features can be selected by the user, or it can be judged based on the information pre-stored by the user in the system. Of course, it can also be judged based on the information pre-stored by the user in the system. If the user has not pre-stored it, the user can make the selection when entering the audio and video activity. There is no limitation here. The determination of features can also be accompanied by an authentication step. For example, when the preset feature classification is job seekers and recruiters, when the user selects a recruiter, he can choose to upload relevant certificates for authentication, and then determine his identity as a recruiter. For another example, when the preset feature classification is gender, after the user selects gender, identity authentication can be assisted to determine his gender.

[0080] S402, by controlling the interaction of audio and video data with each user terminal, scheduling each user to take turns to realize audio and video chat with another characteristic user.

[0081] In one implementation, all the acquired video data of each user terminal is sent to each user terminal in real time. As for audio data, only the audio data of the user currently having an audio or video chat with it is sent to each user terminal. Then, each user terminal can receive the video data of all users participating in the audio or video activity, and can display it after parsing, but the audio played is the audio of the user currently having an audio or video chat with it.

[0082] In another embodiment, the scheduling control unit sends the audio and video data of the user currently chatting with it to each user terminal. Then, each user terminal only receives and displays the video of the user currently chatting with it, and plays the audio of the user currently chatting with it.

[0083] During implementation, each user is scheduled to take turns to have an audio and video chat with a user of another feature. That is, by interacting with the audio and video data of the user terminal, in each round, each terminal device is changed to send audio and video data of a different user of another feature, or the identification code of a different user of another feature is changed to send, so that each user is scheduled to take turns to have an audio and video chat with a user of another feature. Each user is scheduled to take turns to have an audio and video chat with a user of another feature. In each round, the user of another feature with which each user has an audio and video chat can be random. In this case, in order to avoid duplication of audio and video, a judgment is required during matching. If the user has been matched in the previous round, the match is performed again. It is also possible to generate a queue sequence for the user of each feature, and generate a user of another feature for the initial audio and video chat for each user based on the two queue sequences, and then select any direction in any of the queue sequences for rotation to generate a user of another feature for each user's other rounds of audio and video chat. For example, if Figure 3 As shown, 301, 303, 305, 307 are first characteristic users, and 302, 304, 306, 308 are second characteristic users. The queue order generated for the first characteristic users is 303, 305, 301, 307, and the queue order generated for the second characteristic users is 302, 304, 306, 308. The two queue orders are used as the basis, and the first round is generated by 303 and 302, 305 and 304, 301 and 306, 307 and 308 for audio and video chat. The queue order of the second characteristic is rotated to the left, and the second round is generated by 304 having audio and video with 303, 306 having audio and video with 305, 308 having audio and video with 301, and 302 having audio and video with 307. Similarly, the third round is for 303 and 306, 305 and 308, 301 and 302, 307 and 304 to have audio and video chats, and the fourth round is for 303 and 308, 305 and 302, 301 and 304, 307 and 306 to have audio and video chats.

[0084] Of course, the above-mentioned scheduling of each user to rotate and realize audio and video chat with the user of another feature is only one implementation method. The rotation method and rules can be set according to the purpose of the audio and video activity, which is not limited here. In implementation, it may also happen that the number of users of the first feature and the number of users of the second feature are not equal. For example, according to the rule that each user only has audio and video chat with one user of another feature in each round, when users of the feature with a larger number of users rotate, it may happen that users of another feature cannot be matched. At this time, the unmatched users wait.

[0085] Optional, see Figure 5 , scheduling each user to take turns to chat with another user of another feature through audio or video, including:

[0086] S501, grouping users with the first characteristic so that the number of people in each group does not exceed a first preset upper limit of the number of people, and grouping users with the second characteristic so that the number of people in each group does not exceed a second preset upper limit of the number of people.

[0087] During implementation, users with the same characteristics may be grouped randomly or in combination with other situations. For example, if two people form a team to participate in an audio or video activity, the two users who register as a team may be grouped in the same group.

[0088] The first preset upper limit of the number of people and the second preset upper limit of the number of people can be equal or unequal, and there is no restriction here. For example, the first preset upper limit of the number of people and the second preset upper limit of the number of people can both be 2, or the first preset upper limit of the number of people can be 2 and the second preset upper limit of the number of people can be 3, or the first preset upper limit of the number of people can be 1, that is, no grouping, and the second preset upper limit of the number of people can be 3.

[0089] S502, scheduling and controlling the group of each feature to rotate with the group of another feature to realize audio and video chat.

[0090] After grouping, the scheduling controls the group of each feature to alternate with the group of another feature to realize audio and video chat, so that the users of each feature can alternate with the users of another feature to realize audio and video chat. The minimum unit of scheduling is from each person to each group, such as Figure 3 As shown, 301, 303, 305, and 307 are the groups with the first characteristic after grouping, and 302, 304, 306, and 308 are the groups with the second characteristic after grouping. The above-mentioned scheduling of each user to alternately chat with another characteristic user to realize audio and video chat is also applicable here, and will not be repeated here. Each terminal device in the two groups performing audio and video chat will receive and parse the audio and video data of all other users in the two groups.

[0091] In one implementation, the minimum number of first feature groups can be obtained based on the number of first feature users and a first preset upper limit of the number of people, and the minimum number of second feature groups can be obtained based on the number of second feature users and a second preset upper limit of the number of people.

[0092] The larger number of groups between the minimum number of first feature groups and the minimum number of second feature groups is taken as the number of groups when grouping the first feature users and the second feature users.

[0093] For example, if the number of first feature users and second feature users is 10 and 15 respectively, and the first preset upper limit and the second preset upper limit are both 2. According to the number of first feature users and the first preset upper limit, the minimum number of first feature groups is 5, and according to the number of second feature users and the second preset upper limit, the minimum number of second feature groups is 8. 8 is used as the number of groups when the first feature users and the second feature users are grouped. At this time, the number of people in the 8 groups of the first feature users is 2, 2, 1, 1, 1, 1, 1, respectively. The number of people in the 8 groups of the second feature users is 2, 2, 2, 2, 2, 2, 2, 1 respectively.

[0094] In implementation, when the number of first feature users or the number of second feature users is less than the larger number of groups mentioned above, the number of feature users is used as the number of groups, that is, each group of this feature is 1 person. For example, if the number of first feature users and second feature users is 7 and 15 respectively, the first preset upper limit of the number of people and the second preset upper limit of the number of people are both 2. The minimum first feature group number and the second feature group number are 4 and 8 respectively, and the larger number of groups is 8, but the number of first feature users is 7, which is less than the number of groups 8, that is, even if grouping is performed according to 1 person per group, it can only be divided into 7 groups, so 7 of the number of first feature users is used as the number of groups for the first feature.

[0095] In implementation, for users participating in audio and video activities, it cannot be guaranteed that every user will participate in the audio and video activities on time, nor can it be guaranteed that every user will exit the system after the audio and video activities are over. In one implementation, the objects of the above-mentioned scheduling rotation of audio and video are all users participating in audio and video activities. If the user participating in the audio and video activity has not entered the system, the server side will not be able to obtain the audio and video data of the user's terminal, and then the user of another feature that should conduct audio and video with the user will not be able to receive the audio and video data of the user, and will be in a waiting state. When the user enters the system, the audio and video data of the user's terminal can be obtained, and the user of another feature that is currently conducting audio and video chatting with the user can receive and parse its audio and video data. In this implementation, the rotation process will not be affected by any user entering and exiting the system.

[0096] In another embodiment, the object of the above-mentioned scheduling of audio and video rotation is the user who has entered the audio and video system. In the process of rotating audio and video, when there is a new user entering the audio and video system, its characteristics are identified according to the preset characteristic classification.

[0097] Get the number of groups of this feature and compare it with the number of groups of another feature.

[0098] If the number of groups is less than that of another feature, the new users entering the system will be divided into a separate group, and the waiting group in another feature will be selected for audio and video chat.

[0099] If it is greater than or equal to the number of groups of another feature, then determine whether all groups in the feature to which the new user belongs have reached the preset upper limit of the number of people when grouping with the feature. If not all groups have reached the preset upper limit of the number of people when grouping with the feature, then select any of the above groups that has not reached the preset upper limit of the number of people, and assign the new user to this group, and conduct audio or video chat with other people in this group and the group of another feature.

[0100] If the number of people in all groups in the characteristics to which the user who has just entered the system belongs has reached the preset upper limit, the user who has just entered the system will be divided into a separate group and scheduled to join the audio and video in subsequent rounds.

[0101] Optionally, the audio and video chat of each user is scheduled to be synchronous, that is, each user is scheduled to change the user of another feature with whom the audio and video chat is conducted, or each group is scheduled to change the group of another feature with whom the audio and video chat is conducted is synchronous. That is, for each person or group, from the first round of audio and video to the last round of audio and video, the start and end time of each round of audio and video chat is the same. Synchronous rotation of audio and video chat will not cause other people to wait because of the long chat time of individual users.

[0102] By applying the embodiment of the present invention, the user terminal receives and analyzes the data sent by the server, and the server controls the interaction of audio and video data with each user terminal, and schedules each user to take turns to chat with another user of another feature. It can be seen that in this solution, each user completes the audio and video chat with multiple other users participating in the audio and video activity in a multi-person audio and video scene, and there will be no mutual interference caused by audio and video communication, and the problem of being unable to distinguish the source of sound will not occur.

[0103] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the statement "comprise a ..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.

[0104] The various implementation methods in this specification can be arbitrarily combined in a non-contradictory manner. The various embodiments in this specification are described in a related manner, and the same and similar parts between the various embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the method embodiment, since it is basically similar to the system embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the system embodiment.

[0105] The above description is only a preferred embodiment of the present invention and is not intended to limit the protection scope of the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention are included in the protection scope of the present invention.

Claims

1. A multi-person audio and video system, characterized in that: include: User terminal and server side, where The user terminal is used to collect, receive, send and output audio and video data; The server side includes a data collection unit, a data transceiver unit, and a scheduling control unit, wherein: The data collection unit is used to collect audio and video data from the user terminal; The data transceiver unit is used for connection and data exchange between the user terminal and the server; The scheduling control unit is used to classify the users performing audio and video into first characteristic users and second characteristic users according to preset characteristic classification; By controlling the interaction of audio and video data with each user terminal, each user is scheduled to take turns to realize audio and video chat with another feature user.

2. The system according to claim 1, characterized in that The scheduling control unit is further used to group the users with the first characteristic, with the number of people in each group not exceeding the first preset upper limit of the number of people, and to group the users with the second characteristic, with the number of people in each group not exceeding the second preset upper limit of the number of people; The scheduling controls the rotation of the group of each feature to realize audio and video chat with the group of another feature.

3. The system according to claim 2, characterized in that The scheduling control unit is further used to obtain the minimum number of first feature groups according to the number of first feature users and the first preset upper limit of the number of people, and to obtain the minimum number of second feature groups according to the number of second feature users and the second preset upper limit of the number of people; The larger number of groups between the minimum number of first feature groups and the minimum number of second feature groups is taken as the number of groups when grouping the first feature users and the second feature users.

4. The system according to claim 2-3, characterized in that: The scheduling control unit is further used to, during the process of rotating audio and video, when a new user enters the audio and video system, identify the characteristics of the user according to the preset characteristic classification; Determine whether the number of groups of the feature to which the user who has newly entered the audio and video system belongs is less than the number of groups of another feature. If so, divide the newly entered user into a new group, and select the waiting group in the other feature for audio and video chat. If not, continue to determine whether all groups in the feature to which the newly entered user belongs have reached the preset upper limit of the number of people when grouping with the corresponding feature. If not, select any group that has not reached the preset upper limit of the number of people, divide the newly entered user into this group, and conduct audio and video chat with other people in this group and the group of another feature. If so, the newly entered users are grouped separately and scheduled to join the subsequent rounds of audio and video.

5. The system according to claims 1-3, characterized in that: The scheduling control unit is also used to schedule each user to rotate audio and video synchronously.

6. The system according to claims 1-3, characterized in that: The user terminal also includes a VR unit, and the VR unit is used to collect and display VR video data.

7. A method for multi-person audio and video, characterized in that: include: Classifying the users who are performing audio and video into first characteristic users and second characteristic users according to the preset characteristic classification; By controlling the interaction of audio and video data with each user terminal, each user is scheduled to take turns to realize audio and video chat with another feature user.

8. The method according to claim 7, characterized in that The step of scheduling each user to take turns to chat with another user with another feature via audio or video includes: Grouping the users with the first characteristic into groups, with the number of people in each group not exceeding a first preset upper limit of the number of people, and grouping the users with the second characteristic into groups, with the number of people in each group not exceeding a second preset upper limit of the number of people; The scheduling controls the rotation of the group of each feature to realize audio and video chat with the group of another feature.

9. The method according to claim 8, characterized in that The method further comprises: According to the number of users with the first characteristic and the first preset upper limit of the number of users, the minimum number of first characteristic groups is obtained, and according to the number of users with the second characteristic and the second preset upper limit of the number of users, the minimum number of second characteristic groups is obtained; The larger number of groups between the minimum number of first feature groups and the minimum number of second feature groups is taken as the number of groups when grouping the first feature users and the second feature users.

10. The method according to claims 8-9, characterized in that: The method further comprises: During the audio and video rotation process, when a new user enters the audio and video system, the user's characteristics are identified according to the preset characteristic classification; Determine whether the number of groups of the feature to which the user who has just entered the audio and video system belongs is less than the number of groups of another feature. If so, the newly entered user is divided into a new group, and the waiting group in the other feature is selected for audio and video chat. If not, continue to determine whether all the groups in the feature to which the newly entered user belongs have reached the preset upper limit of the number of people when grouping the feature. If not, select any group that has not reached the preset upper limit of the number of people, and divide the newly entered user into this group, and have audio and video chat with other people in this group and the group of another feature. If so, the newly entered user is divided into a group alone, and is scheduled to join the subsequent rounds of audio and video.

11. The method according to claims 7-9, characterized in that: The scheduling of each user taking turns to realize audio and video chat with a user of another feature is that each user takes turns synchronously.

Images