A processing method, equipment, and storage medium for a choral platform.

Abstract

This application discloses a processing method, device, and storage medium for a choral singing platform, relating to the field of audio technology. The method includes: collecting real-time load indicators of a target online choral singing room; determining the number of created RTC rooms in the target online choral singing room; obtaining a matching result between the number of created RTC rooms and the real-time load indicators; if the number of created RTC rooms does not match the real-time load indicators, adjusting the number of created RTC rooms in the target online choral singing room to match the real-time load indicators. This application flexibly adjusts the number of created RTC rooms based on the matching result between the real-time load indicators and the number of created RTC rooms in the current choral singing room, rationally utilizing resources to support multiple RTC rooms in the choral singing room, thereby supporting more people to participate in choral singing in real time.

Description

Technical Field

[0001] This invention relates to the field of audio technology, and in particular to a processing method, device and storage medium for a choral platform. Background Technology

[0002] Currently, for choral singing, the process typically involves downloading the instrumental track of the currently playing song on the lead singer's device after responding to a user's request to join the chorus. This process also involves obtaining the playback progress and timing of the instrumental track on the lead singer's device to determine the target playback progress. The instrumental track is then played on the user's device according to this target progress, allowing for choral singing. However, currently, a single choral room only supports one RTC (Real-Time Communication) room. Due to the limitation on the number of uplink channels in a single RTC room (generally limited to 100), only a limited number of people can participate in choral singing. Therefore, how to enable more people to participate in choral singing in real time remains a problem to be solved. Summary of the Invention

[0003] In view of this, the purpose of this invention is to provide a processing method, device, and storage medium for a choral platform. This method can flexibly adjust the number of created RTC rooms based on the matching result between real-time load indicators and the number of created RTC rooms in the current choral space, thus rationally utilizing resources. Furthermore, it allows the choral space to support multiple RTC rooms, enabling more people to participate in choral singing in real time and improving the user experience. The specific solution is as follows:

[0004] Firstly, this application provides a processing method for a choral platform, including:

[0005] Collect the real-time load index of the target online choir room; the real-time load index is an index determined based on the changes in the number of choir members in the target online choir room.

[0006] Determine the number of created RTC rooms in the target online chorus room;

[0007] Obtain the matching result between the number of created RTC rooms and the real-time load metric;

[0008] If the number of created RTC rooms does not match the real-time load index, then the number of created RTC rooms in the current target online chorus room is adjusted so that the adjusted number of created RTC rooms in the target online chorus room matches the real-time load index.

[0009] Optionally, obtaining the matching result between the number of created RTC rooms and the real-time load metric includes:

[0010] Based on the number of RTC rooms already created, determine the reasonable load-bearing range of the target online chorus room;

[0011] Obtain the matching result between the reasonable load range and the real-time load index.

[0012] Optionally, the collection of real-time load indicators for the current target online choir room includes:

[0013] Determine the number of choruses in the current target online chorus room and the real-time change in the number of choruses in the current target online chorus room;

[0014] The current total number of chorus members is determined based on the number of chorus members in the target online chorus room and the real-time changing number of chorus members.

[0015] Accordingly, determining the reasonable load-bearing range of the target online chorus room based on the number of rooms in the created RTC rooms includes:

[0016] The first reasonable capacity range is determined based on the number of RTC rooms that have been created; the first reasonable capacity range is the reasonable capacity range for the total number of chorus members in the target online chorus room.

[0017] Optionally, the collection of real-time load indicators for the current target online choir room includes:

[0018] Monitor the rate of change in the real-time number of chorus members in the current target online chorus room;

[0019] Accordingly, determining the reasonable load-bearing range of the target online chorus room based on the number of rooms in the created RTC rooms includes:

[0020] The second reasonable capacity range is determined based on the number of RTC rooms already created and the number of chorus members in the current target online chorus room; the second reasonable capacity range is the reasonable capacity range of the current target online chorus room with respect to the rate of change of the number of chorus members.

[0021] Optionally, the operation of adjusting the number of created RTC rooms in the current target online chorus room includes:

[0022] If the real-time load index is greater than the upper limit of the reasonable carrying range, then the number of created RTC rooms in the current target online chorus room will be increased.

[0023] If the real-time load index is less than the lower limit of the reasonable carrying capacity, then the number of created RTC rooms in the current target online chorus room will be reduced.

[0024] Optionally, after increasing the number of existing RTC rooms in the target online chorus room, the method further includes:

[0025] The target online chorus room will determine the chorus users to be scheduled from the existing chorus users before the number increase operation.

[0026] The chorus users to be scheduled are migrated to the new RTC room created after the number increase operation, so that the number of chorus users in the new RTC room after the migration is not less than the preset number.

[0027] Optionally, the method further includes:

[0028] The preset number is determined based on the number of downstream choral audio paths pre-configured for the RTC room in the target online choral room.

[0029] Optionally, the operation of reducing the number of created RTC rooms in the current target online chorus room includes:

[0030] Determine the target RTC room with the fewest choir members from the existing RTC rooms of the target online choir room;

[0031] The chorus users in the current target RTC room are migrated to other RTC rooms, and after there are no more chorus users in the target RTC room, the target RTC room is deleted.

[0032] Optionally, the step of migrating the chorus users in the current target RTC room to other RTC rooms, and then deleting the target RTC room after there are no more chorus users in the target RTC room, includes:

[0033] Migrate some of the chorus users in the current target RTC room to other RTC rooms;

[0034] If the first preset condition is detected, the target RTC room is deleted; the first preset condition is that there are no chorus users in the target RTC room.

[0035] If the second preset condition is detected, the process will jump back to the step of migrating some of the chorus users in the current target RTC room to other RTC rooms; the second preset condition is that there are still chorus users in the current target RTC room, and the real-time load index of the current target online chorus room is less than the lower limit of the reasonable carrying capacity.

[0036] If the third preset condition is detected, the deletion operation of the target RTC room is prohibited, and the current loop ends; the third preset condition is that the real-time load index of the target online chorus room is not less than the lower limit of the reasonable carrying capacity.

[0037] Optionally, the method further includes:

[0038] When the number of created RTC rooms matches the real-time load metric, a migration operation for chorus users is performed between the currently created RTC rooms to achieve a balance in the number of chorus members in the currently created RTC rooms.

[0039] Optionally, the method further includes:

[0040] Obtain preset type information of the first target user; the preset type information includes any one or a combination of several of the following: device performance information, network round-trip time information, end-to-end latency information, user relationship information, and dry sound quality of the first target user;

[0041] Based on the preset type information, a certain number of second target users are determined from the target chorus user range of the current target online chorus room.

[0042] The chorus audio of the second target user is transmitted to the device of the first target user via the corresponding downlink.

[0043] Optionally, if the first target user is a chorus user who has joined an RTC room, then the target chorus user range is the range consisting of all chorus users in the RTC room where the first target user is currently located.

[0044] If the first target user is a non-chorus user who has joined the target online chorus room but not the RTC room, then the target chorus user range is the range consisting of all chorus users in the current target online chorus room.

[0045] Optionally, the method further includes:

[0046] When a non-singing user in the target online chorus room applies for chorus qualification, the RTC room to be joined is determined from the existing RTC rooms of the target online chorus room based on the number of chorus members in each of the existing created RTC rooms and / or the user relationship information of the non-singing user.

[0047] The non-chorus user is added to the RTC room to be joined, thus completing the response to the chorus qualification application.

[0048] Secondly, this application provides a processing device for a choral platform, comprising:

[0049] The load index acquisition module is used to collect the real-time load index of the current target online choir room; the real-time load index is an index determined based on the change in the number of choir members in the current target online choir room.

[0050] The room quantity determination module is used to determine the number of created RTC rooms in the target online chorus room.

[0051] The matching result acquisition module is used to acquire the matching result between the number of created RTC rooms and the real-time load index;

[0052] The room quantity adjustment module is used to adjust the number of created RTC rooms in the target online chorus room if the number of created RTC rooms does not match the real-time load index, so that the number of created RTC rooms in the target online chorus room matches the real-time load index after adjustment.

[0053] Thirdly, this application provides an electronic device, comprising:

[0054] Memory, used to store computer programs;

[0055] A processor for executing the computer program to implement the aforementioned processing method for the choral platform.

[0056] Fourthly, this application provides a computer-readable storage medium for storing a computer program, which, when executed by a processor, implements the aforementioned processing method of the chorus platform.

[0057] This application collects the real-time load index of the current target online choir room; the real-time load index is determined based on the changes in the number of choir members in the current target online choir room; it determines the number of created RTC rooms in the current target online choir room; it obtains the matching result between the number of created RTC rooms and the real-time load index; if the number of created RTC rooms does not match the real-time load index, it adjusts the number of created RTC rooms in the current target online choir room to match the real-time load index. Therefore, this application adjusts the number of created RTC rooms in the current target online choir room based on the matching result between the number of created RTC rooms and the real-time load index, achieving reasonable resource utilization and supporting multiple RTC rooms in one online choir room, without being limited by the uplink path when only one RTC room is supported, thereby enabling more people to participate in large-scale choir singing in real time and improving the user experience. Attached Figure Description

[0058] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on the provided drawings without creative effort.

[0059] Figure 1 This application discloses a flowchart of a processing method for a choral platform.

[0060] Figure 2 This is a schematic diagram of choral user scheduling disclosed in this application;

[0061] Figure 3 This application discloses a flowchart of a specific processing method for a choral platform.

[0062] Figure 4 This is a flowchart illustrating another specific processing method for a choral platform disclosed in this application;

[0063] Figure 5 This is a schematic diagram of a choral audio routing method disclosed in this application;

[0064] Figure 6 This is a schematic diagram of a choral audio transmission method disclosed in this application;

[0065] Figure 7 This is a schematic diagram of the processing device structure of a choral platform disclosed in this application;

[0066] Figure 8 This is a structural diagram of an electronic device disclosed in this application. Detailed Implementation

[0067] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0068] Currently, a single choral singing room only supports one RTC room. Due to the limitation on the number of uplink paths in a single RTC room, typically limited to 100, it can only support a limited number of people singing together. Therefore, how to enable more people to participate in choral singing in real time is a problem that needs to be solved. To address this, this application provides a processing method for a choral platform that can flexibly adjust the number of created RTC rooms based on the matching result of real-time load indicators and the number of rooms already created in the current choral singing room. This allows for the rational use of resources and enables the choral singing room to support multiple RTC rooms, thereby supporting more people to participate in choral singing in real time and improving the user experience.

[0069] See Figure 1 As shown in the figure, an embodiment of the present invention discloses a processing method for a choral platform, including:

[0070] Step S11: Collect the real-time load index of the current target online choir room; the real-time load index is an index determined based on the change in the number of choir members in the current target online choir room.

[0071] In one specific implementation, collecting the real-time load index of the current target online choir room may include determining the number of choir members currently in the target online choir room and the real-time change in the number of choir members in the current target online choir room; and determining the current total number of choir members based on the current number of choir members in the current target online choir room and the real-time change in the number of choir members. The current total number of choir members is the real-time load index. For example, if the current number of choir members in the target online choir room is 100, and the real-time change in the number of choir members in the current target online choir room is 10, then the total number of choir members in the current target online choir room is 110.

[0072] In another specific implementation, collecting the real-time load index of the current target online choir room can include monitoring the rate of change of the real-time number of choir members in the current target online choir room. It can be understood that the rate of change of the real-time number of choir members is the real-time load index. For example, monitoring the change in the number of choir members in the target online choir room within the current second, such as 10 people, would be the rate of change of the real-time number of choir members in the current target online choir room as 10 people / second.

[0073] Step S12: Determine the number of created RTC rooms in the target online chorus room.

[0074] In this embodiment, different numbers of created RTC rooms in the target online chorus room correspond to different reasonable load carrying ranges. Therefore, it is necessary to first determine the number of created RTC rooms in the current target online chorus room so as to match the real-time load indicators in the future.

[0075] Step S13: Obtain the matching result between the number of created RTC rooms and the real-time load index.

[0076] In this embodiment, obtaining the matching result between the number of created RTC rooms and the real-time load index can include determining the reasonable load-bearing range of the relevant load in the current target online choir room based on the number of created RTC rooms; and obtaining the matching result between the reasonable load-bearing range and the real-time load index. It is understood that different numbers of created RTC rooms correspond to different reasonable load-bearing ranges; the more rooms, the larger the reasonable load-bearing range. Therefore, it is necessary to first determine the corresponding reasonable load-bearing range based on the number of created RTC rooms, and then match the reasonable load-bearing range with the real-time load index to obtain the matching result.

[0077] In one specific implementation, if the real-time load metric is the total number of chorus members currently in the target online chorus room, then the corresponding first reasonable capacity range is determined based on the number of RTC rooms already created in the current target online chorus room; wherein, the first reasonable capacity range is the reasonable capacity range for the total number of chorus members in the current target online chorus room. It can be understood that if the maximum number of uplink audio paths for each RTC room is n, and the number of RTC rooms already created in the current target online chorus room is x, then the upper limit of the first reasonable capacity range is x×n×80%, and the lower limit of the first reasonable capacity range is (x-1)×n×70%. Specifically, when n=100, the reasonable capacity ranges corresponding to different numbers of created RTC rooms are shown in Table 1 below.

[0078] Table 1

[0079] Number of rooms Upper limit of reasonable load-bearing capacity Lower limit of reasonable load-bearing range 1 80 0 2 160 70 3 240 140 x x*n*80% (x-1)*n*70%

[0080] In another specific implementation, if the real-time load indicator is the rate of change of the number of singers in the current target online chorus room, then a corresponding second reasonable capacity range is determined based on the number of RTC rooms already created and the number of singers in the current target online chorus room; wherein, the second reasonable capacity range is the reasonable capacity range of the current target online chorus room with respect to the rate of change of the number of singers. It can be understood that if each RTC room has a maximum of 100 uplink audio channels, the current target online chorus room has 2 created RTC rooms, the current target online chorus room has 120 singers, the prediction time is 2 seconds, and based on the number of created RTC rooms, the corresponding upper limit of the total number of singers (160) and lower limit of the total number of singers (70) can be determined, then the upper limit of the second reasonable capacity range is (160-120) / 2 = 20 people / second, and the lower limit of the second reasonable capacity range is (70-120) / 2 = -25 people / second. When the monitored rate of change of the number of singers in the target online choir room is 25 people / second, the total number of singers in the target online choir room will reach 170 people after 2 seconds. That is, the total number of singers in the target online choir room will exceed the upper limit of the total number of singers after 2 seconds. Therefore, the rate of change of the number of singers in the target online choir room at 25 people / second is not in line with the second reasonable carrying capacity.

[0081] Step S14: If the number of created RTC rooms does not match the real-time load index, then adjust the number of created RTC rooms in the current target online chorus room so that the adjusted number of created RTC rooms in the target online chorus room matches the real-time load index.

[0082] In this embodiment, the number of created RTC rooms in the current target online chorus room does not match the real-time load index, that is, the real-time load index does not match the reasonable carrying capacity determined based on the number of created RTC rooms. The mismatch includes the real-time load index being greater than the upper limit of the reasonable carrying capacity or the real-time load index being less than the lower limit of the reasonable carrying capacity.

[0083] In this embodiment, if the real-time load index exceeds the upper limit of the reasonable capacity range, the number of created RTC rooms in the current target online chorus room is increased; if the real-time load index is less than the lower limit of the reasonable capacity range, the number of created RTC rooms in the current target online chorus room is decreased. It can be understood that if the real-time load index exceeds the upper limit of the reasonable capacity range, it indicates that there are many users participating in the chorus, and a new RTC room needs to be created in the current target online chorus room in advance to match the number of created RTC rooms in the adjusted target online chorus room with the real-time load index. If the real-time load index is less than the lower limit of the reasonable capacity range, the target RTC room with the fewest chorus participants can be determined from the created RTC rooms in the current target online chorus room, and the chorus participants in the target RTC room can be reassigned to other RTC rooms. If there are no chorus participants in the reassigned target RTC room, the target RTC room can be deleted to match the number of created RTC rooms in the adjusted target online chorus room with the real-time load index.

[0084] In this embodiment, after increasing the number of existing RTC rooms in the current target online chorus room, the process may further include identifying choral users to be scheduled from the existing choral users in the current target online chorus room before the increase operation; migrating these choral users to the new RTC room created after the increase operation, so that the number of choral members in the new RTC room after the migration is not less than a preset number. The preset number is determined based on the number of downstream choral audio paths pre-configured for the RTC rooms in the target online chorus room. It can be understood that if the number of downstream choral audio paths pre-configured for the RTC rooms in the target online chorus room is 10, then the preset number is 10. Therefore, after creating a new RTC room in the current target online chorus room, it is necessary to first identify choral users to be scheduled from the existing choral users in the other RTC rooms in the current target online chorus room (excluding the new RTC room), and migrate these choral users to the new RTC room, so that the number of choral members in the new RTC room after the migration is not less than the preset number of 10.

[0085] It should be noted that during the migration of choral users to be scheduled, there will be continuous additions and departures of choral users in the existing RTC rooms of the target online choral space. Therefore, the selection of choral users to be scheduled must be based on the premise that the number of choral users in the other RTC rooms besides the new RTC room is not less than the preset number of 10. This selection can be made from one RTC room or from multiple RTC rooms. Simultaneously, it must be ensured that after migrating the choral users to be scheduled to the new RTC room, the remaining number of choral users in the other RTC rooms is not less than the preset number.

[0086] Furthermore, regarding the determination of the number of chorus users to be reassigned, in one scenario, the number of chorus users to be reassigned is the preset number of 10. This means directly migrating 10 chorus users to the new RTC room, ensuring that the number of chorus members in the new RTC room after the migration is not less than the preset number. In another scenario, the current number of chorus members in the new RTC room of the target online chorus room is determined. Based on the current number of chorus members in the new RTC room and the preset number of 10, the number of chorus users to be reassigned is determined, and the corresponding number of chorus users to be reassigned is migrated to the new RTC room, ensuring that the number of chorus members in the new RTC room after the migration is not less than the preset number of 10.

[0087] In this embodiment, if the number of created RTC rooms in the current target online chorus room matches the real-time load index, then a migration operation for chorus users is performed among the currently created RTC rooms to achieve a balance in the number of chorus members in each currently created RTC room. It can be understood that the matching of the number of created RTC rooms in the current target online chorus room with the real-time load index means that the real-time load index matches the reasonable capacity range determined based on the number of created RTC rooms; that is, the real-time load index is not less than the lower limit of the reasonable capacity range and not greater than the upper limit of the reasonable capacity range. When it is detected that the number of chorus members in a certain created RTC room in the current target online chorus room is less than the number of downstream audio paths configured for the RTC room in the target online chorus room, that is, when it is detected that the number of chorus members in a certain created RTC room in the current target online chorus room is less than the preset number, a migration operation of chorus users can be performed between the currently created RTC rooms, provided that the number of chorus members in other RTC rooms in the current target online chorus room is not less than the preset number. In other words, some chorus users in other RTC rooms are relocated to the created RTC rooms with fewer chorus members than the preset number, so that after the migration, the number of chorus members in each created RTC room in the current target online chorus room is not less than the preset number, thus achieving a balance in the number of chorus members in each created RTC room.

[0088] In this embodiment, when a non-singing user in the target online chorus room applies for chorus qualification, the system determines the RTC room to be joined from the existing RTC rooms in the target online chorus room based on the number of chorus members and / or the user relationship information of non-singing users in each existing RTC room. The non-singing user is then added to the RTC room to be joined to complete the response to the chorus qualification application.

[0089] In the first specific implementation, when a non-singing user who has joined the target online chorus room but has not joined the RTC room is received, the RTC room with the fewest chorus members is determined from the various created RTC rooms in the current target online chorus room, and the non-singing user is added to the RTC room to be joined, so as to complete the response to the non-singing user's chorus qualification application.

[0090] In the second specific implementation, when a non-chorus user who has joined the target online chorus room but not the RTC room receives a chorus qualification application, the system determines the RTC room to join from the existing RTC rooms of the current target online chorus room based on the non-chorus user's user relationship information. This can be based on the non-chorus user's close relationship or interaction level, or on the number of users who have a friend relationship with the non-chorus user in each existing RTC room. The non-chorus user is then added to the RTC room to join to complete the response to the non-chorus user's chorus qualification application.

[0091] In the third specific implementation, when a non-chorus user who has joined the target online chorus room but not the RTC room receives a chorus qualification application, a weighted calculation is performed based on the number of chorus members and the user relationship information of non-chorus users in each created RTC room of the current target online chorus room, as well as their respective weights, to determine the RTC room to be joined from the created RTC rooms of the current target online chorus room, and the non-chorus user is added to the RTC room to be joined, thus completing the response to the chorus qualification application.

[0092] like Figure 2As shown, when a non-singing user in the target online chorus room submits a request to join the chorus, the chorus platform's cloud scheduling module determines the desired RTC room (e.g., RTC-1) from the existing RTC rooms in the target online chorus room and adds the non-singing user to RTC-1, thus confirming the non-singing user as a chorus member. For each chorus member joining the RTC room, the chorus platform uploads their audio to the cloud via an uplink and distributes the audio of other chorus members to their respective devices via a downlink. Conversely, when a chorus member in an existing RTC room in the target online chorus room submits a request to leave the chorus, that chorus member becomes a non-singing user in the target online chorus room. Non-singing users can still hear the audio of other chorus members, but cannot participate in the chorus. Furthermore, it is necessary to collect the real-time load index of the current target online choir room and determine the reasonable load capacity range of the current target online choir room based on the number of RTC rooms already created in the current target online choir room. If the real-time load index is greater than the upper limit of the reasonable capacity range, a new RTC room is created in the current target online choir room to increase the number of created RTC rooms in the current target online choir room. Then, choir users to be scheduled are identified from the existing choir users in the current target online choir room before the increase operation, and these users are migrated to the new RTC room created after the increase operation. If the real-time load index is less than the lower limit of the reasonable capacity range, the target RTC room with the fewest choir members is identified from the existing RTC rooms in the current target online choir room. The choir users in the target RTC room are scheduled to other RTC rooms. If there are no choir users in the scheduled target RTC room, the target RTC room is deleted.

[0093] Therefore, this application adjusts the number of RTC rooms in the target online chorus room based on the matching result between the number of RTC rooms created in the target online chorus room and the real-time load index. This achieves reasonable utilization of resources and supports multiple RTC rooms in one online chorus room, without being limited by the number of uplink paths when only one RTC room is supported. This allows more people to participate in large-scale chorus in real time and improves the user experience.

[0094] Based on the previous embodiment, this application has described the complete process of adjusting the number of created RTC rooms in the current target online chorus room and the detailed process of increasing the number. Next, this application will elaborate on the operation of reducing the number of created RTC rooms in the current target online chorus room. See [link to previous application]. Figure 3 As shown in the figure, an embodiment of the present invention discloses a process for reducing the number of created RTC rooms, including:

[0095] Step S21: Determine the target RTC room with the fewest choir members from the existing RTC rooms in the current target online choir room.

[0096] In this embodiment, the real-time load index of the current target online chorus room is collected, and the reasonable load-bearing range of the current target online chorus room is determined based on the number of rooms in the current target online chorus room that have created RTC rooms. When the real-time load index is less than the lower limit of the reasonable load-bearing range, the target RTC room with the fewest chorus members is determined from the created RTC rooms of the current target online chorus room.

[0097] Step S22: Move some of the chorus users in the current target RTC room to other RTC rooms.

[0098] In this embodiment, since the number of chorus users in the existing RTC rooms of the current target online chorus room is constantly changing, a portion of the chorus users in the current target RTC room can be migrated to other RTC rooms. It should be noted that the number of users can be a pre-set number or a number adjusted in real-time based on the current number of chorus users in the target RTC room. Specifically, a portion of the chorus users in the current target RTC room can be migrated individually to other existing RTC rooms; alternatively, all of the chorus users in the current target RTC room can be migrated to the existing RTC room with the fewest chorus users.

[0099] Step S23: If the first preset condition is detected, then the deletion operation of the target RTC room is performed; the first preset condition is that there are no chorus users in the target RTC room.

[0100] In this embodiment, after migrating some chorus users in the current target RTC room to other RTC rooms, if it is detected that there are no chorus users in the migrated target RTC room, the target RTC room can be deleted to save resources.

[0101] Step S24: If the second preset condition is detected, then jump back to the step of migrating some chorus users in the current target RTC room to other RTC rooms; the second preset condition is that there are still chorus users in the current target RTC room, and the real-time load index of the current target online chorus room is less than the lower limit of the reasonable carrying capacity.

[0102] In this embodiment, after migrating some chorus users in the current target RTC room to other RTC rooms, if it is detected that there are still chorus users in the migrated target RTC room, and the real-time load index of the current target online chorus room is still less than the lower limit of the reasonable carrying capacity, then the step of migrating some chorus users in the current target RTC room to other RTC rooms in step S22 will continue to be executed.

[0103] Step S25: If the third preset condition is detected, the deletion operation of the target RTC room is prohibited, and the current loop ends; the third preset condition is that the real-time load index of the target online chorus room is not less than the lower limit of the reasonable carrying capacity.

[0104] In this embodiment, after migrating some chorus users in the current target RTC room to other RTC rooms, if the real-time load index of the current target online chorus room is detected to be greater than or equal to the lower limit of the reasonable carrying capacity, it indicates that it is no longer necessary to perform the deletion operation of the target RTC room. If the real-time load index of the current target online chorus room is greater than the upper limit of the reasonable carrying capacity, it is necessary to perform the operation of increasing the number of created RTC rooms in the current target online chorus room.

[0105] Therefore, this application determines the reasonable load capacity based on the number of existing RTC rooms in the current target online chorus room. When the real-time load index of the current target online chorus room is less than the lower limit of the reasonable load capacity, it identifies the target RTC room with the fewest chorus members from the existing RTC rooms in the current target online chorus room. Then, it reassigns some chorus users from the target RTC room to other RTC rooms. If there are no chorus users in the reassigned target RTC room, it deletes the target RTC room to achieve reasonable utilization of resources. At the same time, it supports multiple RTC rooms in one online chorus room, without being limited by the number of uplink audio paths for chorus when only one RTC room is supported, thereby enabling more people to participate in large-scale chorus in real time and improving the user experience.

[0106] Based on the previous embodiment, this application describes the operation of reducing the number of created RTC rooms in the current target online chorus room. Next, this application will elaborate in detail on how to select high-quality audio data from the created RTC rooms in the current target online chorus room for distribution.

[0107] See Figure 4 As shown in the figure, an embodiment of the present invention discloses a process for transmitting audio data, including:

[0108] Step S31: Obtain the preset type information of the first target user; the preset type information includes any one or a combination of several of the following: device performance information, network round-trip time information, end-to-end time delay information, user relationship information, and dry sound quality of the first target user.

[0109] In this embodiment, preset type information of the first target user is periodically acquired according to a preset time period to update the sent audio data based on the preset time period. It should be noted that the preset time period is set according to the user's actual needs; for example, the preset time period can be set to 10 seconds. Furthermore, by setting priorities and weights for device performance information, network round-trip latency information, end-to-end latency information, user relationship information, and dry sound quality, the audio data of the target user can be evaluated from multiple dimensions. The device performance information includes the device model, version, and type (Bluetooth, speaker, headphones); network round-trip latency information refers to the target user's own network latency; end-to-end latency information refers to the network latency between the target user and other users; user relationship information includes the user's friend relationships, close relationships, or interactive relationships; dry sound quality includes the chorus platform's score for the target user's chorus audio and the target user's noise level; specifically, the chorus platform's score for the target user's chorus audio uses a five-dimensional scoring system to score the target user's pitch, rhythm, breath control, emotion, and technique, and uses the corresponding weights to perform a weighted calculation to obtain the final score for the target user's chorus audio.

[0110] Step S32: Based on the preset type information, determine a number of second target users from the target chorus user range of the current target online chorus room.

[0111] In one specific implementation, if the first target user is a chorus user who has joined an RTC room in the current target online chorus room, then the target chorus user range is the range consisting of all chorus users in the RTC room where the first target user is currently located, so as to determine a certain number of second target users from the target chorus user range of the current target online chorus room based on the preset type information of the first target user; wherein, the certain number is not greater than the number of chorus audio downlink paths pre-configured for the RTC room in the target online chorus room.

[0112] In another specific implementation, if the first target user is a non-chorus user who has joined the target online chorus room but has not joined the RTC room, then the target chorus user range is the range consisting of all chorus users in the current target online chorus room, that is, the target chorus user range consists of all chorus users in the current target online chorus room that have created RTC rooms. Then, based on the preset type information of the first target user, a certain number of second target users are determined from the target chorus user range of the current target online chorus room.

[0113] Step S33: The chorus audio of the second target user is transmitted to the device of the first target user through the corresponding downlink.

[0114] In this embodiment, a number of second target users' choral audio recordings selected from the target choral user range of the current target online chorus room are transmitted to the device of the first target user via a corresponding downlink. In this way, since the choral audio recordings of the second target users are determined based on multiple dimensions including the device performance information, network round-trip latency information, end-to-end latency information, user relationship information, and dry sound quality of the first target user, higher-quality audio data can be selected from the target choral user range of the current target online chorus room, thus improving the user experience.

[0115] like Figure 5 As shown, for choralists joining an existing RTC room in the target online choral room, the choral platform collects preset type information for each choralist and reports it to the cloud server. This preset type information includes each choralist's device performance information, network round-trip latency information, end-to-end latency information, user relationship information, and dry sound quality. For the target user, if the downlink audio path is 3, the platform determines the target user's current RTC room and, based on the target user's preset type information, identifies 3 high-quality target choralists (B, D, E) from all choralists (A, B, C, D, E) in the target user's current RTC room. The target choralists' audio is then transmitted to the target user's device via the downlink. It should be noted that, as... Figure 6 As shown, for choral users (A, B, C) who join the currently target online choral room in an existing RTC room, the choral platform will upload the choral audio of each choral user through the uplink and also send the choral audio of other choral users to the corresponding devices of each choral user through the downlink.

[0116] Therefore, this application evaluates the choral audio of the target user from multiple dimensions, including device performance information, network round-trip latency information, end-to-end latency information, user relationship information, and dry sound quality. Based on the preset type information of the first target user, it comprehensively selects several second target users with better quality from the target choral users in the current target online choral room, and sends the choral audio of the second target users to the device of the first target user through the downlink, thereby improving the user experience and ensuring the effect of the chorus.

[0117] See Figure 7 As shown, an embodiment of the present invention discloses a processing device for a choral platform, comprising:

[0118] The load index acquisition module 11 is used to acquire the real-time load index of the current target online choir room; the real-time load index is an index determined based on the change in the number of choir members in the current target online choir room.

[0119] Room Quantity Determination Module 12 is used to determine the number of created RTC rooms in the current target online chorus room;

[0120] The matching result acquisition module 13 is used to acquire the matching result between the number of created RTC rooms and the real-time load index;

[0121] The room quantity adjustment module 14 is used to adjust the number of created RTC rooms in the target online chorus room if the number of created RTC rooms does not match the real-time load index, so that the adjusted number of created RTC rooms in the target online chorus room matches the real-time load index.

[0122] Therefore, this application adjusts the number of RTC rooms in the target online chorus room based on the matching result between the number of RTC rooms created in the target online chorus room and the real-time load index. This achieves reasonable utilization of resources and supports multiple RTC rooms in one online chorus room, without being limited by the number of uplink paths when only one RTC room is supported. This allows more people to participate in large-scale chorus in real time and improves the user experience.

[0123] In some specific embodiments, the matching result acquisition module 13 includes:

[0124] The range determination submodule is used to determine the reasonable load-bearing range of the relevant load in the current target online chorus room based on the number of rooms of the already created RTC rooms;

[0125] The matching result acquisition unit is used to acquire the matching result between the reasonable bearing range and the real-time load index.

[0126] In some specific embodiments, the load metric acquisition module 11 includes:

[0127] The chorus number determination unit is used to determine the number of choruses in the current target online chorus room and the real-time changing number of choruses in the current target online chorus room;

[0128] The total number of participants determination unit is used to determine the current total number of participants in the choir based on the number of choir members in the target online choir room and the real-time changing number of choir members.

[0129] Accordingly, the range determination submodule includes:

[0130] The first range determination unit is used to determine the corresponding first reasonable carrying range based on the number of rooms in the created RTC rooms; the first reasonable carrying range is the reasonable carrying range of the total number of chorus members in the target online chorus room.

[0131] In some specific embodiments, the load metric acquisition module 11 includes:

[0132] The rate of change monitoring unit is used to monitor the rate of change of the number of chorus members in the current target online chorus room in real time;

[0133] Accordingly, the range determination submodule includes:

[0134] The second range determination unit is used to determine the corresponding second reasonable carrying range based on the number of rooms in the created RTC rooms and the number of chorus members in the current target online chorus room; the second reasonable carrying range is the reasonable carrying range of the current target online chorus room with respect to the rate of change of the number of chorus members.

[0135] In some specific embodiments, the room quantity adjustment module 14 includes:

[0136] The quantity increase unit is used to increase the quantity of the created RTC rooms in the target online chorus room if the real-time load index is greater than the upper limit of the reasonable carrying range.

[0137] The quantity reduction submodule is used to reduce the number of created RTC rooms in the target online chorus room if the real-time load index is less than the lower limit of the reasonable carrying range.

[0138] In some specific embodiments, the processing device of the chorus platform further includes:

[0139] The user to be scheduled determination unit is used to determine the chorus users to be scheduled from the existing chorus users of the target line chorus room before the quantity increase operation.

[0140] The user migration unit is used to migrate the chorus users to the new RTC room created after the number increase operation, so that the number of chorus users in the new RTC room after the migration is not less than the preset number.

[0141] In some specific embodiments, the processing device of the chorus platform further includes:

[0142] A preset quantity determination unit is used to determine the preset quantity based on the number of downstream choral audio paths pre-configured for the RTC room in the target online choral room.

[0143] In some specific embodiments, the quantity reduction submodule includes:

[0144] The target room determination unit is used to determine the target RTC room with the fewest chorus members from the existing RTC rooms of the target online chorus room.

[0145] The target room deletion unit is used to migrate the chorus users in the current target RTC room to other RTC rooms, and to perform the deletion operation on the target RTC room after there are no more chorus users in the target RTC room.

[0146] In some specific embodiments, the target room deletion unit includes:

[0147] A partial user migration unit is used to migrate some chorus users in the current target RTC room to other RTC rooms;

[0148] The deletion operation execution unit is used to perform a deletion operation on the target RTC room if it is detected that a first preset condition is met; the first preset condition is that there are no chorus users in the target RTC room at present;

[0149] The step jump unit is used to jump back to the step of migrating some chorus users in the current target RTC room to other RTC rooms if the second preset condition is detected; the second preset condition is that there are still chorus users in the current target RTC room, and the real-time load index of the current target online chorus room is less than the lower limit of the reasonable carrying range.

[0150] The loop termination unit is used to prevent the deletion operation of the target RTC room and end the current loop if the third preset condition is detected to be met. The third preset condition is that the real-time load index of the target online chorus room is not less than the lower limit of the reasonable carrying capacity.

[0151] In some specific embodiments, the processing device of the chorus platform is further configured to perform a migration operation of chorus users among the currently created RTC rooms when the number of rooms in the created RTC rooms matches the real-time load index, so as to achieve a balance in the number of chorus members in the currently created RTC rooms.

[0152] In some specific embodiments, the processing device of the chorus platform further includes:

[0153] The information acquisition unit is used to acquire preset type information of the first target user; the preset type information includes any one or a combination of several of the following: device performance information, network round-trip time information, end-to-end delay information, user relationship information, and dry sound quality of the first target user.

[0154] The target user determination unit is used to determine a number of second target users from the target chorus user range of the current target online chorus room based on the preset type information.

[0155] The chorus audio transmission unit is used to transmit the chorus audio of the second target user to the device of the first target user through the corresponding downlink.

[0156] In some specific embodiments, the processing device of the chorus platform is further configured to, if the first target user is a chorus user who has joined an RTC room, then the range of target chorus users is the range consisting of all chorus users in the RTC room where the first target user is currently located; if the first target user is a non-chorus user who has joined the target online chorus room but has not joined an RTC room, then the range of target chorus users is the range consisting of all chorus users in the current target online chorus room.

[0157] In some specific embodiments, the processing device of the chorus platform further includes:

[0158] The room to be joined determination unit is used to determine the RTC room to be joined from the existing RTC rooms of the current target online chorus room when a chorus qualification application from a non-chorus user in the target online chorus room is obtained. This is based on the number of chorus members in each of the currently created RTC rooms and / or the user relationship information of the non-chorus users.

[0159] The user addition unit is used to add the non-chorus user to the RTC room to be joined, in order to complete the response to the chorus qualification application.

[0160] Furthermore, embodiments of this application also disclose an electronic device, Figure 8 This is a structural diagram of an electronic device 20 according to an exemplary embodiment. The content of the diagram should not be construed as limiting the scope of this application.

[0161] Figure 8 This is a schematic diagram of the structure of an electronic device 20 provided in an embodiment of this application. Specifically, the electronic device 20 may include: at least one processor 21, at least one memory 22, a power supply 23, a communication interface 24, an input / output interface 25, and a communication bus 26. The memory 22 stores a computer program, which is loaded and executed by the processor 21 to implement the relevant steps in the processing method of the chorus platform disclosed in any of the foregoing embodiments. Furthermore, the electronic device 20 in this embodiment may specifically be an electronic computer.

[0162] In this embodiment, the power supply 23 is used to provide operating voltage for each hardware device on the electronic device 20; the communication interface 24 can create a data transmission channel between the electronic device 20 and external devices, and the communication protocol it follows can be any communication protocol applicable to the technical solution of this application, and is not specifically limited here; the input / output interface 25 is used to acquire external input data or output data to the outside world, and its specific interface type can be selected according to specific application needs, and is not specifically limited here.

[0163] In addition, the memory 22, as a carrier for resource storage, can be a read-only memory, random access memory, disk or optical disk, etc. The resources stored thereon can include operating system 221, computer program 222, etc., and the storage method can be temporary storage or permanent storage.

[0164] The operating system 221 is used to manage and control the various hardware devices on the electronic device 20 and the computer program 222, which may be Windows Server, Netware, Unix, Linux, etc. In addition to including computer programs capable of performing the processing methods of the chorus platform executed by the electronic device 20 as disclosed in any of the foregoing embodiments, the computer program 222 may further include computer programs capable of performing other specific tasks.

[0165] Furthermore, this application also discloses a computer-readable storage medium for storing a computer program; wherein, when the computer program is executed by a processor, it implements the aforementioned processing method for the choral platform. Specific steps of this method can be found in the corresponding content disclosed in the foregoing embodiments, and will not be repeated here.

[0166] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on its differences from other embodiments. Similar or identical parts between embodiments can be referred to interchangeably. For the apparatus disclosed in the embodiments, since it corresponds to the method disclosed in the embodiments, the description is relatively simple; relevant parts can be referred to in the method section.

[0167] Those skilled in the art will further recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the components and steps of the various examples have been generally described in terms of functionality in the foregoing description. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0168] The steps of the methods or algorithms described in conjunction with the embodiments disclosed herein can be implemented directly by hardware, a software module executed by a processor, or a combination of both. The software module can be located in random access memory (RAM), main memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or any other form of storage medium known in the art.

[0169] Finally, it should be noted that in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0170] The technical solutions provided in this application have been described in detail above. Specific examples have been used to illustrate the principles and implementation methods of this application. The descriptions of the above embodiments are only for the purpose of helping to understand the methods and core ideas of this application. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of this application. Therefore, the content of this specification should not be construed as a limitation of this application.

Claims

1. A processing method for a choral platform, characterized in that, include: Collect the real-time load index of the target online choir room; the real-time load index is an index determined based on the changes in the number of choir members in the target online choir room. Determine the number of created RTC rooms in the target online chorus room; Obtain the matching result between the number of created RTC rooms and the real-time load metric; If the number of created RTC rooms does not match the real-time load index, then the number of created RTC rooms in the current target online chorus room is adjusted so that the number of created RTC rooms in the target online chorus room matches the real-time load index after adjustment. The step of obtaining the matching result between the number of created RTC rooms and the real-time load metric includes: Based on the number of RTC rooms already created, determine the reasonable load-bearing range of the target online chorus room; Obtain the matching result between the reasonable load range and the real-time load index; The operation of adjusting the number of created RTC rooms in the target online chorus room includes: If the real-time load index is greater than the upper limit of the reasonable carrying range, then the number of created RTC rooms in the current target online chorus room will be increased. If the real-time load index is less than the lower limit of the reasonable carrying capacity, then the number of created RTC rooms in the current target online chorus room will be reduced.

2. The processing method of the chorus platform according to claim 1, characterized in that, The collection of real-time load metrics for the current target online choir room includes: Determine the number of choruses in the current target online chorus room and the real-time change in the number of choruses in the current target online chorus room; The current total number of chorus members is determined based on the number of chorus members in the target online chorus room and the real-time changing number of chorus members. Accordingly, determining the reasonable load-bearing range of the target online chorus room based on the number of rooms in the created RTC rooms includes: The first reasonable capacity range is determined based on the number of RTC rooms that have been created; the first reasonable capacity range is the reasonable capacity range for the total number of chorus members in the target online chorus room.

3. The processing method for the chorus platform according to claim 1, characterized in that, The collection of real-time load metrics for the current target online choir room includes: Monitor the rate of change in the number of singers in the current online choir room; Accordingly, determining the reasonable load-bearing range of the target online chorus room based on the number of rooms in the created RTC rooms includes: The second reasonable capacity range is determined based on the number of RTC rooms already created and the number of chorus members in the current target online chorus room; the second reasonable capacity range is the reasonable capacity range of the current target online chorus room with respect to the rate of change of the number of chorus members.

4. The processing method for the chorus platform according to claim 1, characterized in that, After increasing the number of existing RTC rooms in the target online chorus room, the method further includes: The target online chorus room will determine the chorus users to be scheduled from the existing chorus users before the number increase operation. The chorus users to be scheduled are migrated to the new RTC room created after the number increase operation, so that the number of chorus users in the new RTC room after the migration is not less than the preset number.

5. The processing method for the chorus platform according to claim 4, characterized in that, Also includes: The preset number is determined based on the number of downstream choral audio paths pre-configured for the RTC room in the target online choral room.

6. The processing method for the chorus platform according to claim 1, characterized in that, The operation of reducing the number of created RTC rooms in the current target online chorus room includes: Determine the target RTC room with the fewest choir members from the currently created RTC rooms of the target online choir room; The chorus users in the current target RTC room are migrated to other RTC rooms, and after there are no more chorus users in the target RTC room, the target RTC room is deleted.

7. The processing method for the chorus platform according to claim 6, characterized in that, The step of migrating the chorus users in the current target RTC room to other RTC rooms, and then deleting the target RTC room after there are no more chorus users in the target RTC room, includes: Migrate some of the chorus users in the current target RTC room to other RTC rooms; If the first preset condition is detected, the target RTC room is deleted; the first preset condition is that there are no chorus users in the target RTC room. If the second preset condition is detected, the process will jump back to the step of migrating some of the chorus users in the current target RTC room to other RTC rooms; the second preset condition is that there are still chorus users in the current target RTC room, and the real-time load index of the current target online chorus room is less than the lower limit of the reasonable carrying capacity. If the third preset condition is detected, the deletion operation of the target RTC room is prohibited, and the current loop ends; the third preset condition is that the real-time load index of the target online chorus room is not less than the lower limit of the reasonable carrying capacity.

8. The processing method of the chorus platform according to any one of claims 1 to 7, characterized in that, Also includes: When the number of created RTC rooms matches the real-time load metric, a migration operation for chorus users is performed between the currently created RTC rooms to achieve a balance in the number of chorus members in the currently created RTC rooms.

9. The processing method of the chorus platform according to any one of claims 1 to 7, characterized in that, Also includes: Obtain preset type information of the first target user; the preset type information includes any one or a combination of several of the following: device performance information, network round-trip time information, end-to-end latency information, user relationship information, and dry sound quality of the first target user; Based on the preset type information, a certain number of second target users are determined from the target chorus user range of the current target online chorus room. The chorus audio of the second target user is transmitted to the device of the first target user via the corresponding downlink.

10. The processing method for the chorus platform according to claim 9, characterized in that, Also includes: If the first target user is a chorus user who has joined an RTC room, then the range consisting of all chorus users in the RTC room where the first target user is currently located will be determined as the target chorus user range. If the first target user is a non-chorus user who has joined the target online chorus room but not the RTC room, then the range consisting of all chorus users in the current target online chorus room will be determined as the target chorus user range.

11. The processing method of the chorus platform according to any one of claims 1 to 7, characterized in that, Also includes: When a non-singing user in the target online chorus room applies for chorus qualification, the RTC room to be joined is determined from the existing RTC rooms of the target online chorus room based on the number of chorus members in each of the existing created RTC rooms and / or the user relationship information of the non-singing user. The non-chorus user is added to the RTC room to be joined, thus completing the response to the chorus qualification application.

12. An electronic device, characterized in that, include: Memory, used to store computer programs; A processor for executing the computer program to implement the processing method of the chorus platform as described in any one of claims 1 to 11.

13. A computer-readable storage medium, characterized in that, Used to store a computer program, which, when executed by a processor, implements the processing method of the chorus platform as described in any one of claims 1 to 11.

Images