A multi-stream multi-partition interaction method, system and storage medium

Abstract

The embodiment of the specification provides a multi-stream multi-partition interaction method, system and storage medium, the method comprises: acquiring a sound source service item, a house type diagram of a target area and a device distribution diagram, the sound source service item comprising a sound source and a sound source type; based on the house type diagram and the device distribution diagram, determining a to-be-configured partition corresponding to a playback device; in response to an application operation on the sound source service item, determining a matched partition corresponding to the sound source service item and / or an application mode of the sound source service item in the matched partition; the matched partition is a to-be-configured partition having a matched relationship with the sound source service item, and the application mode comprises direct application or a mixing operation.

Description

A multi-stream multi-partition interaction method, system and storage medium

[0001] Cross-references

[0002] This application claims priority to Chinese application No. 202311590312.8 filed on November 27, 2023, the entire contents of which are incorporated herein by reference. Technical Field

[0003] The present invention relates to the field of multimedia playback technology, and in particular to a multi-stream and multi-partition interaction method, system, and storage medium. Background Art

[0004] Each area of ​​some specific spaces (such as shopping malls, home spaces, exhibition venues, conference halls, etc.) will be equipped with a corresponding number of terminal playback devices. Due to different audio playback requirements, these terminal devices need to be grouped and partitioned, and the audio source configuration is performed according to the playback requirements, so that the user-specified audio source / video source can be played in each partition. Traditional audio source configuration is generally performed in the form of a list. The operation process is not flexible enough, and the operations of adding, deleting, modifying and checking are relatively cumbersome. Traditional grouping and partitioning are generally also operated in the form of a list. It cannot be effectively partitioned according to the physical location of the device. It is not convenient and intuitive, and the user experience is poor.

[0005] Therefore, we hope to provide a multi-stream and multi-partition interaction method that makes the audio source configuration operation flexible and convenient through a simple interaction method, while making the partition operation more intelligent and intuitive, thereby improving the user experience.

[0006] Summary of the Invention

[0007] One or more embodiments of the present specification provide a multi-stream and multi-partition interaction method, the method comprising: obtaining a sound source service item, a floor plan and a device distribution map of a target area, the sound source service item including a sound source and a sound source type; determining a partition to be configured corresponding to a playback device based on the floor plan or the device distribution map; in response to an application operation on the sound source service item, determining a paired partition corresponding to the sound source service item and / or an application method of the sound source service item in the paired partition; the paired partition is the partition to be configured that has a paired relationship with the sound source service item, and the application method includes direct application or a mixing operation.

[0008] One or more embodiments of the present specification provide a multi-stream and multi-partition interactive system, the system comprising: an acquisition module for acquiring audio source service items, a floor plan and a device distribution map of a target area, the audio source service items comprising audio sources and audio source types; a first determination module for determining, based on the floor plan or the device distribution map, the partition to be configured corresponding to the playback device; a second determination module for determining, in response to an application operation on the audio source service item, a paired partition corresponding to the audio source service item and / or an application method of the audio source service item in the paired partition; the paired partition is the partition to be configured that has a paired relationship with the audio source service item, and the application method includes direct application or mixing operation.

[0009] One or more embodiments of this specification provide a computer-readable storage medium, which stores computer instructions. When a computer reads the computer instructions in the storage medium, the computer executes the multi-stream and multi-partition interaction method.

[0010] Some embodiments of the present specification include at least the following beneficial effects: determining the partition to be configured corresponding to the playback device based on the floor plan or the device distribution map, and determining the paired partition corresponding to the sound source service item and / or the application method of the sound source service item in the paired partition in response to the application operation of the sound source service item, which can reduce the operation steps of the sound source configuration and allow users to interact more flexibly to realize the configuration of the sound source service item and the terminal device. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] This specification will be further described in the form of exemplary embodiments, which will be described in detail with reference to the accompanying drawings. These embodiments are not limiting, and in these embodiments, like numbers represent like structures, wherein:

[0012] FIG1 is a schematic diagram of an application scenario of a multi-stream multi-partition interaction system according to some embodiments of this specification;

[0013] FIG2 is an exemplary module diagram of a multi-stream and multi-partition interactive system according to some embodiments of this specification;

[0014] FIG3 is an exemplary flow chart of a multi-stream multi-partition interaction method according to some embodiments of this specification;

[0015] FIG4 is an exemplary schematic diagram of determining a partition to be configured corresponding to a playback device based on a device distribution map according to some embodiments of this specification;

[0016] FIG5 is another exemplary schematic diagram of determining a partition to be configured corresponding to a playback device based on a device distribution map according to some embodiments of this specification;

[0017] FIG6 is an exemplary diagram of determining a paired partition corresponding to a music source service item and / or an application method of the music source service item in the paired partition according to some embodiments of this specification;

[0018] FIG7 is an exemplary schematic diagram of another method for determining a paired partition corresponding to a music source service item and / or an application method of the music source service item in the paired partition according to some embodiments of this specification;

[0019] FIG8 is an exemplary schematic diagram of determining an application method according to some embodiments of this specification. DETAILED DESCRIPTION

[0020] To more clearly illustrate the technical solutions of the embodiments of this specification, the following briefly describes the drawings required for describing the embodiments. Obviously, the drawings described below are merely examples or embodiments of this specification. Those skilled in the art can apply this specification to other similar scenarios based on these drawings without inventive effort. Unless otherwise apparent from the context or otherwise noted, the same reference numerals in the figures represent the same structure or operation.

[0021] It should be understood that the terms "system," "device," "unit," and / or "module" used herein are a method for distinguishing different components, elements, parts, portions, or assemblies at different levels. However, if other terms can achieve the same purpose, the terms may be replaced by other expressions.

[0022] FIG1 is a schematic diagram of an application scenario of a multi-stream and multi-partition interaction system according to some embodiments of this specification.

[0023] In some embodiments, as shown in FIG1 , an application scenario 100 of a multi-stream multi-partition interactive system may include a processor 110 , a terminal device 120 , a playback device 130 , a user 140 , a network 150 , and a storage device 160 .

[0024] The processor 110 is used to process information and / or data related to the application scenario 100. In some embodiments, the processor 110 can process data and / or information obtained from other devices or system components. The processor 110 can execute program instructions based on these data, information and / or processing results to perform one or more functions described in the embodiments of this specification. For example, the processor 110 can determine the partition to be configured corresponding to the playback device, and determine the paired partition corresponding to the sound source service item and / or the application method of the sound source service item in the paired partition by executing the multi-stream multi-partition interaction method disclosed in this specification. Exemplarily, the processor 110 can obtain the sound source service item, the floor plan of the target area and the device distribution map; based on the floor plan or the device distribution map, determine the partition to be configured corresponding to the playback device 130; in response to the application operation of the sound source service item, determine the paired partition corresponding to the sound source service item and / or the application method of the sound source service item in the paired partition.

[0025] In some embodiments, the processor 110 may include one or more sub-processing devices (e.g., a single-core processing device or a multi-core multi-core processing device). By way of example only, the processor 110 may include a central processing unit (CPU), an application-specific integrated circuit (ASIC), an application-specific instruction processor (ASIP), a graphics processing unit (GPU), a digital signal processor (DSP), a microprocessor, or the like, or any combination thereof. In some embodiments, the processor 110 may be implemented on a cloud platform. By way of example only, the cloud platform may include a private cloud, a public cloud, a hybrid cloud, a community cloud, a distributed cloud, an internal cloud, a multi-layer cloud, or the like, or any combination thereof.

[0026] Terminal device 120 refers to one or more devices or software used by user 140. User 140 may be an operator who controls the playback of an audio source. User 140 may interact with the multi-stream, multi-zone interactive system via terminal device 120. In some embodiments, terminal device 120 may include one or any combination of other devices with input and / or output capabilities, such as mobile device 120-1, tablet computer 120-2, laptop computer 120-3, etc. In some embodiments, processor 110 may be part of terminal device 120.

[0027] In some embodiments, the terminal device 120 may include an interactive interface. The interactive interface refers to an interface for the user 140 to interact with the multi-stream multi-partition interactive system. For example, the interactive interface may be a touch screen, a display screen, etc. In some embodiments, the user 140 may interact with other components of the multi-stream multi-partition interactive system (such as the processor 110, the playback device 130, etc.) through the interactive interface of the terminal device 120. For example, the processor 110 may determine the partition to be configured corresponding to the playback device 130 in response to the user 140 dragging the playback device 130 on the interactive interface of the terminal device 120. For another example, the processor 110 may determine the partition to be configured corresponding to the playback device 130 in response to the user 140 connecting the playback device 130 on the interactive interface of the terminal device 120.

[0028] The playback device 130 refers to a device used to play audio sources. For example, the playback device 130 may include, but is not limited to, speaker devices used in shopping malls and homes, as well as products that can use voice playback functions (such as smart refrigerators, car speakers, etc.). There is no limitation on the type of playback device. In some embodiments, the playback device 130 can be connected to the network 150 to communicate with one or more components of the application scenario 100.

[0029] The network 150 can facilitate the exchange of information and / or data. The network 150 enables communication between components and with other components outside the system, facilitating the exchange of data and / or information. In some embodiments, one or more components of the application scenario 100 (e.g., the processor 110, the terminal device 120, the storage device 160) can send information and / or data to other components of the application scenario 100 via the network 150. For example, the processor 110 can obtain gesture operations of the user 140 from the terminal device 120 via the network 150.

[0030] In some embodiments, network 150 may include any one or more of a wired network or a wireless network. In some embodiments, network 150 may include a cable network, a fiber optic network, the Internet, a Bluetooth network, or any combination thereof. In some embodiments, the network connections between the components in application scenario 100 may adopt one of the above methods or multiple methods. In some embodiments, network 150 may be a point-to-point, shared, centralized, or other topological structure, or a combination of multiple topological structures.

[0031] The storage device 160 can be used to store data, instructions and / or any other information. In some embodiments, the storage device 160 can store data and / or information processed by the processor 110. For example, the storage device 160 can store floor plans, device distribution maps, partitions to be configured, instruction input templates, etc. The storage device 160 may include one or more storage components, each of which may be an independent device or part of other devices. In some embodiments, the storage device 160 may include random access memory (RAM), read-only memory (ROM), removable memory, etc. or any combination thereof. In some embodiments, the storage device 160 can be connected to the network 150 to enable communication with one or more components in the application scenario 100. In some embodiments, the storage device 160 can be implemented on a cloud platform. In some embodiments, the storage device 160 can be integrated or included in one or more other components of the application scenario 100 (e.g., processor 110, terminal device 120).

[0032] For more information about the user characteristics, floor plan, device distribution map, partitions to be configured, command input template and other related parameters mentioned above, please refer to the relevant descriptions of Figures 3 to 8.

[0033] It is worth noting that the application scenario 100 of the multi-stream, multi-zone interactive system is provided for illustrative purposes only and is not intended to limit the scope of this specification. Those skilled in the art can make various changes and modifications based on the description of this specification. For example, the application scenario 100 of the multi-stream, multi-zone interactive system can also include a database, an information source, and the like. For another example, the application scenario 100 of the multi-device playback system can implement similar or different functions on other devices. However, these changes and modifications do not deviate from the scope of this specification.

[0034] Figure 2 is an exemplary block diagram of a multi-stream, multi-zone interaction system according to some embodiments of this specification. In some embodiments, as shown in Figure 2, multi-stream, multi-zone interaction system 200 may include an acquisition module 210, a first determination module 220, and a second determination module 230. In some embodiments, acquisition module 210, first determination module 220, and second determination module 230 may be implemented based on processor 110.

[0035] In some embodiments, the acquisition module 210 can be used to obtain audio source service items, a floor plan of a target area, and a device distribution map.

[0036] In some embodiments, the first determining module 220 may be configured to determine the partition to be configured corresponding to the playback device based on a floor plan or a device distribution map.

[0037] In some embodiments, the first determining module 220 may also be configured to determine the partition to be configured corresponding to the playback device based on a floor plan or a device distribution map in response to a partitioning operation.

[0038] In some embodiments, the first determining module 220 may also be configured to determine the partition to be configured corresponding to the playback device in response to a user dragging operation on the playback device on the interactive interface of the terminal device.

[0039] In some embodiments, the first determining module 220 may also be configured to determine the partition to be configured corresponding to the playback device in response to a user's connection operation on the playback device on an interactive interface of the terminal device.

[0040] In some embodiments, the second determining module 230 may be configured to determine a paired partition corresponding to the audio source service item and / or an application mode of the audio source service item in the paired partition in response to an application operation on the audio source service item.

[0041] In some embodiments, the second determination module 230 can also be used to determine the pairing partition corresponding to the sound source service item based on the user's gesture operation on the sound source service item; and / or determine the application method of the sound source service item in the pairing partition based on at least one of the user's gesture operation on the sound source service item, the time of the gesture operation, the sound source type of the sound source service item, and the position where the user drags the sound source service item into the pairing partition.

[0042] In some embodiments, the second determination module 230 may also be configured to obtain a user input instruction based on the audio source service item, the partition to be configured, and the instruction input template; and determine the paired partition corresponding to the audio source service item based on the user input instruction.

[0043] In some embodiments, the second determination module 230 can also be used to obtain an application scenario set; based on the application scenario set, the sound source service item and the paired partition corresponding to the sound source service item, determine the application mode of the sound source service item in the paired partition.

[0044] In some embodiments, the second determination module 230 can also be used to determine at least one recommended application method of the sound source service item in the paired partition corresponding to the sound source service item in response to the time length between the setting time of the application scenario set and the current time being greater than a duration threshold; and determine the application method of the sound source service item in the paired partition based on at least one recommended application method.

[0045] In some embodiments, the second determination module 230 can also be used to determine, based on historical data, a mixing frequent item set of at least one to-be-configured partition corresponding to multiple playback devices; and determine at least one recommended application method based on the mixing frequent item set, the audio source service item and its corresponding paired partition.

[0046] In some embodiments, the second determining module 230 may also be configured to determine the dragging time based on user characteristics.

[0047] For more information about the acquisition module 210 , the first determination module 220 , and the second determination module 230 , please refer to the relevant descriptions of FIG. 3 to FIG. 8 .

[0048] It should be noted that the above description of the multi-stream and multi-partition interactive system 200 and its modules is for convenience of description only and does not limit this specification to the scope of the embodiments cited. It is understandable that for those skilled in the art, after understanding the principle of the system, it is possible to arbitrarily combine the various modules, or form a subsystem to connect with other modules without deviating from this principle. In some embodiments, the acquisition module 210, the first determination module 220 and the second determination module 230 disclosed in Figure 2 can be different modules in a system, or a module can implement the functions of two or more of the above modules. For example, the modules can share a storage module, or each module can have its own storage module. Such variations are all within the scope of protection of this specification.

[0049] Figure 3 is an exemplary flow chart of a multi-stream, multi-partition interaction method according to some embodiments of this specification. In some embodiments, process 300 may be executed by processor 110 or multiple modules of multi-stream, multi-partition interaction system 200 as shown in Figure 2. As shown in Figure 3, process 300 includes the following steps.

[0050] Step 310: Obtain audio source service items, floor plans of the target area, and equipment distribution maps.

[0051] An audio source service item refers to an item that provides audio source services. For example, an audio source service item may refer to an audio source that specifically needs to be played in a certain audio or video playback scenario. In some embodiments, an audio source service item may include an audio source and an audio source type. Among them, audio sources may include network audio sources and local audio sources, etc. Network audio sources may include Spotify, Airplay2, etc., and local audio sources may include microphone voice, analog input, etc. Audio source types may include voice, music, etc. In some embodiments, different audio source types may be further divided according to different music types.

[0052] In some embodiments, the processor can obtain audio source service items in a variety of ways. For example, the processor can obtain audio source service items through user pre-settings. In another example, the processor can read audio source service items pre-stored by the user from a storage device. The user can pre-set audio source service items corresponding to different scene types. For example, different audio source service items may correspond to a shopping mall scene, a school event scene, and a meeting scene.

[0053] The target area is the area where the sound source needs to be configured. For example, target areas include shopping malls, exhibition venues, conference halls, home spaces, classrooms, etc.

[0054] In some embodiments, the floor plan may include the floor plan structure of the target area and the distribution locations of the playback devices, wherein the distribution locations of the playback devices on the floor plan correspond to the actual physical locations of the playback devices.

[0055] In some embodiments, the floor plan can be replaced in a preset cycle and according to a preset rule. The preset cycle refers to the cycle of repeated changes in the replacement of the floor plan. The preset rule refers to the rule of change of the floor plan within the cycle. The preset cycle and the preset rule can be preset manually according to actual needs. For example, for a certain conference hall, the preset rule is to divide it into four conference halls from Monday to Friday, and to divide it into two conference halls in the east and west from Saturday to the weekend (the two conference halls in the southeast and northeast are combined into one, and the two conference halls in the southwest and northwest are combined into one). The processor can set a default shortcut to replace the floor plan of the conference hall in a preset cycle of one week according to the above preset rule, so as to meet the situation that the layout structure of the target area follows a fixed rule of change, and can improve the utilization rate of the equipment and reduce the complexity of manual operation.

[0056] In some embodiments, the processor may obtain a floor plan of the target area through various methods. For example, the processor may scan the target area with a sensor to obtain a floor plan. In another example, the processor may obtain a floor plan through user input. In another example, when the floor plan changes within a preset period according to a preset pattern, the processor may determine the floor plan of the target area based on the preset pattern.

[0057] In some embodiments, in response to the user's request to configure the sound source for the target area, the processor can obtain a floor plan of the target area. In some embodiments, the processor can display the floor plan on an interactive interface of a terminal device used by the user.

[0058] The device distribution map refers to a map that represents the distribution locations of playback devices in the target area.

[0059] In some embodiments, a device distribution map includes a number of nodes and edges. A node in the device distribution map may be a playback device, with different nodes corresponding to different playback devices. Node features may include the distribution location of the corresponding playback device. In some embodiments, edges may connect nodes within the same preset area. The preset area may be the same actual physical area in a floor plan, such as the same floor or room. The preset area may also be the same partition to be configured. Edge features may include the straight-line distance between the distribution locations of the playback devices. The straight-line distance may be, for example, the Euclidean distance between the distribution locations. The distribution location of a playback device on the device distribution map corresponds to the relative physical location of the playback device. The relative physical location refers to the reference position of the playback location in the device distribution map. For example, the processor may select any playback device within the target area as the origin, establish a rectangular coordinate system with any two mutually perpendicular directions as the X-axis and Y-axis, and use the coordinates in this rectangular coordinate system as the relative physical location of the playback device, i.e., the distribution location of the playback device on the device distribution map.

[0060] In some embodiments, the processor may construct a device distribution map based on the actual location of the playback device. In some embodiments, the processor may display the device distribution map on an interactive interface of a terminal device used by the user.

[0061] For more information about the playback device, terminal device, and interactive interface, please refer to Figure 1 and its related description.

[0062] Step 320: Determine the partition to be configured corresponding to the playback device based on the floor plan or the device distribution map.

[0063] The partition to be configured refers to the partition waiting to be configured with the audio source service item and the playback device. In some embodiments, the partition to be configured may include a combination of one or more sub-areas in the target area. In some embodiments, the partition to be configured may also include a combination of parts of one or more sub-areas in the target area.

[0064] In some embodiments, the partitions to be configured can be virtual areas rather than physical areas. For example, the processor can group three devices in the target area and create a virtual room for that group as the partition to be configured. For another example, the processor can automatically create virtual rooms corresponding to the actual physical space partitions in the target area as the partitions to be configured.

[0065] In some embodiments, the processor may determine the partition to be configured in a variety of ways. For example, the processor may determine a preset partition as the partition to be configured. The preset partition may be determined in advance based on user playback requirements.

[0066] In some embodiments, the processor may determine the partitions to be configured corresponding to each playback device in the target area, that is, one-to-one correspondence between playback devices and partitions to be configured. Each playback device may be divided into a partition to be configured, and a partition to be configured may include one or more playback devices.

[0067] In some embodiments, the processor may determine the partition to be configured corresponding to the playback device in various ways. For example, the processor may automatically identify playback devices with the same link address (e.g., linked to the same Bluetooth, linked to the same WiFi, etc.) and assign one or more playback devices with the same link address to the same partition to be configured.

[0068] In some embodiments, the processor may determine the partition to be configured corresponding to the playback device based on a floor plan or a device distribution map in response to the partition operation.

[0069] A partition operation refers to the operation of dividing the playback devices in the target area into different partition groups. The partition operation can be performed by the user on the interactive interface of the terminal device. In some embodiments, the partition operation can include a user gesture operation on the playback device. For example, a click operation (such as a single click, double click, etc.) on the playback device, a long press operation on the playback device, etc.

[0070] In some embodiments, the floor plan can be displayed on an interactive interface of the terminal device. Accordingly, the interactive interface can display the floor plan structure of the target area and the distribution location of the playback devices.

[0071] In some embodiments, the partition operation may include a user performing a gesture operation on the playback device on the floor plan. In some embodiments, the processor may determine the partition to be configured corresponding to the playback device in response to the user performing a gesture operation on the playback device on the floor plan. The gesture operation on the playback device on the floor plan may include selecting the playback device by gesture, etc.

[0072] In some embodiments, in response to a user selecting a playback device, the processor may determine the selected area as the partition to be configured corresponding to the playback device in the selected area, and associate the playback device in the selected area with the partition to be configured corresponding to the selected area. The selection includes framing the playback device using a polygon, such as by gesture, to select the playback device. The polygon may include a rectangle, a circle, or the like.

[0073] In some embodiments, the floor plan may include an initial partition of the audio device. The initial partition refers to the partition of the audio device before the user performs a gesture operation on the floor plan.

[0074] The initial partition can be determined based on the actual physical layout of the playback devices in the target area. For example, in a home space, the initial partitions on the floor plan can be the different rooms or living areas where the terminal devices are located (such as the master bedroom, second bedroom, study, living room, etc.). For another example, in response to the presence of two playback devices in the same room, the processor can divide the room into an initial partition and determine it as the initial partition corresponding to the two playback devices.

[0075] In some embodiments, the processor can modify the initial partition based on the user's partitioning operation. Partitioning operations can include gesture operations on the initial partition, such as dragging to delete, add, or move playback devices in the initial partition to form a new partition. In some embodiments, the processor can directly use the new partition as the partition to be configured.

[0076] In some embodiments, the processing device may determine the partition to be configured corresponding to the playback device based on further user operations on the new partition. Further operations may include naming the partition and assigning a TX path. The TX path refers to the transmission path of the audio data stream (the data stream that transmits audio data in real time).

[0077] In some embodiments, the processor can name the partitions and assign TX paths in a variety of ways, and determine the partitions to be configured corresponding to the playback devices. For example, in response to a user inputting a name for a partition on a terminal device, the processor can complete the partition naming and determine that the partition with the same name is the partition to be configured corresponding to the playback devices within that partition. For another example, in response to a user assigning a TX path to a partition on a terminal device, the processor can complete the TX path assignment and determine that the partition with the same TX path is the partition to be configured corresponding to the playback devices within that partition.

[0078] In some embodiments of this specification, by further modifying and naming the initial partitions formed by the actual location of the playback device and the layout structure of the physical space where it is located, the efficiency of determining the partitions to be configured can be improved, and the playback device can be effectively partitioned more conveniently and intuitively.

[0079] In some embodiments, based on the device distribution map, it is determined that the partition to be configured corresponding to the playback device is suitable for small scenarios, and corresponding playback operations can be performed through the mobile terminal. Small scenarios may include home, company, etc.

[0080] In some embodiments, based on the device distribution map, it is determined that the partition to be configured corresponding to the playback device is suitable for large-scale scenes, and corresponding playback operations can be performed through a computer terminal or a mobile terminal. Large-scale scenes may include shopping malls, exhibition venues, etc.

[0081] In some embodiments, the user can adjust the apartment structure, the number of playback devices (for example, add or remove playback devices) and the distribution position of the playback devices in the target area through the interactive interface of the terminal device. In response to the user's adjustment, the processor can adaptively adjust the partition to be configured to adapt to the user's adjustment. For example, when the user merges two rooms in the target area through the interactive interface, the processor can automatically merge the partitions to be configured corresponding to the two merged rooms into one partition to be configured. For another example, if the user adds a new playback device to the selected area, the processor can automatically divide the newly added playback device into the selected area and determine the selected area as the partition to be configured corresponding to the newly added playback device. For another example, if the user adjusts the selected area so that a certain selected area covers another selected area (the covered selected area is smaller), the processor can automatically divide the playback devices in the covered small selected area into the large selected area, and determine the large selected area as the partition to be configured corresponding to the playback devices in the large selected area. For another example, if the user expands or contracts a selected area, the processor can automatically move the playback devices that exceed the selected area out of the partition to be configured corresponding to the selected area.

[0082] In some embodiments, the device distribution map can be displayed on an interactive interface of a terminal device. In some embodiments, the partition operation can include a user gesture operation on a playback device on the device distribution map. In some embodiments, the processor can determine the partition to be configured corresponding to the playback device in response to the user gesture operation on the playback device on the device distribution map. The gesture operation on the playback device on the device distribution map can include a single-finger long press operation, a multi-finger long press operation, etc.

[0083] In some embodiments, the processor may determine a corresponding partition to be configured for the playback device that was pressed and held by the user in response to a single-finger long-press operation. For example, when a user presses and holds a playback device in a device distribution map, the processor may pop up a pop-up window on the interactive interface of the terminal device, including multiple partition selections, and the user may further click in the pop-up window to select the partition to be configured corresponding to the playback device.

[0084] In some embodiments, the processor can respond to the user's multi-finger long press operation, divide the multiple playback devices that the user presses with multiple fingers at the same time into the same group, and automatically create corresponding partitions to be configured for the playback devices in the group. For example, the thumb, index finger, and middle finger each press and hold three playback devices at the same time (after the press time exceeds the preset time, the three playback devices can be dragged), and the three pressed playback devices are dragged into a certain area at the same time, then the area is the partition to be configured corresponding to the three playback devices. The preset time can be pre-set by humans or the system. For example, 2 seconds, 3 seconds, etc.

[0085] FIG. 4 is an exemplary schematic diagram of determining a partition to be configured corresponding to a playback device based on a device distribution map according to some embodiments of this specification.

[0086] In some embodiments, the gesture operation may include a drag operation on the playback device. Specifically, the gesture operation performed by the user on the playback device on the device distribution map may include a drag operation on the playback device.

[0087] The drag operation refers to the operation of dragging the playback device to a certain area.

[0088] In some embodiments, the processor may display the playback devices to be assigned and the partitions to be configured in the device distribution map on the user's terminal device. For example, as shown in FIG4 , the processor may display the playback devices to be assigned in a list above the interactive interface of the terminal device and display the partitions to be configured below the interactive interface.

[0089] In some embodiments, the processor may determine the partition to be configured corresponding to the playback device in response to a user dragging operation on the playback device on an interactive interface of the terminal device.

[0090] In some embodiments, in response to a user dragging one or more playback devices to be assigned into a partition to be configured, the processor may automatically generate a correspondence between the one or more playback devices to be assigned and the partition to be configured. As shown in FIG4 , in response to a user dragging playback devices 410-1 and 410-2 into partition to be configured 410, the processor may determine that the partition to be configured corresponding to playback devices 410-1 and 410-2 is partition to be configured 410. Playback devices 410-1 and 410-2 may be simultaneously dragged into partition to be configured 410 based on a multi-finger operation by the user, with one finger corresponding to one playback device.

[0091] In some embodiments, in response to the user dragging one or more playback devices into an area, the processor may automatically generate corresponding partitions to be configured for the one or more playback devices.

[0092] In some embodiments, the playback device corresponding to the partition to be configured has been determined to be not included in the playback device list of the partition to be configured corresponding to the playback device in the next round of determination.

[0093] In some embodiments of the present specification, in response to a user dragging operation on a playback device on an interactive interface of a terminal device, a partition to be configured corresponding to the playback device can be determined intuitively and conveniently.

[0094] FIG. 5 is another exemplary schematic diagram of determining a partition to be configured corresponding to a playback device based on a device distribution map according to some embodiments of this specification.

[0095] In some embodiments, the gesture operation may include a connection operation on the playback device. Specifically, the gesture operation performed by the user on the playback device on the device distribution map may include a connection operation on the playback device.

[0096] Connecting multiple devices means connecting them together.

[0097] In some embodiments, the processor may display the playback devices to be allocated in the device distribution map on the user's terminal device. For example, as shown in FIG5 , the processor may display the playback devices to be allocated in a list form on the interactive interface of the terminal device.

[0098] In some embodiments, the processor may determine the partition to be configured corresponding to the playback device in response to a user's connection operation on the playback device on an interactive interface of the terminal device.

[0099] In some embodiments, the processor can connect the playback devices based on the device distribution map displayed on the interactive interface and the audio source playback requirements, and group the playback devices on the same line. For example, if the audio source playback requirement is to divide the playback devices into a preset number of groups (e.g., 3 groups), and the distribution positions of one or more playback devices in each group are as close as possible, the processor can cluster the playback devices on the device distribution map, divide the playback devices into 3 groups, connect the playback devices in the same group in the clustering results, and group the playback devices on the same line into one group. The clustering method may include K-means clustering, etc.

[0100] In some embodiments, the processor can automatically create corresponding partitions to be configured for playback devices that are grouped together through connection operations. For example, as shown in Figure 5, in response to a user connecting playback devices 510-1 and 510-2 in the device distribution map via a connection, the processor can automatically generate partitions to be configured 510-7 corresponding to playback devices 510-1 and 510-2. In response to a user connecting playback devices 510-3, 510-5, and 510-6 via a connection, the processor can automatically generate partitions to be configured 510-4 corresponding to playback devices 510-3, 510-5, and 510-6.

[0101] In some embodiments of this specification, the playback devices are connected and grouped based on their actual locations and playback requirements, and the partitions to be configured corresponding to the playback devices are determined, making the partitioning process intuitive and easy to operate, thereby improving the user experience.

[0102] In some embodiments, the processor can, in response to determining the partition to be configured corresponding to the playback device, preset an application scenario for each partition to be configured, so as to subsequently determine how the audio source service item is applied in the paired partition based on the application scenario. For more information on this part, please refer to the relevant description of Figure 8.

[0103] In some embodiments of the present specification, in response to a partition operation (a gesture operation on a playback device), the partition to be configured corresponding to the playback device is determined based on a floor plan or a device distribution map, and in response to an application operation on an audio source service item, the paired partition and / or application method corresponding to the audio source service item is determined. This can reduce the operational steps of the audio source configuration, allowing users to interact more flexibly to achieve the configuration of the audio source service item and the terminal device.

[0104] It should be noted that the display methods and display positions of the floor plans and device distribution diagrams described in the embodiments of this specification are merely examples for illustration purposes. In actual applications, various feasible and user-friendly display methods may be employed, and are not limited here.

[0105] Step 330 : In response to the application operation on the audio source service item, determining the paired partition corresponding to the audio source service item and / or the application mode of the audio source service item in the paired partition.

[0106] In some embodiments, the paired partition is a partition to be configured that has a paired relationship with the audio source service item.

[0107] The application operation is to match the audio source service item with the partition to be configured and apply it.

[0108] The application mode refers to the playback mode of the audio source service item in the paired partition. In some embodiments, the application mode may include direct application or mixing operations. Among them, direct application refers to the operation of using the playback device in the paired partition to play a single audio source (an audio source service item of a single audio source type). The mixing operation refers to the operation of mixing multiple audio source service items (for example, integrating audio sources from multiple sources into a stereo track or a mono track), and then using the playback device in the paired partition to play the mixed audio source.

[0109] In some embodiments, the processor can determine the pairing partition corresponding to the sound source service item and / or the application method of the sound source service item in the pairing partition in a variety of ways. For example, the user or the processor can pre-set the correspondence between each sound source service item and the partition to be configured, and pre-set the correspondence between each partition to be configured and the application method, and the pairing partition corresponding to the sound source service item and / or the application method of the sound source service item in the pairing partition can be determined according to the pre-set correspondence. For another example, the user can manually adjust the pre-set pairing partition and its application method. For example, the user can long press the pairing partition whose application method is the mixing operation in the interactive interface, and a setting window will pop up in the interactive interface. The user can adjust the playback volume of the playback device in the pairing partition and the ratio of the playback volume of each sound source service item in the setting window.

[0110] In some embodiments, the processor can display the audio source services to be assigned and the partitions to be configured on the terminal device used by the user. As shown in Figure 6, the processor can display the audio source services in a list below the interactive interface of the terminal device and display the partitions to be configured above the interactive interface.

[0111] It should be noted that the display methods and locations of the audio source service items and partitions to be configured on the interactive interface described in the embodiments of this specification are merely examples for illustrative purposes. In actual applications, a variety of feasible and user-friendly display formats can be adopted, and this specification does not limit this. For example, the audio source service items and / or partitions to be configured can be displayed in one or more areas of the interactive interface, such as the left area, the right area, or the center area.

[0112] In some embodiments, the processor may determine the paired partition corresponding to the audio source service item based on the user's gesture operation on the audio source service item. For example, as shown in Figure 6, in response to the user dragging audio source service item 630 into the to-be-configured partition 620 and dragging audio source service item 640 into the to-be-configured partition 610, the processor may determine that the paired partition corresponding to audio source service item 630 is the to-be-configured partition 620, and the paired partition corresponding to audio source service item 640 is the to-be-configured partition 610.

[0113] In some embodiments, one audio source service item may correspond to multiple paired partitions. Continuing with reference to FIG6 , in response to the user dragging the audio source service item 630 into the partition to be configured 610 and the partition to be configured 620, the processor may determine that the paired partition corresponding to the audio source service item 630 includes the partition to be configured 610 and the partition to be configured 620. If the partition to be configured 610 and the partition to be configured 620 are only the paired partitions corresponding to the audio source service item 630 (no other audio source service items are played in the partition to be configured 610 and the partition to be configured 620), the user can choose to apply the audio source service item 630 in each of its corresponding paired partitions (including the partition to be configured 610 and the partition to be configured 620) as direct application.

[0114] In some embodiments, a paired partition may correspond to multiple audio source service items. Continuing to refer to Figure 6, in response to the user dragging the audio source service item 630 and the audio source service item 640 into the partition to be configured 610 in succession, at this time, the audio source service items 630 and 640 exist in the partition to be configured 610, and in response to the paired partitions corresponding to the audio source service items 630 and 640 being both the partition to be configured 610, the user may choose to apply the audio source service items 630 and 640 in the paired partition as a mixing operation, or replace the audio source service item 630 dragged in earlier with the audio source service item 640 dragged in later. After the audio source service item 640 replaces the audio source service item 630 dragged in earlier, if the partition to be configured 610 is only the paired partition corresponding to the audio source service item 640 (no other audio source service items play audio sources in the partition to be configured 610), the user may choose to apply the audio source service item 640 in the corresponding paired partition (the partition to be configured 610) as direct application. If the user continues to drag other audio service items into the to-be-configured partition 610, the user can select the audio service item 640 as a mixing operation in the corresponding paired partition (to-be-configured partition 610). For the replaced audio service item 630, the user can perform gesture operations again.

[0115] In some embodiments of the present specification, the interactive method of directly dragging the audio source service item into the partition to be configured is simple and efficient, and reduces the number of operation steps.

[0116] In some embodiments, the processor can determine how the sound source service item is applied in the paired partition based on at least one of the user's gesture operation on the sound source service item, the time of the gesture operation, the source type of the sound source service item, and the location where the user drags the sound source service item into the paired partition.

[0117] In some embodiments, the user's gesture operation on the sound source service item may include dragging the sound source service item to the partition to be configured (when the sound source service item is dragged to the partition to be configured, the partition to be configured is the paired partition of the sound source service item). In some embodiments, the time for performing the gesture operation may include the time for dragging the sound source service item into the partition to be configured (this time is called the dragging time) and the dwell time. In some embodiments, the location where the user drags the sound source service item into the paired partition may refer to the location area of ​​the paired partition divided in different forms, for example, the lower left corner and lower right corner of the paired partition, etc.

[0118] In some embodiments, in response to the user's gesture operation on the audio source service item being a drag operation, the processor may determine the application mode of the audio source service item in the paired partition based on the time when the user performs the gesture operation and the preset drag time.

[0119] In some embodiments, in response to the user dragging the audio source service item into the partition to be configured for less than a preset drag time, the processor may determine that the audio source service item is applied to the corresponding paired partition as a direct application. In some embodiments, in response to the user dragging the audio source service item into the partition to be configured for no less than a preset drag time, the processor may determine that the audio source service item is applied to the corresponding paired partition as a mixing operation, and other audio source service items may be added to the corresponding paired partition.

[0120] In some embodiments, the preset drag time can be pre-set.

[0121] In some embodiments, the preset drag time may be related to user characteristics. The processor may determine the preset drag time based on the user characteristics.

[0122] User characteristics refer to relevant characteristic information that can characterize the identity of a user. In some embodiments, user characteristics may include basic user information and user usage information.

[0123] User basic information refers to the basic information about the user, such as the user's age.

[0124] User usage information refers to the time information of the user configuring the audio source. For example, the user usage information may include the total usage time, the current usage time, the single dragging time, the current dragging time sequence, etc.

[0125] The total usage time refers to the total historical time spent by the user configuring the audio source for a target area, for example, the total historical usage time of the software (such as an APP) for configuring the audio source.

[0126] The current usage duration refers to the time it takes for the user to configure the audio source to meet the current playback requirement. For example, if the user's current playback requirement is to play corresponding audio / video sources to multiple areas on the second floor of a shopping mall, the current usage duration is the software usage duration from the time the user opens the software to the completion of the audio source configuration (meeting the current playback requirement). In some embodiments, the total usage duration and the current usage duration can be automatically recorded and counted by the software system (e.g., the app background program).

[0127] The single drag duration refers to the time it takes to drag a music source service item to a paired partition. In some embodiments, the single drag duration can be represented by the historical average drag duration (the ratio of the total historical drag duration to the number of drags). The historical total drag duration refers to the total historical duration spent by a user dragging a music source service item to a paired partition multiple times.

[0128] The current drag duration sequence refers to the sequence of multiple single drag durations corresponding to the user dragging the audio source service item to the corresponding partition to achieve the current playback requirement. For example, the current drag duration sequence can be expressed as [1.3s, 1.2s, 1.3s, 1s, 0.9s], which means that the user dragged the audio source service item to the corresponding partition five times to achieve the current playback requirement, with the durations being 1.3s, 1.2s, 1.3s, 1s, and 0.9s respectively.

[0129] In some embodiments, the processor may determine the drag time by various methods based on user characteristics.

[0130] In some embodiments, the processor can determine the first drag time through vector matching based on the user's age, total usage time and current usage time; determine the second drag time based on the first drag time and the single drag time; determine the drag duration change trend based on the current drag duration sequence; determine the preset drag time based on the drag duration change trend and the second drag time.

[0131] The first drag duration refers to the drag duration roughly estimated with reference to historical users with similar user characteristics. In some embodiments, the processor can cluster the historical user age, historical total usage time, historical current usage time and historical single drag duration corresponding to a large number of historical users to determine multiple cluster centers. A cluster center can correspond to a user age cluster value, a total usage time cluster value, a current usage time cluster value and a single drag duration cluster value. The vector composed of the user age cluster value, the total usage time cluster value and the current usage time cluster value corresponding to the cluster center is used as the standard vector, and the single drag duration cluster value corresponding to the cluster center is determined as the single drag duration corresponding to the standard vector; a target vector is constructed based on the user age, total usage time and current usage time of the current user, and the similarity is calculated with multiple standard vectors corresponding to multiple cluster centers, and the single drag duration corresponding to the standard vector with the highest similarity is selected as the first drag time.

[0132] Clustering methods include, but are not limited to, K-means clustering and mean-shift clustering. Similarity may include, but is not limited to, Euclidean distance and cosine similarity. The smaller the Euclidean distance and the larger the cosine similarity, the higher the similarity.

[0133] The second drag time refers to a more accurate drag time determined in combination with the current user's own situation. In some embodiments, the processor can compare the first drag time with the current user's single drag duration to determine the second drag time. In response to the first drag time being less than the single drag duration, the first drag time is appropriately increased to obtain the second drag time. For example, the second drag time can be expressed by the following formula (1): T2 = T1 × (1 + a%) (1)

[0134] Wherein, T2 represents the second dragging time, T1 represents the first dragging time, and a is a variable coefficient preset manually or by the system (eg, a=5, etc.).

[0135] In response to the first drag time being greater than or equal to the single drag time, the first drag time is appropriately reduced to obtain a second drag time. For example, the second drag time can be expressed by the following formula (2): T2 = T1 × (1-a%) (2)

[0136] The drag duration change trend refers to the change trend between multiple drag times corresponding to the user dragging the audio source service item to the paired partition multiple times. In some embodiments, the drag duration change trend can be represented by a value with both direction and magnitude. For example, the drag duration change trend can be -0.05, indicating that the drag time corresponding to the user dragging the audio source service item to the paired partition this time is reduced by an average of 5% compared to the drag time corresponding to the previous drag. For another example, the drag duration change trend can be +0.04, indicating that the drag time corresponding to the user dragging the audio source service item to the paired partition this time is increased by an average of 4% compared to the drag time corresponding to the previous drag.

[0137] In some embodiments, the processor can determine the drag duration change trend in a variety of ways based on the current drag duration sequence. For example, the processor can determine the drag duration change trend based on the current drag duration sequence using a statistical method. Exemplarily, the current drag duration sequence is [1.3s, 1.2s, 1.3s, 1s, 0.9s], and the regression coefficient calculated by the least squares method is -0.1, then the drag duration change trend can be -0.1, which means that the drag time corresponding to the user's drag this time is reduced by an average of 10% compared to the drag time corresponding to the previous drag.

[0138] In some embodiments, the processor may determine the preset drag time by various methods based on the drag duration change trend and the second drag time. For example, the processor may determine the preset drag time based on the correlation between the drag duration change trend and the second drag time and the preset drag time in a positive feedback relationship. Exemplarily, the preset drag time may be expressed by the following formula (3): T = k × T2 × (1 + b) (3)

[0139] Wherein, T represents the preset dragging time, b represents the dragging duration change trend, and k is a balance coefficient preset by humans or the system (eg, k=0.8, etc.).

[0140] In some embodiments of the present specification, the preset drag time for a gesture operation is determined based on user characteristics. By analyzing the relevant time data of the user's historical operations, the prediction of the preset drag time for the user's next gesture operation can be more accurate and personalized. This can break the operational restrictions on the user's configuration of the sound source for the target area, and provide buffer time for people with inconvenient operation (dragging is performed according to personal circumstances, and there is no uniform requirement for the length of time. People with inconvenient operation have more generous preset drag time), thereby improving the user experience.

[0141] In some embodiments, in response to multiple audio source service items being dragged to the same paired partition, the processor may determine how the multiple audio source service items are applied in the paired partition based on the audio source types of the multiple audio source service items.

[0142] In some embodiments, in response to multiple audio source service items in a paired partition having different audio source types, the processor may determine that the application mode of the multiple audio source service items is a mixing operation. For example, there are two audio source service items, one with a microphone and one with Spotify, and the other with a voice and music source type. When a user drags the two audio source service items into the same to-be-configured partition, the processor may determine that the application mode of the two audio source service items in the corresponding paired partition is a mixing operation.

[0143] In some embodiments, in response to the fact that the sound source types of multiple sound source service items in a paired partition are the same but the sound sources are different, the processor can determine the application mode of the multiple sound source service items in the paired partition based on the residence time when the user drags the sound source service item into the partition to be configured and the preset residence time. The preset residence time can be preset, for example, 1 second. For example, there are two sound source service items, the sound sources are Spotify and Airplay respectively, and the sound source type is the same as music. After the user drags the first sound source service item into a partition to be configured, if the second sound source service item is left on the same partition to be configured and then dragged in, and the residence time is greater than the preset residence time, the processor can determine that the application mode of the two sound source service items in the corresponding paired partition is a mixing operation. If the user drags the second sound source service item directly into the paired partition corresponding to the first sound source service item without stopping (or the residence time is not greater than the preset residence time), the processor can replace the first sound source service item with the second sound source service item. If the paired partition is only the paired partition corresponding to the second audio source service item (no other audio source service items are subsequently dragged into the paired partition), the user can choose to apply the second audio source service item in the paired partition as direct application. If the user continues to drag other audio source service items into the paired partition, the user can choose to apply the second audio source service item and the newly dragged audio source service item in the paired partition as a mixed operation. For the first audio source service item that is replaced, the user can perform the gesture operation again.

[0144] In some embodiments, different gesture operations, different dwell times, and different sound source types may correspond to different application modes. The corresponding relationship may be preset and determined in advance.

[0145] In some embodiments, the processor may determine how the audio source service item is applied in the paired partition based on the position where the user drags the audio source service item into the paired partition.

[0146] In some embodiments, the processor may display the partitions to be configured in a preset format on the terminal device used by the user. The preset format may be pre-set, for example, as shown in FIG7 , the partitions to be configured are displayed in a preset format as partitions to be configured 710 - 1 and partitions to be configured 710 - 2 .

[0147] In some embodiments, areas at different locations in the partition to be configured may correspond to different application modes. The correspondence between different area locations in the partition to be configured and different application modes may be preset by the system or manually.

[0148] For example, assume that the application mode corresponding to the lower left corner of the partition to be configured 710-1 in Figure 7 is direct application, and the application mode corresponding to the lower right corner of the partition to be configured 710-1 is a mixing operation. In response to the user dragging the sound source service item into the lower left corner of the partition to be configured 710-1, the processor can assign the sound source service item to the partition to be configured 710-1, and determine that the application mode of the sound source service item in the corresponding paired partition is direct application; if there is a sound source service item in the lower left corner of the partition to be configured 710-1, it is replaced with the current sound source service item. For another example, in response to the user dragging the sound source service item into the lower right corner of the partition to be configured 710-1, the processor can determine that the application mode of the sound source service item in the corresponding paired partition is to perform a mixing operation with the sound source service item in the lower left area of ​​the partition to be configured 710-1.

[0149] For example, in response to a user dragging a sound source service item into a non-grid area of ​​the partition to be configured 710-2, the processor may allocate the sound source service item to the partition to be configured 710-2 and determine that the application mode of the sound source service item in the corresponding paired partition is direct application; if a sound source service item exists in the area above the partition to be configured 710-2, it is replaced with the current sound source service item. In response to a user dragging a sound source service item into one of the multiple grid areas below the partition to be configured 710-2, the processor may determine that the application mode of the sound source service item in the corresponding paired partition is the application mode corresponding to the grid area.

[0150] For example, assuming that in the grid areas below the to-be-configured partition 710-2 in FIG7 : the application mode corresponding to grid area 1 is direct application, and if a sound source service item already exists in grid area 1, it is replaced with the current sound source service item; the application mode corresponding to grid area 2 is mixing with the sound source service items in grid area 1 or grid area 3; and the application mode corresponding to grid area 3 is mixing with the sound source service items in grid area 1 and grid area 2. In response to the user dragging a sound source service item into any of the aforementioned grid areas, the processor may determine that the application mode of the sound source service item in the corresponding paired partition is the application mode corresponding to the grid.

[0151] In some embodiments, in response to a user operating a partition to be configured in the interactive interface of the terminal device, the processor may display to the user the application method of the partition to be configured. For example, in response to a user long pressing the grid area below the partition to be configured 710-2, the processor may display to the user the corresponding application method of each grid area, allowing the user to select an appropriate grid area and drag it into the audio source service item.

[0152] In some embodiments, a user can long-press a grid area to modify the corresponding application mode. For example, if a user long-presses a grid area with a mixing operation, a settings window may pop up in the interactive interface, allowing the user to adjust the playback volume of the playback devices within the grid area and the ratio of the playback volume of each audio source service item.

[0153] In some embodiments of this specification, the application of a sound source service item in a paired partition is determined based on at least one of a user's gesture operation on the sound source service item, the time the gesture operation was performed, and the sound source type of the sound source service item. This can take into account the different needs of users in different application scenarios and improve the user experience. By determining the application of the sound source service item based on the location where the user drags the sound source service item, the user can more intuitively understand the mixing process and more conveniently select the sound source service item for mixing operations, meeting the user's needs.

[0154] In some embodiments, the processor may also determine how the sound source service items are applied in the paired partitions based on the primary and secondary relationships between the sound source service items. The primary and secondary relationships of the sound source service items include primary and secondary sound sources. When the sound source service item is the primary sound source, the primary sound source is applied in a direct manner. When the sound source service item is a secondary sound source and the number of secondary sound sources exceeds one, the multiple secondary sound sources are applied in a mixing operation. When the sound source service item is a secondary sound source and the number of secondary sound sources is one, the secondary sound source is applied in a direct manner. The secondary sound source can be directly applied after the primary sound source is played. For example, in partition 1 to be configured, sound source service item 1 is the primary sound source, sound source service item 2 is the secondary sound source, and both sound source service item 1 and sound source service item 2 are directly applied. For another example, in partition 2 to be configured, sound source service item 1 is the primary sound source, sound source service item 2 and sound source service item 3 are secondary sound sources, sound source service item 1 is directly applied, and sound source service item 2 and sound source service item 3 are mixing operations.

[0155] In some embodiments, the processor can create and name the partitions in a variety of ways. For example, in response to user gestures performed by applications on the terminal device and / or user input operations on the terminal device, the processor can complete the creation and naming of the partitions, determine the playback device corresponding to each partition, and automatically create the corresponding streaming media source for each partition. A streaming media source refers to a port that continuously transmits audio / video data streams.

[0156] In some embodiments, the processor can determine the playback content of each partition based on a user's gesture operation on the music application corresponding to the music source service item. For example, in response to a user selecting a partition using the casting function in the music application corresponding to the music source service item, the processor can determine that the content played in the selected partition is the audio source from the aforementioned music application. The casting function can be used to display the names of each partition. Music applications may include Spotify, Roon, Airplay2, etc.

[0157] In some embodiments, in response to the user successively selecting the same partition in music applications corresponding to two music source service items, the processor may determine the content played in the selected partition as the sound source from the latter music application.

[0158] In some embodiments, the processor may obtain a user input instruction based on the sound source service item, the partition to be configured, and the instruction input template; and determine a paired partition corresponding to the sound source service item based on the user input instruction.

[0159] A command input template refers to a command template used to standardize the format of user input content. In some embodiments, the command input template may include at least one of a voice input template and a text input template. In some embodiments, the command input template may be pre-set by a technician and stored in a storage device.

[0160] A voice input template is a format template used to standardize the content of user voice input. For example, a voice input template can be "Place audio source service item X and audio source service item Y in the to-be-configured partition D."

[0161] A text input template is a formatting template used to standardize user input content. For example, a text input template might be "Zone D to be configured: Audio source service item X, Audio source service item Y."

[0162] The user input instruction refers to instruction data input by the user that conforms to the instruction input template. In some embodiments, the user input instruction may include at least one of a voice instruction and a text instruction.

[0163] A voice command is a command data inputted by a user through voice that conforms to a voice input template. For example, a voice command may be: "Place audio source service item 1 and audio source service item 2 in zone 1 to be configured."

[0164] A text command is a command data entered by the user that conforms to a text input template. For example, a text command could be: "Zone 1 to be configured: Audio source service item 1, Audio source service item 2."

[0165] In some embodiments, the processor can obtain user input instructions through various methods based on the sound source service items, the partitions to be configured and the instruction input template. For example, the processor can input one or more sound source service items, one or more partitions to be configured and the instruction input template into the large language model, and output the user input instructions. Among them, the content form of the sound source service items and the partitions to be configured input into the large language model can be the sound source service item ID and the partition to be configured ID. One sound source service item corresponds to an exclusive ID, and one partition to be configured also corresponds to an exclusive ID. The ID is related to the format of the user input. For example, the ID can be a name, address, etc. The ID can be preset by the system or manually.

[0166] A large language model (LLM) refers to a machine learning model formed by training based on deep learning technology, large-scale data and computing resources. It is mainly aimed at natural language processing, but can also evolve to process other forms of data. In some embodiments, the large language model can be a large language model based on a pre-training and fine-tuning mode. For example, a model based on the BLOOM model (Big Science Large Open-science Open-access Multilingual Language Model), or a model that interacts in a conversational manner, such as ChatGPT (Chat Generative Pre-Trained Transformer), or at least one of other models, obtained through training. In some embodiments, the large language model can also be an existing large language model. For example, BERT (Bidirectional Encoder Representation from Transformers), GPT (Generative Pre-Trained Transformer), etc.

[0167] In some embodiments, the processor can determine the paired partitions corresponding to the sound source service items based on the user input instructions through a variety of methods. For example, the processor can input the user input instructions into a recognition model and output the correspondence between one or more sound source service items involved in the user input instructions and one or more partitions to be configured. After processing multiple user input instructions using the recognition model, the correspondence between each sound source service item and each partition to be configured can be obtained by combining the output results. Furthermore, the processor can determine the paired partition corresponding to the current sound source service item based on the correspondence between each sound source service item and each partition to be configured.

[0168] In some embodiments, different recognition models are used for different types of user input instructions.

[0169] In some embodiments, in response to the user input instruction being a voice instruction, the recognition model may be a voice recognition model. The processor may input the voice instruction into the voice recognition model and output a correspondence between the audio source service item and the partition to be configured.

[0170] The speech recognition model refers to a model that has speech recognition capabilities. In some embodiments, the speech recognition model can be a machine learning model, such as a deep neural network model such as Connectionist Temporal Classification (CTC) or Recurrent Neural Network Transducer (RNN-T).

[0171] In some embodiments, the input of the speech recognition model can be a voice command, and the output can be the correspondence between the sound source service items and the partitions to be configured. The correspondence between the sound source service items and the partitions to be configured can be expressed as: (Partition D to be configured: (Sound Source Service Item X, Sound Source Service Item Y)). For example, if the voice command "Place Sound Source Service Item 1 and Sound Source Service Item 2 in Partition 1 to be configured" is input into the speech recognition model, the output correspondence between the sound source service items and the partitions to be configured is: (Partition 1 to be configured: (Sound Source Service Item 1, Sound Source Service Item 2)).

[0172] In some embodiments, the processor may use the historical voice instructions in the historical data as the first training sample, and the historical actual correspondence between the corresponding sound source service item and the partition to be configured as the first label corresponding to the first training sample, and use the first training sample and the first label to train the speech recognition model through various methods to update the model parameters. For example, training can be based on the gradient descent method. The first label can be manually labeled. As an example only, multiple first training samples with first labels can be input into the initial speech recognition model, and a first loss function is constructed using the first label and the result of the initial speech recognition model. The model parameters are updated using the first loss function, and the trained speech recognition model is obtained through parameter updating. The method for updating parameters may include but is not limited to gradient descent or other iterative methods. The conditions for completing the update may be that the first loss function is less than the first threshold, the first loss function converges, the training cycle reaches a threshold, etc., or any combination thereof.

[0173] In some embodiments, in response to the user input instruction being a text instruction, the recognition model may be a text recognition model. The processor may also input the text instruction into the text recognition model and output the correspondence between the audio source service item and the partition to be configured.

[0174] A text recognition model refers to a model that has text recognition capabilities. In some embodiments, the text recognition model can be a machine learning model, such as a neural network (NN), a recurrent neural network (RNN), or any combination thereof.

[0175] In some embodiments, the input to the text recognition model can be a text instruction, and the output can be a correspondence between audio source services and the partition to be configured. For example, if the text instruction "Partition to be configured 1: Audio source service item 1, Audio source service item 2" is input into the text recognition model, the output correspondence between audio source services and the partition to be configured is: (Partition to be configured 1: (Audio source service item 1, Audio source service item 2)).

[0176] In some embodiments, the processor may use the historical text instructions in the historical data as the second training sample, and the historical actual correspondence between the corresponding sound source service item and the partition to be configured as the second label corresponding to the second training sample, and use the second training sample and the second label to train the text recognition model. The second label can be manually labeled. For the training process of the text recognition model, please refer to the relevant description of the training process of the speech recognition model above, which will not be repeated here.

[0177] In some embodiments, the processor can comprehensively determine the paired partitions corresponding to the sound source service items based on the correspondence between the sound source service items and the partitions to be configured respectively contained in the multiple user input instructions output by the recognition model multiple times. For example, the correspondence output by the model includes (partition to be configured 1: (sound source service item 1, sound source service item 2)), (partition to be configured 2: (sound source service item 3)), (partition to be configured 3: (sound source service item 2, sound source service item 3)), then the paired partition corresponding to the sound source service item 1 includes the partition to be configured 1, the paired partition corresponding to the sound source service item 2 includes the partition to be configured 1 and the partition to be configured 3, and the paired partition corresponding to the sound source service item 3 includes the partition to be configured 2 and the partition to be configured 3.

[0178] In some embodiments of the present specification, templated user input instructions can be obtained based on the sound source service item, the partition to be configured and the instruction input template. According to the user input instruction, the paired partition corresponding to the sound source service item can be determined quickly and conveniently. Moreover, through the convenient methods of voice input and text input, the operator's operation workload can be greatly reduced, making the configuration process easier.

[0179] In some embodiments, the processor may obtain an application scenario set; based on the application scenario set, the audio source service item, and the paired partition corresponding to the audio source service item, determine how the audio source service item is applied in the paired partition. For more information on this, please refer to the relevant description of Figure 8.

[0180] In some embodiments, the processor can provide an audio export and save function in response to determining how the audio source service item is used in the paired partition. For example, the processor can open the audio export function to the user, allowing the user to export and save the mixed audio source, and the user can choose whether to make the exported and saved mixed audio source an open source to enrich the system's audio library. For another example, the processor can directly store the mixed audio source in the audio library and support user access.

[0181] In some embodiments of the present specification, the partition to be configured corresponding to the playback device is determined based on the floor plan and the device distribution map, and in response to the application operation of the audio source service item, the paired partition corresponding to the audio source service item and / or the application method of the audio source service item in the paired partition is determined. This can reduce the operation steps of the audio source configuration, allowing users to interact more flexibly to realize the configuration of the audio source service item and the terminal device.

[0182] It should be noted that the above description of process 300 is for illustration and purpose only and does not limit the scope of application of this specification. Those skilled in the art may make various modifications and alterations to process 300 under the guidance of this specification. However, such modifications and alterations are still within the scope of this specification.

[0183] FIG8 is an exemplary schematic diagram of determining an application method according to some embodiments of this specification.

[0184] In some embodiments, as shown in FIG8 , the processor may obtain an application scenario set 810 ; based on the application scenario set 810 , the sound source service item 820 , and the paired partition 830 corresponding to the sound source service item 820 , determine an application mode 840 of the sound source service item 820 in the paired partition 830 .

[0185] In some embodiments, the application scenario set may include one or more application scenarios of the partition to be configured. In some embodiments, the application scenario set may include a correspondence between the partition to be configured and the application scenario.

[0186] Application scenarios refer to the usage scenarios for the zones to be configured. These scenarios can include rest, concert, and conference scenarios. Conference scenarios can be categorized as small, medium, and large.

[0187] In some embodiments, the application scenarios of the partitions to be configured can be pre-set manually or by the system based on the user's usage habits. For example, if the user usually uses the partition 1 to be configured as a lounge, the application scenarios corresponding to the partition 1 to be configured can include a rest scene. For another example, if the user usually uses the partition 2 to be configured as a concert hall, the application scenarios corresponding to the partition 2 to be configured can include a concert scene. For another example, if the user usually uses the partition 3 to be configured as a conference room, the application scenarios corresponding to the partition 3 to be configured can include a small meeting scene, a medium-sized meeting scene, and a large meeting scene.

[0188] In some embodiments, the application scenario of the partition to be configured can also be selected by the user from a plurality of preset application scenarios. The selection method may include click selection, line selection, voice input selection, etc.

[0189] In some embodiments, the application scenario of the partition to be configured may also be determined by direct voice input by the user.

[0190] After the application scenarios of multiple scenarios to be configured are determined, an application scenario set can be obtained.

[0191] In some embodiments, when determining the application scenario of the partition to be configured, the processor can simultaneously determine the application method of the partition to be configured in the application scenario. In some embodiments, the correspondence between different application scenarios and different application methods can be preset based on historical data or user usage habits. For example, the application scenario corresponding to the partition to be configured 1 is a rest scene, and the application method corresponding to the rest scene can be that the sound source service item 1 is the main sound source, the sound source service item 2 is the secondary sound source, and the sound source service item 1 and the sound source service item 2 are both directly applied. When determining the application scenario of the partition to be configured, the application method of the partition to be configured in the application scenario can be determined by querying the correspondence between different application scenarios and different application methods.

[0192] In some embodiments, the processor can determine the application method of the audio source service item in the paired partition based on the application scenario set, the audio source service item, and the paired partition corresponding to the audio source service item in various ways. For example, based on the application scenario set, the corresponding relationship between the partition to be configured and the application scenario can be directly obtained; for each partition to be configured, the corresponding relationship between its corresponding application scenario and application method can be directly obtained, thereby automatically configuring the application method of the audio source service item in the paired partition.

[0193] In some embodiments, the processor can determine at least one recommended application method of the sound source service item in the paired partition corresponding to the sound source service item in response to the time length between the setting time of the application scenario set and the current time being greater than a time threshold; and determine the application method of the sound source service item in the paired partition based on at least one recommended application method.

[0194] The setup time refers to the moment when the application scenario set is constructed.

[0195] In some embodiments, the duration threshold can be preset manually or set by the system by default. For example, one month, one year, etc. If the time length between the setting time of the application scene set and the current time is greater than the duration threshold, it means that the construction time of the application scene set is long, and the application scene set may be difficult to meet the user's current playback needs (for example, the application scene of the partition 1 to be configured corresponds to a rest scene. After modification and upgrading, the partition 1 to be configured is used as an audio-visual room, then the original application scene set cannot meet the user's current playback needs for the audio-visual room).

[0196] The recommended application mode refers to the application mode of the audio source service item in the paired partition that is recommended to the user.

[0197] In some embodiments, the processor can determine at least one recommended application method for the audio source service item in the paired partition based on the paired partition corresponding to the audio source service item through various methods. For example, the processor can count the application methods of the audio source service item in multiple paired partitions in the most recent audio source configuration and determine the R application methods that appear the most frequently as recommended application methods. The value of R can be set manually or by system default. For example, R = 1, R = 2, etc.

[0198] In some embodiments, the processor may determine a mixing frequent item set of at least one partition to be configured corresponding to multiple playback devices based on historical data; and determine at least one recommended application method based on the mixing frequent item set, the audio source service item and its corresponding paired partition.

[0199] The historical data may include multiple historical audio source service items, multiple historical playback devices, historical paired partitions corresponding to the historical audio source service items, and historical application methods of the historical audio source service items in the historical paired partitions.

[0200] A mixing frequent itemset refers to a set of mixing frequent items. In some embodiments, a mixing frequent itemset may include multiple mixing frequent items and their corresponding supports. In some embodiments, a partition to be configured corresponds to a mixing frequent itemset.

[0201] Among them, the mixing frequent items refer to information related to the frequently appearing sound source service items. In some embodiments, the mixing frequent items may include the frequently appearing sound source service items, the playback devices of the sound source service items, and the application methods of the sound source service items in the paired partitions. Among them, the correspondence between the sound source service items and the playback devices can be preset by the system or manually. In some embodiments, the mixing frequent items can be represented by vectors. For example, [((sound source service item 1, playback device 1), primary sound source, direct application), ((sound source service item 2, playback device 2), (sound source service item 3, playback device 3), secondary sound source, mixing operation)] Among them, playback devices 1, 2, and 3 are all playback devices corresponding to the same partition to be configured.

[0202] The support refers to a value that characterizes the frequency of occurrence of the mixing frequent item. In some embodiments, the support of the mixing frequent item can be represented by the number of occurrences or the frequency of occurrence of the mixing frequent item in the historical data.

[0203] In some embodiments, the mixing frequent itemset may be represented by a table or set including the mixing frequent items and the support of the mixing frequent items. For example, the mixing frequent itemset may be as shown in Table 1 below:

[0204] Table 1

[0205] Among them, the first column in Table 1 represents the mixed frequent items; the second column represents the support of the mixed frequent items.

[0206] In some embodiments, the processor can determine the mixing frequent item set of at least one to-be-configured partition corresponding to multiple playback devices in a variety of ways based on historical data. For example, the processor can statistically calculate the number of occurrences of each sound source service item in the to-be-configured partition and the application mode of the sound source service item in the paired partition (the to-be-configured partition) based on historical data, sort the number of occurrences from large to small, determine the top N sound source service items as the mixing frequent items of the to-be-configured partition, determine the number of occurrences as the support of the mixing frequent items, and construct a mixing frequent item set based on the mixing frequent items and the support of the mixing frequent items. The value of N can be set manually or by system default. For example, N=3, etc.

[0207] For example, for 200 groups of historical data, in the partition 1 to be configured, the sound source service item 1 is directly applied as the main sound source on the playback device 1, and the sound source service item 2 and the sound source service item 3 are respectively used as the secondary sound source for mixing on the playback device 2 and the playback device 3, and the number of occurrences is 100 times; the sound source service item 2 is directly applied as the main sound source on the playback device 2, and the sound source service item 1 and the sound source service item 3 are respectively used as the secondary sound source for mixing on the playback device 1 and the playback device 3, and the number of occurrences is 50 times; the sound source service item 3 is directly applied as the main sound source on the playback device 3, and the number of occurrences is 30 times; then the items with the top 3 occurrences from largest to smallest are the above 3 items. Items, that is, the mixing frequent items are [((sound source service item 1, playback device 1), primary sound source, direct application), ((sound source service item 2, playback device 2), (sound source service item 3, playback device 3), secondary sound source, mixing operation)], [((sound source service item 2, playback device 2), primary sound source, direct application), ((sound source service item 1, playback device 1), (sound source service item 3, playback device 3), secondary sound source, mixing operation)], [((sound source service item 3, playback device 3), primary sound source, direct application)], with support degrees of 100, 50, and 30 respectively. The mixing frequent item set is constructed through the list.

[0208] In some embodiments, the processor can determine at least one recommended application mode of the sound source service item in the paired partition based on the mixing frequent item set, the sound source service item and its corresponding paired partition of at least one partition to be configured in a variety of ways. For example, the processor can select one or more mixing frequent items that include the sound source service item of the sound source configuration in the mixing frequent item set corresponding to a partition to be configured, and determine the application mode of the sound source service items corresponding to the M mixing frequent items with the highest support in their paired partitions as the recommended application mode. The value of M can be set manually or by system default. For example, M=2, M=1, etc.

[0209] In some embodiments of the present specification, based on historical data, a mixed frequent item set of the partition to be configured can be constructed quickly and accurately, and then based on the mixed frequent item set, the sound source service item and its corresponding paired partition, a reasonable recommended application method can be determined, which is conducive to providing reliable candidate solutions for the final determination of the application method, so that the determination of the application method is more in line with user needs.

[0210] In some embodiments, the processor may determine the application method of the audio source service item in the paired partition based on at least one recommended application method in a variety of ways. For example, the processor may select the recommended application method corresponding to the most supported remix frequent item and determine it as the application method of the audio source service item in the paired partition. For another example, the processor may randomly select a recommended application method from the M most supported recommended application methods corresponding to the most supported remix frequent items and determine it as the application method of the audio source service item in the paired partition.

[0211] In some embodiments of the present specification, when the time length between the setting time of the application scenario set and the current time is greater than the time length threshold, at least one recommended application method of the sound source service item in the paired partition is determined according to the paired partition corresponding to the sound source service item, and then the application method is further determined. This can avoid the construction time of the application scenario set being too long, which may lead to the inability to meet the user's current playback needs. Through personalized recommendations, the determined application method can be more in line with the user's needs on the basis of reducing the user's operation difficulty and saving the user's operation time.

[0212] In some embodiments of the present specification, by obtaining an application scenario set and based on the application scenario set, the sound source service item and the paired partition corresponding to the sound source service item, the application method of the sound source service item in the paired partition can be quickly and conveniently determined, which is easy to operate for the user and conforms to the user's usage habits.

[0213] One of one or more embodiments of this specification provides a computer-readable storage medium, which stores computer instructions. When a computer reads the computer instructions in the storage medium, the computer executes a multi-stream and multi-partition interaction method.

[0214] While the basic concepts have been described above, it will be apparent to those skilled in the art that the detailed disclosure is merely illustrative and does not limit this specification. Although not explicitly stated herein, various modifications, improvements, and revisions to this specification may be made by those skilled in the art. Such modifications, improvements, and revisions are suggested in this specification and remain within the spirit and scope of the exemplary embodiments of this specification.

[0215] This specification also uses specific terms to describe the embodiments of this specification. For example, "one embodiment," "an embodiment," and / or "some embodiments" refer to a feature, structure, or characteristic associated with at least one embodiment of this specification. Therefore, it should be emphasized and noted that references to "one embodiment," "an embodiment," or "an alternative embodiment" two or more times in different locations in this specification do not necessarily refer to the same embodiment. Furthermore, certain features, structures, or characteristics of one or more embodiments of this specification may be appropriately combined.

[0216] In addition, unless expressly stated in the claims, the order of the processing elements and sequences, the use of alphanumeric characters, or the use of other names described in this specification are not intended to limit the order of the processes and methods of this specification. Although the above disclosure discusses some of the invention embodiments currently considered useful through various examples, it should be understood that such details are for illustrative purposes only, and the appended claims are not limited to the disclosed embodiments. On the contrary, the claims are intended to cover all modifications and equivalent combinations that are consistent with the spirit and scope of the embodiments of this specification. For example, although the system components described above can be implemented by hardware devices, they can also be implemented only by software solutions, such as installing the described system on an existing server or mobile device.

[0217] Similarly, it should be noted that, in order to simplify the presentation of this specification and thus facilitate understanding of one or more embodiments of the invention, the foregoing descriptions of the embodiments of this specification sometimes combine multiple features into a single embodiment, figure, or description thereof. However, this disclosure method does not imply that the subject matter of this specification requires more features than those recited in the claims. In fact, an embodiment may have fewer features than all of the features of a single disclosed embodiment.

[0218] Finally, it should be understood that the embodiments described in this specification are intended only to illustrate the principles of the embodiments of this specification. Other variations may also fall within the scope of this specification. Therefore, by way of example and not limitation, alternative configurations of the embodiments of this specification may be considered consistent with the teachings of this specification. Accordingly, the embodiments of this specification are not limited to the embodiments explicitly described and illustrated in this specification.

Claims

1. A multi-stream multi-partition interaction method, characterized in that: The method is executed by a processor, comprising: Obtaining sound source service items, a floor plan of a target area, and a device distribution map, wherein the sound source service items include sound sources and sound source types; Based on the floor plan or the device distribution map, determining the partition to be configured corresponding to the playback device; In response to the application operation of the sound source service item, determine the paired partition corresponding to the sound source service item and / or the application method of the sound source service item in the paired partition; the paired partition is the partition to be configured that has a paired relationship with the sound source service item, and the application method includes direct application or mixing operation.

2. The method according to claim 1, characterized in that The determining, based on the floor plan or the device distribution map, the partition to be configured corresponding to the playback device includes: In response to a partition operation, the partition to be configured corresponding to the playback device is determined based on the floor plan or the device distribution map, and the partition operation includes a gesture operation of the user on the playback device.

3. The method according to claim 2, characterized in that The gesture operation includes a drag operation on the playback device, and the determining the partition to be configured corresponding to the playback device based on the floor plan or the device distribution map includes: In response to the dragging operation of the user on the playback device on the interactive interface of the terminal device, the partition to be configured corresponding to the playback device is determined.

4. The method according to claim 2, characterized in that The gesture operation further includes a connection operation of the playback device, and the determining the partition to be configured corresponding to the playback device based on the floor plan or the device distribution map further includes: In response to the connection operation of the user on the playback device on the interactive interface of the terminal device, the partition to be configured corresponding to the playback device is determined.

5. The method according to claim 1, characterized in that The determining of the paired partition corresponding to the sound source service item and / or the application mode of the sound source service item in the paired partition includes: Determining the paired partition corresponding to the sound source service item based on the gesture operation of the user on the sound source service item; and / or Based on at least one of the user's gesture operation on the sound source service item, the time of performing the gesture operation, the sound source type of the sound source service item, and the position where the user drags the sound source service item into the pairing partition, determine the application method of the sound source service item in the pairing partition.

6. The method according to claim 1, characterized in that The determining the paired partition corresponding to the audio source service item includes: Based on the sound source service item, the partition to be configured and the instruction input template, obtaining a user input instruction; the instruction input template includes at least one of a voice input template and a text input template, and the user input instruction includes at least one of a voice instruction and a text instruction; Based on the user input instruction, the paired partition corresponding to the audio source service item is determined.

7. The method according to claim 1, characterized in that The determining the application mode of the audio source service item in the paired partition includes: Acquire an application scenario set, where the application scenario set includes one or more application scenarios of the partition to be configured; Based on the application scenario set, the sound source service item and the paired partition corresponding to the sound source service item, the application mode of the sound source service item in the paired partition is determined.

8. The method according to claim 7, characterized in that The determining, based on the application scenario set, the sound source service item, and the paired partition corresponding to the sound source service item, the application mode of the sound source service item in the paired partition includes: In response to a time length between a setting time of the application scenario set and a current time being greater than a time length threshold, determining at least one recommended application mode of the sound source service item in the paired partition based on the paired partition corresponding to the sound source service item; Based on the at least one recommended application mode, the application mode of the audio source service item in the pairing partition is determined.

9. The method according to claim 8, characterized in that In response to the time length between the setting time of the application scenario set and the current time being greater than a time length threshold, determining at least one recommended application mode of the sound source service item in the paired partition based on the paired partition corresponding to the sound source service item, including: Based on the historical data, determining a mixing frequent item set of at least one of the partitions to be configured corresponding to the plurality of playback devices; Based on the mixing frequent itemset, the sound source service item and the corresponding pairing item of the at least one partition to be configured area, and determining the at least one recommended application mode.

10. The method according to claim 5, characterized in that The method comprises: In response to the user's gesture operation on the sound source service item being the drag operation, the application mode of the sound source service item in the pairing partition is determined based on the time when the user performs the gesture operation and a preset drag time; the preset drag time is related to user characteristics, and the user characteristics include at least one of user basic information and user usage information.

11. A multi-stream multi-partition interactive system, characterized in that: include: An acquisition module, used to acquire audio source service items, a floor plan of a target area, and a device distribution map, wherein the audio source service items include audio sources and audio source types; A first determination module, configured to determine a partition to be configured corresponding to a playback device based on the floor plan or the device distribution map; The second determination module is used to determine the pairing partition corresponding to the sound source service item and / or the application method of the sound source service item in the pairing partition in response to the application operation of the sound source service item; the pairing partition is the partition to be configured that has a pairing relationship with the sound source service item, and the application method includes direct application or mixing operation.

12. The system according to claim 11, characterized in that The first determining module is further configured to: In response to a partition operation, the partition to be configured corresponding to the playback device is determined based on the floor plan or the device distribution map, and the partition operation includes a gesture operation of the user on the playback device.

13. The system of claim 12, wherein: The gesture operation includes a drag operation on the playback device, and the first determining module is further used for: In response to the dragging operation of the user on the playback device on the interactive interface of the terminal device, the partition to be configured corresponding to the playback device is determined.

14. The system according to claim 11, characterized in that The second determining module is further used for: Determining the paired partition corresponding to the sound source service item based on the gesture operation of the user on the sound source service item; and / or Based on at least one of the user's gesture operation on the sound source service item, the time of performing the gesture operation, the sound source type of the sound source service item, and the position where the user drags the sound source service item into the pairing partition, determine the application method of the sound source service item in the pairing partition.

15. The system of claim 11, wherein: The first determining module is further configured to: Based on the sound source service item, the partition to be configured and the instruction input template, obtaining a user input instruction; the instruction input template includes at least one of a voice input template and a text input template, and the user input instruction includes at least one of a voice instruction and a text instruction; Based on the user input instruction, the paired partition corresponding to the audio source service item is determined.

16. The system of claim 11, wherein: The second determining module is further used for: Acquire an application scenario set, where the application scenario set includes one or more application scenarios of the partition to be configured; Based on the application scenario set, the sound source service item and the paired partition corresponding to the sound source service item, the application mode of the sound source service item in the paired partition is determined.

17. The system of claim 16, wherein: The second determining module is further used for: In response to a time length between a setting time of the application scenario set and a current time being greater than a time length threshold, determining at least one recommended application mode of the sound source service item in the paired partition based on the paired partition corresponding to the sound source service item; Based on the at least one recommended application mode, the application mode of the audio source service item in the pairing partition is determined.

18. The system of claim 17, wherein: The second determining module is further used for: Based on the historical data, determining a mixing frequent item set of at least one of the partitions to be configured corresponding to the plurality of playback devices; Based on the audio mixing frequent itemset, the audio source service item and the corresponding paired partition of the at least one partition to be configured, the at least one recommended application mode is determined.

19. The system of claim 14, wherein: The second determining module is further used for: In response to the user's gesture operation on the sound source service item being the drag operation, the application mode of the sound source service item in the pairing partition is determined based on the time when the user performs the gesture operation and a preset drag time; the preset drag time is related to user characteristics, and the user characteristics include at least one of user basic information and user usage information.

20. A computer-readable storage medium, characterized in that: The storage medium stores computer instructions. When a computer reads the computer instructions, the computer executes the multi-stream multi-partition interaction method according to any one of claims 1 to 10.

Images