Sound playing device and method

Abstract

The embodiment of the invention provides a sound playing device and method. The device comprises a controller, and a sensing module and a sound box which are laid on a stage, the sensing module and the sound equipment are in communication connection with the controller; wherein the sensing module is configured to obtain sensing information triggered by a user and send the sensing information to the controller; the controller is configured to: determine location information of the user based on the sensing information; and determining a target sound based on the position information, and controlling the target sound to play a sound source corresponding to the user.

Description

Technical Field

[0001] This specification relates to the field of audio playback technology, and in particular to an audio playback device and method. Background Art

[0002] With the increasing sophistication of stage performances and interactive entertainment, the demand for precise control of sound effects and personalized experiences continues to grow. Traditional audio playback systems typically use fixed-position audio equipment, which cannot dynamically adjust the sound source based on the real-time location of the performer or user. This results in a mismatch between the sound source and the performer's movements and position, affecting the continuity of the performance and the audience's immersion. Furthermore, traditional systems lack effective fault tolerance and predictive capabilities when faced with lost sensor information or incomplete data, which can easily lead to sound interruptions or false triggering, further degrading the user experience.

[0003] Therefore, there is an urgent need to provide an intelligent audio playback device and method that can obtain the user's precise location information in real time, and when the sensing information is lost or the data is incomplete, ensure the continuity of the sound effects and the stability of the system through prediction mechanisms and fault detection mechanisms, thereby improving the overall experience of stage performances and interactive entertainment activities. Summary of the Invention

[0004] One or more embodiments of the present specification provide an audio playback device, comprising a controller, a sensing module and an audio device laid out on a stage; the sensing module and the audio device are communicatively connected to the controller; wherein the sensing module is configured to obtain sensing information based on user triggering and send it to the controller; the controller is configured to: determine the user's position information based on the sensing information; and determine a target audio device based on the position information, and control the target audio device to play a sound source corresponding to the user.

[0005] One or more embodiments of the present specification provide a sound playback method, the method comprising: obtaining sensing information from a sensing module laid on a stage, the sensing information being triggered by a user; determining position information of the user based on the sensing information; and determining a target sound based on the position information, and controlling the target sound to play a sound source corresponding to the user. BRIEF DESCRIPTION OF THE DRAWINGS

[0006] This specification will be further described in the form of exemplary embodiments, which will be described in detail with reference to the accompanying drawings. These embodiments are not limiting, and in these embodiments, like numbers represent like structures, wherein: Figure 1 is an application scenario diagram of the audio playback device according to some embodiments of this specification; Figure 2is an exemplary module diagram of an audio playback device according to some embodiments of this specification; Figure 3 is an exemplary flow chart of an audio playback method according to some embodiments of this specification; Figure 4 is an exemplary schematic diagram of a fault determination module according to some embodiments of this specification; Figure 5 is an exemplary flowchart of determining predicted location information according to some embodiments of this specification. DETAILED DESCRIPTION

[0007] To more clearly illustrate the technical solutions of the embodiments of this specification, the following briefly describes the drawings required for describing the embodiments. Obviously, the drawings described below are merely examples or embodiments of this specification. Those skilled in the art can apply this specification to other similar scenarios based on these drawings without inventive effort. Unless otherwise apparent from the context or otherwise noted, the same reference numerals in the figures represent the same structure or operation.

[0008] It should be understood that the terms "system," "device," "unit," and / or "module" used herein are a method for distinguishing different components, elements, parts, portions, or assemblies at different levels. However, if other terms can achieve the same purpose, the terms may be replaced by other expressions.

[0009] As used in this specification and claims, unless the context clearly indicates otherwise, the words "a," "an," "an," and / or "the" do not refer to the singular but also include the plural. Generally speaking, the terms "comprises" and "include" only indicate the inclusion of the steps and elements specifically identified, and these steps and elements do not constitute an exclusive list. A method or apparatus may also include other steps or elements.

[0010] Flowcharts are used throughout this specification to illustrate the operations performed by systems according to embodiments of this specification. It should be understood that preceding or following operations do not necessarily need to be performed in exact order. Instead, the steps may be processed in reverse order or simultaneously. Furthermore, other operations may be added to these processes, or one or more operations may be removed from these processes.

[0011] Figure 1 This is a diagram of an application scenario of an audio playback device according to some embodiments of this specification.

[0012] In some embodiments, as Figure 1As shown, an application scenario (hereinafter referred to as application scenario) 100 of the audio playback method may include a stage 110 , a sensing device 120 , an audio device 130 , a processor 140 , a storage device 150 , and a network 160 .

[0013] In some embodiments, the application scene 100 may include a drama, a song and dance performance, etc. For example, if the application scene 100 is a drama, the controller can control the corresponding audio source based on the user's movement trajectory on the stage to achieve a stage effect where the sound follows the person's movement.

[0014] In some embodiments, one or more components in the application scenario 100 may transmit data to other components in the application scenario 100 via the network 160. For example, the processor 140 may obtain information and / or data from the sensing device 120 and the storage device 150 via the network 160, or may send information and / or data to the audio device 130 and the storage device 150 via the network 160.

[0015] The stage 110 is a venue where users perform. In some embodiments, the stage 110 may be equipped with at least one sensing device 120. Users can trigger at least one sensing device 120 on the stage 110 to generate sensing information. Users are individuals participating in a stage performance or interactive experience. For example, users may include actors, dancers, technicians, and the like.

[0016] The sensing device 120 is used to determine the user's sensing information.

[0017] In some embodiments, different sensing devices 120 installed at different locations on the stage 110 correspond to different device numbers. The device number is a number used to identify the corresponding sensing device, and the location of the triggered sensing device on the stage can be determined based on the device number.

[0018] In some embodiments, in response to a user passing by a location on the stage 110 where the sensing device 120 is placed, the sensing device 120 may sense the user through an antenna array and generate sensing information (i.e., be triggered). Based on the triggered sensing device, the user's location on the stage may be determined.

[0019] For example, the sensing device 120 may be a sensing antenna array (e.g., an array consisting of multiple antenna units). The sensing antenna array can be installed beneath the stage. Users can carry an IC device (e.g., an RFID tag, IC tag, NFC tag, Bluetooth, etc.) that connects to different antenna units in the sensing antenna array to generate different sensing information. An antenna unit is a device used to transmit and receive signals. For example, an antenna unit may include a coil antenna or a patch antenna. When the user's IC device triggers the sensing device, it can simultaneously transmit identification information such as the user's ID to the sensing device.

[0020] In some embodiments, a sensing device can only be triggered by one user's IC device at a time.

[0021] In some embodiments, the processor may pre-grid the stage, with each grid unit corresponding to a stage partition, and one or more sensing devices may be positioned beneath each stage partition. In some embodiments, a spatial coordinate system may be established based on the stage, for example, with the center of the stage as the origin, the length of the stage as the Y-axis, the width of the stage as the X-axis, and so on. Each stage partition corresponds to a coordinate range or a coordinate point, for example, the coordinate point of the center point of each stage partition may be used as the coordinate point corresponding to that stage partition.

[0022] In some embodiments, the coordinate information of the stage partition can be used as the coordinate information of the sensing device installed in the stage partition. In some embodiments, the specific position coordinates of the sensing device can be determined based on the specific installation position of the sensing device on the stage.

[0023] The audio device 130 is used to play the audio source sent by the processor 140. For example, different audio devices 130 can play different audio sources based on the audio control parameters sent by the processor 140. For example, the audio can include a speaker, a stage sound, a horn, etc.

[0024] In some embodiments, at least one audio device 130 may be arranged around the stage 110 .

[0025] The processor 140 is used to process data from one or more components or external data sources in the application scenario 100. For example, the processor can be used to receive sensing information from the sensing device 120 and control the audio device 130 to play music.

[0026] In some embodiments, the processor memory stores a plurality of pre-set zone playback systems, wherein a zone playback system may include device numbers of one or more sensing devices in a region and their corresponding one or more audio devices.

[0027] In some embodiments, a sound device can determine its corresponding sensor device based on its distance from each stage partition. For example, if sound device A is the shortest distance from stage partition 1, and stage partition 1 is equipped with sensor devices 1-3, then a zone playback system including sensor devices 1-3 and sound device A is the zone playback system corresponding to stage partition 1.

[0028] In some embodiments, the processor 140 may include a central processing unit (CPU), an application-specific integrated circuit (ASIC), an application-specific instruction set processor (ASIP), a graphics processing unit (GPU), a physical processing unit (PPU), a digital signal processor (DSP), a processor, a microprocessor unit, a reduced instruction set computer (RISC), a microprocessor, etc., or any combination thereof. In some embodiments, the processor 140 may be local or remote.

[0029] Storage device 150 is used to store data, instructions, and / or any other information. In some embodiments, storage device 150 may store data and / or information (e.g., audio control parameters, zone playback system information, etc.) transmitted or retrieved by audio device 130 and processor 140. In some embodiments, storage device 150 may store data and / or instructions used by processor 140 to execute or perform the exemplary methods described herein. For example, storage device 150 may store audio control parameters determined by processor 140. In some embodiments, storage device 150 may include mass storage, removable memory, or any combination thereof. In some embodiments, storage device 150 may be integrated into processor 140.

[0030] Network 160 can be any suitable network capable of facilitating information and / or data exchange. In some embodiments, network 160 can be any one or more of a wired network or a wireless network. Network 160 can include one or more network access points. Through these network access points, one or more components in application scenario 100 can connect to network 160 to exchange data and / or information.

[0031] For more information about the above components, see Figure 2-Figure 5 and its related descriptions.

[0032] It should be noted that the application scenario 100 of the audio playback device is provided for illustrative purposes only and is not intended to limit the scope of this specification. A person skilled in the art may make various modifications or variations based on the description of this specification. However, such modifications and variations do not deviate from the scope of this specification.

[0033] Figure 2 This is an exemplary module diagram of an audio playback device according to some embodiments of this specification.

[0034] In some embodiments, as Figure 2 As shown, the audio playback device 200 may include a sensing module 210, an audio 220, and a controller 230. In some embodiments, the sensing module 210, the audio 220, and the controller 230 are in communication. The sensing module 210 may correspond to Figure 1The sensing device 120 and the sound device 220 may correspond to Figure 1 The audio device 130 in the controller 230 may correspond to Figure 1 The processor 140 in FIG. 1 is shown in FIG. 1 . For descriptions of the sensing device 120 , the audio device 130 , and the processor 140 , see Figure 1 and its related descriptions.

[0035] In some embodiments, the sensing module 210 may be configured to obtain sensing information based on user triggering and send the information to the controller.

[0036] In some embodiments, the speaker 220 is configured to play a sound source corresponding to the user.

[0037] In some embodiments, the controller 230 is configured to determine the user's location information based on the sensing information; and determine a target speaker based on the location information, and control the target speaker to play a sound source corresponding to the user.

[0038] In some embodiments, the controller 230 is further configured to determine the data blank moment and the user's predicted location information based on the user's historical location information in response to the presence of a data gap in the sensing information.

[0039] In some embodiments, the controller 230 is further configured to update the fault statistical information of the sensing module corresponding to the predicted location information based on the predicted location information in response to the presence of data gaps in the sensing information; and, based on the fault statistical information, determine whether there is a faulty module and generate prompt information.

[0040] In some embodiments, the controller 230 is further configured to determine the user's previous trajectory based on the sensing information; determine the user's subsequent trajectory through the target pattern database based on the previous trajectory; and determine the predicted location information based on the subsequent trajectory.

[0041] In some embodiments, the controller 230 is further configured to determine at least one candidate historical trajectory based on the previous trajectory through the target pattern database; for a candidate historical trajectory, determine the pattern completeness of the candidate historical trajectory based on the trajectory length of the candidate historical trajectory; and determine the subsequent trajectory based on the pattern completeness and trajectory similarity corresponding to the candidate historical trajectory.

[0042] For more information about the above modules, please refer to Figure 3-Figure 5 and related instructions.

[0043] In some embodiments of this specification, the audio playback device 200 can quickly obtain the situation of the user triggering the sensing module 210, and accurately control the audio playback source based on the sensing information generated by the user trigger, thereby achieving an actual stage effect in which the sound follows the person's movement.

[0044] It should be noted that the above description of the audio playback device 200 and its modules is for convenience only and does not limit this specification to the scope of the embodiments. It is understandable that those skilled in the art, after understanding the principles of the device, may arbitrarily combine the modules or form sub-devices connected to other modules without departing from the principles. In some embodiments, Figure 2 The sensor module 210, speaker 220, and controller 230 disclosed in the specification may be different modules within a single device, or a single module may implement the functions of two or more of the aforementioned modules. For example, the modules may share a storage module, or each module may have its own storage module. Such variations are within the scope of protection of this specification.

[0045] Figure 3 300 is an exemplary flow chart of an audio playback method according to some embodiments of this specification. In some embodiments, process 300 is executed by a controller. Process 300 includes steps 310 to 330.

[0046] Step 310: Acquire sensing information of the sensing modules placed on the stage.

[0047] Sensing information is based on user triggering. Sensing information refers to the timing information generated when a user triggers a sensing module. In some embodiments, the sensing information may include the user's ID information, the device number of the sensing module, and the location coordinates of the sensing module. For example, the sensing information may include the device number of the sensing module triggered by the user, the location coordinates of the sensing module, and the ID information of the user who triggered the sensing module at multiple times within a preset historical period.

[0048] The preset historical period refers to a period of time earlier than the current moment, such as the historical 5 minutes including the current moment. In some embodiments, the preset historical period can be set by the controller based on a default setting, or preset by a technician based on experience.

[0049] As an example only, the sensing information may be ((ID information, sensing module 1, x1, y1), ...), where x1, y1 are the position coordinates corresponding to the sensing module 1.

[0050] For more information about the sensor module's location coordinates, sensor module device number, user ID information, etc., see Figure 1 The corresponding content.

[0051] In some embodiments, the controller may obtain sensing information sent by the sensing module through a network.

[0052] In some embodiments, a user can trigger a sensing module via an IC device, causing the sensing module to generate sensing information. For example, when a user passes by a stage location where a sensing module is located, the IC device carried by the user connects to the sensing module corresponding to the user's current location (e.g., via RFID, NFC, or Bluetooth). The sensing module can generate sensing information based on the ID information in the connected IC device, the device number of the sensing module, and the location coordinates of the sensing module, and transmit the generated sensing information to the controller.

[0053] Step 320: Determine the user's location information based on the sensing information.

[0054] Position information refers to the coordinates of the current user on the stage.

[0055] In some embodiments, the controller can determine the user's location information based on the sensing information in various ways. For example, the controller can use the location information of the triggered sensing module in the sensing information as the location information of the user who triggered the sensing module. For another example, the controller can use the location information corresponding to the center point of multiple sensing modules triggered by the user in the sensing information as the user's location information.

[0056] In some embodiments, during actual playback control, due to network failure, sensor module failure, etc., the target user's triggering sensor information may not be obtained at a certain moment, resulting in uncertainty about the target user's location at that moment. In this case, it is necessary to predict the target user's location at that moment. The target user can be the user currently performing or a pre-designated user, such as the host.

[0057] In some embodiments, in response to a data gap in the sensing information, the controller may determine the user's predicted location information at the data gap moment based on the user's historical location information.

[0058] A data gap refers to a situation where no sensing information containing the corresponding performer's user ID is collected during a performance period. A performance period refers to the time period when a user performs or experiences on stage. In some embodiments, the performance period can be determined by the controller based on a performance schedule, etc.

[0059] Historical location information refers to the user's location information within a preset historical period.

[0060] In some embodiments, the controller may obtain historical sensing information of the user through a storage device, and determine historical location information of the user based on the historical sensing information of the user.

[0061] The manner in which the controller determines historical location information based on historical sensing information is similar to the manner in which the controller determines location information based on sensing information, and thus will not be described in detail herein.

[0062] The data blank moment refers to the moment when there is a data blank in the sensing information.

[0063] In some embodiments, the controller may determine, based on the sensing information, a time when there is a data blank in the sensing information as a data blank time.

[0064] Predicted location information refers to the user's predicted location at the time when data gaps occur. In some embodiments, to optimize audio playback, the controller can acquire sensing information from each sensing module in real time. When data gaps occur, the controller determines the user's predicted location information. Under normal circumstances, the data gap time is the current time.

[0065] In some embodiments, the controller may determine the predicted location information of the user at the current moment through a storage device based on the sensing information at the current moment and within a preset historical period.

[0066] For example, the controller may use the storage device to store the historical location information of the user at the historical moment closest to the current moment as the predicted location information of the user at the current moment.

[0067] In some embodiments of the present specification, based on the user's historical location information, the user's predicted location information at the data blank moment is determined, which is beneficial to improving the fault tolerance of the device and provides strong support for fault detection and maintenance of the sensing module. At the same time, a relatively correct user location can also be determined when the module fails, so as to perform accurate audio control based on the accurate user location.

[0068] For more information on determining predicted position information, see Figure 5 and its related descriptions.

[0069] Step 330 : determining a target speaker based on the location information, and controlling the target speaker to play a sound source corresponding to the user.

[0070] The target speaker is the speaker that plays the sound source to the user.

[0071] In some embodiments, the controller may determine the target speaker in various ways based on the user's location information.

[0072] For example, the controller can determine the stage partition where the user is located based on the user's location information, and then determine the partition playback system corresponding to the stage partition. The controller can determine the speakers included in the partition playback system as the target speakers. For more information about the partition playback system, see Figure 1 The corresponding content.

[0073] For another example, the controller may determine the speaker closest to the user's location as the target speaker.

[0074] The audio source refers to the audio data played by the speakers. In some embodiments, different users can correspond to different audio sources. For example, the controller can determine the audio source corresponding to each user based on the program that each user is to perform. Once the user is determined, the audio source corresponding to the user can be determined.

[0075] In some embodiments, the controller can determine the user's corresponding sound source and its corresponding sound source's audio control parameters by querying a sound source comparison table based on the user's ID information. Based on the audio control parameters, the controller can control the target speaker to play the user's corresponding sound source. Audio control parameters refer to parameters related to controlling the target speaker's playback of the sound source. For example, audio control parameters may include audio data, sound effect parameters, etc. The sound source comparison table includes the relationship between the ID information, the sound source, and the audio control parameters. In some embodiments, the sound source comparison table can be preset by the controller based on a performance schedule or determined by obtaining user input.

[0076] It should be noted that this manual takes the example of the same performance on stage at the same time. That is, in the same performance, the sound source to be played is the same, and the sound source playing the sound source needs to be flexibly changed based on the position of the performer.

[0077] In some embodiments of this specification, the user's position information is determined based on the sensing information, and then the target sound is determined, and the target sound is controlled to play the sound source corresponding to the user, which is conducive to improving the interactivity and immersion of the stage performance, improving the accuracy of the sound playback effect, and enhancing the flexibility and adaptability of the device to the user's movement.

[0078] It should be noted that the above description of process 300 is for illustration and purpose only and does not limit the scope of application of this specification. Those skilled in the art may make various modifications and alterations to process 300 under the guidance of this specification. However, such modifications and alterations are still within the scope of this specification.

[0079] In some embodiments, in order to reduce the probability of data blanks, the controller needs to monitor the working status of the sensing model in real time and issue a warning in time when a possible faulty module is predicted to ensure the normal operation of the entire device.

[0080] Figure 4 This is an exemplary schematic diagram of a fault determination module according to some embodiments of this specification.

[0081] In some embodiments, as Figure 4As shown, in response to the presence of a data gap 420 in the sensing information 410, the controller can update the fault statistical information 440 of the sensing module corresponding to the predicted position information 430 based on the predicted position information 430; and, based on the fault statistical information 440, determine whether there is a faulty module 450 and generate prompt information 460.

[0082] Fault statistics refer to the cumulative statistics of faults that have occurred in the sensing module. Fault statistics can be represented by a fault statistics count value. The larger the count value, the greater the likelihood that the corresponding sensing module is determined to be a faulty module.

[0083] In some embodiments, the controller may update the fault statistics of the sensing module corresponding to the predicted position information based on the predicted position information.

[0084] For example, the controller may determine the device number of the sensing module corresponding to the predicted location information, and add 1 to the fault statistics count value of the sensing module corresponding to the device number.

[0085] A faulty module refers to a sensing module with a sensing fault. A fault may include a user reaching the sensing module but the sensing module is not triggered.

[0086] In some embodiments, the controller may, based on the fault statistics and a preset threshold, determine that a sensing module whose fault statistics exceed the preset threshold is a faulty module. The preset threshold refers to the minimum fault statistics required to determine a faulty module. In some embodiments, the preset threshold may be set by the controller based on a default setting or by a technician based on experience.

[0087] In some embodiments, different sensing modules correspond to different preset thresholds, and the preset threshold of a sensing module is related to the historical attention of the sensing module and the frequency with which the sensing module is triggered.

[0088] Historical attention refers to the number of times the sensor module was illuminated by stage lights in historical data. Historical data refers to the historical performance data stored in the storage device. Stage lights refer to the lighting equipment above the stage that provides illumination and color effects.

[0089] The historical attention can be represented by a numerical value. The larger the numerical value, the higher the historical attention.

[0090] In some embodiments, the controller may determine the historical attention level based on the operating parameters of the stage lights in the historical data. The operating parameters may include whether the stage lights are on or off, or at an illumination angle. For example, based on the operating parameters of the stage lights in the historical data, the controller may determine which sensor modules are illuminated by each stage light and determine the historical number of times a sensor module has been illuminated by the stage light as the historical attention level of the sensor module.

[0091] Frequency refers to the number of times the sensing module is triggered within a preset historical period. In some embodiments, the frequency can be represented by a numerical value. The larger the numerical value, the more times the sensing module is triggered, and the higher the frequency.

[0092] In some embodiments, the controller may determine how frequently the sensing module is triggered based on the sensing information within a preset historical period. For example, the controller may count the number of times each sensing module generates sensing information within the preset historical period and determine the number of times the sensing module generates sensing information as the frequency of triggering the sensing module.

[0093] In some embodiments, the controller may determine a statistical value of the historical attention and triggering frequency of the sensing module, such as the sum or average of the two, and determine a preset threshold based on the statistical value. For example, the larger the statistical value, the smaller the preset threshold.

[0094] In some embodiments of the present specification, the preset threshold is related to the historical attention of the sensing module and the frequency of the sensing module being triggered. This can fully consider the frequency of use of the sensing module and improve the accuracy requirements for sensing modules with high usage frequency, thereby ensuring the user's performance effect.

[0095] Prompt information refers to information used to inform maintenance personnel or audio control personnel that a sensor module fault exists. For example, prompt information may include, but is not limited to, voice announcements, flashing warning lights, and text error messages. In some embodiments, the controller may also include a display screen, and the controller may send prompt information to the display screen for display.

[0096] In some embodiments, the controller may determine prompt information based on the fault module. For example, in response to the presence of a fault module, the controller may generate prompt information based on the location coordinates of the fault module, the location of the partition playback system, the fault time, etc.

[0097] In some embodiments of this specification, based on the predicted location information, the fault statistical information is updated to determine whether there is a faulty module and generate prompt information, which is conducive to optimizing the maintenance efficiency of the device, accurately locating the faulty module, and thus reducing the audio playback terminals and interference caused by the fault, thereby improving the user experience.

[0098] Figure 5 FIG5 is an exemplary flow chart of determining predicted location information according to some embodiments of this specification. In some embodiments, process 500 is executed by a controller. Process 500 includes steps 510 to 530.

[0099] Step 510: Determine the user's previous trajectory based on the sensing information.

[0100] The previous trajectory refers to the location trajectory of the user within a preset historical period. For example, the previous trajectory can be the location trajectory of the user in the previous 10 minutes including the current time.

[0101] In some embodiments, the controller may determine the previous trajectory of the corresponding user based on the historical sensing information triggered by the corresponding user. For example, the controller may determine the user's location information within a preset historical period based on the sensing information triggered by the user within the preset historical period, and use the time-ordered location information as the user's previous trajectory.

[0102] For example, the controller can determine the user's historical location information based on the historical sensing information triggered by the user. It can then fit the historical location information using a fitting algorithm, and determine all historical locations, including the fitting results, as the user's previous trajectory. Fitting algorithms include least squares method, polynomial fitting, etc.

[0103] Step 520: Based on the previous trajectory, determine the subsequent trajectory of the user through the target pattern database.

[0104] The target pattern database refers to a database used to determine subsequent trajectories. In some embodiments, the target pattern database may include historical motion trajectories of multiple users in multiple historical performances. Historical motion trajectories refer to the motion trajectories of users in historical performances.

[0105] In some embodiments, the controller can generate and save each user's historical motion trajectory based on the location trajectory of each user acquired during each high-quality performance. Each user's location trajectory corresponds to a corresponding historical motion trajectory. A high-quality performance is defined as one in which no actors make mistakes. A subsequent trajectory refers to a user's predicted motion trajectory within a future time period. This future time period can be preset by technical personnel based on experience.

[0106] In some embodiments, the controller may determine the user's subsequent trajectory based on the previous trajectory by matching the target pattern database.

[0107] For example, the controller can traverse the historical motion trajectories in the target pattern database, determine the similarity between the previous trajectory and each historical motion trajectory in the target pattern database, determine the historical motion trajectory with the greatest similarity as the complete trajectory, and determine the historical motion trajectory that follows the portion of the complete trajectory that is similar to the previous trajectory as the subsequent trajectory. The complete trajectory is the trajectory that the user is predicted to follow to complete the performance.

[0108] Among them, before calculating the similarity, the controller can randomly segment each historical motion trajectory based on the target duration to obtain multiple sub-trajectory segments. The target duration can be the duration corresponding to the previous trajectory. The controller can calculate the similarity between the previous trajectory and the multiple sub-trajectory segments respectively, and determine the historical motion trajectory of the sub-trajectory segment with the largest similarity as the complete trajectory.

[0109] In some embodiments, the controller can determine trajectory similarity in a variety of ways. For example, the controller can determine trajectory similarity based on the Hausdorff distance between the previous trajectory and the sub-trajectory segment. For another example, the controller can determine trajectory similarity based on the Fréchet distance between the previous trajectory and the sub-trajectory segment.

[0110] In some embodiments, the controller can determine at least one candidate historical trajectory based on the previous trajectory through the target pattern database; for a candidate historical trajectory, determine the pattern completeness of the candidate historical trajectory based on the trajectory length of the candidate historical trajectory; and determine the subsequent trajectory based on the pattern completeness and trajectory similarity corresponding to the candidate historical trajectory.

[0111] Candidate historical trajectories are historical motion trajectories that could potentially serve as complete trajectories. These can include subtrajectory segments whose similarity to the previous trajectory exceeds a preset similarity threshold, corresponding to the historical motion trajectory. The preset similarity threshold is the minimum similarity between the previous trajectory and the historical motion trajectory.

[0112] In some embodiments, the preset similarity threshold may be set by the controller based on a default setting.

[0113] In some embodiments, the preset similarity threshold is related to the time interval for currently acquiring sensing information of the sensing module. For example, the smaller the time interval, the smaller the preset similarity threshold.

[0114] In some embodiments of this specification, when the time interval between the sensing module sending sensing information is short, it means that the number of location points generated by the candidate historical trajectory is relatively large, and the accuracy of the generated candidate historical trajectory is relatively high. Appropriately lowering the preset similarity threshold can ensure that each candidate historical trajectory is similar to the previous trajectory, while also increasing the number of candidate historical trajectories and increasing the selectivity, thereby improving the accuracy of the final subsequent trajectory.

[0115] Trajectory length refers to the length of a candidate history trajectory.

[0116] In some embodiments, the controller may determine the trajectory length of the candidate historical trajectory based on the number of position points included in the candidate historical trajectory.

[0117] Pattern completeness refers to the completeness of a candidate historical trajectory. Pattern completeness can include the density of location points on a candidate historical trajectory. Location points refer to the locations on a candidate historical trajectory where presence sensing information was generated. Location points can include the location and time at which the sensing information was generated.

[0118] In some embodiments, the controller may determine the location points included in the candidate historical trajectory based on the historical sensing information corresponding to the candidate historical trajectory.

[0119] In some embodiments, the controller may determine pattern completeness based on the ratio between the number of location points (i.e., the trajectory length of the candidate historical trajectory) and the time length of the candidate historical trajectory. The time length of the candidate historical trajectory is the difference between the time corresponding to the first location point and the time corresponding to the last location point.

[0120] In some embodiments, the pattern completeness also includes the uniformity of the position points on the candidate historical trajectory.

[0121] Evenness refers to the distribution of location points on the candidate historical trajectories.

[0122] In some embodiments, the controller may determine the uniformity based on the time intervals between adjacent position points on the candidate historical trajectory. For example, the uniformity may be determined by the following formula (1):

[0123] Among them, y represents the uniformity of the position points on the candidate historical trajectory, represents the uniformity coefficient, n represents the number of position points on the candidate historical trajectory, represents the time corresponding to the i-th position point, In some embodiments, the uniformity coefficient Can be set by the controller based on default settings.

[0124] In some embodiments of the present specification, pattern completeness includes the uniformity of position points on the candidate historical trajectory. The sensitivity and performance of the sensing module can be determined based on the uniformity, while also considering the accuracy of the candidate historical trajectory, thereby improving the accuracy of the determined subsequent trajectory.

[0125] In some embodiments, for each candidate historical trajectory, the controller may determine the pattern completeness of the candidate historical trajectory based on the density and uniformity of the location points on the candidate historical trajectory. For example, the controller may perform a weighted summation of the density and uniformity of the location points to determine the pattern completeness. The weights of this weighted summation may be set by the controller based on default settings.

[0126] In some embodiments, the controller may determine the subsequent trajectory of the user based on the pattern completeness and trajectory similarity of the candidate historical trajectories.

[0127] For example, the controller can normalize the pattern completeness and trajectory similarity of candidate historical trajectories, perform a weighted sum of the normalized pattern completeness and trajectory similarity of the candidate historical trajectories, and use the candidate historical trajectory with the largest weighted sum as the historical motion trajectory that matches the previous trajectory, and use the motion trajectory that follows the similar portion of the previous trajectory as the subsequent trajectory. The normalization process can include Min-Max normalization. The weights of the weighted summation can be set by the controller based on default settings.

[0128] In some embodiments of this specification, the pattern completeness of a candidate historical trajectory is determined based on its trajectory length, and subsequent trajectories are determined based on trajectory similarity. The accuracy of the candidate historical trajectory can be determined by the number of location points on the candidate historical trajectory, thereby lowering the preset similarity threshold. While ensuring that each candidate historical trajectory is similar to the previous trajectory, the number of candidate historical trajectories can be increased, increasing the selectivity and thus improving the accuracy of the determined subsequent trajectories.

[0129] Step 530: Determine predicted position information based on the subsequent trajectory.

[0130] In some embodiments, the controller may determine the position information corresponding to the position point closest to the current moment in the subsequent trajectory as the predicted position information.

[0131] In some embodiments of the present specification, the previous trajectory is determined based on the sensing information, and then the subsequent trajectory of the user is determined through the target pattern database, and the predicted position information is determined. This is conducive to utilizing the user's historical behavioral habits, accurately predicting the user's subsequent trajectory, and improving the accuracy of determining the predicted position information, so as to adjust the sound effects in advance to ensure close matching with the user's real-time position and movements, and enhance the continuity and fluency of the performance.

[0132] It should be noted that the above description of process 500 is for illustration and purpose only and does not limit the scope of application of this specification. Those skilled in the art may make various modifications and variations to process 500 under the guidance of this specification. However, such modifications and variations are still within the scope of this specification.

[0133] While the basic concepts have been described above, it will be apparent to those skilled in the art that the detailed disclosure is merely illustrative and does not limit this specification. Although not explicitly stated herein, various modifications, improvements, and revisions to this specification may be made by those skilled in the art. Such modifications, improvements, and revisions are suggested in this specification and remain within the spirit and scope of the exemplary embodiments of this specification.

[0134] This specification also uses specific terms to describe the embodiments of this specification. For example, "one embodiment," "an embodiment," and / or "some embodiments" refer to a feature, structure, or characteristic associated with at least one embodiment of this specification. Therefore, it should be emphasized and noted that references to "one embodiment," "an embodiment," or "an alternative embodiment" two or more times in different locations in this specification do not necessarily refer to the same embodiment. Furthermore, certain features, structures, or characteristics of one or more embodiments of this specification may be appropriately combined.

[0135] In addition, unless expressly stated in the claims, the order of the processing elements and sequences, the use of alphanumeric characters, or the use of other names described in this specification are not intended to limit the order of the processes and methods of this specification. Although the above disclosure discusses some of the invention embodiments currently considered useful through various examples, it should be understood that such details are for illustrative purposes only, and the appended claims are not limited to the disclosed embodiments. On the contrary, the claims are intended to cover all modifications and equivalent combinations that are consistent with the spirit and scope of the embodiments of this specification. For example, although the system components described above can be implemented by hardware devices, they can also be implemented only by software solutions, such as installing the described system on an existing server or mobile device.

[0136] Similarly, it should be noted that, in order to simplify the presentation of this specification and thus facilitate understanding of one or more embodiments of the invention, the foregoing descriptions of the embodiments of this specification sometimes combine multiple features into a single embodiment, figure, or description thereof. However, this disclosure method does not imply that the subject matter of this specification requires more features than those recited in the claims. In fact, an embodiment may have fewer features than all of the features of a single disclosed embodiment.

[0137] In some embodiments, numbers describing the quantity of components and attributes are used. It should be understood that such numbers used in the description of the embodiments are modified by the modifiers "about", "approximately" or "substantially" in some examples. Unless otherwise stated, "about", "approximately" or "substantially" indicate that the numbers are allowed to vary by ±20%. Accordingly, in some embodiments, the numerical parameters used in the description and claims are approximate values, which may vary according to the required features of the individual embodiments. In some embodiments, the numerical parameters should take into account the specified significant digits and adopt the general method of retaining digits. Although the numerical domains and parameters used to confirm the breadth of their range in some embodiments of this specification are approximate values, in specific embodiments, the settings of such numerical values are as accurate as possible within the feasible range.

[0138] Each patent, patent application, patent application publication, and other materials, such as articles, books, specifications, publications, and documents, cited in this specification is hereby incorporated by reference in its entirety. This excludes any application history documents that are inconsistent with or conflicting with the content of this specification, as well as any documents (currently or subsequently appended to this specification) that limit the broadest scope of the claims of this specification. It should be noted that if the descriptions, definitions, and / or terminology used in the accompanying materials are inconsistent or conflicting with the content of this specification, the descriptions, definitions, and / or terminology used in this specification shall prevail.

[0139] Finally, it should be understood that the embodiments described in this specification are intended only to illustrate the principles of the embodiments of this specification. Other variations may also fall within the scope of this specification. Therefore, by way of example and not limitation, alternative configurations of the embodiments of this specification may be considered consistent with the teachings of this specification. Accordingly, the embodiments of this specification are not limited to the embodiments explicitly described and illustrated in this specification.

Claims

1. A sound playing device, comprising a controller, a sensing module and a sound player placed on a stage; the sensing module and the sound player are in communication with the controller; wherein: The sensing module is configured to obtain sensing information based on user triggering and send the information to the controller; The controller is configured to: determining the location information of the user based on the sensing information; as well as, A target speaker is determined based on the position information, and the target speaker is controlled to play a sound source corresponding to the user.

2. The device according to claim 1, wherein The controller is further configured to: in response to a data gap in the sensing information, determine the predicted location information of the user at the data gap moment based on the historical location information of the user.

3. The device according to claim 2, wherein The controller is further configured to: In response to the data gap in the sensing information, updating the fault statistical information of the sensing module corresponding to the predicted location information based on the predicted location information; as well as, Based on the fault statistical information, it is determined whether there is a faulty module and prompt information is generated.

4. The device according to claim 2, wherein The controller is further configured to: Determining a previous trajectory of the user based on the sensing information; Based on the previous trajectory, determining the subsequent trajectory of the user through a target pattern database; and Based on the subsequent trajectory, the predicted position information is determined.

5. The device according to claim 4, characterized in that The controller is further configured to: Based on the previous trajectory, determining at least one candidate historical trajectory through the target pattern database; For a candidate historical trajectory, determining a pattern completeness of the candidate historical trajectory based on the trajectory length of the candidate historical trajectory; The subsequent trajectory is determined based on the pattern completeness and trajectory similarity corresponding to the candidate historical trajectory.

6. A sound playing method, comprising: Acquiring sensing information of sensing modules laid on the stage, wherein the sensing information is triggered by a user; determining the location information of the user based on the sensing information; as well as, A target speaker is determined based on the position information, and the target speaker is controlled to play a sound source corresponding to the user.

7. The method according to claim 6, wherein The determining of the user's position information on the stage based on the sensing information includes: in response to a data gap in the sensing information, determining the user's predicted position information at the data gap moment based on the user's historical position information.

8. The method according to claim 7, wherein The method comprises: In response to the data gap in the sensing information, updating the fault statistics information of the sensing module corresponding to the predicted location information based on the predicted location information; and Based on the fault statistical information, it is determined whether there is a faulty module and prompt information is generated.

9. The method according to claim 7, wherein: In response to a data gap in the sensing information, determining the predicted location information of the user based on the historical location information of the user includes: Determining a previous trajectory of the user based on the sensing information; Based on the previous trajectory, determining the subsequent trajectory of the user through a target pattern database; and Based on the subsequent trajectory, the predicted position information is determined.

10. The method according to claim 6, wherein Determining the subsequent trajectory of the user through a target pattern database based on the previous trajectory includes: Based on the previous trajectory, determining at least one candidate historical trajectory through the target pattern database; For a candidate historical trajectory, determining a pattern completeness of the candidate historical trajectory based on the trajectory length of the candidate historical trajectory; The subsequent trajectory is determined based on the pattern completeness and trajectory similarity corresponding to the candidate historical trajectory.

Images