Remote control method and system for multimedia equipment

Abstract

The invention relates to the technical field of multimedia control, and discloses a remote control method and system for multimedia equipment, and the method comprises the steps: obtaining equipment parameter data, environment data and layout data under an initial playing sequence; inputting the first playing sequence, the equipment parameter data, the environment data and the layout data into a pre-trained audio playing effect detection model to predict an audio playing quality index; when the audio playing effect does not reach the standard, obtaining an adjustment playing sequence of the multimedia audio equipment by using a pre-configured genetic algorithm; the conference room multimedia center console controls all multimedia audio devices in the conference room according to the adjusted playing sequence, and corresponding opening or closing operation is executed; the audio playing effect of the conference room can be ensured to be in the best state.

Description

Technical Field

[0001] The present invention relates to the field of multimedia control technology, and more specifically, to a multimedia device remote control method and system. Background Art

[0002] With the rapid growth of the demand for intelligent modern office, multimedia conference rooms have become an important scene for internal corporate meetings, academic seminars and remote collaboration; these conference rooms are usually equipped with audio systems, video systems and intelligent control equipment to improve meeting efficiency and user experience; however, existing technologies still have many shortcomings in the dynamic management and optimization control of multimedia audio equipment, and cannot fully meet actual needs.

[0003] At present, the debugging and control of multimedia audio equipment mainly rely on manual intervention, which is not only inefficient, but also limited by the experience level of personnel, making it difficult to ensure the stability and consistency of audio playback quality. At the same time, in actual use, the audio playback effect is often significantly affected by environmental factors, such as the acoustic characteristics of the room, equipment layout, and environmental noise. However, the existing technology does not effectively capture and explore the potential relationship between these factors and the audio playback effect, which makes it difficult for traditional methods to flexibly control the audio device combination mode according to changes in these factors. This limitation not only restricts the improvement of audio playback effects, but also increases the complexity and time cost of system debugging, affecting users' satisfaction and trust in the conference room multimedia system. Summary of the invention

[0004] In order to overcome the above-mentioned defects of the prior art, an embodiment of the present invention provides a method and system for remotely controlling a multimedia device.

[0005] To achieve the above object, the present invention provides the following technical solutions:

[0006] In a first aspect, a method for remotely controlling a multimedia device is provided, the method comprising:

[0007] Obtain device parameter data of all multimedia audio devices in the conference room in the initial playback sequence, as well as environmental data and layout data of the conference room in the current state;

[0008] Inputting the first playback sequence, device parameter data, environment data and layout data into a pre-trained audio playback effect detection model to predict the audio playback quality index of the initial playback sequence in the current state;

[0009] When it is determined according to the audio playback quality index that the audio playback effect of the initial playback sequence does not meet the standard, a pre-configured genetic algorithm is used to obtain an adjusted playback sequence of the multimedia audio device, and the adjusted playback sequence is fed back to the conference room multimedia console, where the adjusted playback sequence is the optimal playback sequence of the multimedia audio device in the conference room under the current state;

[0010] The conference room multimedia central console controls all multimedia audio devices in the conference room according to the adjusted playback sequence, and performs corresponding opening or closing operations to optimize the audio playback effect of the initial playback sequence.

[0011] Furthermore, the device parameter data includes but is not limited to the volume, output power and playback mode of each multimedia audio device in the initial playback sequence; the environmental data includes but is not limited to noise intensity, noise spectrum distribution and temperature and humidity; the layout data includes but is not limited to the size of the conference room, the location distribution of each multimedia audio device and the number of multimedia audio devices in operation.

[0012] Furthermore, the method for generating the audio playback effect detection model is as follows:

[0013] Acquire historical audio playback effect detection data, and divide the historical audio playback effect detection data into an audio playback effect detection training set and an audio playback effect detection test set; the historical audio playback effect detection data includes audio playback effect impact feature data and its corresponding audio playback quality index;

[0014] Wherein, the audio playback effect impact characteristic data includes a first playback sequence, device parameter data, environment data and layout data;

[0015] Construct a CNN convolutional neural network, use the audio playback effect impact feature data in the audio playback effect detection training set as the input of the CNN convolutional neural network, and use the audio playback quality index in the audio playback effect detection training set as the output of the CNN convolutional neural network, train the CNN convolutional neural network, and obtain an initial convolutional neural network model;

[0016] The initial convolutional neural network model is verified using the audio playback effect detection test set, and an initial convolutional neural network model with a test error threshold that is less than or equal to the preset test error threshold is output as the trained audio playback effect detection model.

[0017] Furthermore, the method for obtaining the audio playback quality index in the historical audio playback effect detection data is as follows:

[0018] In the test scenario, obtain audio playback quality reflection data of N preset audio test points in the conference room, wherein the audio playback quality reflection data includes the measured sound pressure level, the measured audio clarity and the reverberation time, where N is an integer greater than zero;

[0019] Substituting the audio playback quality reflection data into a preset audio playback quality calculation model to obtain an audio playback quality index;

[0020] The expression of the audio playback quality calculation model is as follows:

[0021]

[0022] Where: Q audio Indicates the audio playback quality index; P i represents the measured sound pressure level of the ith audio test point; T represents the ideal sound pressure level; C 80，i represents the measured audio clarity of the i-th audio test point; C 80，ideal Indicates ideal audio clarity; RT i is the reverberation time of the i-th audio test point; N is the total number of audio test points.

[0023] Further, after predicting the audio playback quality index using the initial playback sequence, the method further includes:

[0024] comparing the audio playback quality index with a preset audio playback quality index threshold;

[0025] If the audio playback quality index is less than or equal to the audio playback quality index threshold, it is determined that the audio playback effect of the initial playback sequence does not meet the standard;

[0026] If the audio playback quality index is greater than the audio playback quality index threshold, it is determined that the audio playback effect of the initial playback sequence meets the standard.

[0027] Further, when it is determined that the audio playback effect of the initial playback sequence meets the standard, the first playback sequence is fed back to the conference room multimedia console;

[0028] The conference room multimedia central console controls all multimedia audio devices in the conference room according to the first play sequence and performs corresponding opening or closing operations.

[0029] Furthermore, the method of obtaining the adjusted play sequence of the multimedia audio device by using a preconfigured genetic algorithm includes:

[0030] a1: Initialize the population: randomly generate an original population, which contains X individuals, each of which represents a playback sequence, and X is an integer greater than zero;

[0031] a2: Fitness evaluation: Under each individual, obtain the audio playback quality index; input the audio playback quality index into the pre-built fitness function to calculate the fitness of each individual;

[0032] The calculation formula of the pre-constructed fitness function is: In the formula: Fitness is the fitness, Q target It is the audio playback quality index under ideal conditions;

[0033] a3: Selection: Use the roulette method to select two individuals with high fitness in the original population as the father and mother;

[0034] a4: Crossover: Perform crossover operation on the father and mother to produce new individuals;

[0035] a5: Mutation: Perform mutation operation on the new individuals to obtain Y new individuals, combine the Y new individuals into a new population, replace the original population with the new population, and return to step a2;

[0036] a6: Repeat steps a2 to a5 above until the fitness of individuals in the original population or the new population is greater than or equal to a preset fitness threshold, or the number of iterations is greater than or equal to a preset maximum number of iterations threshold, output the playback sequence represented by the corresponding individual as the optimal playback sequence, and use the optimal playback sequence as the adjusted playback sequence of the multimedia audio device.

[0037] In a second aspect, a multimedia device remote control system is provided, which is implemented based on the multimedia device remote control method described above, and the system includes:

[0038] The information acquisition module is used to obtain the device parameter data of all multimedia audio devices in the conference room under the initial playback sequence, as well as the environmental data and layout data of the conference room in the current state;

[0039] A data prediction module, used for inputting the first playback sequence, device parameter data, environment data and layout data into a pre-trained audio playback effect detection model to predict the audio playback quality index of the initial playback sequence in the current state;

[0040] A sequence optimization module is used to obtain an adjusted playback sequence of the multimedia audio device using a preconfigured genetic algorithm when it is determined that the audio playback effect of the initial playback sequence does not meet the standard according to the audio playback quality index, and feed the adjusted playback sequence back to the conference room multimedia console, wherein the adjusted playback sequence is the optimal playback sequence of the multimedia audio device in the conference room under the current state;

[0041] The automatic control module is used to control all multimedia audio devices in the conference room according to the adjusted playback sequence by the conference room multimedia console, and perform corresponding opening or closing operations to optimize the audio playback effect of the initial playback sequence.

[0042] In a third aspect, an electronic device is provided, comprising a memory, a processor, and a computer program stored in the memory and running on the processor, wherein when the processor executes the computer program, the remote control method for a multimedia device described in any one of the above items is implemented.

[0043] In a fourth aspect, a computer-readable storage medium is provided, on which a computer program is stored, and when the computer program is executed, any of the above-mentioned methods for remotely controlling a multimedia device is implemented.

[0044] Compared with the prior art, the present invention has the following beneficial effects:

[0045] The present application discloses a method and system for remotely controlling multimedia devices, including: obtaining device parameter data, as well as environmental data and layout data under an initial playback sequence; inputting the first playback sequence, device parameter data, environmental data and layout data into a pre-trained audio playback effect detection model to predict an audio playback quality index; when the audio playback effect does not meet the standard, using a pre-configured genetic algorithm to obtain an adjustment playback sequence for the multimedia audio device; the conference room multimedia console controls all multimedia audio devices in the conference room according to the adjustment playback sequence and performs corresponding opening or closing operations; based on the above characteristics, the present invention can effectively capture and mine the potential relationship between these factors and the audio playback effect, thereby facilitating flexible control of the audio device combination mode, ensuring that the conference room is always in the best audio playback effect, avoiding audio management deviations caused by manual adjustments on site by debugging personnel, avoiding the problem of conference process interruption caused by audio playback, and improving users' satisfaction and trust in the conference room multimedia system. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] Figure 1 A flowchart of the multimedia device remote control method provided by the present invention;

[0047] Figure 2 A module structure diagram of the multimedia device remote control system provided by the present invention;

[0048] Figure 3 The present invention provides a schematic structural diagram of an electronic device. DETAILED DESCRIPTION

[0049] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0050] Example 1

[0051] See also Figure 1 As shown, this embodiment discloses a method for remotely controlling multimedia devices, which aims to remotely and dynamically adjust the playback sequence of multimedia devices by real-time acquisition of status data and environmental information of multimedia devices in a conference room, combined with intelligent prediction and optimization algorithms, so as to ensure the best audio playback effect. The method includes:

[0052] S101: Acquire device parameter data of all multimedia audio devices in the conference room in the initial playback sequence, as well as environmental data and layout data of the conference room in the current state;

[0053] It should be understood that: with the continuous improvement of the demand for intelligent office and remote collaboration in modern enterprises, multimedia conference rooms have become the core scenes for corporate meetings, academic seminars and cross-regional communication; such conference rooms are usually equipped with audio systems, video systems and intelligent control equipment to improve the interactivity and efficiency of meetings; among them, the multimedia audio equipment (such as speakers) in existing multimedia conference rooms need to be manually adjusted by equipment debugging personnel before the meeting starts, and are subject to the accumulation of experience of debugging personnel, which easily leads to the audio playback effect failing to meet the actual meeting needs. At the same time, due to the lack of consideration of the impact of environmental characteristics and the lack of automated means, when problems such as poor audio playback effects occur, debugging personnel need to manually adjust on-site, which increases the complexity of the meeting process and may interrupt the meeting process; therefore, it is necessary to provide an efficient and intelligent solution for the audio management of multimedia conference rooms;

[0054] The initial playback sequence refers to the playback combination of all multimedia audio devices (such as speakers) in the conference room in an initial random state, which can be set manually, or according to the default settings (such as turning on all speakers) or according to the last setting. For example, assuming that there are multiple speakers distributed in a conference room, namely A1, A2, A3 and A4, and assuming that A1, A2, A3 and A4 are all turned on before the meeting starts, then [A1, A2, A3, A4] is used as the initial playback sequence. If only A1, A2 and A3 are turned on before the meeting starts, then [A1, A2, A3] is used as the initial playback sequence, and A4 is turned off. It is worth noting that setting according to the last setting means that, assuming that only A1 and A2 are turned on for the multimedia audio devices, then the last setting [A1, A2] is used as the initial playback sequence.

[0055] Specifically, the device parameter data includes but is not limited to the volume (expressed in decibels (dB) or percentage, usually ranging from 0-100%), output power (in watts) and playback mode (such as stereo, surround sound and mono, etc.) of each multimedia audio device in the initial playback sequence; the environmental data includes but is not limited to noise intensity (the overall sound pressure level of background noise, in dB), noise spectrum distribution (describing the energy distribution of background noise at different frequencies, in dB / Hz) and temperature and humidity, etc.; the layout data includes but is not limited to the size of the conference room (length, width and height), the location distribution of each multimedia audio device (i.e., the relative coordinates relative to the center coordinates of the conference room) and the number of running multimedia audio devices, etc.;

[0056] Specifically, the equipment parameter data, environmental data and layout data are acquired through historical records or various sensors, and the various sensors include but are not limited to noise sensors, visual sensors, temperature and humidity sensors, etc.

[0057] S102: inputting the first play sequence, device parameter data, environment data and layout data into a pre-trained audio play effect detection model to predict the audio play quality index of the initial play sequence in the current state;

[0058] In implementation, the method for generating the audio playback effect detection model is as follows:

[0059] Acquire historical audio playback effect detection data, and divide the historical audio playback effect detection data into an audio playback effect detection training set and an audio playback effect detection test set; the historical audio playback effect detection data includes audio playback effect impact feature data and its corresponding audio playback quality index;

[0060] Wherein, the audio playback effect impact characteristic data includes a first playback sequence, device parameter data, environment data and layout data;

[0061] It should be noted that the audio playback effect impact characteristic data and the audio playback quality index of the historical audio playback effect detection data are obtained by technical personnel based on experimental data or historical data collection and recording;

[0062] The method for obtaining the audio playback quality index in the historical audio playback effect detection data is as follows:

[0063] In the test scenario, obtain audio playback quality reflection data of N preset audio test points in the conference room, wherein the audio playback quality reflection data includes the measured sound pressure level, the measured audio clarity and the reverberation time, where N is an integer greater than zero;

[0064] Substituting the audio playback quality reflection data into a preset audio playback quality calculation model to obtain an audio playback quality index;

[0065] Specifically, the expression of the audio playback quality calculation model is as follows:

[0066]

[0067] Where: Q audio Indicates the audio playback quality index; P i represents the measured sound pressure level of the ith audio test point, which represents the actual sound intensity measured at a specific location in the audio test environment; T represents the ideal sound pressure level, which is set by the technician; C 80，i Indicates the measured audio clarity of the ith audio test point, which is used to measure the energy ratio of direct sound and reflected sound (reverberation sound) at a certain position (the ith audio test point) in the room. Specifically, it indicates the ratio of the early sound energy (direct sound + early reflected sound) within 80 milliseconds in the sound to the reverberation sound energy after 80 milliseconds at a certain test point; C 80，ideal Indicates the ideal audio clarity, which is set by the technicians and is usually 5-10dB; RT i is the reverberation time of the ith audio test point (in seconds), which indicates the time required for the sound energy to decay by 60 dB, that is, the time required for the sound energy to decay by 60 dB from the initial value; N is the total number of audio test points;

[0068] It should be understood that: Q audio The size of Q directly reflects the quality of audio playback, that is, whether the audio equipment can meet the expected playback effect when playing audio in the room; when Q audio The larger the Q is, the better the audio playback effect is. audio The smaller the value, the greater the difference between the audio playback effect and the ideal state, that is, the audio playback effect is not good;

[0069] Construct a CNN convolutional neural network, use the audio playback effect impact feature data in the audio playback effect detection training set as the input of the CNN convolutional neural network, and use the audio playback quality index in the audio playback effect detection training set as the output of the CNN convolutional neural network, train the CNN convolutional neural network, and obtain an initial convolutional neural network model;

[0070] The initial convolutional neural network model is verified using the audio playback effect detection test set, and an initial convolutional neural network model with a test error threshold less than or equal to a preset test error threshold is output as a trained audio playback effect detection model;

[0071] In implementation, after predicting the audio playback quality index using the initial playback sequence, it includes:

[0072] comparing the audio playback quality index with a preset audio playback quality index threshold;

[0073] If the audio playback quality index is less than or equal to the audio playback quality index threshold, it is determined that the audio playback effect of the initial playback sequence does not meet the standard;

[0074] If the audio playback quality index is greater than the audio playback quality index threshold, it is determined that the audio playback effect of the initial playback sequence meets the standard;

[0075] S103: When it is determined according to the audio playback quality index that the audio playback effect of the initial playback sequence does not meet the standard, a preconfigured genetic algorithm is used to obtain an adjusted playback sequence of the multimedia audio device, and the adjusted playback sequence is fed back to the conference room multimedia console, where the adjusted playback sequence is the optimal playback sequence of the multimedia audio device in the conference room under the current state;

[0076] In a specific implementation, when it is determined that the audio playback effect of the initial playback sequence meets the standard, the first playback sequence is fed back to the conference room multimedia console;

[0077] The conference room multimedia central console controls all multimedia audio devices in the conference room according to the first play sequence and performs corresponding opening or closing operations;

[0078] It can be understood that: when the audio playback effect of the playback combination of the multimedia audio devices in the conference room under the default setting or the initial random state meets the expectations (that is, the audio playback effect meets the standard), there is no need for subsequent optimization and adjustment, and all the multimedia audio devices in the conference room can be directly controlled according to the first playback sequence;

[0079] For example, following the above example, assume that there are multiple speakers distributed in a conference room, namely A1, A2, A3 and A4, and assume that A1, A2, A3 and A4 are all turned on before the meeting starts. At this time, [A1, A2, A3, A4] is used as the initial playback sequence, and under the initial playback sequence, the audio playback effect detection model predicts that the audio playback effect in the conference room meets expectations in the current state, then the conference room multimedia console controls A1, A2, A3 and A4 to be all turned on;

[0080] In implementation, the method of obtaining the adjusted play sequence of the multimedia audio device by using a preconfigured genetic algorithm includes:

[0081] a1: Initialize the population: randomly generate an original population, which contains X individuals, each of which represents a playback sequence, and X is an integer greater than zero;

[0082] a2: Fitness evaluation: Under each individual (i.e., each playback sequence in the original population), obtain the audio playback quality index; input the audio playback quality index into the pre-built fitness function to calculate the fitness of each individual;

[0083] In genetic algorithms, fitness evaluation is one of the core steps, which is used to determine the fitness of each individual, that is, to determine how well each individual performs in a given problem; the design of the fitness function directly affects the efficiency of the algorithm and the quality of the final solution;

[0084] It should be understood that: the same as the logic of obtaining the audio playback quality index of the initial playback sequence, the audio playback quality index of each individual (i.e., each playback sequence in the original population) is also predicted by the pre-trained audio playback effect detection model. For details on the prediction process and the generation logic of the audio playback effect detection model, please refer to the above-mentioned relevant parts, and no further repetition will be given here;

[0085] The calculation formula of the pre-constructed fitness function is: Where: Fitness is fitness, Q target It is the audio playback quality index under ideal conditions, which is set by technicians based on experimental data or historical data;

[0086] a3: Selection: Use the roulette method to select two individuals with high fitness in the original population as the father and mother;

[0087] The roulette wheel method is a commonly used selection method, which is used in genetic algorithms to select individuals with higher fitness to enter the next generation. It simulates the process of roulette, and each individual obtains a corresponding "roulette wheel" area according to its fitness. The higher the fitness of the individual, the larger the corresponding area, and the higher the probability of being selected.

[0088] a4: Crossover: Perform crossover operation on the father and mother to produce new individuals;

[0089] It should be noted that the crossover operation on the paternal parent and the maternal parent is implemented based on a crossover operation, and the crossover operation includes but is not limited to one of a single-point crossover, a uniform crossover or a sequential crossover, etc.;

[0090] In genetic algorithms, crossover is an important genetic operation used to generate a new generation of candidate solutions; the basic idea of ​​crossover is to simulate the sexual reproduction process in biological genetics, in which two parents produce offspring by combining their genetic information; this process helps to introduce diversity in the solution space and may produce new individuals that are more adaptable to the environment;

[0091] a5: Mutation: Perform mutation operation on the new individuals to obtain Y new individuals, combine the Y new individuals into a new population, replace the original population with the new population, and return to step a2;

[0092] In genetic algorithms, mutation operations are used to introduce genetic diversity and prevent the algorithm from falling into a local optimum. The mutation operation on new individuals is implemented by uniform mutation or Gaussian mutation.

[0093] a6: Repeat the above steps a2 to a5 until the fitness of the individuals in the original population or the new population is greater than or equal to the preset fitness threshold, or the number of iterations is greater than or equal to the preset maximum number of iterations threshold, output the playback sequence represented by the corresponding individual as the optimal playback sequence, and use the optimal playback sequence as the adjustment playback sequence of the multimedia audio device;

[0094] For example: Assume that the maximum number of iterations is 100 times, and record the individual with the highest fitness in the current population and its fitness value after each iteration; if it is found that the fitness value has not changed significantly in a certain generation, it is considered that the convergence condition is met, the iteration is stopped, and the playback sequence represented by the corresponding individual is output as the optimal playback sequence, that is, the adjusted playback sequence of the multimedia audio device is obtained;

[0095] S104: the conference room multimedia central console controls all multimedia audio devices in the conference room according to the adjusted playback sequence, and performs corresponding opening or closing operations to optimize the audio playback effect of the initial playback sequence;

[0096] For example, based on the above assumptions, if the initial playback sequence is [A1, A2, A3, A4], and it is assumed that the audio playback quality index predicted under the initial playback sequence does not meet expectations, then the adjusted playback sequence [A1, A4] is obtained through genetic algorithm optimization. Therefore, the conference room multimedia console controls A2 and A3 to be in a closed state, and controls A1 and A4 to be in an open state, that is, the optimization adjustment of the initial playback sequence is completed, and the conference room is in a state to ensure the best audio playback effect;

[0097] By real-time collection of status data and environmental information of multimedia devices in the conference room, combined with intelligent prediction and optimization algorithms, the playback sequence of multimedia devices can be remotely and dynamically adjusted. The present invention is conducive to ensuring that the conference room is always in the best audio playback effect, avoiding audio management deviations caused by manual adjustments on site by debuggers, providing high-quality audio experience, avoiding the interruption of the conference process caused by audio playback, and improving users' satisfaction and trust in the conference room multimedia system.

[0098] Example 2

[0099] See also Figure 2 As shown, based on the same inventive concept, this embodiment discloses a multimedia device remote control system. For details not provided in this embodiment, please refer to the relevant parts of the above embodiment 1. The system includes:

[0100] The information acquisition module 210 is used to acquire device parameter data of all multimedia audio devices in the conference room in the initial playback sequence, as well as environmental data and layout data of the conference room in the current state;

[0101] The data prediction module 220 is used to input the first playback sequence, device parameter data, environment data and layout data into a pre-trained audio playback effect detection model to predict the audio playback quality index of the initial playback sequence in the current state;

[0102] The sequence optimization module 230 is used to obtain an adjusted playback sequence of the multimedia audio device by using a preconfigured genetic algorithm when it is determined that the audio playback effect of the initial playback sequence does not meet the standard according to the audio playback quality index, and feed the adjusted playback sequence back to the conference room multimedia console, wherein the adjusted playback sequence is the optimal playback sequence of the multimedia audio device in the conference room under the current state;

[0103] The automatic control module 240 is used for the conference room multimedia console to control all multimedia audio devices in the conference room according to the adjusted playback sequence, and perform corresponding opening or closing operations to optimize the audio playback effect of the initial playback sequence.

[0104] Example 3

[0105] See also Figure 3 As shown, this embodiment discloses an electronic device, including a memory, a processor, and a computer program stored in the memory and running on the processor, and when the processor executes the computer program, it implements any one of the multimedia device remote control methods provided by the above methods.

[0106] Since the electronic device introduced in the content of this embodiment is an electronic device used to implement a multimedia device remote control method in the embodiment of this application, based on the multimedia device remote control method introduced in the embodiment of this application, the technical personnel of this field can understand the specific implementation of the electronic device of this embodiment and its various variations, so how the electronic device implements the method in the embodiment of this application is not described in detail here. As long as the technical personnel of this field implement the electronic device used in the multimedia device remote control method in the embodiment of this application, it belongs to the scope of protection of this application.

[0107] Example 4

[0108] This embodiment discloses a computer-readable storage medium, including a memory, a processor, and a computer program stored in the memory and running on the processor. When the processor executes the computer program, it implements any one of the multimedia device remote control methods provided by the above methods.

[0109] The above formulas are all dimensionless and numerical calculations. The formula is a formula for the most recent real situation obtained by collecting a large amount of data and performing software simulation. The preset parameters, weights and thresholds in the formula are set by technicians in this field according to actual conditions.

[0110] The above embodiments can be implemented in whole or in part by software, hardware, firmware or any other combination. When implemented by software, the above embodiments can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions or computer programs. When the computer instructions or computer programs are loaded or executed on a computer, the process or function described in the embodiment of the present invention is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website site, computer, server or data center to another website site, computer, server or data center through a wired network or a wireless network. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that contains one or more available media sets. The available medium can be a magnetic medium (for example, a floppy disk, a hard disk, a tape), an optical medium (for example, a DVD) or a semiconductor medium. The semiconductor medium can be a solid-state hard disk.

[0111] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed in the present invention can be implemented in electronic hardware or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0112] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0113] In the several embodiments provided by the present invention, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of the units is only one, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0114] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0115] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0116] The above is only a specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed by the present invention, which should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

[0117] Finally: The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. A multimedia device remote control method, characterized in that: The method comprises: Obtain device parameter data of all multimedia audio devices in the conference room in the initial playback sequence, as well as environmental data and layout data of the conference room in the current state; Inputting the first playback sequence, device parameter data, environment data and layout data into a pre-trained audio playback effect detection model to predict the audio playback quality index of the initial playback sequence in the current state; When it is determined according to the audio playback quality index that the audio playback effect of the initial playback sequence does not meet the standard, a pre-configured genetic algorithm is used to obtain an adjusted playback sequence of the multimedia audio device, and the adjusted playback sequence is fed back to the conference room multimedia console, where the adjusted playback sequence is the optimal playback sequence of the multimedia audio device in the conference room under the current state; The conference room multimedia central console controls all multimedia audio devices in the conference room according to the adjusted playback sequence, and performs corresponding opening or closing operations to optimize the audio playback effect of the initial playback sequence.

2. The multimedia device remote control method according to claim 1, characterized in that: The device parameter data includes but is not limited to the volume, output power and playback mode of each multimedia audio device in the initial playback sequence; the environmental data includes but is not limited to noise intensity, noise spectrum distribution and temperature and humidity; the layout data includes but is not limited to the size of the conference room, the location distribution of each multimedia audio device and the number of multimedia audio devices in operation.

3. The multimedia device remote control method according to claim 2, characterized in that: The method for generating the audio playback effect detection model is as follows: Acquire historical audio playback effect detection data, and divide the historical audio playback effect detection data into an audio playback effect detection training set and an audio playback effect detection test set; the historical audio playback effect detection data includes audio playback effect impact feature data and its corresponding audio playback quality index; Wherein, the audio playback effect influence characteristic data includes a first playback sequence, device parameter data, environment data and layout data; Construct a CNN convolutional neural network, use the audio playback effect impact feature data in the audio playback effect detection training set as the input of the CNN convolutional neural network, and use the audio playback quality index in the audio playback effect detection training set as the output of the CNN convolutional neural network, train the CNN convolutional neural network, and obtain an initial convolutional neural network model; The initial convolutional neural network model is verified using the audio playback effect detection test set, and an initial convolutional neural network model with a test error threshold that is less than or equal to the preset test error threshold is output as the trained audio playback effect detection model.

4. The multimedia device remote control method according to claim 3, characterized in that: The method for obtaining the audio playback quality index in the historical audio playback effect detection data is as follows: In the test scenario, obtain audio playback quality reflection data of N preset audio test points in the conference room, wherein the audio playback quality reflection data includes the measured sound pressure level, the measured audio clarity and the reverberation time, where N is an integer greater than zero; Substituting the audio playback quality reflection data into a preset audio playback quality calculation model to obtain an audio playback quality index; The expression of the audio playback quality calculation model is as follows: Where: Q audio Indicates the audio playback quality index; P i represents the measured sound pressure level of the ith audio test point; T represents the ideal sound pressure level; C 80，i represents the measured audio clarity of the i-th audio test point; C 80，ideal Indicates ideal audio clarity; RT i is the reverberation time of the i-th audio test point; N is the total number of audio test points.

5. The multimedia device remote control method according to claim 4, characterized in that: After predicting the audio playback quality index using the initial playback sequence, including: comparing the audio playback quality index with a preset audio playback quality index threshold; If the audio playback quality index is less than or equal to the audio playback quality index threshold, it is determined that the audio playback effect of the initial playback sequence does not meet the standard; If the audio playback quality index is greater than the audio playback quality index threshold, it is determined that the audio playback effect of the initial playback sequence meets the standard.

6. The multimedia device remote control method according to claim 5, characterized in that: When it is determined that the audio playback effect of the initial playback sequence meets the standard, the first playback sequence is fed back to the conference room multimedia console; The conference room multimedia central console controls all multimedia audio devices in the conference room according to the first play sequence and performs corresponding opening or closing operations.

7. The multimedia device remote control method according to claim 6, characterized in that: The method of obtaining the adjusted play sequence of the multimedia audio device by using a preconfigured genetic algorithm includes: a1: Initialize the population: randomly generate an original population, which contains X individuals, each of which represents a playback sequence, and X is an integer greater than zero; a2: Fitness evaluation: Under each individual, obtain the audio playback quality index; input the audio playback quality index into the pre-built fitness function to calculate the fitness of each individual; The calculation formula of the pre-constructed fitness function is: Where: Fitness is fitness, Q target It is the audio playback quality index under ideal conditions; a3: Selection: Use the roulette method to select two individuals with high fitness in the original population as the father and mother; a4: Crossover: Perform crossover operation on the father and mother to produce new individuals; a5: Mutation: Perform mutation operation on the new individuals to obtain Y new individuals, combine the Y new individuals into a new population, replace the original population with the new population, and return to step a2; a6: Repeat steps a2 to a5 above until the fitness of individuals in the original population or the new population is greater than or equal to a preset fitness threshold, or the number of iterations is greater than or equal to a preset maximum number of iterations threshold, output the playback sequence represented by the corresponding individual as the optimal playback sequence, and use the optimal playback sequence as the adjusted playback sequence of the multimedia audio device.

8. A multimedia device remote control system, characterized in that: The system is implemented based on the multimedia device remote control method according to any one of claims 1 to 7, and the system comprises: The information acquisition module is used to obtain the device parameter data of all multimedia audio devices in the conference room under the initial playback sequence, as well as the environmental data and layout data of the conference room in the current state; A data prediction module, used for inputting the first playback sequence, device parameter data, environment data and layout data into a pre-trained audio playback effect detection model to predict the audio playback quality index of the initial playback sequence in the current state; A sequence optimization module is used to obtain an adjusted playback sequence of the multimedia audio device using a preconfigured genetic algorithm when it is determined that the audio playback effect of the initial playback sequence does not meet the standard according to the audio playback quality index, and feed the adjusted playback sequence back to the conference room multimedia console, wherein the adjusted playback sequence is the optimal playback sequence of the multimedia audio device in the conference room under the current state; The automatic control module is used to control all multimedia audio devices in the conference room according to the adjusted playback sequence by the conference room multimedia console, and perform corresponding opening or closing operations to optimize the audio playback effect of the initial playback sequence.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and running on the processor, characterized in that: When the processor executes the computer program, the multimedia device remote control method according to any one of claims 1 to 7 is implemented.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed, the multimedia device remote control method according to any one of claims 1 to 7 is implemented.

Images