An information processing method, apparatus, device, and storage medium

Abstract

Embodiments of the present application disclose an information processing method, which is applied to a cloud device. The method comprises: obtaining a first audio signal, a second audio signal and a target audio feature corresponding to to-be-analyzed audio information; wherein the to-be-analyzed audio information is collected by a voice collection module included in a voice control device; the target audio feature is obtained by performing feature fusion processing on the first audio signal and the second audio signal; determining a current use state of the voice collection module based on the first audio signal, the second audio signal and the target audio feature; and sending the current use state to a terminal device, so that the current use state is displayed on a display screen corresponding to the terminal device and / or a display screen corresponding to the voice control device. Embodiments of the present application also disclose an information processing apparatus, a device and a storage medium.

Description

Technical Field

[0001] This application relates to the field of communication technology, and in particular to an information processing method, apparatus, device and storage medium. Background Technology

[0002] With the advancement of IoT technology and the improvement of residents' living standards, smart home appliances have emerged. As these appliances become more widely used, the Internet of Things (IoT) is gradually being realized, meaning all smart home appliances are interconnected and connected to the IoT. With the increasing popularity of smart home appliances, voice control functionality is typically included for convenient control. This voice control is usually achieved through voice acquisition devices such as microphones and speakers.

[0003] However, during the long-term use of smart home appliances, voice acquisition devices such as microphones will wear out, resulting in reduced sensitivity and severely impacting the user experience. Determining the usage status of voice acquisition devices in smart home appliances so as to replace them in a timely manner has become an urgent technical problem to be solved. Summary of the Invention

[0004] To address the aforementioned technical problems, this application aims to provide an information processing method, apparatus, device, and storage medium. This solves the current problem of not being able to predict the usage status of voice acquisition devices in smart home appliances, and proposes a method for predicting the usage status of voice acquisition devices in smart home appliances. This ensures the performance of the voice acquisition devices in smart home appliances and improves their working efficiency.

[0005] The technical solution of this application is implemented as follows:

[0006] In a first aspect, an information processing method is applied to a cloud device, the method comprising:

[0007] The method involves acquiring a first audio signal, a second audio signal, and target audio features corresponding to the audio information to be analyzed; wherein the audio information to be analyzed is acquired by a voice acquisition module included in the voice control device, and the target audio features are obtained by feature fusion processing of the first audio signal and the second audio signal;

[0008] Based on the first audio signal, the second audio signal, and the target audio features, determine the current usage status of the voice acquisition module;

[0009] The current usage status is sent to the terminal device so that the current usage status is displayed on the display screen of the terminal device and / or the display screen of the voice control device.

[0010] Secondly, an information processing apparatus, applied to a cloud device, the apparatus comprising: an acquisition unit, a determination unit, and a transmission unit; wherein:

[0011] The acquisition unit is used to acquire a first audio signal, a second audio signal, and a target audio feature corresponding to the audio information to be analyzed; wherein, the audio information to be analyzed is acquired by a voice acquisition module included in the voice control device, and the target audio feature is obtained by feature fusion processing of the first audio signal and the second audio signal;

[0012] The determining unit is used to determine the current usage status of the voice acquisition module based on the first audio signal, the second audio signal, and the target audio features;

[0013] The sending unit is used to send the current usage status to the terminal device so that the current usage status is displayed on the terminal device and / or the voice control device.

[0014] Thirdly, a cloud device, the device comprising: a memory, a processor, and a communication bus; wherein:

[0015] The memory is used to store executable instructions;

[0016] The communication bus is used to realize the communication connection between the processor and the memory;

[0017] The processor is configured to execute the information processing program stored in the memory to implement the steps of the information processing method as described in any of the preceding claims.

[0018] Fourthly, a storage medium storing an information processing program, which, when executed by a processor, implements the steps of the information processing method as described in any of the preceding claims.

[0019] In this embodiment, the cloud device acquires the first audio signal, the second audio signal, and the target audio features corresponding to the audio information to be analyzed. Based on these, it determines the current usage status of the voice acquisition module and then sends the current usage status to the terminal device so that it can be displayed on the terminal device's display screen and / or the voice control device's display screen. In this way, by predictively analyzing the first audio signal, the second audio signal, and the target audio features acquired by the voice acquisition module of the voice control device, the current usage status of the voice acquisition module is determined. This solves the current problem of not being able to predict the usage status of voice acquisition devices in smart home appliances, and proposes a method for predicting the usage status of voice acquisition devices in smart home appliances, ensuring the performance of the voice acquisition devices in smart home appliances and improving their working efficiency. Attached Figure Description

[0020] Figure 1 Flowchart of the information processing method provided in the embodiments of this application Figure 1 ;

[0021] Figure 2 Flowchart of the information processing method provided in the embodiments of this application Figure 2 ;

[0022] Figure 3 Flowchart of the information processing method provided in the embodiments of this application Figure 3 ;

[0023] Figure 4 This is a schematic diagram of an application scenario provided by an embodiment of this application;

[0024] Figure 5 This is a schematic diagram of the structure of an information processing device provided in an embodiment of this application;

[0025] Figure 6 This is a schematic diagram of the structure of a cloud device provided in an embodiment of this application. Detailed Implementation

[0026] The technical solutions in the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings.

[0027] The embodiments of this application provide an information processing method, referring to... Figure 1 As shown, the method is applied to cloud devices and includes the following steps:

[0028] Step 101: Obtain the first audio signal, the second audio signal, and the target audio features corresponding to the audio information to be analyzed.

[0029] The audio information to be analyzed is acquired by the voice acquisition module included in the voice control device, and the target audio features are obtained by feature fusion processing of the first audio signal and the second audio signal.

[0030] In this embodiment, the voice control device is a device that can be managed and controlled by voice, such as a smart voice-controlled home appliance, like a smart voice-controlled air conditioner or air purifier. The cloud device can be a device that provides cloud services to the voice control device, such as a cloud server. The audio information to be analyzed is the user's voice information collected by the voice acquisition module of the voice control device, such as a microphone. In some application scenarios, the audio information to be analyzed can be voice control commands sent by the user to the voice control device, or other voice information sent by the user to the voice control device. The first audio signal and the second audio signal are signals obtained by processing the audio information to be analyzed using different signal processing methods. The generation locations of the first audio signal, the second audio signal, and the target audio features can be determined according to the actual application scenario.

[0031] Step 102: Determine the current usage status of the voice acquisition module based on the first audio signal, the second audio signal, and the target audio features.

[0032] In this embodiment, the current usage state of the voice acquisition module is used to indicate the wear and tear status of the voice acquisition module. The current usage state of the voice acquisition module is obtained by analyzing and processing the first audio signal, the second audio signal, and the target audio features.

[0033] Step 103: Send the current usage status to the terminal device.

[0034] Specifically, the current usage status is sent to the terminal device so that the current usage status is displayed on the display screen of the terminal device and / or the display screen of the voice control device.

[0035] In some application scenarios, the terminal device is a device that has a communication connection with a cloud device and can be used to manage and control the voice control device, such as an edge computing device. In other application scenarios, the terminal device can be the voice control device itself, meaning the terminal device can directly communicate with the cloud device. The current usage status of the voice control module of the voice control device is sent to the terminal device so that the terminal device can display the current usage status, for example, on its own display screen, or the terminal device sends the current usage status of the voice control device to the display screen corresponding to the voice control device. This allows the user to know the current usage status of the voice acquisition module of the voice control device, determine whether the voice acquisition module needs to be replaced, improve the acquisition efficiency and accuracy of the voice acquisition module, and enhance the user experience.

[0036] In this embodiment, the cloud device acquires the first audio signal, the second audio signal, and the target audio features corresponding to the audio information to be analyzed. Based on these, it determines the current usage status of the voice acquisition module and then sends the current usage status to the terminal device so that it can be displayed on the terminal device's display screen and / or the voice control device's display screen. In this way, by predictively analyzing the first audio signal, the second audio signal, and the target audio features acquired by the voice acquisition module of the voice control device, the current usage status of the voice acquisition module is determined. This solves the current problem of not being able to predict the usage status of voice acquisition devices in smart home appliances, and proposes a method for predicting the usage status of voice acquisition devices in smart home appliances, ensuring the performance of the voice acquisition devices in smart home appliances and improving their working efficiency.

[0037] Based on the foregoing embodiments, embodiments of this application provide an information processing method applied to a cloud device, the method comprising the following steps:

[0038] Step 201: Obtain the first audio signal, the second audio signal, and the target audio features corresponding to the audio information to be analyzed.

[0039] The audio information to be analyzed is acquired by the voice acquisition module included in the voice control device, and the target audio features are obtained by feature fusion processing of the first audio signal and the second audio signal.

[0040] In this embodiment, the voice control device is an intelligent voice-controlled air conditioning device, and the corresponding audio information to be analyzed is the user voice information collected by the voice acquisition module of the intelligent voice-controlled air conditioning device, such as the microphone. The corresponding first audio signal can be a time-domain signal obtained by processing the user voice information, and the second audio signal is a frequency-domain signal obtained by processing the user voice information. The target audio feature is the feature information obtained by feature fusion processing of the time-domain signal and the frequency-domain signal corresponding to the user voice information.

[0041] Step 202: Based on the first audio signal, the second audio signal, and the target audio features, determine the current usage status of the voice acquisition module.

[0042] In this embodiment, the time-domain signal, frequency-domain signal, and target audio features are analyzed and processed to determine the current usage status of the microphone in the intelligent voice-controlled air conditioning device.

[0043] Step 203: Send the current usage status to the terminal device.

[0044] Specifically, the current usage status is sent to the terminal device so that it is displayed on the terminal device's corresponding display screen and / or the voice control device's corresponding display screen. The terminal device includes at least a voice control device, or an edge computing device communicatively connected to the voice control device.

[0045] In this embodiment, the current usage status of the microphone of the smart voice-controlled air conditioner is sent to the terminal device for display on the terminal device's corresponding display screen and / or the voice control device's corresponding display screen. In some application scenarios, the terminal device's corresponding display screen can be either the display screen itself or a third-party device with a communication connection to the terminal device, such as a smart mobile terminal device or a smart home central control device. Similarly, the voice control device's corresponding display screen can be either the display screen itself or a third-party device with a communication connection to the voice control device, such as a smart mobile terminal device or a smart home central control device.

[0046] Based on the foregoing embodiments, in other embodiments of this application, step 201 can be implemented by step 201a:

[0047] Step 201a: Receive the first audio signal, the second audio signal, and the target audio features sent by the terminal device.

[0048] The target audio features are obtained by feature fusion processing of the first audio signal and the second audio signal.

[0049] In this embodiment, the first audio signal, the second audio signal, and the target audio signal may all be generated by the terminal device. That is, after the terminal device obtains the audio signal to be analyzed, it analyzes and processes the audio signal to obtain the first audio signal, the second audio signal, and the target audio feature. If the terminal device is an information forwarding device between the voice control device and the cloud device, the first audio signal, the second audio signal, and the target audio signal may also be sent from the voice control device to the terminal device. However, it should be noted that the first audio signal, the second audio signal, and the target audio feature may also be partially generated in the voice control device and partially generated in the terminal device. The specific generation can be determined by the functions of the voice control device and the terminal device, and no specific limitation is made here.

[0050] Based on the foregoing embodiments, in other embodiments of this application, step 201 can also be implemented by steps 201b to 201c:

[0051] Step 201b: Receive the first audio signal and the second audio signal sent by the terminal device.

[0052] In this embodiment, both the first audio signal and the second audio signal are obtained by the terminal device. The first and second audio signals can be obtained by the terminal device analyzing and processing the audio information to be analyzed. If the terminal device is an information forwarding device between the cloud device and the voice control device, the first and second audio signals can also be obtained by the voice control device processing the collected audio information to be analyzed. Furthermore, one of the first and second audio signals can be processed in the voice control device, and the other in the terminal device. The specific implementation process can be determined by the functions of the voice control device and the terminal device, and is not specifically limited here.

[0053] Step 201c: Based on the first audio signal and the second audio signal, obtain the target audio features.

[0054] In this embodiment of the application, after receiving the first audio signal and the second audio signal of the audio information to be analyzed, the cloud device analyzes and processes the first audio signal and the second audio signal to obtain the target audio features.

[0055] Based on the foregoing embodiments, in other embodiments of this application, step 201 can also be implemented by steps 201d to 201g:

[0056] Step 201d: Receive the audio information to be analyzed sent by the terminal device.

[0057] In this embodiment, when the terminal device is a voice control device, the audio information to be analyzed is collected by the terminal device itself. When the terminal device is an edge computing device, the audio information to be analyzed is collected by the voice control device and then sent to the terminal device.

[0058] Step 201e: Perform frequency domain analysis on the audio information to be analyzed to obtain the first audio signal.

[0059] In this embodiment of the application, the cloud device performs frequency domain analysis processing on the audio information to be analyzed sent by the terminal device to obtain a first audio signal.

[0060] Step 201f: Perform time-domain analysis on the audio information to be analyzed to obtain the second audio signal.

[0061] In this embodiment of the application, the cloud device performs time-domain analysis processing on the video signal to be analyzed to obtain a second audio signal.

[0062] Step 201g: Based on the first audio signal and the second audio signal, obtain the target audio features.

[0063] In this embodiment of the application, the cloud device analyzes and processes the first audio signal and the second audio signal to obtain the target audio features.

[0064] Based on the foregoing embodiments, in other embodiments of this application, steps 201c and 201g can be implemented by steps a11 to a13:

[0065] Step a11: Perform feature extraction processing on the first audio signal to obtain the first feature information.

[0066] In this embodiment of the application, the cloud device can perform feature extraction processing on the first audio signal through a preset neural network model to obtain the first feature information.

[0067] Step a12: Perform feature extraction processing on the second audio signal to obtain the second feature information.

[0068] In this embodiment of the application, the cloud device can perform feature extraction processing on the second audio signal through a preset neural network model to obtain the second feature information.

[0069] Step a13: Fuse the first feature information and the second feature information to obtain the target audio features.

[0070] In this embodiment, the cloud device processes the first feature information and the second feature information using a neural network module for fusion processing to obtain the target audio features.

[0071] Based on the foregoing embodiments, in other embodiments of this application, step 201 can also be implemented by steps 201h to 201j:

[0072] Step 201h: Receive the first audio signal and the second audio signal sent by the terminal device.

[0073] Step 201i: Receive the first feature information and the second feature information sent by the terminal device.

[0074] The first feature information is obtained by performing feature extraction processing on the first audio signal, and the second feature information is obtained by performing feature extraction processing on the second audio signal.

[0075] In this embodiment of the application, the cloud device receives first feature information and second feature information sent by the terminal device. The first feature information and second feature information can be obtained by the terminal device performing feature extraction processing on the first audio signal and the second audio signal respectively, or they can be obtained by the voice control device performing feature extraction processing on the first audio signal and the second audio signal respectively. The specific details are determined by the functions of the terminal device and the voice control device, and are not specifically limited here.

[0076] Step 201j: The first feature information and the second feature information are fused to obtain the target audio features.

[0077] Based on the foregoing embodiments, in other embodiments of this application, step 202 can be implemented by step 202a:

[0078] Step 202a: Using the trained target analysis model, perform usage status prediction processing based on the first audio signal, the second audio signal, and the target audio features to obtain the current usage status.

[0079] Based on the foregoing embodiments, in other embodiments of this application, reference is made to... Figure 2 As shown, after executing step 202, the cloud device can also be used to execute steps 204 to 206:

[0080] Step 204: Obtain the historical usage status of the voice acquisition module included in the voice control device.

[0081] Historical usage status includes at least one usage status data.

[0082] In this embodiment of the application, after the cloud device analyzes the usage status of the voice acquisition module included in the voice control device, it will store the analyzed usage status according to the analysis time. In this way, the cloud device can obtain the historical usage status of the voice acquisition module included in each voice control device.

[0083] Step 205: Using the trained target prediction model, perform remaining lifespan prediction processing based on historical usage status and current usage status to determine the target remaining lifespan corresponding to the voice acquisition module.

[0084] In this embodiment, the trained target prediction model is a neural network model trained with a large amount of historical sample data to predict the remaining lifespan of the voice acquisition module. The target prediction model is used to predict the historical and current usage states to determine the target remaining lifespan of the voice acquisition module.

[0085] Step 206: Send the target remaining lifetime to the terminal device.

[0086] Specifically, the remaining lifespan of the target device is sent to the terminal device so that the current usage status is displayed on the terminal device and / or the voice control device.

[0087] In this embodiment, the predicted target remaining lifespan is sent to the terminal device so that it can be displayed on the display screen of the terminal device and / or the voice control device. This prompts the user to replace the voice acquisition module in a timely manner based on the displayed target remaining lifespan, reducing the possibility that the voice acquisition module may not accurately identify the data due to inaccurate voice information collected after prolonged use, thus ensuring a better user experience.

[0088] It should be noted that step 203 can be executed before steps 204 to 206, after steps 204 to 206, or simultaneously with steps 204 to 206. The specific execution order can be determined by the actual situation.

[0089] Based on the foregoing embodiments, in other embodiments of this application, step 205 can be implemented by steps 205a to 205b:

[0090] Step 205a: Sort the historical usage status and current usage status according to the time when the status was determined to obtain the target status data.

[0091] In this embodiment of the application, before predicting the historical and current usage states, the cloud device needs to sort the historical and current usage states according to the time of state determination to obtain target state data. The target state data can be represented by a data distribution curve.

[0092] Step 205b: Using the target prediction model, perform remaining useful life prediction processing on the target state data to determine the target's remaining useful life.

[0093] In this embodiment of the application, the cloud device inputs the target status data to the input terminal of the target prediction model, and uses the target prediction model to predict the remaining lifespan of the voice acquisition module to obtain the target remaining lifespan.

[0094] Based on the foregoing embodiments, in other embodiments of this application, reference is made to... Figure 3 As shown, before the cloud device executes step 205, it is also used to execute steps 207 to 209:

[0095] Step 207: Determine the prediction model to be trained.

[0096] In this embodiment of the application, the prediction model to be trained is a predetermined neural network model that needs to be trained.

[0097] Step 208: Obtain historical sample data.

[0098] The historical sample data includes the usage status of different voice acquisition modules at different remaining lifespans.

[0099] In this embodiment of the application, the historical sample data includes the usage status of a large number of voice acquisition modules at each remaining lifespan.

[0100] Step 209: Use historical sample data to train the prediction model to obtain the target prediction model.

[0101] In this embodiment of the application, a model training method is used to train the prediction model to be trained using historical sample data until a trained target prediction model is obtained.

[0102] Based on the foregoing embodiments, this application provides an application scenario, such as... Figure 4 As shown, the system includes an intelligent voice-controlled air conditioning device A, an edge computing device B, and a cloud server C. Correspondingly, the implementation flow of an information processing method can be as follows:

[0103] Step b11: After the microphone of the intelligent voice-controlled air conditioner collects the user's audio information, it sends the user's audio information to the edge computing device.

[0104] Step b12: The edge computing device performs frequency domain analysis and time domain analysis on the user's audio information in decibels to obtain frequency domain signals and time domain signals.

[0105] Step b13: The edge computing device uses a neural network model to extract features from the time-domain signal and the frequency-domain signal respectively, and then fuses the extracted time-domain features and frequency-domain features to obtain high-dimensional abstract feature information.

[0106] Among them, the frequency domain features and the time domain features correspond to the aforementioned first feature information and second feature information, respectively, and the high-dimensional abstract feature information corresponds to the aforementioned target audio features.

[0107] Step b14: The edge computing device sends the frequency domain signal, time domain signal, and high-dimensional abstract feature information to the cloud server.

[0108] Step b15: The cloud server performs fault prediction on the microphone based on frequency domain signals, time domain signals, and high-dimensional abstract feature information to determine the current usage status of the microphone.

[0109] Step b16: The cloud server obtains the historical usage status of the microphone.

[0110] Step b17: Based on the historical and current usage status, the cloud server plots a status curve with the time of determining the usage status as the axis.

[0111] Step b18: The cloud server inputs the state curve into the trained target prediction model to predict the remaining lifespan of the microphone target.

[0112] Step b19: The cloud server sends the predicted target remaining lifetime to the edge computing device.

[0113] Step b20: The edge computing device sends the target remaining lifetime to the voice-controlled air conditioner.

[0114] Step b21: Voice control air conditioner displays the target remaining lifespan of the microphone.

[0115] In this way, when the microphone wears out significantly, the user can replace the microphone according to the target remaining lifespan, which improves the voice control efficiency of the air conditioner and ensures the user experience.

[0116] It should be noted that the descriptions of the same steps and contents as in other embodiments in this embodiment can be found in the descriptions in other embodiments, and will not be repeated here.

[0117] In this embodiment, the cloud device acquires the first audio signal, the second audio signal, and the target audio features corresponding to the audio information to be analyzed. Based on these, it determines the current usage status of the voice acquisition module and then sends the current usage status to the terminal device so that it can be displayed on the terminal device's display screen and / or the voice control device's display screen. In this way, by predictively analyzing the first audio signal, the second audio signal, and the target audio features acquired by the voice acquisition module of the voice control device, the current usage status of the voice acquisition module is determined. This solves the current problem of not being able to predict the usage status of voice acquisition devices in smart home appliances, and proposes a method for predicting the usage status of voice acquisition devices in smart home appliances, ensuring the performance of the voice acquisition devices in smart home appliances and improving their working efficiency.

[0118] Based on the foregoing embodiments, embodiments of this application provide an information processing apparatus applied to a cloud device, with reference to... Figure 5 As shown, the information processing device 3 may include: an acquisition unit 31, a determination unit 32, and a transmission unit 33; wherein:

[0119] The acquisition unit 31 is used to acquire a first audio signal, a second audio signal, and target audio features corresponding to the audio information to be analyzed; wherein, the audio information to be analyzed is acquired by the voice acquisition module included in the voice control device, and the target audio features are obtained by feature fusion processing of the first audio signal and the second audio signal;

[0120] The determining unit 32 is used to determine the current usage status of the voice acquisition module based on the first audio signal, the second audio signal, and the target audio features;

[0121] The sending unit 33 is used to send the current usage status to the terminal device so that the current usage status is displayed on the terminal device and / or the voice control device.

[0122] In other embodiments of this application, the acquisition unit includes: a first receiving module; wherein:

[0123] The first receiving module is used to receive a first audio signal, a second audio signal, and a target audio feature sent by the terminal device; wherein the target audio feature is obtained by feature fusion processing of the first audio signal and the second audio signal.

[0124] In other embodiments of this application, the acquisition unit includes: a second receiving module and a first obtaining module; wherein:

[0125] The second receiving module is used to receive the first audio signal and the second audio signal sent by the terminal device;

[0126] The first obtaining module is used to obtain target audio features based on the first audio signal and the second audio signal.

[0127] In other embodiments of this application, the acquisition unit includes a third receiving module, a first processing module, and a second obtaining module; wherein:

[0128] The third receiving module is used to receive the audio information to be analyzed sent by the terminal device;

[0129] The first processing module is used to perform frequency domain analysis on the audio information to be analyzed, and obtain the first audio signal.

[0130] The first processing module is used to perform time-domain analysis on the audio information to be analyzed, and obtain the second audio signal.

[0131] The second obtaining module is used to obtain target audio features based on the first audio signal and the second audio signal.

[0132] In other embodiments of this application, the first obtaining module or the second obtaining module is specifically used to implement the following steps:

[0133] The first audio signal is subjected to feature extraction processing to obtain the first feature information;

[0134] The second audio signal is processed by feature extraction to obtain the second feature information;

[0135] The first and second feature information are fused to obtain the target audio features.

[0136] In other embodiments of this application, the acquisition unit includes a fourth receiving module and a fusion processing module; wherein:

[0137] The fourth receiving module is used to receive the first audio signal and the second audio signal sent by the terminal device;

[0138] The fourth receiving module is used to receive first feature information and second feature information sent by the terminal device; wherein, the first feature information is obtained by feature extraction processing of the first audio signal, and the second feature information is obtained by feature extraction processing of the second audio signal;

[0139] The fusion processing module is used to fuse the first feature information and the second feature information to obtain the target audio features.

[0140] In other embodiments of this application, the determining unit includes: a prediction module; wherein:

[0141] The prediction module is used to perform usage status prediction processing based on the first audio signal, the second audio signal, and the target audio features using a pre-trained target analysis model, in order to obtain the current usage status.

[0142] In other embodiments of this application, after the determining unit, the information processing apparatus further includes: a prediction unit; wherein:

[0143] The acquisition unit is also used to acquire the historical usage status corresponding to the voice acquisition module included in the voice control device; wherein the historical usage status includes at least one usage status data;

[0144] The prediction unit is used to perform remaining lifespan prediction processing based on historical and current usage states using a pre-trained target prediction model, and to determine the target remaining lifespan of the voice acquisition module.

[0145] The sending unit is also used to send the target remaining lifespan to the terminal device so that the current usage status is displayed on the terminal device and / or the voice control device.

[0146] In other embodiments of this application, the prediction unit includes: a sorting module and a second processing module; wherein:

[0147] The sorting module is used to sort the historical usage status and current usage status according to the time of status determination to obtain the target status data;

[0148] The second processing module is used to perform remaining useful life prediction processing on the target state data through the target prediction model to determine the remaining useful life of the target.

[0149] In other embodiments of this application, before the prediction unit, the information processing apparatus further includes: a model training unit; wherein:

[0150] The unit is also used to determine the prediction model to be trained;

[0151] The acquisition unit is also used to acquire historical sample data; wherein, the historical sample data includes the usage status of different voice acquisition modules at different remaining lifespans;

[0152] The model training unit is used to train the prediction model to be trained using historical sample data, so as to obtain the target prediction model.

[0153] In other embodiments of this application, the terminal device includes at least a voice control device, or an edge computing device that is communicatively connected to the voice control device.

[0154] It should be noted that the specific implementation process of information interaction between units and modules in this embodiment can be referred to Figures 1-3The implementation process of the information processing method provided in the corresponding embodiments will not be described in detail here.

[0155] In this embodiment, the cloud device acquires the first audio signal, the second audio signal, and the target audio features corresponding to the audio information to be analyzed. Based on these, it determines the current usage status of the voice acquisition module and then sends the current usage status to the terminal device so that it can be displayed on the terminal device's display screen and / or the voice control device's display screen. In this way, by predictively analyzing the first audio signal, the second audio signal, and the target audio features acquired by the voice acquisition module of the voice control device, the current usage status of the voice acquisition module is determined. This solves the current problem of not being able to predict the usage status of voice acquisition devices in smart home appliances, and proposes a method for predicting the usage status of voice acquisition devices in smart home appliances, ensuring the performance of the voice acquisition devices in smart home appliances and improving their working efficiency.

[0156] Based on the foregoing embodiments, embodiments of this application provide a cloud device, referring to... Figure 6 As shown, the cloud device 4 may include: a memory 41, a processor 42, and a communication bus 43; wherein:

[0157] Memory 41 is used to store executable instructions;

[0158] Communication bus 43 is used to realize the communication connection between processor 42 and memory 41;

[0159] Processor 42 is used to execute information processing programs stored in memory 41 to implement, for example... Figures 1-3 The implementation process of the method shown will not be described in detail here.

[0160] Based on the foregoing embodiments, embodiments of this application provide a computer-readable storage medium, simply referred to as a storage medium, which stores one or more programs that can be executed by one or more processors to achieve, as follows: Figures 1-3 The implementation process of the information processing method provided in the corresponding embodiments will not be described in detail here.

[0161] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of hardware embodiments, software embodiments, or embodiments combining software and hardware aspects. Furthermore, this application can take the form of a computer program product implemented on one or more computer-usable storage media (including, but not limited to, disk storage and optical storage) containing computer-usable program code.

[0162] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart... Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0163] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0164] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0165] The above description is merely a preferred embodiment of this application and is not intended to limit the scope of protection of this application.

Claims

1. An information processing method, characterized in that, The information processing method is applied to a cloud device, and the method includes: The method involves acquiring a first audio signal, a second audio signal, and target audio features corresponding to the audio information to be analyzed; wherein the audio information to be analyzed is acquired by a voice acquisition module included in the voice control device, and the target audio features are obtained by feature fusion processing of the first audio signal and the second audio signal; Based on the first audio signal, the second audio signal, and the target audio features, determine the current usage status of the voice acquisition module; The historical usage status corresponding to the voice acquisition module included in the voice control device is obtained; wherein, the historical usage status includes at least one usage status data; Using a pre-trained target prediction model, the remaining lifespan of the voice acquisition module is predicted based on the historical and current usage states to determine the target remaining lifespan of the voice acquisition module. Send the target remaining lifetime to the terminal device so that the target remaining lifetime is displayed on the terminal device and / or the voice control device; The current usage status is sent to the terminal device so that the current usage status is displayed on the display screen of the terminal device and / or the display screen of the voice control device.

2. The method according to claim 1, characterized in that, The acquisition of the first audio signal, the second audio signal, and the target audio features corresponding to the audio information to be analyzed includes: The terminal device receives the first audio signal, the second audio signal, and the target audio feature; wherein the target audio feature is obtained by feature fusion processing of the first audio signal and the second audio signal.

3. The method according to claim 1, characterized in that, The acquisition of the first audio signal, the second audio signal, and the target audio features corresponding to the audio information to be analyzed includes: Receive the first audio signal and the second audio signal sent by the terminal device; The target audio features are obtained based on the first audio signal and the second audio signal.

4. The method according to claim 1, characterized in that, The acquisition of the first audio signal, the second audio signal, and the target audio features corresponding to the audio information to be analyzed includes: Receive the audio information to be analyzed sent by the terminal device; The audio information to be analyzed is subjected to frequency domain analysis to obtain the first audio signal; The audio information to be analyzed is subjected to time-domain analysis to obtain the second audio signal; The target audio features are obtained based on the first audio signal and the second audio signal.

5. The method according to claim 3 or 4, characterized in that, The process of obtaining the target audio features based on the first audio signal and the second audio signal includes: The first audio signal is subjected to feature extraction processing to obtain the first feature information; The second audio signal is subjected to feature extraction processing to obtain the second feature information; The first feature information and the second feature information are fused to obtain the target audio feature.

6. The method according to claim 1, characterized in that, The acquisition of the first audio signal, the second audio signal, and the target audio features corresponding to the audio information to be analyzed includes: Receive the first audio signal and the second audio signal sent by the terminal device; The terminal device receives first feature information and second feature information; wherein the first feature information is obtained by feature extraction processing of the first audio signal, and the second feature information is obtained by feature extraction processing of the second audio signal. The first feature information and the second feature information are fused to obtain the target audio feature.

7. The method according to any one of claims 1 to 4, 6, characterized in that, Determining the current usage status of the voice acquisition module based on the first audio signal, the second audio signal, and the target audio features includes: Using a pre-trained target analysis model, the current usage status is predicted based on the first audio signal, the second audio signal, and the target audio features.

8. The method according to claim 1, characterized in that, The step of determining the target remaining lifespan of the voice acquisition module by performing remaining lifespan prediction processing based on the historical usage state and the current usage state using a pre-trained target prediction model includes: The historical usage status and the current usage status are sorted according to the time when the status was determined to obtain the target status data; The remaining useful life of the target is determined by performing remaining useful life prediction processing on the target state data using the target prediction model.

9. The method according to claim 1, characterized in that, Before determining the target remaining lifespan of the voice acquisition module by performing remaining lifespan prediction processing based on the historical usage state and the current usage state using a pre-trained target prediction model, the method further includes: Identify the prediction model to be trained; Acquire historical sample data; wherein, the historical sample data includes the usage status of different voice acquisition modules at different remaining lifespans; The historical sample data is used to train the prediction model to obtain the target prediction model.

10. The method according to claim 1, characterized in that, The terminal device is the voice control device, or an edge computing device that is communicatively connected to the voice control device.

11. An information processing device, characterized in that, The information processing device is applied to a cloud-based device, and the device includes: an acquisition unit, a determination unit, a prediction unit, and a transmission unit; wherein: The acquisition unit is used to acquire a first audio signal, a second audio signal, and a target audio feature corresponding to the audio information to be analyzed; wherein, the audio information to be analyzed is acquired by a voice acquisition module included in the voice control device, and the target audio feature is obtained by feature fusion processing of the first audio signal and the second audio signal; The determining unit is used to determine the current usage status of the voice acquisition module based on the first audio signal, the second audio signal, and the target audio features; The acquisition unit is further configured to acquire the historical usage status corresponding to the voice acquisition module included in the voice control device; wherein the historical usage status includes at least one usage status data; The prediction unit is used to perform remaining lifespan prediction processing based on the historical usage state and the current usage state using a pre-trained target prediction model, and to determine the target remaining lifespan corresponding to the voice acquisition module. The sending unit is configured to send the target remaining lifespan to the terminal device so that the target remaining lifespan is displayed on the terminal device and / or the voice control device; and to send the current usage status to the terminal device so that the current usage status is displayed on the terminal device and / or the voice control device.

12. A cloud device, characterized in that, The device includes: a memory, a processor, and a communication bus; wherein: The memory is used to store executable instructions; The communication bus is used to realize the communication connection between the processor and the memory; The processor is configured to execute the information processing program stored in the memory to implement the steps of the information processing method as described in any one of claims 1 to 10.

13. A storage medium, characterized in that, The storage medium stores an information processing program, which, when executed by a processor, implements the steps of the information processing method as described in any one of claims 1 to 10.

Images